The Apple Car could help drivers and passengers work out where they dropped their iPhone within the vehicle using the car’s vibrations, with the same system potentially allowing an iPhone to be used as an in-vehicle remote control.
It is inevitable that at some point, the average iPhone user will have accidentally dropped their device in a car when they are a passenger. While it may fall into a place that’s easily visible and reachable from the seat, there’s a chance that the device will slide under seats and into different places within the vehicle cabin, making it harder to locate.
While systems like AirTag use Ultra Wideband to track down an iPhone, such a concept won’t necessarily work in this case. For a start, Find My doesn’t use UWB to track down iPhones and iPads at this time.
Find My instead relies on GPS and other technologies that narrow down the position to a few feet, which will basically tell users the iPhone is in the car, rather than exactly where it is in the vehicle. Lastly, you have the problem of needing a secondary mobile device to load up Find My, which may not be available.
In a patent titled “Systems and methods for locating mobile devices within a vehicle,” granted by the U.S. Patent and Trademark Office on May 11, Apple outlines a couple of methods that could be employed to work out where an iPhone is located within the vehicle.
The first and most plausible method is the use of multiple signal generators and sensors spread out throughout the vehicle. These can be used in tandem with a signal generator and sensors built into the mobile device to detect its position.
The signal generation can use various technologies, including infrared, Wi-Fi, Bluetooth, and audio chirps.
By detecting how the signal generators interact with the sensors, the system could work out if the device is closer to some generator locations than others. By processing the sensor data, such as with time-of-flight calculations, as well as taking into account the car furnishings that could impact signals, the system could determine the position of the mobile device.
It is also reasoned the mobile device could also work out its position using its own sensors and the signal generators, as well as knowledge of the interior of the vehicle.
Apple also suggests that the use of Inertial Measurement Units, or IMUs, could do a similar job. The IMUs continuously collect motion data when the vehicle is moving, which is then collected and analyzed by the car’s computer.
Rigid body motion calculations could be used, though the same IMU system could use vibrational movement of a vehicle in motion to locate objects as well, by detecting unusual vibration patterns. Where these differences occur, an object is likely to be located.
It is also feasible that an IMU component in the mobile device could also be employed to detect low-level vibrations. This data could be transmitted to the onboard computer, and again can be used to work out its location.
To assist with IMU-based detection, specific parts of the vehicle could be designed to exhibit special kinds of vibrations, enabling a variety of vibrations to be detected and analyzed. In the case of the phone-based IMU, such a method could more immediately alert a driver to their iPhone being kept in the trunk or another internal compartment.
A third and more conventional method is offered in the form of using a vehicle’s cameras. By using imaging data along with a 3D model of the vehicle’s cabin, the image processing system may be able to see items in the cabin that don’t match the model.
Though using cameras may not provide adequate coverage of everywhere in a vehicle, Apple suggests it could be used to provide an initial visual sweep of a vehicle before employing other search methodologies.
A system for device location could be used in other ways. One example given in the patent is that it could be used as a remote control, such as enabling a passenger at the back of the vehicle to control electric windows on the opposite side of the cabin, assisted by knowing the orientation and position of the device.
A cab or bus may determine a mobile device is left behind, which could prompt an alert to the passenger before they have travelled too far away to be uncontactable.
On a plane, the system could track down passengers as they move about, ensuring passengers are sat in their respective seats at takeoff or landing.
The patent was originally filed on January 31, 2020, and lists its inventors as Sawyer I. Cohen, Jack J. Wanderman, Romain A. Teil, and Scott M. Herz.
Apple files numerous patent applications on a weekly basis, but while the existence of a patent indicates areas of interest for Apple’s research and development teams, they do not guarantee the existence of the idea in a future product or service.
While not strictly in-car device location, Apple already has its CarKey API that allows for an iPhone to replace the keys of a vehicle. This currently relies on NFC, which means the iPhone has to be in close proximity to specific areas of the vehicle, but that could change.
The Car Connectivity Consortium, which counts Apple as a member, updated its Digital Key specification in April to include support for both Bluetooth LE and Ultra Wideband, which could allow for a more flexible and location-aware system to be used.
Inter-car-mobile communications have also been raised. One patent from June 2020 aimed to cut down the amount of distracted driving by having an iPhone or iPad display notifications on the device screens based on vehicular events, and to remind drivers to keep looking at the road.
Stay on top of all Apple news right from your HomePod. Say, “Hey, Siri, play AppleInsider,” and you’ll get latest AppleInsider Podcast. Or ask your HomePod mini for “AppleInsider Daily” instead and you’ll hear a fast update direct from our news team. And, if you’re interested in Apple-centric home automation, say “Hey, Siri, play HomeKit Insider,” and you’ll be listening to our newest specialized podcast in moments.