METHOD AND DEVICE FOR ENHANCED DRIVER EXPERIENCE INCLUDING DYNAMIC POI RECOGNITION

Abstract

System that includes: a processor (3) configured to: Receiving vehicle coordinates; Comparing the vehicle coordinates with geo-fence coordinate sets of a plurality of geo-fences (219, 245, 249, 267) surrounding a point of interest (POI), wherein at least one section of each geo-fence is located at some specified distance from the vehicle coordinates, Receiving POI-related information (207) when the vehicle coordinates are within the geo-fence coordinates (273), and Arranging a presentation of the received information for vehicle occupants.

Description

[0001] The illustrated embodiments generally relate to a method and a device for an enhanced driving experience incorporating dynamic recognition of points of interest (POIs).

[0002] Many of today's vehicles are equipped with complex and powerful data processing and data transmission systems. These systems, which often include navigation, user interaction, and various other functions, can enhance and improve the driving experience. By connecting to cloud-based processors and the wealth of information available on the internet and remote servers, these systems can access numerous remote resources to further enhance the driving experience.

[0003] US Patent 8,290,704 B2 generally relates to a system and method for collecting and transmitting information about points of interest (POIs). The system detects when a vehicle is at a previously unknown POI, collects information about the new POI, and updates a central server with the information about the new POI location. In this context, a POI can be any type of place, including roads, gas stations, shopping malls, retail stores, restaurants, hospitals, police stations, etc. POI information can include various data, such as the location of new roads, new road access points, toll fees, gas station names, gasoline prices, shopping mall names, retail store names, restaurant names, sales and special offers, hospital names, the location of emergency room entrances, police station entrances, etc.

[0004] US Patent 2012 / 0259537A1 concerns a system for tracking agricultural vehicles and provides a moving geofence around a vehicle's location. If the moving geofence touches a point of interest, such as another moving geofence, an alert is issued. The specific characteristics of the moving geofence can be generated according to a predefined scheme.

[0005] US Patent 2012 / 0 197 690 A1 concerns a method for operating a navigation system to deliver an advertisement. A desired arrival time at a destination is determined, and the advertisement is selected from an advertising database. The advertisement includes an incentive to visit a point of interest associated with the advertisement in order to obtain a product or service.

[0006] US 2009 / 0045924A1 provides methods for remotely monitoring trailers attached to a vehicle. The method includes assigning an identification tag or an ABS ECU configured to send a trailer identification signal to a trailer. The method further includes receiving the trailer identification signal on board the vehicle, associating the trailer identification signal with the vehicle, transmitting the trailer identification signal to a remote processor, and receiving the trailer identification signal at the remote processor.

[0007] DE 21 2013 000 071 U1 describes a server for a navigated shopping service, a network connection, one or more processors and a storage device containing instructions which, when executed on the server for the navigated shopping service, cause the server to execute a planned route or...to receive a route via the network connection from a mobile device, to access a list of objects for which a user has indicated an interest in purchasing during a trip along the planned route, to locate a plurality of merchants within a predefined distance from the planned route, each of whom sells at least one object included in the list of objects, and to transmit the plurality of merchants, including object data assigned to each merchant from the plurality of merchants and location information for each merchant from the plurality of merchants, to the mobile device.

[0008] US Patent 2008 / 0162034A1 discloses a system and a method for automatically generating a set of geo-fences that are used by a telematics device attached to a mobile object when tracking the mobile object as it moves from a starting location to an end location, wherein the set of geo-fences is selected from a library of geo-fences based on an expected travel route between the starting location and the end location and one or more criteria.

[0009] US 2007 / 0 219 706 A1 generally describes methods, devices, and systems for determining the relevance of points of interest to a user. An application server receives information about a user's location and speed, as well as other user settings, and adjusts a search space and filters points of interest, identifying those relevant to the user. The relevance of the points of interest is based on the user's route, location, and speed.

[0010] US Patent 7,286,931 B2 generally relates to a vehicle navigation device provided to display current POI (point of interest) information about points of interest that serve as landmarks near a route to the destination, thereby improving visibility when a user identifies the route. A vehicle navigation device is connected to a service provider for the purpose of offering a transmission service for map information, which includes current POI information relating to locations on a map where the points of interest are situated. The navigation device includes a display unit, data input means, data transmission means, and control means.The control device accesses the provider via the data transmission device when the guidance route to the destination is set using the data input device, in order to obtain the current POI information about an area near the set guidance route from the map information, so that the obtained current POI information, along with the guidance route and a vehicle position marker to indicate the current position of the vehicle, is displayed on a screen of the display unit.

[0011] In a first illustrative embodiment, a system includes a processor configured to receive vehicle coordinates. The processor is also configured to compare the vehicle coordinates with geofencing coordinate sets of a plurality of geofences surrounding a point of interest (POI), where at least one segment of each geofence is located at some predetermined distance from the vehicle coordinates. The processor is further configured to receive information relating to the POI when the vehicle coordinates are within the geofencing coordinates and to arrange for the presentation of the received information to vehicle occupants.

[0012] In a second illustrative embodiment, the method involves computer-based reception of vehicle coordinates. It further includes comparing the vehicle coordinates, using a data processing system, with geofencing coordinate sets of a plurality of geofences surrounding a point of interest (POI), wherein at least one segment of each geofence is located at some predetermined distance from the vehicle coordinates. The method also includes receiving POI-related information when the vehicle coordinates are within the geofenced coordinates and arranging a presentation of the received information for vehicle occupants.

[0013] In a third illustrative embodiment, instructions are stored on a non-volatile, computer-readable storage medium. When executed by a processor, these instructions cause the processor to perform a procedure that includes receiving vehicle coordinates. The procedure further includes comparing the vehicle coordinates, using a data processing system, with geofencing coordinate sets of a plurality of geofences surrounding a point of interest (POI), where at least one segment of each geofence is located at some predetermined distance from the vehicle coordinates. The procedure further includes receiving POI-related information when the vehicle coordinates are within the geofenced coordinates and arranging a presentation of the received information for vehicle occupants. Fig. Figure 1 shows an illustrative vehicle data processing system; the Fig. 2A and Fig. Figure 2B shows an illustrative example of a process for identifying and providing a point of interest (POI); Fig. Figure 3 shows an illustrative example of a POI preloading process; Fig. Figure 4A shows an illustrative example of another pre-loading process; Fig. Figure 4B shows an illustrative example of a POI recognition process and Fig. Figure 5 shows an illustrative example of a POI playback process.

[0014] As necessary, detailed embodiments of the present invention are disclosed herein; however, it is understood that the disclosed embodiments are merely exemplary of the invention, which can be implemented in various and alternative forms. The drawings are not necessarily to scale, and some features may be exaggerated or minimized to show details of certain components. Therefore, the specific structural and functional details disclosed herein should not be understood as limiting, but merely as a representative basis for teaching those skilled in the art to apply the present invention in different ways.

[0015] Fig. Figure 1 illustrates an exemplary block topology for a vehicle-based data processing system (VCS) 1 for a vehicle 31. An example of such a vehicle-based data processing system 1 is the SYNC system manufactured by THE FORD MOTOR COMPANY. A vehicle equipped with a vehicle-based data processing system may include a visual front-end interface 4 located within the vehicle. The user may also be able to interact with the interface, for example, if it includes a touchscreen. In another illustrative embodiment, interaction is achieved through button presses, audible speech, and speech synthesis.

[0016] At the in Fig. In the illustrative embodiment shown in Figure 1, a processor 3 controls at least part of the operation of the vehicle-based data processing system. The processor provided in the vehicle enables the processing of instructions and routines on board the vehicle. The processor is also connected to both non-persistent 5 and persistent memory 7. In this illustrative embodiment, the non-persistent memory is random access memory (RAM), and the persistent memory is a hard disk drive (HDD) or flash memory.

[0017] The processor is also equipped with a number of different inputs that allow the user to connect (interface) to the processor. In this illustrative embodiment, a microphone 29, an additional input 25 (for an input 33), a USB input 23, a GPS input 24, and a BLUETOOTH input 15 are provided. An input selector 51 is also provided to allow the user to switch between different inputs. Inputs to the microphone and the additional input are converted from analog to digital by means of a converter 27 before being forwarded to the processor. Although not shown, a vehicle network (such as, but not limited to, a CAN bus) can be used for data exchange with the VCS for many of the vehicle components and accessories to or from the VCS (or its components).

[0018] Outputs of the system may include, but are not limited to: a visual display 4 and a loudspeaker 13, or an output of a stereo system. The loudspeaker is connected to an amplifier 11 and receives its signal from the processor 3 by means of a digital-to-analog converter 9. Outputs may also be made to a remotely located BLUETOOTH device, such as a PND 54, or a USB device, such as a vehicle navigation device 60, in each case along the bidirectional data streams shown in Figures 19 and 21.

[0019] In an illustrative embodiment, the system 1 uses the BLUETOOTH transceiver 15 for data exchange 17 with a user's nomadic device 53 (e.g., cordless phone, smartphone, PDA, or any other device capable of wirelessly connecting to a remotely located wireless network). The nomadic device can then be used for data exchange 59 with a network 61 outside the vehicle 31, for example, by means of data exchange 55 with a cell tower 57. In some embodiments, the tower 57 can be a Wi-Fi access point.

[0020] An exemplary data exchange between the nomadic device and the BLUETOOTH transceiver is represented by signal 14.

[0021] A coupling of the nomadic device 53 with the BLUETOOTH transceiver 15 can be arranged using a switch 52 or a similar input. Accordingly, the CPU is instructed to couple the onboard BLUETOOTH transceiver with a BLUETOOTH transceiver in a nomadic device.

[0022] Data can be exchanged between the CPU 3 and the network 61, for example, using a data plan, data-over-voice, or DTMF tones associated with the nomadic device 53. Alternatively, it may be desirable to include an onboard modem 63 with an antenna 18 to exchange data between the CPU 3 and the network 61 via the voice band 16. The nomadic device 53 can then be used for data exchange 59 with a network 61 outside the vehicle 31, for example, by means of a data exchange 55 with a mobile phone tower 57. In some embodiments, the modem 63 can establish a data exchange 20 with the tower 57 for data exchange with the network 61. As a non-limiting example, the modem 63 can be a cellular USB modem, and the data exchange 20 can be cellular data transmission.

[0023] In one illustrative embodiment, the processor is equipped with an operating system and an API for exchanging data with modem application software. The modem application software can access an embedded module or firmware in the Bluetooth transceiver to complete wireless data exchange with a remotely located Bluetooth transceiver (such as one in a mobile device). Bluetooth is a subset of the IEEE 802 PAN (personal area network) protocols. Wi-Fi is one of the IEEE 802 LAN (local area network) protocols, and they share considerable functionality with IEEE 802 PAN. Both are suitable for wireless data transmission in a vehicle. Other data transmission methods that can be used in this area include free-space optical data transmission (such as IrDA) and non-standard consumer IR protocols.

[0024] In another embodiment, the nomadic device 53 includes a modem for voice-band or broadband data transmission. In the data-over-voice embodiment, a technique known as frequency-division multiplexing can be implemented when the owner of the nomadic device can speak through the device while data is being transmitted. At other times, when the user is not using the device, the entire bandwidth (for example, 300 Hz to 3.4 kHz) can be used for data transmission. Although frequency-division multiplexing may be common and is still used for analog cellular data transmission between the vehicle and the internet, it has been largely replaced for digital cellular data transmission by hybrid code-domain multiple access (CDMA), time-domain multiple access (TDMA), and space-domain multiple access (SDMA).These are all standards compliant with ITU IMT-2000 (3G) and offer data rates of up to 2 Mbit / s for stationary or walking users and 385 kbit / s for users in a moving vehicle. 3G standards are currently being replaced by IMT-Advanced (4G), which offers 100 Mbit / s for users in a vehicle and 1 Gbit / s for stationary users. If the user has a data plan associated with the nomadic device, it is possible that the data plan allows broadband transmission, enabling the system to utilize a much greater bandwidth (which speeds up data transmission). In yet another embodiment, the nomadic device 53 is replaced by a cellular data transmission device (not shown) attached to the vehicle 31.In yet another embodiment, the NV 53 can be a wireless local area network (LAN) device capable of transmitting data, for example (and without restriction), via an 802.11g network (i.e., WiFi) or a WiMax network.

[0025] In one embodiment, incoming data can be routed via a data-over-voice or data tariff through the onboard BLUETOOTH transceiver and into the vehicle's internal processor 3. In the case of certain temporary data, the data can be stored, for example, on the HDD or on other storage media 7 until a time when the data is no longer needed.

[0026] Other sources that can connect to the vehicle include a personal navigation device 54, for example, with a USB port 56 and / or an antenna 58, a vehicle navigation device 60 with a USB 62 or other port, an onboard GPS device 24, or a remote navigation system (not shown) capable of connecting to the network 61. USB is one of a class of serial network protocols. The serial protocols IEEE 1394 (FireWire), EIA (Electronics Industry Association), IEEE 1284 (Centronics Port), S / PDIF (Sony / Philips Digital Interconnect Format), and USB-IF (USB Implementers Forum) form the backbone of serial device-to-device standards. Most of these protocols can be implemented for both electrical and optical data transmission.

[0027] The CPU can also exchange data with various other peripheral devices 65. These devices can be connected via a wireless 67 or wired connection 69. Peripheral devices 65 can include, but are not limited to, personal media players, wireless health devices, portable computers, and the like.

[0028] Alternatively, or in addition, the CPU can be connected to a vehicle-based wireless router 73, for example using a WiFi transceiver 71. This can allow the CPU to establish a connection with remotely located networks within range of the local router 73.

[0029] In addition to the execution of exemplary processes by a vehicle data processing system located within the vehicle, in certain embodiments these exemplary processes can be executed by a data processing system that exchanges data with the vehicle data processing system. Such a system can include, but is not limited to, a wireless device (e.g., a mobile phone) or a remotely located data processing system (e.g., a server) connected via the wireless link. Collectively, such systems can be referred to as "vehicle-associated computing systems" (VACS). In certain embodiments, depending on the specific implementation of the system, certain components of the VACS can execute specific parts of a process.As an example, and not a limitation: If a process involves a sending and receiving step with a coupled wireless device, it is likely that the wireless device will not perform the process, since the wireless device would not "send and receive" information with itself. Experts will understand when it is inappropriate to apply a particular VACS to a given solution. All solutions assume that at least the vehicle data processing system (VCS) within the vehicle is capable of performing the exemplary processes.

[0030] The Fig. 2A and Fig. Figure 2B shows an illustrative example of a process for identifying and providing a point of interest (POI). Fig. 2A Customer data 203 is sent to a remotely located server 205 201 for POI processing. This data allows the identification of a customer's vehicle, route, location, subscriptions, permissions, etc. The data 207 can also be signed and encrypted 209 for further processing, ensuring the security of a customer's location and personal data.

[0031] In this illustrative example, points of interest (POIs) are assigned geofences. For larger POIs (such as a highly visible monument or building), these geofences can be extended, so a driver may not need to be in the immediate vicinity. For smaller POIs, a normal-sized building, a park, etc., these geofences may be smaller, so they are only triggered by a vehicle passing in close proximity to the POI. Naturally, any modifications a provider deems appropriate can be made.

[0032] POI information 207 and / or geo-fence information 211 can be compared with current customer data on a remote server to determine whether any criteria for preloading POI information into a vehicle are met. For example, if a route has been provided to the remote server, the process can compare the route with potential POIs and geo-fences to decide whether to preload the POI information relevant to the route.

[0033] In this illustrative example, POI and geofencing information is uploaded to a remotely located server 213, 215. The POI and geofencing information 217 is also shared with a system in the vehicle. The POI information is sent 221 and the geofencing information is sent 223 so that a local vehicle processor can determine if there is any match between the current vehicle location and a POI.

[0034] Furthermore, during this process, an acknowledgment and a notification are received (225) when a POI is "locked" into the vehicle. A notification about this message (227) is sent to a remotely located server (229) for processing. The notification (231) can be sent to a metrics processor (233) to determine how frequently certain POI information is used. This can contribute to the further development of the POI database.

[0035] Fig. Figure 2B shows another section of the entire exemplary system, viewed from the perspective of a mobile device and a VCS. In this illustrative example, the POI provisioning function is enabled on the VCS 263. The system uses GPS or other coordinates 261 to compare a vehicle position 259 with geofences of various POIs 257. For example, without restriction, the process can receive a number of confined areas, and if a GPS coordinate of the vehicle is within one of these confined areas, the process triggers a "geo-fenced" tag 249. The geofence coordinates themselves can be received by the remotely located server 255, which sends the coordinates 243 relating to various objects with geofences.

[0036] The server also sends POI information 241, which relates to various points of interest along a route, within a given area, etc. If the VCS detects that a vehicle is within a geofence, indicated by the geofence tag, the VCS can retrieve the POI information 247. This information 251 is then forwarded to a playback function, where the VCS can play the POI information 253 for the user to review or present it in some other way.

[0037] The notification that a vehicle is within a geo-fence 245 can also be sent back to the monitoring server, so that the general usage of different geo-fences can be tracked.

[0038] Additionally or alternatively, the tracking function can be enabled on a mobile device 281. If the mobile device is equipped with GPS, the process can track the coordinates of the mobile device itself (which is located, for example, either in the vehicle or in the possession of a person walking). The device's coordinates are compared with the geofencing coordinates provided by the remote server 277 to determine whether the device is within the geofencing 267. As with the vehicle, the mobile device receives the geofencing coordinates 273 from the remote server and forwards the coordinates 275 to the comparison function.

[0039] When the mobile device is within the geofencing of a POI, it can retrieve the POI information 265 and forward the POI information 269 to a process for viewing / displaying / presenting 271. In this way, users can use the system while walking and / or can use the system even if a vehicle is not equipped with all the appropriate technology to enable the onboard experience.

[0040] Fig. Figure 3 shows an illustrative example of a POI preloading process. Since numerous POIs along a route may be passed quickly and may have smaller geofences assigned to them, it can be useful to preload the geofences and / or POI information for various features whose presence along a route has been projected. Then, at least with respect to these coordinates, the process has the necessary information when the geofence is breached, allowing the information to be presented quickly. Even a deviation from the route can be compensated for, as the process then only needs to retrieve the coordinates related to the detour.

[0041] In this illustrative example, a remotely located server, or a process on board a ship or on a phone, can receive a route 301 to travel. Based on this route, a series of coordinate positions along the route 303 can be determined. For each coordinate, or for a subset of coordinates, the process can compare the coordinates with various geofences known to be within the area of ​​the coordinate 305. If a match is found (i.e., the coordinates are within the geofence), the process can download POI data.

[0042] If the process is running on a remote server, downloading can consist of sending the information to a local device (vehicle / phone). If the process is running on a local device, downloading can consist of requesting the information from the remote server.

[0043] The process can then continue with additional coordinate points 309 until all coordinate points have been examined 313. Once all coordinate points for a projected route have been examined (which may include a deviation standard if desired), the process can begin tracking the vehicle position 315 to determine whether the vehicle is actually encountering a geofence.

[0044] Fig. Figure 4A shows an illustrative example of another preloading process. In this illustrative example, the process receives a route 401 based on an input destination. This example considers a deviation from a route, which might involve defining a restricted perimeter around the route 403.

[0045] The perimeter need not be uniform with respect to the deviation, but can be defined according to reasonable requirements. Once the perimeter has been defined, various geofences within the route area can be compared with respect to matching points. For each geofence that intersects the perimeter around the route, a subset can be created representing geofences that might "possibly" come into contact with the vehicle during a trip. If this set is small enough, or if it is suitable, this subset of POIs can be downloaded in the same way as those projected to intersect the route.

[0046] Fig. Figure 4B shows an illustrative example of a POI recognition process. In this process, which runs on a remotely located server, the server receives GPS coordinates of a vehicle (401). It is possible to perform "cloud tracking" of the vehicle, meaning the server decides whether to deliver a POI. It is also possible to track the vehicle locally to compare it with the geofences of various POIs. In this example, a number of POIs were pre-sent to a vehicle.

[0047] Once the GPS coordinates are received, the process determines whether cloud tracking is enabled (403). If the vehicle is being tracked locally (meaning the comparison is being made locally), a perimeter can be set up around the GPS coordinates for comparison purposes (411). This can help detect geofences that are not exactly in the immediate vicinity of a vehicle. Of course, larger geofences can serve the same purpose. Also, in this example, since the vehicle is performing the comparison, the server can provide a slightly larger (or any) perimeter, so that the projected coordinates are within the fence before the actual coordinates (thus allowing additional time for data transmission).

[0048] If a given geofence lies within the perimeter around coordinates 413, the process checks whether information about the geofence and POI has already been sent 415. If this information has not yet been sent, the geofence and POI information is sent to the vehicle 417.

[0049] If tracking is to be carried out in the cloud, the process compares the current coordinates with the fences of various objects 405. If a match is found (i.e., the vehicle is near an object) 407, the process can send the POI data relating to the nearby object 409.

[0050] Numerous options can be used to select suitable geofences. For example, without limitation, the comparison engine could overlay a circle, square, or other shape onto a map containing geofences. The shape can be centered around a coordinate point. Subsequently, each geofence within the shape can be considered a potential point of interest (POI) that one might encounter. Other suitable considerations can also be applied, including, but not limited to, the distance of a fence's center point, the POI, or any segment of the fence from a current route.

[0051] Fig.Figure 5 shows an illustrative example of a POI playback process. In this illustrative example, the process receives a POI request for information 501. This corresponds to information about a specific POI and may include the playback capabilities of various devices. If the request originates from a vehicle 503, the process sends the playback information to the vehicle 505. This information may be configured to be played back specifically in a vehicle and may differ from information for mobile devices.

[0052] Similarly, if the request originates from a mobile device (507), the process can send the information back to the mobile device (509). Again, the information can be uniquely formatted for playback on a mobile device, if desired. This can be continued for any other devices that might request the POI information.

[0053] Although exemplary embodiments are described above, these embodiments are not intended to describe all possible forms of the invention. Rather, the words used in the description serve to describe rather than to limit the scope, and it is understood that various modifications can be made without deviating from the inventive concept and the scope of protection of the invention. Furthermore, the features of different implementing embodiments can be combined to form further embodiments of the invention.

Claims

[1] System that includes: a processor (3) configured to: Receiving vehicle coordinates; Comparing the vehicle coordinates with geo-fence coordinate sets of a plurality of geo-fences (219, 245, 249, 267) surrounding a point of interest (POI), wherein at least one section of each geo-fence is located at some specified distance from the vehicle coordinates, Receiving POI-related information (207) when the vehicle coordinates are within the geo-fence coordinates (273), and Arranging a presentation of the received information for vehicle occupants. [2] System according to claim 1, wherein the processor (3) is further configured to receive a route including a plurality of projected vehicle coordinates. [3] System according to claim 2, wherein the processor (3) is further configured to compare one or more of the projected coordinates with one or more geo-fence coordinate sets. [4] System according to claim 3, wherein the geo-fence coordinate(s) (273) for comparison with each projected coordinate are determined by ensuring that any section of the geo-fence (219, 245, 249, 267) for each set of coordinates is located at any predetermined distance from the projected coordinate. [5] System according to claim 4, wherein the processor (3) is configured to preload information for all matches of projected coordinates and a geo-fence coordinate set for a given POI. [6] System according to claim 2, wherein the processor (3) is further configured to receive one or more geo-fence coordinate sets relating to a POI, wherein any coordinate feature of each coordinate set is located at a predetermined distance from at least one projected coordinate. [7] System according to claim 1, wherein the processor (3) is provided as part of a mobile device (281), a vehicle data processing system (1) or a remotely arranged server (205, 213) which is in wireless data exchange with the mobile device (281) or the vehicle data processing system (1).

Images