Collection of user-provided data about navigable networks
By using location-specific triggers to automatically collect sensor data from devices within a navigable network, the method addresses the inefficiencies and errors of current map update methods, enabling more reliable and cost-effective updates to navigation systems.
Patent Information
- Application Number
- JP2021576407
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-07-03
- Filing Date
- 2020-07-03
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-07-03
AI Technical Summary
Existing methods for updating electronic maps, such as those used in navigation systems, are resource-intensive, costly, and prone to errors due to reliance on dedicated mapping vehicles and user-provided data, which often requires significant user interaction and validation.
A method and system that automatically collect sensor data from devices moving within a navigable network using location-specific triggers, minimizing end-user involvement by issuing requests for sensor data acquisition when devices reach predefined locations, and processing the data to determine attributes of the network, which can then be reported to map service providers.
This approach allows for more frequent, efficient, and reliable updates to electronic maps with reduced user interaction and resource consumption, providing accurate and up-to-date information for navigation systems.
Smart Images

Figure 0007581260000002 
Figure 0007581260000003 
Figure 0007581260000004
Abstract
Description
[Technical field]
[0001] The present invention generally relates to a method for obtaining information about a navigable network from devices (i.e., users) moving within the navigable network. In other words, the present invention relates to a "crowdsourced" technique for obtaining such information. In particular, embodiments of the present invention enable sensor data to be obtained automatically at various locations from user devices moving within the navigable network, preferably with minimal end-user involvement. The obtained sensor data can then be processed to, for example, determine one or more attributes of the navigable network. This information is then preferably reported to a map service provider, for example, to update an electronic map representation of the navigable network accordingly. However, various other applications are of course possible, and the obtained information may generally be used for any suitable and desired purpose. [Background technology]
[0002] Map data for electronic navigation devices, including GPS-based personal navigation devices such as dedicated navigation systems like the TomTom GO™ Sat Nav system, as well as navigation software running on smartphone applications, and in-vehicle navigation systems, is typically obtained from specialized map service providers such as TomTom International BV. This electronic map data is specifically designed to be used by route guidance algorithms, typically in combination with position data from a GPS module, to plan an optimal route for the navigation device to travel through a navigable network to a desired destination.
[0003] An electronic map is thus a digital representation of a real-world navigable (e.g. road) network. For example, a road segment can be described as a line, i.e., a vector (e.g., road start, end, direction), where a road is, for example, composed of multiple such segments, each uniquely defined by its start / end / direction parameters.
[0004] An electronic map then typically includes a set of such road segments, data associated with each segment (including that segment's "attributes" such as speed limits, direction of travel, etc.), and any other points of interest (POIs), road names, other geographic features such as park and river boundaries, which may also desirably be defined within the map.
[0005] All features of the map (e.g. road segments, POIs, etc.) are preferably defined in a coordinate system that corresponds to or is related to the GPS coordinate system, allowing the location of the device determined through the GPS system to be mapped to the corresponding road segments defined in the map.
[0006] Thus, navigation instructions for guiding a user along a predetermined route can be provided using such an electronic map by matching the (current) location of the device to the map and then providing relevant navigation instructions as the device approaches various intersections or other decision points within the navigable network. For example, navigation guidance can include instructions generated for display to the user, such as instructions to "turn left at the next junction." However, it will be appreciated that navigation instructions may also be generated using an electronic map, which is then provided to, for example, an advanced driver assistance system (ADAS), or an autonomous driving module, for use in navigating the vehicle around the network.
[0007] A key factor for improving user experience and ensuring user safety is not to make the navigation device user / vehicle perform actions that are not actually permitted (or possible) when generating such navigation instructions. It is therefore important that electronic map data is reliable and accurately reflects any, e.g., legal or physical, driving limitations in the network. For example, navigation services typically aim to provide speed information for each road segment. In such cases, the map information includes a maximum speed for the road segment that the navigation service may display or otherwise use when generating navigation instructions. Of course, this functionality relies on the speed limit information being provided together with the correct electronic map.
[0008] To build an electronic map, basic road infrastructure information can be obtained from various sources, such as the Ordnance Survey for at least UK roads. Map service providers also typically have a large dedicated fleet of road-driving vehicles configured to acquire imagery and / or LIDAR data around the road network, as well as personnel who check other maps and aerial (satellite) imagery to update and check the map data. This data forms the core of the map database, which is continually enhanced with new georeferenced data.
[0009] Due to constant changes to the road infrastructure, maintaining an accurate and up-to-date map database requires a continuous effort. Furthermore, as mentioned above, the navigation guidance preferably takes into account not only the basic road geometry in the road network, but also current traffic regulations (e.g., speed limits), road closures, parking conditions, traffic delays, traffic density, points of interest, etc., and therefore that information is typically provided along with (or as part of) the electronic map data. This information typically changes more dynamically than the road infrastructure, and therefore must be continually updated or supplemented with live data to be able to provide reliable and up-to-date navigation guidance.
[0010] It is therefore generally desirable to be able to obtain more information more frequently in order to keep an electronic map up to date. In this regard, various approaches may be considered. For example, the base map data may also be supplemented by other data (which may include "live" data), such as position data obtained from navigation devices moving within the network, which may relate to the movement of the devices around the network as a function of time (i.e., probe data). This probe data may be processed to determine "live" traffic conditions and to infer traffic restrictions, road closures, and other such conditions that persist at least semi-permanently within the network.
[0011] It is also known to obtain "crowd-sourced" (i.e., user-provided) information for the purpose of updating electronic maps. For example, it is relatively common to allow end users of navigation services to inform the map or navigation instructions that there is an error, for example by the user directly reporting such an error via an appropriate web interface. Such user reports are transmitted to the map service provider, who can review and verify the user reports before updating the map information appropriately. Existing mapping systems can vary substantially in the extent to which user input is used and the extent to which user-provided data is validated. Without validation, an erroneous update of the map would result in map errors requiring input from other users to correct or cancel the previous update. EP 2 335 021 A1, EP 3 029 421 A1 and EP 3 029 422 A1 describe various other examples of navigation systems for issuing map update requests to navigation devices. Again, these systems involve user feedback to determine whether there is a need for a map update.
[0012] Map data may also be obtained from a reward platform (such as Gigwalk) that incentivizes users by offering some reward in exchange for obtaining some local information, for example by visiting a specific location to take a photo of the area. Reward platforms require users to download an application to a mobile terminal such as a smartphone, which shows the user available tasks, for example, in the user's vicinity. The application then guides the user through the steps required to obtain the necessary information (such as images) related to the task. For example, such reward platforms can be used to obtain information on off-street parking facilities, which can then be incorporated into an electronic map for use by a navigation service.
[0013] However, updating and validating these electronic maps requires significant resources and it is believed that there is still room for improvement in this regard. It would therefore be desirable to provide an improved method for obtaining information about navigable networks. Summary of the Invention
[0014] According to a first aspect of the present invention, there is provided a method of obtaining information about a navigable network from a device associated with a user moving through the navigable network, comprising the steps of: receiving at the device a request to acquire sensor data, the request including a set of one or more instructions for acquiring sensor data from one or more sensors accessible by the device and a location-specific trigger associated with a location within the navigable network; automatically operating the instructions to obtain the requested sensor data when the device is determined to have reached the location associated with the trigger; A method is provided that includes:
[0015] Thus, the present invention, in embodiments, provides a method for automatically obtaining information about a navigable network without requiring substantial end-user interaction (other than perhaps initially configuring (setting up) the device / sensor etc. to enable this functionality). This is accomplished by issuing specific requests for sensor data ("data acquisition requests") to devices (users) moving within the navigable network. For example, each data acquisition request includes a location (acting as a "trigger"), a set of instructions (i.e., a script) detailing the sensor data to be obtained at the location specified in the request, and any other processing steps that are preferably to be performed by the device.
[0016] Thus, a request for sensor data is issued to the device that includes a "trigger" that causes the device to automatically collect desired sensor data (specified in the request) when the device passes a particular location in the network associated with the trigger, and then preferably processes the data to generate and return an appropriate sensor data report. For example, the trigger location can typically be defined relative to an electronic map representation of the navigable network, e.g., an electronic map used by a navigation application running on the device. The trigger location can be effectively overlaid on the electronic map, and when it is determined based on the electronic map that the device has reached the trigger location, the device automatically acquires the requested sensor data. The device then preferably provides the acquired sensor data (or more typically data indicative of the acquired sensor data) for output.
[0017] In this manner, such information can be collected remotely at any desired location within a navigable network from a device currently moving within the network by issuing a request including an appropriate trigger. It will thus be appreciated that the present invention facilitates improved collection of such information regarding a navigable network, as the information (i.e., sensor data) can be obtained without the need for a dedicated mapping fleet of vehicles and without the need for significant input from the device user (i.e., without the need for significant end-user input).
[0018] For example, sensor data acquired in response to a particular trigger may be usable to determine one or more attributes of the navigable network at a location associated with the trigger. That is, once acquired, the sensor data may be processed (preferably at least partially at the device, as described further below) to determine one or more attributes regarding the navigable network. The sensor data and / or the determined attribute(s) may then be provided for output from the device accordingly.
[0019] For example, in some preferred embodiments, a request for sensor data is issued from a server, e.g., belonging to a map service provider, and the information is then returned to the map service provider, which can then update the electronic map accordingly (preferably after validating any data received from one or more devices moving within the network) based on the determined attributes.
[0020] An example of this is determining the speed limit on a particular road segment, for example by having a camera associated with a device moving on that road segment take an image (or a series of images, e.g., video) of a speed limit sign, which image can then be processed to determine a speed limit value, which is then reported and used to update an electronic map, if necessary.
[0021] However, various other applications are contemplated, and it will be understood that the present invention may be used generally to obtain any suitable sensor data and / or determine any attributes of a navigable network, which may then be used for any desired purpose.
[0022] Thus, in an embodiment, the device may be running a navigation application capable of processing such requests for sensor data. In some preferred embodiments, the invention may relate to a navigation application for acquiring sensor data by receiving a location trigger, processing the location trigger to extract a location trigger and an action request, waiting for the device to reach the location, processing the action request at the location to acquire the sensor data, and sending the sensor data to a map information update system after the action request is completed. However, other configurations are of course possible.
[0023] The present invention thus provides improved techniques for obtaining information about a navigable network that requires minimal end-user input, and which information can be suitably used, for example, to update an electronic map representing the navigable network (although other configurations are of course possible).
[0024] For example, as users increasingly rely on map information for navigation services (including route planning as well as advanced / autonomous driving features), keeping electronic map data accurate and up-to-date is important for map service providers. Current approaches for updating / providing map information typically rely on fleets of dedicated mapping vehicles, which are relatively costly, energy inefficient, and can introduce substantial scheduling and processing delays.
[0025] Although also known as "crowdsourced" map updates, it will be understood that updating map information from crowdsourced input involves the use of potentially untrusted data, particularly when user input is required. For example, known techniques for crowdsourcing map updates typically require users to interact with the map system to provide feedback, signal updates, or provide details regarding the map update. Such user interaction can provide a barrier to user participation and can also result in errors.
[0026] In contrast, as explained above, the technology presented herein, at least in its preferred embodiments, allows for information to be obtained from end-user devices (i.e., crowd-sourced) on demand without significant end-user input. That is, once the devices and sensors are initially set up, relevant access permissions are granted, etc., information can be obtained at any desired location within the navigable network, as needed, using sensors associated with the devices as they move through the network.
[0027] Thus, desired information can be collected automatically (i.e., without end-user intervention) upon request from a server, essentially by enabling remote access to one or more sensors associated with or accessible by a device moving within the navigable network. In particular, the sensor(s) may be controlled by issuing requests to the device to obtain specific sensor data (e.g., from a central map service provider), which requests may include location-specific triggers that cause the sensor(s) to obtain data at a particular location within the network as defined by the trigger.
[0028] Also, in at least preferred embodiments, as described further below, the collection and reporting of such data preferably involves relatively less processing and / or power bandwidth than some existing arrangements that typically use local storage to store any sensor data, to avoid draining the battery and / or data allowance of the device used to acquire the data, such that the acquired sensor data can be provided for output and reported substantially at the time of acquisition, i.e., on the fly, as long as there is an available communications link.
[0029] Although various embodiments described herein relate to obtaining information for use in updating electronic maps, it will be understood that the invention is not limited to this application and that information that may be obtained in accordance with embodiments of the invention may find utility in a variety of applications. For example, rather than being used directly to update a map, the information may be used to focus mapping resources on a particular location. Similarly, information about networks may be used for purposes such as highway maintenance, traffic management, and the like, and is not limited to use for mapping purposes. Such information may also be of interest to automobile manufacturers, freight companies, and the like. Thus, in general, information obtained about navigable networks may be used for any suitable application.
[0030] The invention also extends to a system for carrying out the method of the first aspect, preferably carried out on a device such as a navigation device which may comprise either a dedicated portable navigation device (PND), an on-board computer, or an application running on a smartphone or other portable electronic device (mobile terminal).
[0031] Thus, from the second aspect, there is provided a device operable to obtain information regarding a navigable network in which the device is moving, said device having access to one or more associated sensors, said device comprising: receiving a request to acquire sensor data, the request including a set of one or more instructions for acquiring sensor data from one or more sensors accessible by the device and a location-specific trigger associated with a location within the navigable network; determining when the device reaches the location associated with the trigger, and in response to the determining, automatically operating the instructions to obtain the requested sensor data. A device is provided that includes one or more processors configured to:
[0032] This second aspect of the invention may, and preferably does, include any one or more or all of the preferred and optional features of the invention described herein in relation to the first aspect in any of its embodiments as appropriate. For example, even if not explicitly stated, in an embodiment the device may include means for carrying out any step or steps described in relation to the method herein in any of its aspects or embodiments, and vice versa.
[0033] The steps of the first and second aspects are preferably performed locally at the device, for example using one or more processors and sensors associated with the device. However, the device is preferably controlled to acquire sensor data using requests (triggers) issued from a central server. It should be understood that as used herein, a "server" can generally refer to a set of one or more clusters of servers. In particular, it will be understood that a server need not be a (single) physical data server, but may include, for example, a virtual server running a cloud computing environment. Thus, the server may be a cloud server. Of course, various other configurations are possible.
[0034] Thus, the device preferably receives a request to obtain sensor data from the server, which may be appropriately processed by the device. Once the device has obtained the requested sensor data, this data (or, more typically, information or other data obtained from processing this sensor data) may then be reported back to the server.
[0035] Accordingly, from another aspect, there is provided a method for obtaining information about a navigable network from one or more devices each associated with a user moving through the navigable network, the method comprising: issuing a request from a server to one or more devices traveling within the navigable network to acquire sensor data, the request including a set of one or more instructions for acquiring sensor data from one or more sensors accessible by the device and a location-specific trigger associated with a location within the navigable network, the trigger configured to cause the device to automatically operate the instructions to acquire the sensor data when the device is determined to have reached the location associated with the trigger; receiving, at the server, data indicative of the sensor data obtained from one or more of the devices in response to the request for sensor data; A method is provided that includes:
[0036] From a further aspect, a server configured to obtain information about a navigable network from one or more devices respectively associated with users moving within the navigable network, the server comprising: issuing a request to one or more devices moving within the navigable network to acquire sensor data, the request including a set of one or more instructions for acquiring sensor data from one or more sensors associated with or accessible by the device, the trigger configured to cause the device to automatically operate the instructions when the device is determined to have reached the location associated with the trigger; receiving data indicative of the sensor data obtained from one or more of the devices in response to the request for sensor data; A server is provided that includes one or more processors configured to:
[0037] It will be appreciated that the invention also extends to systems and methods overall for collecting such information, for example steps preferably performed by a server according to these further aspects are used in combination with steps preferably performed by devices according to the first and second aspects, and thus in an embodiment there is provided a system including such a server and device communicating over a suitable wireless communications network.
[0038] Accordingly, from another aspect, there is provided a method for obtaining information about a navigable network from one or more devices each associated with a user moving through the navigable network, the method comprising: issuing, from a server, a request to one or more devices moving within the navigable network to acquire sensor data, the request including one or more sets of instructions for acquiring sensor data from one or more sensors accessible by the devices and a location-specific trigger associated with a location within the navigable network; receiving the request to acquire sensor data at a device moving within the navigable network; automatically operating the instructions to obtain the requested sensor data when it is determined that the device has reached the location associated with the trigger; providing data indicative of the acquired sensor data to the server for output; A method is provided that includes:
[0039] Correspondingly, from yet another aspect, a system for obtaining information about a navigable network from one or more devices each associated with a device moving within the navigable network, the system comprising: a server; and one or more devices; the server is configured to issue a request to one or more of the devices moving within the navigable network to acquire sensor data, the request including a set of one or more instructions for acquiring sensor data from one or more sensors accessible by the device and a location-specific trigger associated with a location within the navigable network; A server is provided, the server being configured to determine when the device, after receiving the request, reaches the location associated with the trigger, and in response to the determination, automatically operate the instructions to acquire the requested sensor data, and provide data indicative of the acquired sensor data to the server for output.
[0040] Again, it will be understood that the methods and systems of these further aspects may, and preferably do, generally include devices and servers as described in relation to the previous aspects and embodiments, and thus can include any combination of optional / preferred features of these aspects.
[0041] The means for performing any of the steps described in connection with the method or device according to the invention in any of its aspects or embodiments may include one or more processors and / or a set of suitable processing circuits or circuits. Thus, the present invention is preferably a computer-implemented invention, and any of the steps described in connection with any of the aspects or embodiments of the invention may be performed under the control of one or more processors and / or a set of suitable processing circuits / circuits. The processing circuits / circuits may generally be implemented in either hardware or software, as appropriate. For example, but not limited to, the means or processing circuits / circuits for performing any of the steps described herein in connection with the method or system of the present invention may comprise one or more suitable processors, a controller or controllers, functional units, circuits / circuits, processing logic, microprocessor configurations, etc., operable to perform various steps or functions, etc., such as suitable dedicated hardware elements (processing circuits / circuits) and / or programmable hardware elements (processing circuits / circuits) that can be programmed to operate in a desired manner.
[0042] The present invention may be implemented in relation to any kind of navigable element. Preferably, the navigable elements are road elements (of a road network), but it will be appreciated that the techniques are applicable to any kind of road element for which it is desired to obtain information (e.g. attributes), or indeed to other types of navigable elements. Thus, while the exemplary embodiment refers to road elements of a road network, it will be appreciated that the techniques presented here are more generally applicable to any form of navigable element, including elements such as routes, rivers, canals, cycle paths, towpaths, railway lines, etc.
[0043] A navigable network can be represented, for example, by an electronic map, in a manner generally known in the art. An electronic map is thus a digital representation of a real-world navigable network. An electronic map can thus represent the configuration of navigable elements (e.g., roads) in the network. Furthermore, an electronic map can also (and typically does) include specific attributes (e.g., speed limits, directions of travel) associated with the navigable elements. An electronic map may also define any other features, such as points of interest (POIs), that may be desirably represented on the map. The use and generation of such maps, for example, for navigation purposes, is generally well understood. Electronic maps are typically maintained (updated) and provided to users by a map service provider, such as TomTom International BV.
[0044] The one or more devices are typically associated with a user (and thus may be referred to as "user devices"). That is, the devices are preferably associated with an existing user of the navigable network by using (for example) a navigation application that controls the collection of such information. In other words, the devices are preferably associated with an existing user of the navigable network, as opposed to a dedicated fleet of mapping vehicles that are used specifically to collect such information.
[0045] Preferably, the device (or each device) is also associated with a vehicle. Thus, in such an embodiment, references to data such as sensor data obtained from the device may be replaced by references to data obtained from the vehicle, references to movement of one or more devices may be replaced by references to movement of the vehicle, etc., even if not explicitly mentioned. The device may be integrated with the vehicle or may be a separate device otherwise associated with the vehicle, for example a portable navigation device or a smartphone or other mobile device mounted on or within the vehicle.
[0046] However, this is not necessarily the case and the device may be carried by a pedestrian and used to obtain information about networks navigable by foot.Of course, other configurations are possible.
[0047] Of course, the sensor data can be obtained from a combination of different devices or from a single type of device.
[0048] The device (or each device) may also have access to one or more sensor(s). The sensor(s) may be associated with the device in any suitable manner, depending for example on the nature of the device and the sensor, and therefore accessible by the device. For example, the sensor may be the device's sensor, in which case the device may directly access and control the sensor to obtain the desired sensor data. Thus, (at least some of) the sensor(s) may be incorporated into the device, such that the device comprises such sensor(s). For example, in an embodiment, the device may comprise a smartphone or other such mobile terminal, and the sensor(s) may comprise the device's camera, GPS module, accelerometer, etc. However, it is also conceivable that the device may simply access the sensor(s) by communicating with the sensor, for example, via a suitable wireless (e.g., Bluetooth) connection. In that case, the sensor(s) may be a sensor provided as part of another device (in the same vehicle) that forms part of a wireless communication network interconnected with the device that is processing the request. For example, in an embodiment, the device may comprise an in-vehicle navigation system, in which case the device may have access to the vehicle's sensors.
[0049] Of course, various other configurations are possible, including combinations of the two examples presented above, for example when a smartphone or other mobile device also accesses the vehicle's on-board sensors. For example, the devices and sensors may generally comprise part of an interconnected wireless network, for example in an "Internet of Things" type environment. Thus, the devices can (and preferably do) access multiple sensors, preferably of different types. Preferably, the devices and sensors are associated with the same vehicle or user.
[0050] The sensors may be of any suitable type, including, but not limited to, a camera, an accelerometer, a direction detector, an odometer, a microphone, or the like, or indeed any other type of sensor that may typically be accessible by a device.
[0051] For example, it will be appreciated that automobiles and other vehicles are increasingly equipped with on-board cameras and other sensors (e.g., distance detection sensors). Some high-end vehicles already use these cameras to constantly search for road signs (i.e., "traffic sign recognition"). After detecting the road sign, an on-board processor then processes the images and determines the speed limit on the road segment on which the vehicle is traveling. This function is usually referred to as "speed limit assist". Similar techniques can also be used to locate the vehicle relative to a map. For example, WO 2018 / 104563 describes a method in which image data obtained from one or more cameras associated with a vehicle traveling in a road network is obtained and then used to generate a local map representation that can be compared to sections of a reference map to locate the vehicle. Such techniques can also be extended such that if an "error", such as an "incorrectly mapped feature or a feature that is not where it should be" is identified in the reference map, this information can be communicated to a map service provider and used to update the electronic map. This means that the in-vehicle system can detect discrepancies between the acquired sensor data and the electronic map used as a reference, and can therefore transmit the acquired sensor data to the map service provider in order to update the map.
[0052] Similarly, mobile navigation devices or navigation applications on mobile devices increasingly have access to cameras and other sensors (accelerometers, microphones, orientation detectors), which can also be used as sources of such information. Software systems in vehicles increasingly provide information exchange with mobile terminals such as mobile phones, tablets, smart watches, etc. This connectivity relies on wireless networks in the car and networks of mobile devices, within the so-called "Internet of Things" environment.
[0053] The present invention thus enables these existing sensors to be remotely controlled, for example from a map service provider, to obtain desired sensor data on demand without the need for significant user interaction.
[0054] Once acquired, the sensor data is preferably processed to determine one or more attributes of the navigable network. Thus, the sensor data may include any suitable data that may desirably be used to determine any attribute of the navigable network. The processing required will of course depend on the nature of the sensor data. For example, in an embodiment, the sensor data may include image data acquired from one or more cameras associated with the device. An example of this may be an image of a speed limit sign that is processed to extract the speed limit value for that road segment. Appropriate image processing software may then be used to extract such information. However, various other image data may be acquired for a variety of applications, including, but not limited to, assessing current traffic conditions within the network.
[0055] Where the sensor data includes image data, any suitable image processing technique may be used to process the image data to determine the desired attributes, depending, for example, on the nature of the image and the attributes to be determined. For example, image processing may generally be performed using a suitable classification algorithm ("classifier"), which may include, for example, a neural network or other suitably trained algorithm trained on previous image data so that the desired features can be extracted. For example, a classifier (e.g., a neural network) may be provided that is trained to identify speed limit values based on training data that includes a set of images that include traffic restriction signs. The classifier may then be executed, preferably on-device, to process the resulting image data and extract the speed limit information.
[0056] However, the sensor data need not include image data. For example, in another embodiment, the sensor data may include acceleration data obtained from one or more accelerometers associated with the device. The acceleration data may then be processed, for example, to determine the condition of road elements, e.g., to identify potholes, speed bumps, etc. Another example would be ambient noise data, e.g., obtained from a microphone. Of course, various other configurations are possible.
[0057] Thus, the determined attributes may preferably include suitable information to be incorporated in or with the electronic map. Attributes may be semi-permanent features of the road network, such as speed limits, that typically change relatively infrequently (e.g., weeks, months, or years), or may reflect a more dynamic state of the network, such as current traffic conditions. Attributes may generally be time-dependent. For example, sensor data may be provided for output with a timestamp, which may be used to determine temporal variations in the network. For example, speed limits and driving restrictions may only be in place at certain times of the day (e.g., driving restrictions may only be in place on weekends, or only during rush hours, etc.). This temporal behavior may be captured and preferably incorporated into the electronic map. Similarly, if attributes relate to dynamic or "live" conditions in the network, the data may be discarded or given less weighting after a period of time has passed (e.g., because it may no longer reflect the current conditions and therefore should be replaced with new data, if available).
[0058] Preferably, at least part of this processing of the acquired sensor data is performed on the device, e.g. to avoid having to send useless or redundant information to a server (thus saving bandwidth). However, other configurations are of course possible. For example, the processing may be performed only on the server. In that case, the acquired sensor data may be provided for output and transmitted essentially in its raw format (although the device preferably performs at least a data compression step to reduce the size of the transmitted data packets). The data received by the server may then be suitably processed on the server in order to determine the desired attributes. If the processing is performed on the server, this may be done using suitable algorithms executed on the server or even by manual processing.
[0059] However, as noted above, preferably at least some of the processing of the sensor data is performed on the device. Thus, preferably, rather than providing the acquired sensor data for output in its raw format, the device first processes the acquired sensor data to generate a sensor data report that can be transmitted to a server. Thus, in an embodiment, providing data indicative of the acquired sensor data for output includes processing the acquired sensor data to generate a sensor data report and providing such sensor data report for output.
[0060] For example, in a preferred embodiment, the device processes the acquired sensor data to determine or extract information about one or more attributes of the navigable network, for example in the manner described above. In this way, the amount of data that needs to be transmitted from the device can be further reduced, since it is only necessary to transmit data indicative of the value of the determined attribute (e.g., a speed limit value) and not the raw sensor data (e.g., an image or image sequence). Furthermore, processing the acquired sensor data at the device allows the device to discard (and therefore not report) any data that is irrelevant or redundant. Again, such data does not need to be sent back to a server, again meaning that bandwidth requirements may be reduced.
[0061] In other words, the device can process the sensor data locally to increase the reliability and information density of the information transmitted to the map service provider. The local processing can be controlled via a suitable script (i.e., a set of instructions) that is preferably also included in the request to acquire the sensor data. That is, the local processing of the acquired sensor data may be performed under the instructions of the server, which instructions are included in the request. That is, the device is preferably made to automatically acquire and process the requested sensor data when it reaches a trigger location.
[0062] As well as the determined attributes and / or information obtained from processing the sensor data, the sensor data report may typically include other information, preferably including one or more of: (i) the time the sensor data was obtained, (ii) the location where the sensor data was obtained, and (iii) a device and / or sensor identifier. The data indicative of the obtained sensor data (e.g., the sensor data report) is also preferably tagged or otherwise encoded to enable the server to associate the received data with the request (trigger) that caused the data to be obtained. That is, the sensor data report preferably also includes a "request identifier" that enables the server to associate the sensor data report with the respective request that generated the data. Thus, the sensor data report preferably also includes a request identifier indicative of the request that generated the sensor data report. This enables the server to correlate the received data with the issued request (trigger).
[0063] Thus, the server receives sensor data reports from the devices that preferably include not only data indicative of the acquired sensor data (preferably including one or more attributes determined from processing of the sensor data so that the sensor data itself does not need to be transmitted from the device), but also any other desired information about the sensor data, or the device that provided the sensor data. Preferably, the server receives multiple such sensor data reports from multiple different devices moving within the navigable network. The received sensor data reports may then be suitably processed by the server to extract desired information (e.g., attributes) about the navigable network.
[0064] In some preferred embodiments, the device output (e.g., determined attributes and / or sensor data) is provided to a map service provider and used to update the electronic map. The map service provider can then use the collected information to update the electronic map, with appropriate map updates then being released periodically, or more dynamically (e.g., substantially in real-time), for example, depending on the nature of the information.
[0065] Preferably, the acquired sensor data, or at least data indicative thereof, is provided directly to the server as it is acquired. For example, the acquired sensor data may be transmitted to the server (or servers, e.g., if the map update service is based on a cloud server) substantially on the fly, so long as there is a suitable data connection available. However, in a less preferred embodiment, it is also contemplated that the data collected by the device may be stored on the device until such time that it is desired to transmit the data to the map update service. The data is preferably transmitted to the server using a wireless communication network (e.g., GSM 1G-4G, 5G, Narrowband-IoT, LoRa, etc.) that provides Internet access. Of course, various configurations in this regard would be possible.
[0066] Of course, data obtained from the device may potentially be unreliable, for example if the sensor is faulty or incorrectly installed, or if the device's location determination functionality is faulty. Therefore, before this information is used, the data received from the device is preferably verified at the server, for example to ensure the quality and content of the data. Various approaches to verifying the obtained data are possible.
[0067] For example, preferably the acquired sensor data is verified by combining and / or comparing sensor data acquired from multiple different devices (e.g., substantially simultaneously within a time window or by comparing the data with past (historical) sensor data). Thus, in an embodiment, processing the received data at the server comprises verifying the acquired sensor data, where verifying the acquired sensor data comprises combining and / or comparing the sensor data acquired from multiple different devices. Validation of the received data may also check authentication and confidentiality credentials associated with the data, and this information may also be specified in the sensor data report.
[0068] In accordance with the present invention, sensor data is acquired remotely from devices (and their associated sensors), with the acquisition of the sensor data controlled using one or more location-specific "triggers" that can be issued from a server to the device as part of a request to acquire the sensor data.
[0069] The server can, for example, issue a request for the sensor data itself when it determines that some information is needed on the server side. For example, if a map service provider wants to obtain information at a certain location, the map service provider can issue a request via the server to one or specific (and potentially all available) devices currently moving within the navigable network for sensor data at that location. However, other configurations are of course possible.
[0070] Thus, in an embodiment, a request for sensor data may be issued to a device along with an electronic map and associated data. The trigger may then be effectively added to the electronic map, for example, in a manner similar to points of interest or other features that may be overlaid on an electronic map. As a device using the electronic map moves around a navigable network, the requested sensor data may be automatically acquired and reported to a server whenever the device reaches (or passes) the trigger. That is, if it is determined that the device has reached the trigger, the device is caused to automatically acquire the requested sensor data.
[0071] A request for sensor data thus includes a location (acting as a "trigger"), a set of instructions (e.g., a script) detailing the sensor data to be acquired, and preferably the steps the device should perform to acquire the sensor data. Thus, when the device determines that it has reached a location specified by the trigger, it can then cause the sensor to begin acquiring data at that location by performing the actions specified in the instructions.
[0072] Thus, the set of instructions may include a "WAIT" instruction that causes the device to wait until a specified location before moving on to the next instruction (which may be, for example, an instruction to begin acquiring sensor data), or the script may be loaded only when it is determined that the specified location has been reached. Of course, various other configurations are possible.
[0073] The instructions also include instructions to control the sensor operation, maneuvering the sensor to obtain the requested data. For example, if the sensor is a camera, the instructions may include instructions to obtain a sequence of images at certain intervals (in time / space) along a particular road segment. Similarly, the instructions may be to obtain a video sequence for a certain duration along the road segment. An example of this is the case of determining speed limit information, as described above. In that case, the server issuing the request may not know the exact location of the speed limit sign, but may know that it is located at a certain point along the road segment. Thus, a request may be issued to have a device arriving at the start of the road segment take image / video data for substantially the entire road segment (or at least until a speed limit sign is detected). This image sequence is then preferably processed in the device to extract a speed limit value, which can then be reported back (preferably without reporting the entire image sequence), thereby saving bandwidth.
[0074] As well as instructions for activating the sensors to acquire data, the set of instructions may include any other desired instructions, for example, for pre-configuring the device and / or the sensors and / or for processing acquired sensor data. For example, the instructions may also include instructions for the device to generate a sensor data report for output, as described above.
[0075] Thus, the instructions may detail the type of sensor to be used to complete the data acquisition request, the desired orientation of the sensor (e.g., if the sensor is determined to be incorrectly installed, the script may abort at that point without acquiring any sensor data), the duration of data collection, any collection steps that are repeated, and / or any further processing steps to be performed when acquiring the sensor data and preparing it for output.
[0076] All of these instructions can be (and preferably are) included within the request, thus essentially eliminating end-user involvement in processing the request.
[0077] Thus, a request for sensor data is a data package that includes location-specific triggers to cause the sensor data to be acquired at a specified location (which may be defined, for example, relative to an electronic map), as well as instructions to acquire the sensor data, e.g., acquire the sensor data, process (or pre-process) the acquired sensor data, and generate an appropriate sensor data report including data indicative of the acquired sensor data, along with any other desired attributes. A device receiving such a request can thus unpack the package (request) to extract the location-specific triggers, read any instructions needed to acquire and / or process the sensor data, etc.
[0078] In some embodiments, the server can automatically issue a request for sensor data including such a trigger if it is determined that something has changed in the navigable network relative to the current version of the electronic map. For example, in an embodiment, a map update system is provided that is configured to detect locations where observed behavior of devices in the navigable network does not match expected behavior based on the electronic map, and then automatically issue a request including a trigger for sensor data at the location. In some embodiments, the system can be configured to obtain location data regarding the movement of one or more devices as a function of time relative to the electronic map, and process the obtained location data to identify instances where observed behavior does not match expected behavior based on the current version of the electronic map. Once such instances are identified, a request including an appropriate trigger for obtaining sensor data to attempt to resolve the apparent discrepancy can be generated. Thus, in an embodiment, the request (trigger) may be generated by the map service provider (and then issued to multiple devices accordingly).
[0079] Alternatively, triggers may be requested from the device. For example, after the device has determined a route to follow (e.g., using known route planning algorithms as typically found in navigation devices / software), the device may then request triggers located along that route from a server. A request for sensor data including such triggers may then be issued, and the triggers are added to the route (path) at the relevant locations. That is, rather than the server pushing requests (triggers) to the device, the device (client) may pull the triggers.
[0080] In this manner, the trigger causes the device to acquire sensor data when it is determined that the device has reached a location associated with the trigger. Thus, the techniques described herein may include determining when the device has reached a location specified by the trigger. This determination may be performed in a variety of ways. For example, it will be appreciated that a device is generally capable of determining its own location (e.g., using GPS, or other similar positioning capabilities known in the art), and thus, the device may determine when it is approaching the trigger location. Thus, in a preferred embodiment, the determination of when the device has reached the location specified by the trigger is made by the device, e.g., by a suitable positioning module associated with the device. Preferably, this determination is made in relation to an electronic map representation of the navigable network. For example, the location of the device may be matched on a map (e.g., using known map matching techniques) to compare the device's location with the trigger location, which is preferably defined (mapped) on the electronic map. However, other configurations are possible.
[0081] The determination of when the device has reached the location specified by the trigger may be made when the device is determined to be within a predetermined threshold distance of the location trigger (at which point the sensor(s) may be activated and begin acquiring data in the manner described above). The threshold distance may be "zero," i.e., data is acquired as the device passes the trigger location. In some cases, the trigger may also include a directional indication, such that sensor data is obtained only if the device is determined to be approaching the location associated with the trigger from a selected direction. Of course, various other configurations are possible in this regard.
[0082] It will thus be appreciated that the requested sensor data may be obtained and reported to the server automatically, i.e., without end-user interaction (save for initially configuring the device to enable this functionality and allow access to the sensors). Thus, the present invention, at least in its preferred embodiments, allows for a crowd-sourced update loop that requires minimal user interaction. For example, the techniques presented herein can be used to provide high-quality electronic maps with more up-to-date speed limit information. However, the present invention is of course not limited to determining speed limits. For example, the present invention can also support crowd-sourced map updates for various static and dynamic map attributes, including, but not limited to, speed limits, traffic lights, number of lanes, speed cameras, new roads, turning restrictions, road works, road closures, types of road markings (e.g., dashed lines indicating overtaking is permitted), POI confirmation, etc.
[0083] In some preferred embodiments, the techniques are implemented on a mobile platform, for example, with a mobile device such as a smartphone mounted within the vehicle, however, the invention may generally be implemented using any suitable devices and sensors, which may be associated with the mobile device, may be on-board sensors, or may be some combination.
[0084] Thus, in its preferred embodiment, the invention enables a map content provider to send data collection requests to a navigation application running in a vehicle and connected via an in-vehicle network to a set of computing devices and associated sensors. Because there is no user involvement (other than an initial setup to set access rights), the system is hassle-free for the user, provides more reliable information, and enables a faster feedback loop for updating map information.
[0085] It will be appreciated that the method according to the invention in any of its aspects or embodiments may be implemented at least partly using software. Viewed from further aspects and further embodiments, the invention will therefore be seen to extend to a computer program product comprising computer readable instructions arranged to carry out any or all of the methods described herein when executed on suitable data processing means (data processors). The invention also extends to a computer software carrier comprising such software. Such a software carrier may be a physical (or non-transitory) storage medium, or may be a signal such as an electrical signal over a wire, an optical signal or a wireless signal to a satellite or the like.
[0086] Thus, from yet another embodiment, the techniques described herein can be seen to include computer software specifically configured to perform the methods described herein when installed on a data processor, computer program elements including computer software code portions for performing the methods described herein when the program elements are executed on a data processor, and computer programs including code configured to perform any or all steps of the methods described herein when the program elements are executed on a data processor. The data processor can be a microprocessor system, a programmable FPGA (Field Programmable Gate Array), etc.
[0087] Thus, the techniques described herein may suitably be implemented as a computer program product for use with a computer system. Such implementation may include, for example, a set of computer-readable instructions fixed on a tangible, non-transitory medium, such as a diskette, CD-ROM, ROM, RAM, flash memory, or hard disk. It may also include a set of computer-readable instructions transmittable to a computer system via a modem or other interface device, via a tangible medium, including but not limited to optical or analog communication lines, or intangibly using wireless techniques, including but not limited to microwave, infrared, or other transmission techniques. The set of computer-readable instructions embodies all or a portion of the functionality previously described herein.
[0088] Those skilled in the art will appreciate that such computer readable instructions can be written in a number of programming languages for use with many computer architectures or operating systems. Furthermore, such instructions may be stored using any present or future memory technology, including but not limited to semiconductor, magnetic, or optical, or transmitted using any present or future communications technology, including but not limited to optical, infrared, or microwave. Such computer program products are contemplated for distribution as, for example, shrink-wrapped software, a removable medium with accompanying printed or electronic documentation, preloaded into a computer system, e.g., a system ROM or fixed disk, or distributed over a network, e.g., a server or bulletin board on the Internet or World Wide Web.
[0089] The invention according to any of its further aspects or embodiments may include, to the extent not mutually inconsistent, any of the features described with reference to the other aspects or embodiments of the invention.
[0090] It should be noted that in this specification, references to the location of a device, or a navigable network / map, etc., should be understood to refer to data indicative thereof, unless the context requires otherwise. The data may indicate the relevant parameter in any manner, and may indicate it directly or indirectly. Thus, any reference to a location, attribute, etc. may be replaced by a reference to data indicative thereof, i.e., location data, or attribute data, etc. It should also be noted that the phrase "associated" should not be construed as requiring any particular restriction on the data storage location. The phrase only requires that the features be identifiably related.
[0091] Various features of the embodiments of the invention are described in further detail below. [Brief description of the drawings]
[0092] Various aspects of the present teachings, and configurations embodying those teachings, are described below by way of illustrative examples with reference to the accompanying drawings. [Figure 1] FIG. 1 illustrates generally a system in which embodiments of the techniques presented herein may be implemented. [Diagram 2] FIG. 2 illustrates the processing steps performed by a device upon receiving a location trigger, according to one embodiment. [Diagram 3] FIG. 3 is a high level architecture diagram of a map information updating system according to an embodiment. [Figure 4] FIG. 4 shows how location triggers can be incorporated into an electronic map representation of a road network. [Diagram 5] FIG. 5 shows how a change in speed limit can be detected from the observation of probe data in a road network. [Figure 6] FIG. 6 illustrates how a location trigger can be used to check if a speed limit has changed according to one embodiment. [Figure 7] FIG. 7 shows an example of speed records as a function of time at a location in a road network. [Figure 8] FIG. 8 shows the distribution of speed records for the locations in the example of FIG. 7 at two different times. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0093] An embodiment of the present invention relates to a method of collecting information (e.g., map information) about a navigable network from user devices currently moving within the network. In other words, the embodiment relates to a technique for "crowdsourcing" such information. Preferably, the navigable network is a road network, and the information is collected from devices associated with vehicles moving within the network. For example, the information may be collected from user devices such as smartphones carried or mounted within the vehicles, and / or from in-vehicle systems.
[0094] 1 illustrates an example of a system in which embodiments of the present invention may be implemented. As illustrated, a vehicle 10 includes a set of interconnected devices 12 that may communicate with each other via an in-vehicle network 14. Some of the devices 12 are also connected, e.g., via a server 18, to a long-range wireless network 16 (such as a cellular network, GSM G1-G4, G5, Narrowband-IoT, LoRa, etc.) that provides access to one or more Internet services.
[0095] FIG. 1 shows several devices 12 attached to an in-vehicle network. Each device 12 typically includes a processor, some memory and a network interface. At least some of the devices 12 also include one or more sensors 13, such as a microphone, a camera, an accelerometer, a positioning sensor, a proximity sensor, a radar, a laser range finder, an ambient light detector, etc. Some of the devices 12 may be embedded in the vehicle such that their sensors 13 have a fixed orientation. However, some of the devices 12 may belong to a user, such as the user's smartphone, and therefore may need to be attached in a given location before they can be used reliably.
[0096] Any devices 12 connected to the in-vehicle network 14 can be configured to share their resources (e.g., sensors 13) with other devices 12 in the network 14. For example, a mobile device can be enabled to access a video sensor embedded in a device embedded in the vehicle. Similarly, an application running on an embedded device can be enabled to access a long-range wireless network of a mobile device. Thus, devices 12 can communicate within an "Internet of Things" type infrastructure that allows resources to be shared.
[0097] At least one of the devices 12 may be running a navigation application. As is commonly known, a navigation application may assist a user in navigating to a new destination or may simply provide relevant information for navigating to commonly used destinations (home, work, etc.). In either mode, the navigation application may use locally stored map information and may receive map information from a map content provider using the long-range wireless network 16.
[0098] The map content provider provides a wide range of map information. It should be appreciated that map information relating to road networks is relatively static and map updates may be scheduled well in advance as road construction may take months or years to complete. However, other map information such as traffic density, accidents, road closures, updated road signs, points of interest, etc. may be more dynamic. The map content provider may observe location data points from the navigation application to detect differences (differences) between historical and recent navigation data. Such differences may indicate changes in the map information. This and other types of reports are processed by the map update system.
[0099] Location Trigger Processing Embodiments enable the map update system to quickly obtain local information to assist in map update decisions, including navigation applications in the in-vehicle network 14 that can assist in handling location triggers, as shown in FIG.
[0100] FIG. 2 shows the processing steps of the navigation application starting from receiving a location trigger (step 20) containing a location point and an action request. A location point is a specification of a point on a map, expressed for example with a longitude and latitude value pair. A location point is usually located on a road segment or on a new road segment. A location point may also contain a direction indication. An action request describes a data collection request for mapping purposes at the associated location point. An action request may specify taking one or more images by an accessible camera or recording a short video sequence. An action request may also specify recording accelerometer readings over a time segment. Thus, any sensor accessible to the navigation application can be included in the action request. After receiving the action request, the navigation application waits for vehicle location data to indicate that it is within a certain margin of the location point provided in the location trigger (step 21).
[0101] At the location trigger point, the navigation application collects sensor data (step 22) from local sensors or from accessible sensors of another device in the in-vehicle network indicated in the action request. Optionally, the navigation application can process the collected sensor data (step 23). The processing can use code (script, set of bytecode, binary code) included in the location trigger message or can use predefined sensor data processing functions supported by the navigation application.
[0102] An example of sensor data processing is searching for features in an image or a data compression operation. This processing can reduce the size of the sensor data by detecting and removing redundant or irrelevant information. The processing step can also combine the collected sensor data with other sensor information such as time, date, location, device ID, sensor ID, etc. into a sensor data report. The sensor data report preferably uses authentication and confidentiality techniques. The sensor data report is sent in response to the received location trigger (step 24).
[0103] On the other hand, if the vehicle position data does not reach the location point within a predetermined margin, the navigation application returns an error message after the expiration of a timeout window.
[0104] Map Update System The features embodied in the navigation application as described above may be advantageously used in a map information update system. Figure 3 includes a high level architecture diagram of a map information update system according to an embodiment.
[0105] Thus, FIG. 3 shows a map information update system with a map information controller 35 for generating a location trigger message. If the location point of the location trigger is within a certain range of a road segment, a reference or location trigger identifier is added to the road segment associating the road segment with the location trigger. It will be understood that such an association may thus be similar to a point of interest (POI) or road segment attribute in an electronic map. The location trigger is then issued to navigation applications 31 associated with vehicles moving in the network via the scheduler 30. Optionally, the scheduler 30 may also collect position data from the navigation applications 31 and then determine which navigation applications 31 to issue the location trigger based on the probe data. For example, the scheduler 30 may selectively issue the location trigger only to navigation applications 31 that are in the vicinity of the associated location. Alternatively, the scheduler 30 may issue the location trigger to all navigation applications 31 currently operating in the road network.
[0106] For example, the navigation application 31 may receive the association information as part of the map data. This is illustrated in FIG. 4, which shows two location triggers 40 superimposed on an electronic map representation of a road network. Alternatively, the navigation application 31 may request any such association near the current location, near a planned route, or near a frequently traveled route. For example, the navigation application 31 may request the transmission of a location trigger with the association information (reference, identifier).
[0107] Each of the above described embodiments results in the transmission of a location trigger over the long range communications network 16. The navigation application 31 receiving the location trigger can then collect the requested sensor data from associated sensors 32 in the in-vehicle network 14 and then process the location trigger using appropriate sensor data processing software 33, as described in the previous section, to generate and return a sensor data report.
[0108] The map information controller 35 may then use the sensor data reports to appropriately update the map information 36. At this stage, the update process may generally be comparable to known map update or mapping mechanisms.
[0109] Since the sensor data report can be regarded as untrusted user data, the map information update system employs a message validation module 34 to validate the trust level of the sensor data report before it can be used in the map information controller. The validation operation can check the authentication and confidentiality techniques used in the sensor data report. It can also compare the sensor data with sensor data history from other sources. Another validation technique would be to compare sensor data reports generated by different navigation applications for the same location trigger and combine (merge) them into a more reliable sensor data report.
[0110] Use Case - Speed Change Update Crowdsourced map updates can be used to keep speed limit information up to date in map products that attempt to report speed limit changes in a live fashion.
[0111] In this case, there are four systems working together to update the electronic map: A change detector (running on a server in the cloud) that monitors the relevant road network and detects changes, for example from GPS data. Apps running on mobile platforms, such as behind a windshield AI-based object detection algorithms running on mobile platforms Map services
[0112] The entire road network is monitored for example for speed changes. This can be done by measuring the speed (or other attributes) of cars as they pass through road segments (shown in Figure 7). The speed distribution of the road segments is then calculated over a certain duration (such as a week or a day) (shown in Figure 8). Then, for example, the Kullback-Leibler divergence
number
[0113] For example, Figure 5 shows an example where there is a change in the speed distribution between two set intervals. The change in distribution forms the basis for issuing a request to collect data on a road segment.
[0114] The mobile app can run on a smartphone, suitably mounted with its camera facing the road. However, it is also contemplated that the app may run on a dedicated navigation device, or on a navigation system built into the vehicle, where access to the vehicle's camera, or indeed the smartphone camera, is provided as part of the device's in-vehicle network. As shown in Figure 6, the navigation application displays road attributes such as speed limits that engage the user based on static map content provided by a map server. Thus, the display shows the user's current location 41 relative to an electronic map 42, but also provides a panel display (at the bottom of the screen in Figure 6) showing the local speed limit.
[0115] In the example shown in FIG. 6, the speed limit is shown to be 120 km / h. However, the distribution in FIG. 5 indicates that the speed limit may have changed (to 80 km / h). In this case, the mobile app receives a request to identify potential attribute changes on the road segment. In response to this request, the mobile application automatically turns on the camera to capture images of the speed limit signs (as shown in panel 73 shown in FIG. 6). Preferably, a camera is used to capture a series of images (i.e., a video stream) along the road. For example, the exact location of the speed limit signs may not be known. The camera can be used to obtain images for the entire segment of the road, knowing that the speed limit signs will be captured in at least some of these images.
[0116] The mobile app then executes a suitable object detection algorithm to process the image 73 and extract the speed limit value. This value can be sent to a map service to update the map, and the corrected speed limit value 60 can then be displayed to the user. It will be appreciated that processing the image data on the device helps to save significant bandwidth. In contrast, in some previous approaches, the entire image sequence would have been passed to a cloud server for analysis. Thus, typically, this was only done at a later time (to avoid excessive data bandwidth usage), such as, for example, after the end of the trip when the user returns home and connects to the home Internet connection. Thus, the described embodiments also allow data to be reported back and used more regularly and / or at lower bandwidth costs.
[0117] Other use case examples Although examples relating to obtaining speed limit information are provided above, it will be appreciated that such location triggers may be used to obtain any desired information regarding a road network. For example, other example location triggers are given below: A location trigger involves a request to acquire a series of images at location intervals along a road segment and / or at time intervals (e.g., at a rate of one image per several-second interval of traffic in a road segment to estimate traffic density). Location triggers with requests to capture images of road junctions in response to changes in junction delay Location triggers that involve a request to record accelerometer data and / or ambient noise conditions along a road segment to determine road surface conditions (e.g., for pothole detection). A location trigger with a request to create a series of images at location intervals along a road segment
[0118] It will also be appreciated that the obtained information does not have to be provided to a map service provider, but may find utility in a range of other applications (not limited to updating electronic maps). For example, the information may be used for traffic management, urban planning, or provided to automobile manufacturers or other users of the road network.
[0119] Thus, while various aspects and embodiments of the invention have been described above, it will be understood that the scope of the invention is not limited to the specific configurations described herein, but instead is extended to encompass all configurations falling within the scope of the appended claims, and modifications and variations thereof.
[0120] An embodiment of the present invention may be implemented as a computer program product for use with a computer system, for example a series of computer instructions stored on a tangible data recording medium or embodied in a computer data signal, which may implement all or part of the functionality described above and may be stored in any storage device, volatile or non-volatile, such as semiconductor, magnetic, optical, or other storage device.
[0121] Those skilled in the art will also appreciate that, while the preferred embodiment implements certain functions through software, the functions may equally well be implemented in hardware alone (e.g., through one or more ASICs (application specific integrated circuits)), or indeed through a mixture of hardware and software. Thus, the scope of the present invention should not be construed as being limited solely to being implemented in software.
[0122] Finally, it should also be noted that, although the appended claims recite particular combinations of features described in this specification, the scope of the present invention is not limited to the specific combinations claimed below, but instead is extended to encompass any combination of features or embodiments disclosed herein, whether or not that particular combination is currently specifically recited in the appended claims.
Claims
1. 1. A method for obtaining information about a navigable network from a device associated with a user traveling within the navigable network, comprising: receiving at the device a request to acquire sensor data, the request including one or more sets of instructions for acquiring sensor data from one or more sensors accessible by the device, processing the acquired sensor data to determine or extract information related to one or more attributes of the navigable network, and providing for output a sensor data report including the information related to the one or more attributes of the navigable network, the request further including a location-specific trigger associated with a location within the navigable network; automatically operating the instructions included in the request to acquire and process the requested sensor data and generate a corresponding sensor data report for output when it is determined that the device has reached the location associated with the trigger; The method includes:
2. The method of claim 1 , further comprising providing for output data indicative of the acquired sensor data.
3. 3. The method of claim 2, wherein the sensor data report includes data indicative of the acquired sensor data, as well as other information including one or more of: (i) a time the sensor data was acquired, (ii) a location where the sensor data was acquired, (iii) a device and / or sensor identifier, and (iv) a request identifier indicative of the request that generated the sensor data report.
4. 4. The method of claim 1, wherein the sensor data comprises (i) image data and / or video data captured by a camera associated with the device, and / or (ii) acceleration data obtained from one or more accelerometers associated with the device, and processing the acceleration data at the device comprises determining a state of road elements of the navigable network.
5. 5. The method of claim 1, wherein the device is capable of determining its own position relative to an electronic map, and the device is determined to have reached the location associated with the trigger if the device's position relative to the electronic map is determined to be within a predetermined threshold distance of the location.
6. 6. The method of claim 1, wherein the trigger includes a directional indication, and the sensor data is acquired only if the device is determined to be approaching the location associated with the trigger from a selected direction.
7. 1. A method for obtaining information about a navigable network from one or more devices each associated with a user moving through the navigable network, comprising: issuing a request from a server to one or more devices traveling within the navigable network to acquire sensor data, the request including one or more sets of instructions for acquiring sensor data from one or more sensors accessible by the devices, processing the acquired sensor data to determine or extract information regarding one or more attributes of the navigable network, and providing for output a sensor data report including the information regarding the one or more attributes of the navigable network, the request further including a location-specific trigger associated with a location within the navigable network, the trigger configured to, when the device is determined to have reached the location associated with the trigger, automatically operate the instructions included in the request to acquire and process the sensor data to generate a corresponding sensor data report for output; receiving, at the server, one or more sensor data reports obtained from one or more of the devices in response to the request for sensor data; The method includes:
8. 8. The method of claim 7, further comprising: further processing the data received at the server, wherein the processing comprises validating the acquired sensor data, and wherein validating the acquired sensor data comprises combining and / or comparing sensor data acquired from a plurality of different devices.
9. 9. A method according to claim 7 or 8, comprising using the received data to update an electronic map representation of the navigable network.
10. 10. A method according to any one of claims 7 to 9, wherein the trigger is issued in response to a request from the device for a trigger in the device's vicinity and / or for a given route along which the device is navigating.
11. 11. A method according to any one of claims 7 to 10, wherein the trigger is issued in response to detecting a potential error in an electronic map representation of the navigable network, and the location associated with the trigger is the location where the potential error was detected.
12. 1. A method for obtaining information about a navigable network from one or more devices each associated with a user moving through the navigable network, comprising: issuing, from a server, a request to one or more devices moving within the navigable network to acquire sensor data, the request including one or more sets of instructions for acquiring sensor data from one or more sensors accessible by the devices, processing the acquired sensor data to determine or extract information related to one or more attributes of the navigable network, and providing for output a sensor data report including the information related to the one or more attributes of the navigable network, the request further including a location-specific trigger associated with a location within the navigable network; receiving the request to acquire sensor data at a device moving within the navigable network; automatically operating the instructions included in the request to acquire and process the requested sensor data and generate a corresponding sensor data report for output when it is determined that the device has reached the location associated with the trigger; providing the generated sensor data report to the server for output; The method includes:
13. 1. A device operable to obtain information regarding a navigable network in which the device is moving, the device having access to one or more associated sensors, the device comprising: receiving a request to acquire sensor data, where the request includes one or more sets of instructions for acquiring sensor data from one or more sensors accessible by the device, processing the acquired sensor data to determine or extract information related to one or more attributes of the navigable network, and providing for output a sensor data report including the information related to the one or more attributes of the navigable network, the request further including a location-specific trigger associated with a location within the navigable network; determining when the device reaches the location associated with the trigger, and in response to the determining, automatically operating the instructions included in the request to obtain and process the requested sensor data and generate a corresponding sensor data report for output.
23. A device comprising one or more processors configured to:
14. a server configured to obtain information about a navigable network from one or more devices each associated with a user moving through the navigable network, issuing a request to one or more devices moving within the navigable network to acquire sensor data, where the request includes one or more sets of instructions for acquiring sensor data from one or more sensors associated with or accessible by the device, processing the acquired sensor data to determine or extract information regarding one or more attributes of the navigable network, and providing for output a sensor data report including the information regarding the one or more attributes of the navigable network, the request further including a location-specific trigger associated with a location within the navigable network, the trigger configured to, when the device is determined to have reached the location associated with the trigger, automatically operate the instructions included in the request to acquire and process the sensor data to generate a corresponding sensor data report for output; receiving generated sensor data reports from one or more of the devices in response to the request for sensor data; 2. A server comprising one or more processors configured to:
15. A system comprising one or more devices according to claim 13 in communication with a server according to claim 14.
Citation Information
Patent Citations
Map Based Feedback Loop for Vehicle Observation
US20170332198A1
High definition map updates based on sensor data collected by autonomous vehicles
US20180188045A1
