Control of an on-board vehicle navigation system

Abstract

The invention relates to a method for controlling an on-board navigation system of a vehicle, comprising obtaining (400; 401) an image including a sign displaying information about at least one service station and identifying (402), for each of said at least one service station, a brand name and a distance from said at least one service station, from the image obtained. The method then comprises determining (403), for each of said at least one service station, a point of interest from the brand name and said distance, the point of interest being assigned to the service station. A user-selectable graphic element is displayed, for each determined point of interest, on a graphical interface of the on-board navigation system, FIG. 4

Description

Title of the invention: Control of an on-board vehicle navigation system

[0001] The present invention belongs to the field of vehicle function control, in particular the control of an on-board vehicle navigation system.

[0002] The term “vehicle” means any type of vehicle such as a private, utility or heavy goods vehicle.

[0003] The vehicles incorporate on-board navigation systems using satellite signals from a satellite positioning system, such as the GPS system, for "Global Positioning System" in English, or the Galileo system for example, in order to position the vehicle in space.

[0004] A vehicle user can select charging or service station stops when programming a trip. To this end, after selecting a destination, they can request the positioning of several points of interest, such as service stations, along the route, in order to select one and add it as an intermediate stop in the programmed trip. Such programming generally takes place before starting the trip, or at the driver's initiative during the trip, in the event that the user wishes to take a break, following an alert generated by a fatigue detection function, or to recharge their vehicle.

[0005] However, it is not permitted for such navigation functions to dynamically suggest points of interest such as service stations, outside of route programming.

[0006] There is therefore a need to allow the selection of points of interest such as service stations, in a way that is simple for the user, without disrupting driving, and dynamic depending on the driving situation and / or the position of the vehicle.

[0007] The present invention improves the situation.

[0008] To this end, a first aspect of the invention relates to a method for controlling an on-board navigation system of a vehicle comprising the following steps: - obtaining an image including a sign indicating information relating to at least one service station; - identification, for each service station among said at least one service station, of a brand name and a distance from said at least one service station, from the image obtained; - determination, for each service station among said at least one service station, of a point of interest based on the brand name and said distance, the point of interest being assigned to the service station; - display, on a graphical interface of the embedded navigation system, of a graphical element selectable by a user for each determined point of interest.

[0009] Thus, points of interest corresponding to service stations can be dynamically suggested to a driver while driving, when a sign displaying information about service stations is detected in the vehicle's vicinity. This results in easier selection of a point of interest representing a service station in an on-board navigation system.

[0010] According to some embodiments, the method may include a step of receiving a first image from a camera on the vehicle, and determining whether a sign indicating information about at least one service station is present in the first image. If a sign indicating information about at least one service station is present in the first image, the image obtained may be the first image.

[0011] Thus, a camera mounted in the vehicle can acquire images of a scene outside the vehicle, allowing the detection of signs by analyzing the captured images.

[0012] In addition, if there is no sign indicating information relating to at least one service station in the first image, the method includes receiving a second image from the camera, and the determination of the presence of a sign indicating information relating to at least one service station is repeated for the second image.

[0013] Thus, sign detection in the images captured by the camera is carried out in real time and continuously, which allows for high responsiveness in sign detection, and therefore in the display of points of interest relevant to the driver.

[0014] According to some embodiments, each point of interest can identify a service station location.

[0015] Thus, the point of interest can be located in map data used by the on-board navigation system.

[0016] In addition, upon selection of a selectable graphic element by a vehicle user, the method may further include adding the point of interest associated with the selected graphic element, as an intermediate step or destination of the on-board navigation system.

[0017] Thus, it is made possible for the user to add the point of interest to his route, in a simple way while driving the vehicle.

[0018] According to embodiments, for each service station among said at least one service station, the distance can be determined by a character recognition algorithm applied to a part of the image.

[0019] Such an algorithm can be embedded in the vehicle, allowing for quick and simple identification of the distance between the vehicle and each service station indicated on the sign in the image.

[0020] According to embodiments, for each service station among said at least one service station, the brand name can be determined by an icon identification service which the vehicle accesses by a wireless communication method.

[0021] Thus, this embodiment takes advantage of the capabilities offered by a connected vehicle that can access remote, so-called "offboard" services.

[0022] According to embodiments, each point of interest can be determined by querying a database of points of interest from an instruction indicating a current position of the vehicle and, for each service station among said at least one service station the brand name and the identified distance.

[0023] Thus, the accuracy associated with the points of interest is improved since the latter are selected from a predefined set.

[0024] A second aspect of the invention relates to a computer program comprising instructions for implementing the method according to the first aspect of the invention, when these instructions are executed by a processor.

[0025] A third aspect of the invention relates to a control module for an on-board vehicle navigation system, the module comprising an interface capable of obtaining an image including a sign indicating information relating to at least one service station, and a processor configured to: - identify, for each service station among said at least one service station, a brand name and a distance from said at least one service station, from the image obtained; - determine, for each service station among said at least one service station, a point of interest from the brand name and said distance, the point of interest being assigned to the service station; - display, on a graphical interface of the embedded navigation system, a graphical element selectable by a user for each determined point of interest.

[0026] Other features and advantages of the invention will become apparent from an examination of the detailed description below, and the accompanying drawings in which:

[0027] [Fig-1] illustrates a vehicle driving situation according to embodiments of the invention;

[0028] [Fig.2] illustrates a motor vehicle passenger compartment according to embodiments of the invention;

[0029] [Fig.3] represents an image acquired by a vehicle camera according to modes realization of the invention;

[0030] [Fig.4] illustrates a method for controlling an on-board navigation system of the vehicle according to embodiments of the invention;

[0031] [Fig.5] illustrates a graphical interface of an embedded navigation system of the vehicle according to embodiments of the invention;

[0032] [Fig.6] illustrates a control module of an on-board navigation system of a vehicle according to embodiments of the invention.

[0033] Fig. 1 illustrates a driving situation of a vehicle 100 according to embodiments of the invention.

[0034] Vehicle 100 is travelling on a road 10. A road infrastructure may include a set of traffic signs indicating traffic rules and / or information for drivers of motor vehicles.

[0035] Certain signs, such as a 110 sign, indicate information relating to at least one service station, including: - an identifier of at least one service station, such as a sign identifier for example, the identifier being a logo; - for each identified service station, a distance between the position of sign 110 and the service station; - optionally additional information, such as, for each service station, a fuel price.

[0036] The service stations identified on sign 110 are service stations located along route 10, in the direction of travel of vehicle 100 towards which sign 110 is directed.

[0037] In the driving situation shown in [Fig.1], sign 110 can indicate information relating to three service stations 111.1, 111.2 and 111.3, located along Route 10.

[0038] A first service station 111.1 is located along Route 10 at a first distance 112.1. A second service station 111.2 is located along Route 10 at a second distance 112.2 greater than the first distance 112.1. A third service station 111.3 is located along Route 10 at a third distance 112.3 greater than the second distance 112.2.

[0039] The vehicle 100 according to the invention includes a camera 103 capable of acquiring an image of a scene external to the vehicle 100 comprising the panel 110. To this end, the camera 103 may be capable of acquiring a representative image of a scene facing the vehicle and arranged in a central position within the vehicle. For example, the The camera can be arranged in a high and central position in the windshield of vehicle 100. Alternatively, the camera 103 is capable of acquiring representative images of the roadside 10 and can be arranged in a lateral position in vehicle 100, for example in a rearview mirror of vehicle 100.

[0040] The camera 103 may be capable of acquiring images continuously, at a given frequency, which is preferably greater than 1 image per second, for example at least 24 images per second.

[0041] Fig. 2 illustrates vehicle 100 according to embodiments of the invention, seen from the passenger compartment inside vehicle 100.

[0042] The vehicle 100 according to the invention comprises a control module 101, capable of controlling an on-board navigation system of the vehicle 100. The control module 101 may be of the ECU type, for "Electronic Control Unit". The control module 101 may be specifically dedicated to controlling the on-board navigation system or may be a centralized control module of the vehicle 100, capable of controlling a plurality of vehicle functions. For example, the control module 101 may be capable of controlling an infotainment system of the vehicle 100.

[0043] The vehicle 100's on-board navigation system may include: - map data stored in a memory 106 of the vehicle 100 and / or downloaded remotely via a wireless communication module 104 of the vehicle; - a user interface that may include a display 102. There are no restrictions on the technology associated with the display 102, which may be an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or any other display technology. There are also no restrictions on the position of the display 102 within the passenger compartment. For example, as shown in [Fig. 2], the display 102 may be centrally located in the passenger compartment, in an area known as the center console; - a satellite positioning module 105, such as a GPS (Global Positioning System), capable of obtaining and maintaining a current position of the vehicle 100. This current position of the vehicle 100 may be overlaid by the control module 101 with the aforementioned map data in order to locate the vehicle 100 within the surrounding road infrastructure.

[0044] The wireless communication module 104 can be a cellular communication module capable of accessing a cellular network, such as a 3G, 4G, 5G or any other generation network, for example, or it can be a V2X interface allowing communication with other equipment, such as road infrastructure or other vehicles traveling near the vehicle 100. The vehicle 100 can, in particular, be capable of communicating, via the communication module 104, with a remote entity, such as a A remote server or a remote terminal accessible via an internet network, through the cellular network. Such a vehicle is said to be "connected".

[0045] Fig. 3 illustrates an image 300 acquired by the camera 103 of a vehicle 100 according to embodiments of the invention, the image 300 being representative of a scene outside the vehicle including the panel 110 described previously.

[0046] In the particular example of [Fig.3], given by way of illustration, panel 110 indicates the following information relating to the three service stations 111.1-111.3 described previously: - for the first service station 111.1: a first sign identifier "El" in a first part 301.1 of the image 300, associated with a first distance indication in a second part 302.1 of the image 300, corresponding to the first distance 112.1 which is 17 kilometers in this example; - for the second service station 111.2: a second sign identifier "E2" in the first part 301.2 of image 300, associated with a second distance indication in the second part 302.2 of image 300, corresponding to the second distance 112.2, which is 77 kilometers in this example; and - For the third service station, 111.3: a third sign identifier, "El," in the first part, 301.3, of image 300, associated with a third distance indication in the second part, 302.3, of image 300, corresponding to the third distance, 112.3, which is 132 kilometers in this example. Note that in this example, the third sign identifier in the first part, 301.3, is identical to the first sign identifier in the first part, 301.1, which is common practice when the number of signs is limited in a given area.

[0047] Thus, the brand identifiers “El” and “E2” can be logos identifying companies operating service stations and / or supplying fuel at service stations, for example.

[0048] Fig. 4 is a diagram illustrating the steps of a method for controlling an on-board navigation system of a vehicle, according to embodiments of the invention.

[0049] The control method can be implemented by the control module 101 described with reference to [Fig.2], and with reference to [Fig.6] described below.

[0050] At a step 400, the control module 101 obtains an image 300 captured by the camera 103. For example, the control module 101 can continuously and in real time obtain the images acquired by the camera 103. Alternatively, the control module 101 receives an image every N images captured by the camera, N being greater than or equal to 2.

[0051] At a step 401, the control module 101 determines whether a sign indicating information relating to at least one service station is included or not in The image 300 received in step 400. No restrictions are attached to such a determination step, which can be based on an image analysis algorithm capable of differentiating elements of the scene represented by the received images 300, in order to identify a sign and determine whether the identified sign is of the type of sign 110, that is, whether the sign indicates information relating to at least one service station. Step 401 can, in particular, segment the image 300 to extract the first parts 301.1-301.3 and the second parts 302.1-302.3.

[0052] If the control module 101 determines that the image 300 does not include a sign indicating information relating to at least one service station, the process returns to step 400. Otherwise, if the control module 101 determines that the image 300 includes a sign indicating information relating to at least one service station, the process proceeds to a step 402.

[0053] Alternatively, the control module 101 may only receive images from the camera 103 that include a sign displaying information about at least one service station, in which case step 401 is not performed and step 402 follows step 400 of receiving the image containing a sign displaying information about at least one service station. For this purpose, the camera 103 may, for example, be connected to a processing unit capable of applying an image processing algorithm to the images acquired by the camera 103, in order to determine whether each acquired image includes a sign displaying information about at least one service station. The image 300 received in step 400 by the control module 101 is thus transmitted from this processing unit only if the image 300 includes a sign displaying information about at least one service station.

[0054] At step 402, the control module identifies in the received image 300 including sign 110, for each service station for which information is indicated by sign 110: - the sign of the service station; - the distance between sign 110 and the service station; - optionally, additional information.

[0055] The sign of each service station can be identified by a remotely connected service, also called "offboard," accessible via the communication module 104 described previously. The connected service can be dedicated to recognizing a sign identifier. The control module 101 can thus send the first parts 301.1-301.3 of the image 300, after cropping around each first part 301.1 to 301.3 containing the sign identifiers, which can be icons or logos as previously explained, and receives in return a sign name from the connected service.

[0056] The identification of the distance and optionally additional information during step 402, can be implemented by a text recognition algorithm, of the OCR type for example for "Optical Character Recognition", implemented by the control module 101 or by the camera 103. The OCR algorithm can be applied to the second parts 302.1 to 302.3 obtained after segmentation of the image 300, as previously described.

[0057] Thus, at the end of step 402, the control module 101 can obtain a matrix comparing the identified sign names with the identified distances.

[0058] The matrix can take the form of Table 1 below:

[0059] [Tables 1] Store names Distance in kilometers El - Noml 17 E2 - Nom2 77 El- Noml 132

[0060] At a step 403, the control module 101 determines a point of interest for each service station identified in the image 300, based on the sign name and distance identified for the service station during step 402.

[0061] The point of interest thus determined for a service station is assigned to the service station during step 403.

[0062] A point of interest, or POI, is defined as a point representing a location within a set of map data, such as the map data used by the vehicle's onboard navigation system. Thus, a point of interest is associated with a given location, which can be situated within a set of map data in order to determine a route to the point of interest.

[0063] The on-board navigation system is thus able to determine a route between a current position of the vehicle and a point of interest, when the point of interest is selected on a user interface of the on-board navigation system, as described below with reference to [Fig.5].

[0064] To determine a point of interest for each service station identified in image 300, the control module 101 can: - perform a search in a database of points of interest stored in memory 106 of vehicle 100, or in internal memory of control module 101, the search being based on the sign names and distances identified in step 402, and on a current position of vehicle 100; and / or - to conduct a search in resources external to vehicle 100, for example by using a search engine capable of accessing a database external points of interest, and to return points of interest based on an instruction. The instruction submitted to the search engine may include the sign names and distances identified during step 402 and a current position of vehicle 100.

[0065] In order to limit the time spent searching databases, the search can indicate the direction of travel of the vehicle, which avoids a 360° search.

[0066] To determine the point of interest to assign to each identified service station, the control module 101 can obtain one or more points of interest for each service station from the internal or external database. The control module then selects, for each identified service station, a point of interest based on the distance from the vehicle's current position, which is the position of sign 110, and based on the name of the sign.

[0067] During step 403, the control module 101 can also add the point of interest assigned to each service station in the matrix of the preceding Table 1, to obtain the modified matrix of Table 2 below:

[0068] Table 2: Sign names Distance in kilometers POI El - Name 17 POIE1-1 E2 - Name2 77 POI E2 El- Name 132 POI El-2

[0069] At a step 404, the control module 101 controls a graphical interface of the on-board navigation system displayed on the screen 102, in order to display a user-selectable graphical element for each point of interest assigned during step 403. For each point of interest, the corresponding displayed selectable graphical element may indicate the sign name and distance associated with the point of interest in the modified matrix.

[0070] Fig. 5 illustrates a graphical interface 500 of an embedded navigation system, displayed on the screen 102 during step 404 of the process according to embodiments of the invention.

[0071] The graphical interface 500 may include a first area 501 in which the driving scene is represented with navigation information for the vehicle driver: directional information to guide the vehicle to the destination, contextual information on the weather, or regulatory information on speed limits, for example. Alternatively, in the first area 501, the graphical interface 500 may include map data, according to an aerial view, in which is positioned a current vehicle position, with the aforementioned navigation information.

[0072] According to the invention, the graphical interface 500 further includes a selectable graphical element for each point of interest assigned during step 403.

[0073] Thus, in the example considered here, the graphical interface 500 displays: - a first selectable graphic element 502.1 associated with the first point of interest POI-E1-1 assigned to the first service station 111.1; - a second selectable graphic element 502.2 associated with the second point of interest POI-E2 assigned to the second service station 111.2; and - a third selectable graphic element 502.3 associated with the third point of interest POI-E1-2 assigned to the second service station 111.3.

[0074] As previously stated, in the example in [Fig.5], each of the selectable graphic elements 502.1 to 502.3 indicates the name of the sign and the distance associated with the points of interest they respectively represent.

[0075] Each graphic element 502.1 to 502.3 is selectable by a vehicle user via user input, which could be a touch input on the screen 102, for example. When one of the graphic elements 502.1 to 502.3 is selected, the point of interest associated with the selected graphic element can be added to the current route as an intermediate stop or as a destination.

[0076] Thus, the invention makes it possible to dynamically propose points of interest associated with service stations located along a vehicle route, based on the detection of a sign indicating information relating to service stations.

[0077] Figure 6 shows the structure of the control module 101 according to embodiments of the invention.

[0078] The control module 101 includes a processor 601 configured to communicate unidirectionally or bidirectionally, via one or more buses or via a direct wired connection, with a memory 602 such as a Random Access Memory (RAM), a Read Only Memory (ROM), or any other type of memory (Flash, EEPROM, etc.). Alternatively, the memory 602 comprises several memories of the aforementioned types.

[0079] The memory 602 is capable of storing, permanently or temporarily, at least some of the data used and / or resulting from the implementation of the process described with reference to [Fig.4].

[0080] For example, memory 602 can store the internal database of points of interest and / or map data of the vehicle 100's on-board navigation system.

[0081] The processor 601 is capable of executing instructions, stored in memory 602, for the implementation of the steps of the process according to the invention, described in reference to [Fig.4]. Alternatively, the 601 processor can be replaced by a microcontroller designed and configured to carry out the steps of the process according to the invention, described with reference to [Fig.4].

[0082] The control module 101 includes a first interface 603 capable of bidirectional communication with the screen 102, in order to control in particular the display of the graphical interface 500 during the step 404 described above.

[0083] The control module 101 may further include a second interface 604 capable of communicating with the camera 103, for receiving the image 300 during the step 400 described previously.

[0084] The control module 101 may further include a third interface 605 capable of communicating with the wireless communication module 104 described above, in particular to access a remote server or a remote terminal, and / or to access the external database of points of interest via the search engine as previously described.

[0085] The control module 101 may further include a fourth interface 606 capable of communicating with the location module 105 described previously.

[0086] The control module 101 may further include a fifth interface 607 capable of communicating with the memory 106 of the vehicle 100, for example to query the internal database of points of interest, when it is stored in the memory 106.

[0087] The present invention is not limited to the embodiments described above by way of example; it extends to other variants.

Claims

Demands

1. A method for controlling an on-board navigation system of a vehicle (100) comprising the following steps: - obtaining (400; 401) an image (300) including a sign (110) indicating information relating to at least one service station (111.1-111.3); - identifying (402), for each service station among said at least one service station, a brand name and a distance (112.1-112.3) from said at least one service station, from the image obtained; - determining (403), for each service station among said at least one service station, a point of interest from the brand name and said distance, the point of interest being assigned to the service station; - display (404), on a graphical interface (500) of the embedded navigation system, of a graphical element selectable (502.1-502.3) by a user for each determined point of interest.

2. A method according to claim 1, comprising a receiving step (400) of a first image from a camera (103) of the vehicle (100), and a determination (401) of the presence, in the first image, of a sign (110) indicating information relating to at least one service station (111.1-111.3); wherein, in the event of the presence of a sign indicating information relating to at least one service station in the first image, the image (300) obtained is the first image;

3. A method according to claim 2, wherein, in the absence of a sign (110) indicating information relating to at least one service station (111.1-111.3) in the first image, the method comprises receiving (400) a second image from the camera, and the determination of the presence of a sign indicating information relating to at least one service station is repeated for the second image.

4. A method according to any one of the preceding claims, wherein each point of interest identifies a service station position (111.1-111.3).

5. A method according to claim 4, wherein, upon selection of a selectable graphic element (502.1-502.3) by a vehicle user (100), the method further comprises adding the point of interest associated with the selected graphic element as an intermediate step or destination of the on-board navigation system.

6. A method according to any one of the preceding claims, wherein, for each service station (111.1-111.3) among said at least one service station, the distance (112.1-112.3) is determined by a character recognition algorithm applied to a part (302.1-302.3) of the image (300).

7. A method according to any one of the preceding claims, wherein, for each service station (111.1-111.3) among said at least one service station, the sign name is determined by an icon identification service which the vehicle (100) accesses by a wireless communication method (104).

8. A method according to any one of the preceding claims, wherein each point of interest is determined by querying a database of points of interest from an instruction indicating a current position of the vehicle (100) and, for each service station among said at least one service station (111.1-111.3) the brand name and the distance (112.1-112.3) identified.

9. Computer program comprising instructions for carrying out the method according to any one of the preceding claims, when such instructions are executed by a processor (601).

10. Control module (101) of an on-board navigation system of a vehicle (100), the control module comprising an interface (604) capable of obtaining an image (300) comprising a panel (110) indicating information relating to at least one service station (111.1-111.3), and a processor (601) configured to: - identify, for each service station among said at least one service station, a brand name and a distance from said at least one service station, from the image obtained; - determine, for each service station among said at least one service station, a point of interest from the brand name and said distance, the point of interest being assigned to the service station; - display, on a graphical interface of the on-board navigation system, a graphical element selectable by a user for each point of interest determined.

Images