Connected navigation system embedded in a motor vehicle

Abstract

A connected navigation system (CNS) comprising a connected navigation device (DNV) installed in a motor vehicle (MV), belonging to an infotainment system (IVR) of the vehicle (MV), and comprising a touchscreen display (TSD) coupled to the navigation device (DNV); said navigation device (DNV) being connected to a remote server (RDS) capable of providing a dedicated connected service for the video stream from a surveillance camera (WC3), associated with a point of interest (POI) selected on the touchscreen display (TSD), via a specified connection address (ASC; APD); said infotainment system (IVI) further comprising a video stream display management module (DGM) configured to select a specified connection address (ASC; APD) and conditionally validate the display of the video stream on the touchscreen display (TSD). (Figure 1)

Description

Title of the invention: Connected navigation system embedded in a motor vehicle

[0001] The present invention relates generally to connected navigation systems embedded in motor vehicles and relates more particularly to a connected navigation system managing the display of a specific category of "POIs", an Anglo-Saxon acronym for "Point Of Interest", in particular a category concerning networked surveillance cameras, or "webcams", as well as the display of video streams provided by these webcams.

[0002] A connected navigation system embedded in a vehicle is generally integrated into, or coupled with, a so-called vehicle infotainment system that manages exchanges between the vehicle and the outside world: remote servers, portable electronic terminals, ...

[0003] An infotainment system on board a motor vehicle, also designated by the Anglo-Saxon acronym "IVI", for "In-Vehicle Infotainment", or IVI system, or multimedia system, is a term from the automotive industry which refers to a system which combines entertainment and the provision of information to drivers and passengers.

[0004] Such an infotainment system classically comprises a central unit associated with a digital display screen equipped with a touch control surface, also called a multimedia screen, allowing the user, and in particular the driver, to navigate through a menu tree giving access to many vehicle functions and in particular to connected navigation via a vehicle navigation device implementing digital map data and real-time vehicle location data provided by a geolocation device commonly referred to as a "GPS" receiver, an Anglo-Saxon acronym for "Global Positioning System".

[0005] The navigation system also benefits from another feature of the infotainment system: connectivity to the outside of the vehicle and in particular to one or more remote servers, capable of providing various services to the user, also referred to as "connected services".

[0006] These remote servers, in conjunction with the vehicle's infotainment system, provide real-time data related to car navigation with high bandwidth and low latency, via secure access through a dedicated application and a subscription to the service also designated by "Connected service".

[0007] This data complements the data already present, pre-recorded in a cartographic database of the on-board navigation device.

[0008] Such servers can thus provide real-time map data with potentially useful information for the user such as information on road traffic, danger zones and also POIs.

[0009] Today, among the categories of POIs existing in embedded navigation devices, we find POIs relating to: parking lots, service stations, shops, etc.

[0010] However, it is not possible, using on-board navigation systems, to access a category of POIs of the "webcam" type from the on-board navigation system's map, nor to view video feeds captured by webcams when available. Therefore, it is not possible to offer the user the ability to view real-time images, for example, of the destination or a stage of a route programmed into the vehicle's on-board navigation system.

[0011] To overcome these drawbacks, the invention proposes a solution for managing the display of video streams, in relation to pre-recorded webcam POIs in the on-board navigation device, via the vehicle's infotainment system.

[0012] To this end, the present invention has as its first object a connected navigation system comprising a connected navigation device embedded in a motor vehicle, belonging to a vehicle infotainment system, and comprising a touch display screen coupled to the connected navigation device, capable of displaying a determined route, superimposed on a road map, and at least one point of interest near said route indicating a location of at least one surveillance camera capable of providing a real-time video stream related to the environment of said location; said point of interest being selectable on the touch display screen by a user of the vehicle so as to connect the connected navigation device to a remote server capable of providing a connected service dedicated to the video stream of the surveillance camera related to said location via a determined connection address;said infotainment system further includes a video stream display management module configured to select the connection address and conditionally validate the display of the video stream on the touchscreen display.

[0013] According to one feature, the display management module is configured to validate the display of the video stream related to the location of the surveillance camera, after verifying a subscription to the connected service dedicated to providing the video stream from the vehicle's infotainment system or a mobile application dedicated to audit connected service, previously downloaded onto a portable terminal of the vehicle user when the portable terminal is connected to the infotainment system.

[0014] According to another feature, the management module is configured to use, as a priority, a first connection address to the connected service, provided by the application hosted on the user's portable terminal when the latter is connected to the vehicle's infotainment system, or a second connection address, called backup, previously registered in the management module, when the portable terminal, hosting the application dedicated to the connected service, is not connected to the infotainment system.

[0015] According to one feature, the management module is configured to receive backup address updates via radio waves.

[0016] According to another feature, the user's portable terminal, when connected to the infotainment system, is connected by a wired USB type link, or by a wireless communication link of the Wifi type.

[0017] According to another feature, the connected navigation device is connected to the remote terminal via the connection address determined by a wireless communication link supporting a protocol of a 5G type wireless communication network.

[0018] According to another feature, the connected navigation device is configured to display the video feed provided by the surveillance camera in real time on the touch display screen, superimposed on the map, in a so-called "pop-up" window, with other available information displayed in said window, relating to the environment of the surveillance camera selected by the user via the point of interest corresponding to said surveillance camera on said touch display screen, when the management module has verified the subscription to the connected service.

[0019] According to another feature, the connected navigation device is configured to display only the points of interest of the available surveillance cameras, close to the route.

[0020] The present invention has as its second object a method for managing the display of the video stream provided by the surveillance camera to the connected navigation system as described above; said method, implemented by the management module when the vehicle user selects the point of interest displayed on the touchscreen by touch, consists of checking whether the handheld terminal is connected to the vehicle's infotainment system, and if the handheld terminal is connected, then selecting the connection address provided by the user's handheld terminal after verifying the subscription to the connected service for displaying the video stream, Otherwise, if the portable terminal is not connected to the vehicle's infotainment system, then select the backup connection address, pre-registered in the management device after verifying the subscription to the connected service for displaying the video stream.

[0021] The present invention has as its third object a computer program product comprising instructions which, when the program is executed by the management module, lead the latter to implement the steps of the process as described above.

[0022] The connected navigation system according to the invention allows users of vehicles implementing such a system to be able to view the real-time environment of the destination or programmed stages from the connected navigation devices, embedded in these vehicles as well as the surroundings.

[0023] Other advantages and features of the present invention will become clearer from the following description, given solely by way of non-limiting example and made with reference to the drawings in which:

[0024] [Fig-1] illustrates a functional diagram of a connected navigation system according to the invention;

[0025] [Fig.2] illustrates an example of displaying a video stream captured by a webcam on a display screen of the navigation system connected according to the invention; and

[0026] [Fig.3] illustrates by a flowchart, the main steps of a display management process implemented by the management module of the connected navigation system according to the invention.

[0027] The connected navigation system according to the invention makes it possible to overcome the lack of an additional category of POIs of the type "webcam" POIs by exploiting this category previously stored in a map database of the navigation device embedded in the vehicle, and also makes it possible to manage access to the display of video streams captured by the webcams, on a touch display screen of the vehicle's infotainment system; the display of the video streams offered to the user in the form of a connected service, being conditional upon the user subscribing to the connected service.

[0028] Webcams are now increasingly common in urban areas, particularly for monitoring road traffic in areas with a high concentration of motor vehicles: urban ring roads, bridges, mountain passes, tunnels, toll plazas, motorway access points, ... and for providing various information such as weather information in specific geographical locations.

[0029] These webcams are mostly networked (internet), communicating with one or more supervisory bodies, capable of making the video streams captured by the surveillance cameras available to third parties, either free of charge or for a fee. paid or other usage fees.

[0030] Fig. 1 illustrates a functional diagram of an SNC-connected navigation system according to the invention.

[0031] It implements an IVI infotainment system embedded in a motor vehicle comprising a connected navigation device DNV, and an ECR touch display screen, for example a multimedia screen of the vehicle, or a remote screen for example the screen of a portable terminal, coupled to the DNV navigation device, capable of displaying routes from a determined route, calculated by a search engine of the DNV navigation device, not shown.

[0032] The DNV navigation device also has a map database BdD in which are stored, in particular, POIs usually available in navigation devices, advantageously enriched with a "webcam POI" category.

[0033] This last category POI webcam can be updated with each evolution of the navigation software in particular for the updating of map data, by a wired connection, in particular of type USB (Universal Serial Bus), or by a wireless communication link supporting a protocol of a wireless communication network of type 4G, 5G using in particular OTA (Over-the-Air) technology, between the IVI infotainment system and a server of the car manufacturer of the brand to which the vehicle belongs, VHL or its representatives, not shown.

[0034] The DNV navigation device is also configured to filter the display of webcam POIs. This filtering consists of only considering webcam POIs to be displayed whose locations are either on the route TRJ calculated and selected by the user or within a radius determined from the selected route TRJ. This radius is configurable: for example, it is set to 150 m by default.

[0035] The IVI infotainment system also includes a configured MDG display management module, to manage the APD or ASC connection address used by the DNV connected navigation device and to validate access rights to a connected service dedicated to video streams captured by the WC1-WC3 webcams.

[0036] The MDG management module uses the connectivity resources, not shown, of the IVI infotainment system or those of the DNV connected navigation device to establish a connection with a remote SDF server via a wireless communication link supporting a 5G type wireless communication network protocol (low latency and high speeds).

[0037] The remote SDF server belongs for example to a navigation data provider in contractual relationship with the car manufacturer or its representatives and which provides a connected service dedicated to video streams captured by the WC1-WC3 webcams.

[0038] The MDG management module is configured to use, as a priority, a first ASC connection address, or URL (Uniform Resource Locator), to the connected service, address which will be read (retrieved) by the DNV navigation device to display video streams on the ECR touch display screen.

[0039] This first ASC connection address is transmitted by the remote SDF server to a portable SMP terminal of a USG user of the VHL vehicle, for example a smartphone, which has subscribed to the connected service via an APM mobile application developed by, or for, the car manufacturer and hosted on the USG user's SMP smartphone.

[0040] The ASC connection address is transmitted to the SMP smartphone following activation of the APM application by the USG user via DAS activation means of the SMP smartphone.

[0041] When the SMP smartphone is connected to the IVI infotainment system either by a wired USB connection or by a short-range wireless communication connection of the Wifi type, not shown, with the APM application activated, T / F access control means of the MDG management module check whether a subscription to the connected service has been subscribed to and activated by the USG user from the APM application, via the DAS means.

[0042] After validation of the subscription by the T / F control means of the MDG management module, the connected navigation device DNV displays the video streams on the ECR touch display screen retrieved (read) via the ASC connection address.

[0043] If the MDG management module detects a lack of connection between the SMP smartphone and the IVI infotainment system, then a second APD connection address, known as the backup address, pre-registered in the MDG management module, is used. This second "backup" address corresponds to an address pre-registered at the factory, or registered in the MDG management module, particularly during the last OTA update.

[0044] The activation of the connected service is then done from a DAI HMI (Human Machine Interface) of the IVI infotainment system for example via the entry of a code allowing the T / F access control means to validate the display of the video streams.

[0045] A "backup channel" is thus provided, the specific elements and links of which are shown in [Fig. 2] as a dashed line. This backup channel ensures continuity of service for the subscribing USG user.

[0046] Without going into details that fall outside the scope of the present invention, it is simply stated that for secure authentication and connection, the SNC connected navigation system relies on the VIN, or VIN code, for "Vehicle Identification Number" or VHL, which is a unique number corresponding to the vehicle's serial number (or chassis number) and a UIN "Unique Identifier Number" which is a unique identifier associated with the vehicle's IVI infotainment system.

[0047] This VIN, UIN information is provided by the car manufacturer, or its representatives, to the video stream provider who, once authentication is verified, provides the connected service.

[0048] In the example of [Fig.2], the ECR touch display screen shows a portion of the CAR road map and three POIs, PC1-PC3, corresponding here to the locations of three webcams WC1-WC3 ([Fig.1]), arranged on or near a TRJ selected from among the routes proposed by the search engine of the connected navigation device DNV between points A and B.

[0049] A scenario of use of the SDN navigation system, as seen by the user USG, is described below with reference to [Fig.2].

[0050] Thus, when the USG user enters a destination in the DNV navigation device's menu, for example, a destination corresponding to point B, the DNV navigation device displays a portion of the CAR map on the VHL vehicle's ECR touchscreen display, here a two-dimensional (2D) map, with a route TRJ calculated by the DNV navigation device's search engine according to the USG user's preferences. The ECR touchscreen display also shows the location of the webcams WC1-WC3, in the form of webcam POIs PC1-PC3, identified along the selected route TRJ, in the form of a graphic representation suggestive of a webcam, here a camera.

[0051] Each PC1-PC3 webcam POI is a touchpad which, when activated by the USG user, controls the display (opening) of the PUP window superimposed on the current display; this type of PUP window is also referred to as "pop up" in Anglo-Saxon terminology.

[0052] The PUP window then displays information related to the activated webcam POI, here PC3.

[0053] A new press on the touchpad corresponding to the PC3 webcam POI makes the PUP window disappear (closes) from the ECR touch display screen.

[0054] The USG user can also choose to display the video feeds of the three webcam POIs PC1-PC3 simultaneously on the ECR touch display screen, in which case three windows corresponding respectively to the three webcam POIs PC1-PC3 are displayed at the same time on the ECR screen.

[0055] If the USG user has previously subscribed to a connected service dedicated to displaying video streams, and the service has been activated via their SMP smartphone (via DAS means), or via the HMI (via DAI means) of the IVI infotainment system, then the FVD video stream captured by the WC3 webcam is displayed instantly in the PUP window, potentially with information on the location of the WC3 webcam: street name, GPS coordinates, ...

[0056] In the event of no subscription, the FVD video stream is not displayed in the PUP window and a message may be displayed to inform the USG user of the non-subscription to the connected service.

[0057] A flowchart of the main steps of a method for managing the display of the FVD video stream provided by the WC3 surveillance camera to the connected navigation device DNV is described below with reference to [Fig.3]; said method being implemented by the MDG management module.

[0058] The method is implemented when the USG user of the VHL vehicle selects "by touch" on the ECR touch screen, coupled to the NDV navigation device, the location of the WC3 surveillance camera located by a point of interest PC3 displayed on the ECR touch display screen, near the route TRJ calculated by the connected DNV navigation device.

[0059] The process then consists of checking 100 whether the SMP handheld terminal is connected to the VHL vehicle's IVI infotainment system, and if the SMP handheld terminal is connected then selecting 300 the ASC connection address provided by the USG user's SMP handheld terminal after checking 200 the subscription to the connected service, otherwise if the SMP handheld terminal is not connected to the IVI infotainment system then, selecting 500 the APD backup connection address, pre-registered in the MDG management device after checking 400 the subscription to the connected service.

[0060] The present invention implements a computer program product comprising instructions which, when the program is executed by the MDG management module, lead the latter to implement the steps of the process described above.

Claims

Demands

1. Connected Navigation System (CNS) comprising a connected navigation device (DNV) embedded in a motor vehicle (MV), belonging to an infotainment system (IVI) of the vehicle (MV), and comprising a touch display screen (ECR) coupled to the connected navigation device (DNV), capable of displaying a determined route (TRJ), superimposed on a road map (CAR), and at least one point of interest (PC3) in the vicinity of said route (TRJ) indicating a location of at least one surveillance camera (WC3) capable of providing a real-time video feed (FVD) related to the environment of said location;said point of interest (PC3) being selectable on the touch display screen (ECR) by a user (USG) of the vehicle (VHL) so as to connect the connected navigation device (DNV) to a remote server (SDF) capable of providing a dedicated connected service to the video stream (FVD) from the surveillance camera (WC3) relating to said location via a determined connection address (ASC; APD); said infotainment system (IVI) further comprising a video stream display management module (MDG) configured to select the connection address (ASC; APD) and conditionally validate the display of the video stream (FVD) on the touch display screen (ECR).

2. System (SNC) according to the preceding claim wherein the display management module (MDG) is configured to validate the display of the video stream (FVD) in relation to the location of the surveillance camera (WC3), after verification of a subscription to a connected service dedicated to the provision of the video stream (FVD) from the vehicle's infotainment system (IVI) (VHL) or a mobile application (APM) dedicated to said connected service, previously downloaded onto a user's handheld terminal (SMP) (USG) of the vehicle (VHL) when the handheld terminal (SMP) is connected to the infotainment system (IVI).

3. System (SNC) according to the preceding claim, wherein the management module (MDG) is configured to use, as a priority, a first connection address (ASC) to the connected service, provided by the application (APM) hosted on the user's portable terminal (SMP) (USG) when the latter (SMP) is connected to the vehicle's infotainment system (IVI) (VHL), or a second connection address (APD), also called backup address, previously registered in the management module (MDG), when the portable terminal (SMP), hosting the application (APM) dedicated to the connected service, is not connected to the infotainment system (IVI).

4. System (SNC) according to the preceding claim, wherein the management module (MDG) is configured to receive backup address (APD) updates via radio waves.

5. System (SNC) according to any one of claims 2 to 4, wherein the user's portable terminal (SMP) (USG), when connected to the infotainment system (IVI), is connected by a wired USB-type link, or by a wireless communication link of the Wifi type.

6. System (SNC) according to any one of the preceding claims, wherein the connected navigation device (DNV) is connected to the remote server (SDF) via the determined connection address (APD; ASC) by a wireless communication link supporting a protocol of a 5G type wireless communication network.

7. System (SNC) according to any one of the preceding claims, wherein the connected navigation device (DNV) is configured to display the video stream (FVD) provided by the surveillance camera (WC3) in real time on the touch display screen (ECR), superimposed on the map (CAR), in a pop-up window (PUP), with other available information displayed in said window (PUP), related to the environment of the surveillance camera (WC3) selected by the user (USG) via the point of interest (PC3) corresponding to said surveillance camera (WC3) on said touch display screen (ECR), when the management module (MDG) has verified the subscription to the connected service.

8. System (SNC) according to any one of the preceding claims, wherein the connected navigation device (DNV) is configured to display only the points of interest (POI) of the surveillance cameras (WC1-WC3) available, in the vicinity of the route (TRJ).

9. A method for managing the display of the video stream (FVD) provided by the surveillance camera (WC3) to the connected navigation system (SDN) according to the preceding claims; said method, implemented by the management module (MDG) when the vehicle user (USG) (VHL) selects the point of interest (PC3) displayed on the touchscreen display (CR) by touch on the touchscreen (ECR), consisting of checking (100) whether the handheld terminal (SMP) is connected to the system vehicle infotainment (IVI) system (VHL), and if the handheld terminal (SMP) is connected then, to select (300) the connection address (ASC) provided by the user's handheld terminal (SMP) (USG) after verification (200) of the subscription to the connected service for displaying the video stream (FVD), otherwise if the handheld terminal (SMP) is not connected to the vehicle infotainment (IVI) system (VHL) then, to select (500) the backup connection address (APD), pre-registered in the management device (MDG) after verification (400) of the subscription to the connected service for displaying the video stream (FVD).

10. Product computer program comprising instructions which, when the program is executed by the management module (MDG), cause the latter to implement the steps of the process according to claim 9.

Images