Method and control device for a display system for displaying information on an alternating one-way parking zone
The system addresses the challenge of displaying information about alternating unilateral parking areas by using an on-board vehicle display system that detects approaching limits and provides augmented reality alerts, enhancing driver awareness and user experience.
Patent Information
- Application Number
- FR2023012267
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-09
- Publication Date
- 2025-05-16
AI Technical Summary
Existing systems struggle to effectively display information about alternating unilateral parking areas, which are complex to represent and not easily identifiable by drivers, especially when parking rules alternate by day or month.
A process and device for controlling an on-board display system in a vehicle, which includes obtaining geographic position data, road environment mapping data, and alternating unilateral parking zone data. The system detects approaching alternating unilateral parking area limits and displays augmented reality graphic content on a display device, including real and virtual objects to visually alert the driver.
The system provides clear and timely visual alerts to drivers about the start or end of alternating unilateral parking areas, improving driver awareness and user experience through the use of augmented reality.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Method and device for controlling a display system for displaying information in a unilateral alternating parking zone Technical field
[0001] The present invention relates to methods and devices for displaying information in a unilateral alternating parking zone. In particular, the present invention relates in particular to methods and devices for controlling an on-board display system in a vehicle, in particular but not exclusively a motor vehicle. Technological background
[0002] To assist the driver of a vehicle, it is known to display information relating to the road environment in which the vehicle is traveling, for example on a display device of the vehicle or on a display screen of a mobile communication device such as a smartphone embedded in the vehicle. The display of such information is done for example via a human-machine interface (HMI) of a navigation system. Such a navigation system uses map data such as digital road maps indicating the roads of the road environment in which the vehicle is traveling, this map data being associated with or including additional data relating to the road environment such as the presence of places of interest such as parking lots or information on current traffic conditions.
[0003] Some information is difficult to present to the driver. For example, information relating to unilateral alternating parking zones in which parking is permitted on one side of the roadway on certain days of the month and then permitted on the other side of the roadway on other days of the month, in an alternating manner, is complex to represent.
[0004] Furthermore, if the location of a unilateral alternating parking zone is public, such a zone is not easily identifiable by a driver of a vehicle traveling through it. Summary of the present invention
[0005] An object of the present invention is to solve at least one of the problems of the technological background described above.
[0006] Another object of the present invention is to better alert a driver of a vehicle of the presence of a unilateral alternating parking zone.
[0007] Another object of the present invention is to improve the user experience vis- with regard to information associated with a unilateral alternating parking zone during a journey in progress.
[0008] According to a first aspect, the present invention relates to a method for controlling an on-board display system in a vehicle, the display system comprising a display device, the method comprising the following steps: - obtaining first data representative of the geographical positions of the vehicle, second data representative of a map of a road environment in which the vehicle is traveling and third data representative of a set of alternating unilateral parking zones included in the road environment; - detection of a boundary of a unilateral alternating parking zone of the set of unilateral alternating parking zones, the vehicle being approaching and at a determined distance from the boundary when the vehicle is traveling in the road environment, the boundary being detected according to the first, second and third data, the boundary corresponding to a boundary of the start type of the unilateral alternating parking zone or to a boundary of the end type of the unilateral alternating parking zone for the vehicle, the type of the boundary being determined according to a direction of travel of the vehicle in the road environment; - control of display of a first graphic content in augmented reality on the display device following the detection, the first graphic content comprising a first image of a real scene located in front of the vehicle acquired by a camera on board the vehicle and a first virtual graphic object superimposed on the first image, the first virtual graphic object being representative of the limit, a graphic representation of the first virtual graphic object being a function of the type of the limit.
[0009] Such a method makes it possible to visually alert a driver of a vehicle to the start or end of a unilateral alternating parking zone. The use of augmented reality makes it possible to embed virtual objects on an image of the scene, providing the driver with clear information. The driver is thus aware of the presence of this zone when approaching the start of the zone and of video verbalization simply by looking at the road map displayed on the screen.
[0010] According to a variant, the graphic representation of the first virtual graphic object corresponds to: - a gantry supporting at least one first road sign indicating the start of a unilateral alternating parking zone when the boundary is of the start of a unilateral alternating parking zone type; and - a gantry supporting at least a second road sign indicating the end of a unilateral alternating parking zone when the limit is end type of unilateral alternating parking zone.
[0011] According to another variant, the first graphic content varies as a function of a movement of the vehicle in the road environment, the first image being a function of a point of view of the on-board camera and the graphic representation of the first virtual graphic object being furthermore a function of a distance between the vehicle and the limit at a time instant of acquisition of the first image.
[0012] According to another variant, the method further comprises the following steps when the limit is of the start of a unilateral alternating parking zone type: - determination of a set of lateral delimitations of a road in the road environment on which the vehicle is traveling by processing image data representative of a second image of a real scene located in front of the vehicle acquired by the on-board camera; - control of display of a second graphic content in augmented reality on the display device, the second graphic content comprising the second image, a set of second virtual graphic objects representative of a parking authorization and a set of third virtual graphic objects representative of a parking ban, the set of second virtual graphic objects and the set of third virtual graphic objects each being superimposed on the second image on a lateral delimitation different from the set of lateral delimitations determined as a function of temporal information representative of a current date.
[0013] According to an additional variant, the display system is associated with a navigation system on board the vehicle.
[0014] According to an additional variant, the direction of travel of the vehicle in the road environment is determined from: - at least part of the first data representative of a plurality of successive geographical positions of the vehicle in association with the second data; or - fourth data representative of a vehicle route calculated by the on-board navigation system in association with the first and second data.
[0015] According to a second aspect, the present invention relates to a device for controlling an on-board display system in a vehicle, the device comprising a memory associated with a processor configured for implementing the steps of the method according to the first aspect of the present invention.
[0016] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.
[0017] According to a fourth aspect, the present invention relates to a computer program which comprises instructions adapted for executing the steps of the method according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.
[0018] Such a computer program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0019] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the present invention.
[0020] On the one hand, the recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a microelectronic circuit type ROM memory, or a magnetic recording means or a hard disk.
[0021] Furthermore, this recording medium may also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam or by other means. The computer program according to the present invention may in particular be downloaded from an Internet-type network.
[0022] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to perform or to be used in performing the method in question. Brief description of the figures
[0023] Other characteristics and advantages of the present invention will emerge from the description of the particular and non-limiting exemplary embodiments of the present invention below, with reference to the appended figures 1 to 7, in which:
[0024] [Fig-1] schematically illustrates an environment of a vehicle, according to an example particular and non-limiting embodiment of the present invention;
[0025] [Fig.2] schematically illustrates a passenger compartment of a vehicle, according to a particular and non-limiting exemplary embodiment of the present invention;
[0026] [Fig.3] schematically illustrates a display screen on board the vehicle of [Fig.l], according to a first particular and non-limiting exemplary embodiment of the present invention;
[0027] [Fig.4] schematically illustrates a display screen on board the vehicle of [Fig.1], according to a second particular and non-limiting exemplary embodiment of the present invention;
[0028] [Fig.5] schematically illustrates a display screen on board the vehicle of [Fig.1], according to a third particular and non-limiting exemplary embodiment of the present invention;
[0029] [Fig.6] schematically illustrates a device configured for controlling an on-board display system in the vehicle of [Fig.1], according to a particular and non-limiting exemplary embodiment of the present invention;
[0030] [Fig.7] illustrates a flowchart of the different steps of a method for controlling an on-board display system in the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention. Description of examples of implementation
[0031] A method and a device for controlling an on-board display system in a vehicle will now be described in the following with joint reference to FIGS. 1 to 7. The same elements are identified with the same reference signs throughout the description which follows.
[0032] The terms "first(s)", "second(s)" (or "first(s)", "second(s)"), etc. are used in this document by arbitrary convention to enable different elements (such as operations, means, etc.) implemented in the embodiments described below to be identified and distinguished. Such elements may be distinct or correspond to a single element, depending on the embodiment.
[0033] According to a particular and non-limiting example of embodiment of the present invention, the control of a display system on board a vehicle is for example implemented by one or more computers of the vehicle, for example via one or more processors, or by one or more processors of a mobile communication device on board the vehicle, in particular when the display system is integrated into the mobile communication device.
[0034] For this purpose, first data representative of geographical positions of the vehicle, second data representative of a map of a road environment in which the vehicle is traveling and third data representative of a set of alternating unilateral parking zones included in the road environment are obtained. The first data are for example obtained or received from a receiver of a geolocation system (of the vehicle or of the mobile communication device). The second data are for example obtained or received from a remote device (for example a server of the "cloud" (or "cloud" in French)) and / or a memory, the second data being for example intended to be used by a navigation system (of the vehicle or of the device mobile communication). The third data are, for example, obtained or received from a remote device (for example, a cloud server, identical or different from the one providing the second data) and / or from a memory, the second data being, for example, intended to be used by the navigation system (of the vehicle or of the mobile communication device).
[0035] A boundary of a unilateral alternating parking zone of the set of unilateral alternating parking zones is detected on the basis of the first, second and third data when the vehicle approaches this boundary during a journey in the road environment, in particular when the vehicle is at a determined distance from this boundary (for example 10, 20, 50 or 100 m).Such a limit corresponds to a limit of the type beginning of the unilateral alternating parking zone (when the vehicle is about to enter the zone) or to a limit of the type end of the unilateral alternating parking zone (when the vehicle is about to leave the zone), the type of the limit being determined according to a direction of movement of the vehicle in the road environment (which direction of movement is for example determined according to a plurality of successive geographical positions, knowing the mapping of the road environment, or is determined according to a route calculated by the navigation system when the latter is used by the vehicle in guidance mode to reach a specific destination).
[0036] The display of a first graphic content in augmented reality is controlled in such a way that this first graphic content is displayed on a display device of the display system following the detection of the boundary. The first graphic content comprises a first image of a real scene located in front of the vehicle, which first image is acquired by a camera on board the vehicle (for example a camera of the vehicle or a camera of the mobile communication device) and a first virtual graphic object displayed superimposed on the first image. The first virtual graphic object represents or illustrates the boundary, its graphic representation depending on the type of the boundary (start or end of zone).
[0037] A unilateral alternating parking zone corresponds to a part of a road environment (for example, a few streets or roads, a district of a city) where parking is regulated: vehicles are authorized to park on one side of the roadway (with a ban on parking on the other side, i.e. the second side opposite the first side) on certain days of a determined period of time, and conversely, vehicles are authorized to park on the second side of the roadway (with a ban on parking on the first side of the roadway) on other days of the determined period of time.
[0038] Different unilateral alternating parking rules may apply to different unilateral alternating parking zones, the rules being indicated or displayed on road signs installed for this purpose in the road environment.
[0039] For example, alternating unilateral parking corresponds to semi-monthly unilateral parking, with parking authorized from the 1st to the 15th of the current month on the odd-numbered (or respectively even-numbered) side of the roadway (and parking prohibited on the even-numbered, respectively odd-numbered side) and parking authorized from the 16th to the 31st of the current month on the even-numbered (or respectively odd-numbered) side of the roadway (and parking prohibited on the odd-numbered, respectively even-numbered side).
[0040] [Fig. 1] schematically illustrates a vehicle 10 in an environment 1, according to a particular and non-limiting exemplary embodiment of the present invention.
[0041] [Fig.l] illustrates a vehicle 10, for example a motor vehicle, in an environment 1, the environment 1 corresponding to a road environment in which the vehicle 10 moves and circulates.
[0042] The vehicle 10 corresponds for example to a vehicle with a thermal engine, with electric motor(s) or even a hybrid vehicle with a thermal engine and one or more electric motors. The vehicle 10 thus corresponds for example to a land vehicle, for example a car, a truck, a bus.
[0043] According to a particular exemplary embodiment, the vehicle 10 carries a communication system configured to communicate with one or more remote devices or servers 111 via a wireless communication network infrastructure.
[0044] The remote server(s) 111 each correspond, for example, to a server of the “cloud” 100 (or “cloud” in French). The wireless communication infrastructure comprises, for example, a set of communication devices of the LTE (Long Term Evolution) cellular network antenna type 110 4G or 5G. According to an alternative embodiment, the communication devices belonging to the wireless communication infrastructure correspond to UBR (Roadside Unit).
[0045] The communication system of the vehicle 10 comprises, for example, one or more communication antennas connected to a telematic control unit, called TCU (from the English “Telematic Control Unit”), itself connected to one or more computers of the on-board system of the vehicle 10. The antenna(s), the TCU unit and the computer(s) form, for example, a multiplexed architecture for the realization of different services useful for the proper functioning of the vehicle and for assisting the driver and / or the passengers of the vehicle in the control of the electric vehicle 10. The computer(s) and the TCU unit communicate and exchange data between them via one or more computer buses, for example a communication bus of the CAN data bus type (from the English "Controller Area Network" or in French "Network of controllers"), CAN FD (from the English “Flexible Data-Rate Controller Area Network”, FlexRay (according to ISO 17458) or Ethernet (according to ISO / IEC 802-3).
[0046] According to a particular embodiment, the vehicle 10 carries a navigation and geolocation system, also called a GNSS system (Geolocation and Navigation by a Satellite System), for example a GPS (Global Positioning System) or Galileo type system. According to this embodiment, the vehicle 10 carries a geolocation system receiver allowing the vehicle 10 to obtain first data representative of its geographical position at any time, for example in the form of GPS coordinates (latitude and longitude), via a satellite link with a set of satellites 101.
[0047] The navigation system of the vehicle 10 is for example connected via an OTA (Over The Air) type link to receive map data and data relating to one or more alternating unilateral parking zones as the vehicle 10 moves, via the communication system of the vehicle 10. According to a variant, such data is recorded in a memory of the vehicle 10 associated with the navigation system, the recorded data being for example updated via the OTA link (for example periodically or when the map data and / or the alternating unilateral parking zone data have been updated on the remote device 111).
[0048] According to another particular embodiment, the vehicle 10 carries a mobile communication device, such as a smartphone (from the English "Smartphone") or a tablet, such a wireless communication device being for example arranged on a support fixed to an element of the passenger compartment of the vehicle 10 so that the display screen of the mobile communication device is visible to the driver when the latter is driving the vehicle 10. According to such an embodiment, the mobile communication device incorporates a navigation and geolocation system, also called a GNSS system (Geolocation and Navigation by a Satellite System), for example a GPS type system (from the English "Global Positioning System" or in French "Geo-positioning system by satellites"), for example installed on the communication device in the form of a mobile application.Such an embodiment allows the driver of the vehicle 10 to use the navigation system and the display system of the mobile communication device, for example when the vehicle 10 does not incorporate a navigation system or when the driver prefers to use the navigation system of the communication device. mobile communication instead of the vehicle navigation system 10. The mobile communication device is advantageously connected in wireless communication with the remote device(s) 111 via the wireless network infrastructure, for example to receive map data as well as data relating to one or more alternate unilateral parking zones, or updates of such data stored in the memory of the mobile communication device. The mobile communication device is for example connected in wireless communication to the vehicle 10, for example via a wireless link of the Bluetooth® or Wifi® type.
[0049] The remote server 111 is for example configured to send data relating to the road infrastructure such as: - second mapping data, for example first data representative of road maps, and / or - third data representative of one or more unilateral alternating parking zones, for example data representative of the coordinates of zone boundaries (corresponding for example to intersections with roads or streets), the parking rules in each of the zones, etc., and / or - other data such as the location and availability of services, the presence and position of work zones, etc.
[0050] According to a particular embodiment illustrated in [Fig.2], vehicle 10 has a display system comprising a display device or screen 13 and a computer configured to control the display of content(s) of a graphical MMI on the touch screen 13. The computer corresponds for example to the computer of the infotainment system, called the IVI computer (from the English “In-Vehicle Infotainment” or in French “Infodivertissement embargo”) of the vehicle 10.
[0051] According to an alternative embodiment, the display system of the vehicle 10 comprises one or more other screens, for example a screen of a device or system called a head-up display corresponding for example to a transparent or semi-transparent blade arranged in such a way that a driver seated in the seat 16 sees the content displayed or projected on the transparent blade when the driver is driving the vehicle 10, or a display screen 15 called a handset or dashboard generally arranged in an area behind the steering wheel 14 in the dashboard 11.
[0052] The screen 13 is for example associated with a touch interface and corresponds for example to a screen of the LCD type (from the English “Liquid Crystal Display” or in French “Display à cristals liquide”), for example of the TFT type (from the English “Thin-Film Transistor” or in French “Transistor en film mince”), or OLED type (from the English “Organic Light-Emitting Diode” or in French “Diode électroluminescente biologique”).
[0053] The screen 13 is configured to display content intended for the driver and vehicle passengers. The screen 13 is also configured to allow the driver and / or passengers of the vehicle to interact with one or more systems embedded in the vehicle via a human machine interface (HMI) displayed on the screen 13. For example, the screen 13 is configured to interact with the IVI system and / or a navigation system of the vehicle 10.
[0054] According to a particular embodiment, the screen 13 is not integrated into the passenger compartment of the vehicle but corresponds to a screen of a mobile communication device (smartphone, tablet), connected in communication, for example wirelessly, with the on-board system of the vehicle 10.
[0055] The vehicle 10 also carries, for example, one or more cameras, for example a camera 12 corresponding to a front camera (also called a windshield camera). Such a camera 12 is arranged in the passenger compartment of the vehicle 10 under the windshield and at the top and in the middle of this windshield. Such a front camera 12 has a field of vision corresponding to the space located in front of the vehicle 10 in the direction of travel of the vehicle 10. Such a camera 12 is thus configured for the acquisition of image data representative of the real scene located in front of the vehicle 10, in the direction of travel of the vehicle 10.
[0056] The camera 12 comprises for example the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising for example an arrangement of one or more lenses; and - optionally one or more calculators associated with memory and configured for processing images acquired by the sensor.
[0057] According to an alternative embodiment, the camera corresponds to a camera of the mobile communication device on board the vehicle 10, if applicable. The camera of the mobile communication device is also configured for the acquisition of image data representative of the real scene located in front of the vehicle 10, depending on where the mobile communication device is arranged in the passenger compartment of the vehicle 10.
[0058] A process for controlling a display system on board the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by a computer of an on-board system of the vehicle 10 such as the IVI system or the navigation system or by a processor of the mobile communication device. The on-board display system thus corresponds to a display device integrated into the vehicle 10 or to a display system of a mobile communication device itself embedded in the vehicle 10.
[0059] In a first operation of the process, first data representative of geographical positions of the vehicle 10, second data representative of a map of the road environment in which the vehicle 10 is traveling and third data representative of a set of alternating unilateral parking zones included in the road environment 1 are obtained.
[0060] The first data are for example received from a receiver of a geolocation system 101. The second and third data are for example received from a memory and / or from a remote device such as a server 111 configured to make such data available to navigation systems of so-called connected vehicles and / or mobile navigation applications of mobile communication devices.
[0061] The second and third data received correspond for example to data relating to the road environment in which the vehicle 10 is traveling at each instant, these second and third data varying as the vehicle 10 moves in its environment 1. For example, the second and third data relate to an area surrounding the vehicle 10, for example over a radius equal to a few kilometers or a few hundred meters.
[0062] In a second operation of the process, a boundary of a unilateral alternating parking zone is detected when the vehicle 10 approaches such a boundary during its movement in the urban environment.
[0063] The limit of the zone is detected when the vehicle 10 arrives at a determined distance from this limit, for example when the vehicle 10 is located 10, 20, 50, 100 or 500 m away.
[0064] The detection of the limit is obtained as a function of the first, second and third data. Thus, knowing the current geographical position of the vehicle 10 and the road on which the vehicle 10 is traveling (via the first and second data) and knowing the position of the limits of the alternating unilateral parking zone(s) in the traffic zone of the vehicle 10 (via the third data), the device implementing the invention is able to know at any time whether the vehicle 10 is approaching such a limit and at what distance the vehicle 10 is from such a zone limit.
[0065] A type of the zone boundary is further determined knowing the current geographical position of the vehicle 10 and the direction of movement of the vehicle 10.
[0066] The type of the zone boundary corresponds to: - a start of a unilateral alternating parking zone when the vehicle 10, at the moment of detection of the limit, is outside the unilateral alternating parking zone and approaching the latter (for example on a roadway with which the unilateral alternating parking zone forms an intersection); or - an end of a unilateral alternating parking zone when the vehicle 10, at the time of detection of the limit, is in the unilateral alternating parking zone and approaching the latter to exit the zone.
[0067] The direction of travel of the vehicle in the road environment is for example determined from: - of successive geographical positions of the vehicle 10, obtained from first data representative of the plurality of geographical positions obtained at different successive time instants, in association with the second mapping data: the second data makes it possible to determine on which road or street the vehicle 10 is traveling, the succession of geographical positions making it possible to determine the direction of travel along this wheel or street; or - fourth data representative of a route of the vehicle calculated by the on-board navigation system in association with the first and second data: when the navigation system is used in guidance mode and a route has been calculated and selected by the navigation system (for example based on a destination of the journey by the driver), the route data and the associated guidance instructions so that the vehicle 10 or its driver follows the route make it possible to know the direction of travel of the vehicle 10.
[0068] Knowledge of the geographical position of the vehicle 10 and the direction of travel / movement of the vehicle 10 in the road environment makes it possible to determine whether the vehicle 10 is actually approaching a limit of a unilateral alternating parking zone and to determine the type of limit (start or end of zone).
[0069] In a third operation of the process, the display of a first graphic content in augmented reality is controlled so that this first graphic content is displayed on a display device, for example the screen 13.
[0070] The display control is triggered by the detection of the limit, i.e. when the vehicle 10 is approaching the limit at a determined distance from this limit.
[0071] The first graphic content advantageously comprises: - a first image of the real scene located in front of the vehicle 10 acquired by a camera on board the vehicle such as the camera 12; and - a first virtual graphic object displayed superimposed on the first image, the first virtual graphic object being representative of the limit, a graphic representation of the first virtual graphic object being a function of the type of the limit.
[0072] Controlling the display includes rendering the first graphical content, such rendering corresponding to a set of operations performed by one or more processors on the pixels of the first image to compose the first graphical content. For example, rendering consists of associating with a set of pixels of the first image of pixel data (for example, color data expressed in an RGB (Red, Green, Blue) type space) associated with the first virtual graphic object.
[0073] The first virtual graphic object corresponds to a graphic object obtained by image synthesis, the first virtual graphic object being superimposed on the first image at the location of the limit of the zone to visually materialize this limit on the first image. Thus, the pixels of the first image at the location of the inlay of the first virtual object in the first image are replaced by the pixels defining the first virtual graphic object.
[0074] [Fig. 3] illustrates an example of the result of such rendering, i.e. the display of a first graphic content 30 on the screen 13.
[0075] The first graphic content 30 thus displayed results from the overlaying of a first virtual graphic object 32, for example a 3-dimensional (3D) graphic object, on a first image 31 whose content represents the real scene that the driver sees (at least partially) through the windshield of the vehicle 10 at the time of acquisition of the first image 31 (or with a slight time shift necessary for the composition of the first graphic content 30, of the order of a few hundred milliseconds for example).
[0076] The rendering result thus corresponds to so-called augmented reality content (noted RA, or AR in English for “Augmented Reality”) in that this content mixes content representing a real environment (acquired by a camera) with digital virtual content obtained by computer.
[0077] The first graphic content 30 varies according to the movement of the vehicle 10 on the roadway, as the vehicle 10 approaches the limit materialized on the screen 13 by the first graphic object 32.
[0078] The first graphic content 30 varies via: - the first displayed image which varies as the image data received from the camera 12 changes depending on the point of view of the camera 12 which evolves and varies depending on the movement of the vehicle 10, the first images being for example refreshed / displayed at a frequency of 24, 48 or 50 images per second; and - an adjustment of the representation of the first graphic object 32 as the vehicle 10 approaches the zone boundary, that is to say as a function of the distance between the zone boundary and the position of the vehicle 10 at the time instant of acquisition of the first corresponding image, in particular when the first graphic object corresponds to a 3D object: the adjustment of the graphic representation makes it possible to adapt the perspective according to the evolution of the point of view of the first graphic content 30 which varies with the movement of the vehicle 10, the limit of the zone being fixed in the real world (also called world space) with geo- coordinates fixed graphics (e.g. latitude and longitude).
[0079] According to the example of [Fig. 3], the first graphic object 32 is representative of a zone boundary of the zone start type. According to this example, the first graphic object 32 corresponds to or represents a gantry supporting at least one first road sign (2 signs according to the example of [Fig. 3]) indicating the start of a unilateral alternating parking zone.
[0080] Of course, the first graphic object 32 is not limited to such a representation but extends to any virtual graphic representation, for example to a line drawn on the roadway at the location of the zone limit in the real world or to one or more icons (for example each representing the first road sign indicating the start of a unilateral alternating parking zone) affixed by overlay on the roadway represented in the first associated image.
[0081] [Fig.4] illustrates another example of the result of such rendering with the display of a first graphic content 40 on the screen 13 representing an approach to an exit from a unilateral alternating parking zone.
[0082] According to the example of [Fig.4], the vehicle 10 is heading towards the exit of a unilateral alternating parking zone which it has just crossed during its journey, the end of the zone being represented by a first graphic object 42 displayed superimposed on a first image acquired by the camera 12, as explained with regard to [Fig.3].
[0083] According to the example of [Fig.4], the first graphic object 42 is representative of a zone boundary of the end of zone type. According to this example, the first graphic object 42 corresponds to or represents a gantry supporting at least one first road sign (2 signs according to the example of [Fig.4]) signaling an end of a unilateral alternating parking zone.
[0084] The first graphic content 40 varies according to the movement of the vehicle 10 on the roadway, as the vehicle 10 approaches the limit materialized on the screen 13 by the first graphic object 42, as explained previously with regard to [Fig.3].
[0085] According to a particular embodiment illustrated in [Fig.5], the process further comprises the following operations: - determination of a set of lateral delimitations of a road of the road environment on which the vehicle 10 is traveling, according to any known image processing method (for example by segmentation) applied to image data representative of a second image of the real scene located in front of the vehicle acquired by the on-board camera 12, the second image corresponding for example to one of the first images acquired by the camera 12 when the vehicle 10 is approaching a zone limit or to other images, for example images acquired by the vehicle 10 traveling in the unilateral parking zone alternating without visual on the detected zone limit; - display control of a second graphic content in augmented reality 50 to display the second graphic content 50 on the display device 13.
[0086] The second graphic content 50 comprises the second image 51, a set of second virtual graphic objects 52 representative of a parking authorization and a set of third virtual graphic objects 53 representative of a parking ban. The set of second virtual graphic objects 52 and the set of third virtual graphic objects 53 are each superimposed on the second image 51 on a lateral delimitation different from the set of lateral delimitation determined as a function of temporal information representative of a current date, that is to say the date of the day when the vehicle 10 is traveling in the alternating unilateral parking zone represented in the second image 51.
[0087] The alternating parking rule is for example obtained from the third data. According to a variant, the alternating parking rule is obtained by image processing applied to the images acquired by the camera 12 when the vehicle 10 enters the unilateral alternating parking zone, such images comprising a visual of the traffic sign indicating entry into the zone and the dates of the month on which it is possible to park on the side of the even, respectively odd numbers of the roads or streets of the zone crossed by the vehicle 10.
[0088] According to the example of [Fig. 5], a second virtual graphic object 52 represents a sign indicating a parking zone, such a second graphic object being displayed on the second image 52 on the side of the roadway where parking is authorized on the current date. Alternatively, the second virtual graphic objects 52 are further displayed only where parking is materialized (for example materialized by ground marking lines recognized by image processing) or not prohibited (for example prohibited at a pedestrian crossing recognized by image processing or prohibited via a continuous yellow line applied to the side of the roadway).
[0089] According to the example of [Fig.5], a third virtual graphic object 53 represents a no parking sign, such a third graphic object being displayed on the second image 52 on the side of the roadway where parking is prohibited on the current date.
[0090] The second graphic content 50 adapts as the vehicle 10 moves in the alternating unilateral parking zone, with a successive display of second images acquired by the camera 12 whose point of view varies with the movement of the vehicle 10 and with a display of the second virtual graphic objects 52 and the second virtual graphic objects 53 adapted to the second image 51 currently being displayed on the screen 13.
[0091] Alternatively, the second 52 and third 53 virtual graphic objects are displayed with the first virtual graphic object 31 or 32 on the same sequence of images of the real environment acquired by the camera 12 when the vehicle 10 is approaching a zone start limit or approaching a zone end limit.
[0092] According to yet another variant, other virtual graphic objects are for example added to the first graphic content 30, 40 and / or to the second graphic content 50, for example when the navigation system is used in a guidance mode (following a route calculated by the navigation system), these other virtual graphic objects representing for example guidance instructions (for example arrows inlaid on the roadway to materialize the route to follow) to indicate to the driver the route to follow.
[0093] [Fig. 6] schematically illustrates a device 6 configured for controlling a display system on board a vehicle, for example the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The device 6 corresponds for example to a device on board the vehicle 10, for example a computer, or to a device or unit of a mobile communication device.
[0094] The device 6 is for example configured for the implementation of the operations described with regard to figures 1 to 5 and / or the steps of the method described with regard to [Fig.7]. Examples of such a device 6 include, but are not limited to, on-board electronic equipment such as an on-board computer of a vehicle, an electronic calculator such as an ECU (“Electronic Control Unit”), a smartphone, a tablet, a laptop. The elements of the device 6, individually or in combination, can be integrated in a single integrated circuit, in several integrated circuits, and / or in discrete components. The device 6 can be produced in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.
[0095] The device 6 comprises one (or more) processor(s) 60 configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software(s) embedded in the device 6. The processor 60 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 6 further comprises at least one memory 61 corresponding for example to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.
[0096] The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored in the memory 61.
[0097] According to various particular and non-limiting embodiments, the device 6 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (from the English “Telematic Control Unit” or in French “Unité de Contrôle Télématique”), for example via a communication bus or through dedicated input / output ports.
[0098] According to a particular and non-limiting exemplary embodiment, the device 6 comprises a block 62 of interface elements for communicating with external devices. The interface elements of the block 62 comprise one or more of the following interfaces: - RF radio frequency interface, for example Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English “Universal Serial Bus” or “Universal Serial Bus” in French); - HDMI interface (from the English “High Definition Multimedia Interface” or “High Definition Multimedia Interface” in French); - LIN interface (from the English “Local Interconnect Network”).
[0099] According to another particular and non-limiting exemplary embodiment, the device 6 comprises a communication interface 63 which makes it possible to establish communication with other devices (such as other computers of the on-board system) via a communication channel 630. The communication interface 63 corresponds for example to a transmitter configured to transmit and receive information and / or data via the communication channel 630. The communication interface 63 corresponds for example to a wired network of the CAN (Controller Area Network) type, CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by the ISO 17458 standard) or Ethernet (standardized by the ISO / IEC 802-3 standard).
[0100] According to a particular and non-limiting exemplary embodiment, the device 6 can provide output signals to one or more external devices, such as a display screen 640, touch-sensitive or not, one or more speakers 650 and / or other peripherals 660 (projection system) via output interfaces 64, 65 and 66 respectively. According to a variant, one or other of the external devices is integrated into the device 6.
[0101] [Fig.7] illustrates a flowchart of the different steps of a method for controlling a display system on board a vehicle, for example the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The method is for example implemented by a device on board the vehicle 10, by a mobile communication device or by the device 6 of [Fig.6].
[0102] In a first step 71, first data representative of geographical positions of the vehicle, second data representative of a map of a road environment in which the vehicle is traveling and third data representative of a set of alternating unilateral parking zones included in the road environment are obtained.
[0103] In a second step 72, a boundary of an alternating unilateral parking zone of the set of alternating unilateral parking zones is detected, the vehicle being approaching and at a determined distance from the boundary when the vehicle is traveling in the road environment, the boundary being detected as a function of the first, second and third data, the boundary corresponding to a start type boundary of the alternating unilateral parking zone or to an end type boundary of the alternating unilateral parking zone for the vehicle, the type of the boundary being determined as a function of a direction of travel of the vehicle in the road environment.
[0104] In a third step 73, the display of a first graphic content in augmented reality is controlled on a display device of the display system following the detection of the second step 72, the first graphic content comprising a first image of a real scene located in front of the vehicle acquired by a camera on board the vehicle and a first virtual graphic object superimposed on the first image, the first virtual graphic object being representative of the limit, a graphic representation of the first virtual graphic object being a function of the type of the limit.
[0105] According to a variant, the variants and examples of the operations described in relation to one of figures 1 to 5 apply to the steps of the method of [Fig.7].
[0106] Of course, the present invention is not limited to the exemplary embodiments described above but extends to a method for displaying graphic content in augmented reality which would include secondary steps without thereby departing from the scope of the present invention. The same would apply to a device configured for implementing such a method.
[0107] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-based motor vehicle, comprising the device 6 of [Fig.6] or a display system comprising the device 6 of [Fig.6] connected in communication to a screen 13.
Claims
Claims
1. Method for controlling an on-board display system in a vehicle (10), said display system comprising a display device (13), said method being implemented by at least one processor and comprising the following steps: - obtaining (71) first data representative of geographical positions of the vehicle (10), second data representative of a map of a road environment (1) in which said vehicle (10) is traveling and third data representative of a set of alternating unilateral parking zones included in said road environment (1); - detection (72) of a limit of an alternating unilateral parking zone of said set of alternating unilateral parking zones, said vehicle (10) being approaching and at a determined distance from said limit when said vehicle (10) is traveling in said road environment (1), said limit being detected as a function of said first, second and third data, said limit corresponding to a start type limit of said alternating unilateral parking zone or to an end type limit of said alternating unilateral parking zone for said vehicle (10), the type of said limit being determined as a function of a direction of travel of said vehicle (10) in said road environment (1); - display control (73) of a first graphic content (30; 40) in augmented reality on said display device (13) following said detection (72), said first graphic content (30; 40) comprising a first image (31; 41) of a real scene located in front of said vehicle (10) acquired by a camera (12) on board said vehicle and a first virtual graphic object (32; 42) superimposed on said first image (30; 40), said first virtual graphic object (32; 42) being representative of said limit, a graphic representation of said first virtual graphic object being a function of the type of said limit.
2. Method according to claim 1, for which the graphic representation of said first virtual graphic object (32; 42) corresponds to: - a gantry supporting at least one first road sign indicating the start of an alternating unilateral parking zone when the limit is of the start of a unilateral parking zone type alternating; and - a gantry supporting at least a second road sign indicating the end of a unilateral alternating parking zone when the boundary is of the end of unilateral alternating parking zone type.
3. Method according to claim 1 or 2, for which said first graphic content (30; 40) varies as a function of a movement of said vehicle (10) in said road environment (1), said first image (31; 41) being a function of a point of view of said on-board camera (12) and the graphic representation of said first virtual graphic object (32; 42) being furthermore a function of a distance between said vehicle (10) and said limit at a time instant of acquisition of said first image (31; 41).
4. Method according to one of claims 1 to 3, further comprising the following steps when said limit is of the alternating unilateral parking zone start type: - determination of a set of lateral delimitations of a road of said road environment on which said vehicle (10) is traveling by processing image data representative of a second image (51) of a real scene located in front of said vehicle (10) acquired by said on-board camera (12);- display control of a second graphic content (50) in augmented reality on said display device (13), said second graphic content (50) comprising said second image (51), a set of second virtual graphic objects (52) representative of a parking authorization and a set of third virtual graphic objects (53) representative of a parking ban, said set of second virtual graphic objects (52) and said set of third virtual graphic objects (53) each being superimposed on said second image (51) on a different lateral delimitation of said set of lateral delimitation determined as a function of temporal information representative of a current date.;
5. Method according to claim 4, for which each second virtual graphic object (52) of said set of second virtual graphic objects is representative of a road sign indicating a place provided for parking and each third virtual graphic object (53) of said set of third virtual graphic objects is representative of a no parking road sign.
6. Method according to one of claims 1 to 5, for which said display system is associated with a navigation system on board said vehicle (10).
7. Method according to claim 6, for which the direction of travel of said vehicle (10) in said road environment (1) is determined from: - at least part of the first data representative of a plurality of successive geographical positions of said vehicle (10) in association with said second data; or - fourth data representative of a route of said vehicle (10) calculated by said on-board navigation system in association with the first and second data.
8. Computer program comprising instructions for implementing the method according to any one of the preceding claims, when these instructions are executed by a processor.
9. Device (6) for controlling an on-board display system in a vehicle, said device (6) comprising a memory (61) associated with at least one processor (60) configured for implementing the steps of the method according to any one of claims 1 to 7.
10. Vehicle (10) comprising the device (6) according to claim 9.
Citation Information
Patent Citations
VEHICLE CONTROL BASED ON THE SPATIAL MODEL OF THE SITE
DE102018128286A1
Perception-based parking assistance for autonomous machine systems and applications
DE102023105582A1
Method for determining parking spaces and free-parking space assistance system
US11113967B2