Method and device for controlling a system for displaying graphic content on a vehicle screen based on the morphology of a driver
By determining the driver's eye position and adjusting graphic objects on the vehicle's screen to be visible without head movement, the method addresses readability and ergonomic issues, enhancing safety and comfort by maintaining driver attention on the road.
Patent Information
- Application Number
- FR2024001417
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-14
- Publication Date
- 2025-08-15
AI Technical Summary
The placement of instrument clusters behind the steering wheel in vehicles leads to distractions, readability issues, and ergonomic problems, compromising driver safety and comfort due to the need for drivers to look away from the road to consult information.
A method and device that determine the driver's eye position and visible area relative to the screen, adjusting the position and visibility of graphic objects on the screen to ensure they are visible without requiring head movement, using a vision system and computer-controlled display system.
Enhances ergonomic and intuitive display by keeping critical information visible without requiring head movement, reducing distractions and improving driver focus on the road.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Method and device for controlling a system for displaying graphic content on a vehicle screen according to the morphology of a driver Technical field
[0001] The present invention relates to a method and a device for controlling a system for displaying graphic content on a screen of a vehicle, in particular of the automobile type. The invention also relates to a method and a device for controlling a position of graphic objects on a screen as a function of its visibility. Technological background
[0002] Many vehicles are equipped with an instrument cluster, also known as a dashboard, which is a set of instruments and displays grouped in a portion of a vehicle's driver's compartment, usually behind a steering wheel. It provides the driver with essential information about the vehicle's operation and driving conditions. This information may include vehicle speed, engine speed, fuel level, engine temperature, tire pressure, direction indicators, high beams, warning lights, and other data related to advanced driver assistance systems, known as AD AS systems.
[0003] Such AD AS are for example: - a frontal collision warning system displaying, for example, an activation indicator and a graphic object on the instrument cluster to alert the driver to the risk of an imminent collision, - a lane keeping assistance system displaying, for example, an activation indicator and a graphic object on the instrument cluster to encourage the driver to correct their trajectory, - a blind spot monitoring system displaying, for example, an activation indicator and a graphic object on the instrument cluster when a vehicle is detected in a blind spot, - an adaptive cruise control, known as ACC, displaying, for example, the set distance, the current speed and the vehicle being followed, - a traffic sign recognition system displaying, for example, the maximum authorized speed and one or more graphic objects representing traffic signs, a driver fatigue warning or driver fatigue detection system, for example, displaying warnings on the dashboard to en- encourage the driver to take a break.
[0004] The instrument cluster may vary depending on the type of vehicle and its features, but its main purpose is to help the driver monitor and control various aspects of the vehicle's operation while driving. Nowadays, with technological advances, some dashboards also integrate touchscreens and infotainment systems, known as IVI (In-Vehicle Infotainment) systems to provide additional features such as navigation, smartphone connectivity, music and other services.
[0005] In order to be placed in the vehicle driver's field of vision, the instrument cluster is often placed behind the steering wheel. However, its location can lead to distractions, as the driver must look away from the road to consult the displayed information, thus increasing the risk of an accident, as the driver's alertness is reduced. In addition, if the instrument cluster is poorly designed or not very intuitive, it can be difficult for the driver to quickly interpret the information, resulting in a loss of time and concentration. Finally, drivers of different sizes or postures may have difficulty seeing the instrument cluster clearly, which can lead to ergonomic and comfort problems.In summary, placing the instrument cluster behind the steering wheel can lead to distractions and problems with readability and ergonomics, thus compromising driver safety and comfort. Summary of the present invention
[0006] An object of the present invention is to solve at least one of the problems of the technological background described above.
[0007] Another object of the present invention is to improve the readability of a screen placed behind a steering wheel of a vehicle.
[0008] An additional object of the present invention is to provide an ergonomic and intuitive interface for adjusting graphic content displayed on a screen of a vehicle according to a driving position of a driver of the vehicle.
[0009] According to a first aspect, the invention relates to a method for controlling a display system of a vehicle, the display system comprising a screen positioned behind a steering wheel of the vehicle, the method being implemented by a computer and comprising a set of steps comprising the following steps: - reception of first data representative of an image of a driver in the driving position of the vehicle, the image being acquired by a vision system on board the vehicle; - receiving second data representative of a current position of the steering wheel; - determining third data representative of a position of each eye of a set of eyes comprising at least one eye of the driver of the vehicle by relative to a position of said screen based on the first data; - determination of fourth data representative of at least one visible area of the screen included in a field of vision of the driver as a function of the second and third data; - determination of fifth data representative of a position on the screen of each graphic object of a set of graphic objects as a function of the fourth data; and - control of the display system to display the set of graphic objects on the screen according to the fifth data.
[0010] The position of each graphic object is thus determined so as to display the graphic object in an area of the screen depending on the visibility of this area for the driver of the vehicle in the driving position, an area of the screen being visible in particular when it is not masked by the steering wheel. By placing graphic objects in the driver's field of vision, they are then seen by the driver of the vehicle without him having to move his head to see them. The display is then more ergonomic and the driver does not waste time looking for certain information associated with these graphic objects, he is then more attentive to the road.
[0011] According to a variant of the method, the set of steps is repeated periodically.
[0012] According to another variant, the method further comprises a step of determining sixth data representing dimensions of each graphic object of the set of graphic objects as a function of the fourth data, the control of the display system being a function of the sixth data.
[0013] According to another variant, the method comprises a step of receiving seventh data representative of user parameters, at least one graphic object from the set of graphic objects being selected from a library of graphic objects as a function of the seventh data.
[0014] According to a further variant of the method, the set of eyes comprises two eyes.
[0015] According to yet another variant of the method, the vision system comprises a camera belonging to a driver attention monitoring system, called a DMS system, on board the vehicle.
[0016] According to another variant of the method, the screen belongs to an instrument cluster of the vehicle.
[0017] According to a second aspect, the invention relates to a device for controlling a display system of a vehicle, the device comprising a memory associated with at least one processor configured for implementing the steps of the method as described according to the first aspect of the invention.
[0018] According to a third aspect, the invention relates to a vehicle comprising a device as described above according to the second aspect of the invention.
[0019] According to a fourth aspect, the invention relates to a computer program which comprises instructions adapted for executing the steps of the method according to the first aspect of the invention, in particular when the computer program is executed by at least one processor.
[0020] Such a computer program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0021] According to a fifth aspect, the invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the invention.
[0022] On the one hand, the recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a microelectronic circuit type ROM memory, or a magnetic recording means or a hard disk.
[0023] Furthermore, this recording medium may also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam or by other means. The computer program according to the invention may in particular be downloaded from an Internet-type network.
[0024] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to perform or to be used in performing the method in question. Brief description of the figures
[0025] Other characteristics and advantages of the invention will emerge from the description of the non-limiting embodiments of the invention below, with reference to the appended figures 1 to 7, in which:
[0026] [Fig-1] schematically illustrates a part of the passenger compartment of a vehicle in a first configuration, according to a particular exemplary embodiment of the present invention;
[0027] [Fig.2] schematically illustrates a part of the passenger compartment of the vehicle of [Fig.l] in a second configuration, according to a particular exemplary embodiment of the present invention;
[0028] [Fig.3] schematically illustrates a sectional view of part of the passenger compartment of the vehicle of [Fig.l] in the first configuration, according to a particular exemplary embodiment of the present invention;
[0029] [Fig.4] schematically illustrates a screen of the vehicle of [Fig.l] in the first configuration, according to a particular exemplary embodiment of the present invention;
[0030] [Fig.5] schematically illustrates a screen of the vehicle of [Fig.l] in the second configuration, according to a particular exemplary embodiment of the present invention;
[0031] [Fig.6] illustrates a flowchart of the different steps of a method for controlling a display system of the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention; and
[0032] [Fig.7] illustrates a device configured to control a display system of a vehicle of the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention. Description of the embodiments
[0033] A method and a device for controlling a display system of a vehicle will now be described in the following with joint reference to Figures 1 to 7. The same elements are identified with the same reference signs throughout the description which follows.
[0034] The terms "first(s)", "second(s)" (or "first(s)", "second(s)"), etc. are used in this document by arbitrary convention to enable different elements (such as operations, means, etc.) implemented in the embodiments described below to be identified and distinguished. Such elements may be distinct or correspond to a single element, depending on the embodiment.
[0035] According to a particular and non-limiting example of embodiment of the invention, a method for controlling a display system of a vehicle comprising a screen positioned behind a steering wheel is implemented by a computer of the vehicle, for example by a computer associated with the IVI system of the vehicle.
[0036] Indeed, the method comprises the reception of first data representative of an image of a driver in the driving position and the reception of second data representative of a current position of the steering wheel.
[0037] A position of each eye of the driver is then determined relative to a position of the screen and at least one visible area of the screen is determined.
[0038] A position on the screen of each graphical object of a set of graphical objects is determined based on the at least one visible area and the display system is controlled to display the set of graphical objects on the screen.
[0039] [Fig.l] schematically illustrates a part of the passenger compartment of a vehicle in a first configuration, according to a particular exemplary embodiment of the present invention.
[0040] In this example, the vehicle 10 corresponds to a vehicle with a thermal engine, with electric motor(s) or even a hybrid vehicle with a thermal engine and one or more electric motors. The vehicle 10 thus corresponds, for example, to a land vehicle such as an automobile, a truck, a bus, a motorcycle.
[0041] According to this example, the driver of the vehicle 10 is installed in a seat 15, called the driver's seat. The driving position is on the left or on the right of the vehicle 10, depending on the regulations applicable in each country. According to the particular and non-limiting example of [Fig.l], the driving position of the vehicle 10 corresponds to a position on the left corresponding to countries where vehicles travel on the right-hand lane of roads.
[0042] The vehicle 10 advantageously incorporates in its passenger compartment 10 a display system comprising a screen 12 and a computer configured to control the display of content(s) of a human-machine interface, called HMI, graphic on the screen 12. The computer corresponds for example to the computer of the infotainment system, called IVI computer (from the English “In-Vehicle Infotainment” or in French “Infodivertissement embargo”) of the vehicle 10.
[0043] Such a display system comprising the screen 12 is for example provided or configured to reduce the number of screens present in the passenger compartment.
[0044] The screen 12 is for example touch-sensitive and corresponds for example to a screen of the LCD type (from the English “Liquid Crystal Display” or in French “Display à cristals liquide”), for example of the TFT type (from the English “Thin-Film Transistor” or in French “Transistor en film mince”), or OLED type (from the English “Organic Light-Emitting Diode” or in French “Diode électroluminescente biologique”). The screen 12 is for example arranged on a dashboard 13, a part of the screen 12 being located behind a steering wheel 11. The screen 12 makes it possible to display contents intended for the driver and, for example, for the passengers of the vehicle 10.
[0045] According to a particular exemplary embodiment, the screen 12 is also configured to allow the driver and / or passengers of the vehicle to interact with one or more systems embedded in the vehicle via 1THM displayed on the screen 12. For example, the screen 12 makes it possible to control the infotainment system, also called the IVI system of the vehicle 10.
[0046] According to another particular embodiment, the screen 12 belongs to an instrument cluster of the vehicle 10. Such an instrument cluster provides the driver of the vehicle 10 with essential information on the operation of the vehicle 10 and on its driving environment. It displays in particular graphic objects representative of: - a rev counter, displaying the engine speed in revolutions per minute (rpm), allowing the driver to know the rotation speed of the vehicle's engine 10, and / or - a speedometer, indicating the vehicle's speed in kilometers per hour (km / h) or miles per hour (mph), helping the driver to observe speed limits, and / or - a fuel and / or energy gauge, indicating the level of fuel and / or energy remaining in the tank and / or battery, allowing the driver to monitor fuel consumption and avoid a breakdown, and / or - a temperature gauge, indicating the temperature of the engine coolant and warning the driver of any risk of engine overheating, and / or - warning lights, indicating various vehicle operating conditions, such as lights on, seat belt not fastened, mechanical problems, and / or - information determined by a calculator or on-board computer, such as instantaneous fuel consumption, remaining range, outside temperature, etc.
[0047] The steering wheel 11 of the vehicle 10 has a certain shape. For example, the steering wheel 11 is: - circular in shape, that is to say in the form of a ring, - D-shaped or with a flat surface characterized by the presence of a flat part often made in a lower part to facilitate the installation of a driver, - rectangular to be more ergonomic, or - of a particular shape other than the usual shapes presented above.
[0048] The steering wheel 11 is for example: - small size, such a steering wheel being often used in sports or small vehicles, - medium-sized, for example offering a good balance between comfort and maneuverability, or - large size, generally used in luxury or large vehicles, providing a smoother driving feel and ideal for long journeys.
[0049] The steering wheel 11 comprises, for example, thumb rests for greater comfort for the driver of the vehicle 10 installed in the driver's seat 15.
[0050] Finally, the position of the steering wheel 11 is adjustable. The driver is thus able to adapt the location of the steering wheel relative to the dashboard according to his size in order to improve the ergonomics of the driving position by allowing him to find a comfortable driving position which corresponds to his size, the position of his arms and the position of his legs. This in particular reduces fatigue during long journeys and contributes to a better driving posture for the driver. The adjustment makes it possible, for example, to move the steering wheel 11 in the passenger compartment of the vehicle 10 in two directions, a first corresponding to a depth of the steering wheel 11, for example by allowing the translation of the steering wheel 11 along the steering column, a second corresponding to a height of the steering wheel 11, for example by allowing the vertical translation of the steering wheel or a rotation of the steering wheel 11 around an axis normal to the first direction. Thus, the driver of the vehicle 10 is able to adjust the distance separating him from the steering wheel 11 via the depth adjustment and to adjust the height of the steering wheel 11 in order to have space available between the steering wheel 11 and his legs via the height adjustment.
[0051] Sensors from a set of sensors, positioned for example in a fixing element of the steering wheel 11 or on the steering column, make it possible in particular to transmit data representative of the position of the steering wheel 11 relative to a reference frame associated with the passenger compartment of the vehicle 10 to a computer on board the vehicle 10, the reference frame associated with the passenger compartment of the vehicle 10 being called hereinafter “passenger compartment reference frame”.
[0052] According to a particular exemplary embodiment, the position of the steering wheel 11 is adjusted manually by the driver of the vehicle 10.
[0053] According to another particular embodiment, the position of the steering wheel 11 is adjusted automatically and / or electrically according to the size of the driver of the vehicle 10.
[0054] The vehicle 10 advantageously carries a vision system comprising at least one camera 14 configured to acquire images representing a part of the driver of the vehicle 10, in particular including a part of the driver's face, the part of the face comprising at least one eye 100.
[0055] According to an exemplary embodiment illustrated in [Fig.l], the vision system comprises a camera 14 placed in a central rearview mirror 15 of the vehicle 10. Such a position makes it possible to acquire images of the driver from a point of view from which it is easy to see the eyes 100 of the driver of the vehicle 10.
[0056] According to other particular embodiments, the vision system comprises one or more cameras placed at other locations in the passenger compartment, for example on the dashboard 13, or even attached to the screen 12.
[0057] According to a particular embodiment, the vehicle 10 has one or more on-board systems each controlled by one or more computers. These computers, with the IVI computer, form for example a multiplexed architecture for the realization of different services useful for the proper functioning of the vehicle 10 and for assisting the driver and / or the passengers of the vehicle in the control of the vehicle via the control of the system(s) embedded in the vehicle. The computers communicate and exchange data between them via one or more computer buses, for example a communication bus of the CAN data bus type (from the English “Controller Area Network” or in French “Réseau de controllers”), CAN FD (from the English “Controller Area Network Flexible Data-Rate”), FlexRay (according to the ISO 17458 standard), LIN (from the English “Local Interconnect Network” or in French “Réseau interconnecté local”) or Ethernet (according to the ISO / IEC 802-3 standard).
[0058] Among these on-board systems, the vehicle 10 for example carries a driver attention monitor, called DMS (from the English “Driver Monitoring System”) and also called driver fatigue warning system, the vision system being configured to cooperate with this DMS, such a system making it possible to monitor the driver’s attention and to alert the latter when a fall asleep or a drop in attention is detected. The DMS thus interacts with one or more cameras 14 detecting the orientation of the driver’s head and / or gaze to deduce therefrom whether the driver is attentive, that is to say whether he is looking in the direction of the road, and / or whether the driver is falling asleep by detecting the closing or blinking of the eyes.
[0059] The DMS acquires data representative of the driver's face via the vision system comprising the camera 14, for example images of the face, data relating to certain points of the face, data relating to certain parts of the face (for example the eyes, the eyelids).
[0060] The camera(s) 14 correspond(s) for example to one or more of the following acquisition devices: - infrared camera; - RGB type image acquisition camera (from the English “Red, Green, Blue” or in French “Rouge, vert, bleu”); - image acquisition camera associated with one or more devices (for example one or more LEDs (from the English “Light-Emitting Diode” or in French “Electroluminescent Diode”) emitting light in the infrared or in the near infrared band.
[0061] The DMS implements a set of primary functions ensuring, for example, the tracking of the driver's gaze (from the English "gaze tracking"), the determination or tracking of the driver's head posture (from the English "head pose" or "head gaze") and / or the tracking of the face (from the English "face tracking").
[0062] Such functions rely on the data obtained from the camera(s) 14 for example: - detect the eyes 100 in the face and determine the direction associated with the driver's gaze (inattention detection); and / or - determine the frequency of eyelid closure and the duration for which the eyelids are closed (sleep detection); and / or - determine the posture of the head and thus determine in which direction the driver is looking (inattention detection).
[0063] The vision system thus makes it possible to determine the position of each eye 100 of a set of eyes of the driver in the passenger compartment, for example in a reference frame associated with one of the cameras 14 of the vision system on board the vehicle 10.
[0064] According to a particular exemplary embodiment, the set of eyes only comprises one eye threshold 100.
[0065] According to another particular embodiment, the set of eyes comprises two eyes 100.
[0066] [Fig. 1] shows a first configuration in which the steering wheel 11 is set in a first position, called the low position. The positions of the eyes 100 of a set of eyes comprising two eyes correspond to those of a large person.
[0067] [Fig.2] schematically illustrates a part of the passenger compartment of the vehicle of [Fig.l] in a second configuration, according to a particular exemplary embodiment of the present invention.
[0068] [Fig. 2] shows a second configuration in which the steering wheel 11 is set in a second position, called the high position. The positions of the eyes 100 of a set of eyes comprising two eyes correspond to those of a person of small build.
[0069] A process for controlling the display system of the vehicle 10 is for example implemented by a computer of an on-board system of the vehicle 10, for example by the computer of the IVI system. Such a process comprises the following operations.
[0070] In a first operation, first data representative of an image of a driver in the driving position of the vehicle 10 are received. The image is acquired by at least one camera 14 of the vision system on board the vehicle 10. It comprises for example a set of pixels representing a part of the face of the driver of the vehicle 10, the part of the face represented comprising a set of eyes comprising at least one eye 100.
[0071] In a second operation, second data representative of a current position of the steering wheel 11 are received. This data comes for example from the set of sensors associated with the steering wheel 11. This second data is representative of a position of the steering wheel, for example in the passenger compartment reference frame.
[0072] The passenger compartment reference frame is for example defined in the following manner: the center of the passenger compartment reference frame corresponds to the center of the screen 12, an x axis corresponds to a direction associated with the width of the screen 12, the x axis being generally horizontal, and a y axis corresponds to a direction associated with the height of the screen 12, the y axis being generally vertical. The z axis is defined normal to a plane comprising the x and y axes so as to define an orthonormal (x; y; z) reference frame.
[0073] In a third operation, third data representative of a position of each eye 100 of the set of eyes are determined relative to a position of the screen 12 as a function of the first data. The position of each eye is for example determined in a reference frame associated with a camera 14 of the vision system. Knowledge of extrinsic parameters associating the reference frame of the camera 14 with the passenger compartment reference frame then makes it possible to convert the position of each eye 100 in the reference frame of the camera 14 into a position of each eye 100 in the passenger compartment reference frame.
[0074] It should be noted that the extrinsic parameters depend on the relative positions of the screen 12 and the camera 14 defined by the relative positions of these elements in the passenger compartment of the vehicle 10. These extrinsic parameters are therefore known and for example recorded in a memory of the computer in charge of the process.
[0075] In a fourth operation, fourth data representative of at least one visible zone 121 of the screen 12 are determined as a function of the second and third data, a visible zone 121 being included in a field of vision of the driver. Here, visible zone 121 is understood to mean an area of the screen 12 not masked by the steering wheel 11 from the point of view of an eye 100 of the set of eyes. Conversely, a non-visible area, or masked area 122 is an area of the screen 12 not visible from the point of view of an eye 100 because it is masked by the steering wheel 11. In other words, an area of the screen 12 is visible when the steering wheel 11 is not placed in an axis between a position of an eye 100 of the set of eyes and a pixel of the screen 12, the pixel belonging to a visible area 121.
[0076] [Fig. 3] schematically illustrates a sectional view of a passenger compartment portion of the vehicle of [Fig. 1] in the first configuration, according to a particular embodiment of the present invention.
[0077] The position of an eye 100 is for example defined in the passenger compartment reference frame by its coordinates (xk» ; hi00 ; du»). The position of the steering wheel is for example defined by the position of its high point (xn ; hn ; du).
[0078] The screen 12 has a height equal to H[2, its center therefore has coordinates (0; Hi2 / 2; 0) in the passenger compartment reference frame.
[0079] The section plane P passes through the eye 100 and is parallel to the y axis. It is then possible, from the previously defined dimensions, to determine the pixels of the screen 12 intersecting the section plane whether they are visible or not. For example, the ordinate Yp of a pixel p corresponding to the lower part of a first visible zone 121 is determined by the following formula: Yp = p * (hioo- hn) / (dp), Thus, all the pixels intersecting the cutting plane P whose ordinate is between H12 / 2 and Yp are visible and belong to a first visible zone 121.
[0080] Similarly, the coordinates of boundary pixels are for example determined for each limit of the steering wheel 11. The coordinates of these limits depend on the position of the steering wheel 11 but also on the shape of the steering wheel 11, thus the geometric data of the steering wheel 11 as well as of the screen 12 are for example recorded in a memory of the computer in charge of the process. In the example illustrated in [Fig.3] the steering wheel thus has two sections, an upper section 11a and a lower section 11b corresponding here to its hub. According to other examples and other sectional planes, the number of sections and their respective dimensions vary.
[0081] According to a particular exemplary embodiment, the fourth coordinates comprise a list of pixels of the screen 12 belonging to a visible zone 121.
[0082] According to another particular exemplary embodiment, the fourth data correspond to an index associated with each pixel of the screen 12, for example on a determined channel, a first value being attributed to the pixels associated with a visible zone 121, a second value different from the first value or an absence of value being attributed to the pixels associated with a masked zone 122.
[0083] [Fig.4] schematically illustrates a screen of the vehicle of [Fig.l] in the first configuration, according to a particular exemplary embodiment of the present invention.
[0084] The screen 12 has two visible zones 121 and a masked zone 122. The shape of the masked zone corresponds to the projection of the steering wheel on the screen 12.
[0085] In a fifth operation, fifth data representative of a position on the screen 12 of each graphic object 123 of a set of graphic objects are determined as a function of the fourth data, the fourth data being representative of at least one visible zone 121 of the screen 12.
[0086] The fifth operation consists for example in implanting graphic objects from a set of graphic objects to be displayed on the screen 12, so as to position the graphic objects in a visible zone 121 of the screen 12.
[0087] According to a particular exemplary embodiment, the graphic objects of the set of graphic objects are classified in order of importance, the graphic objects of higher order of importance are for example associated with a visible zone 121 while the graphic objects 123 of lower order of importance are associated with a masked zone 122 when the visible zones 121 do not allow their association, for example because they are saturated by the graphic objects 123 of higher order of importance.
[0088] Thus, the graphic objects 123 are associated with different sets of pixels of the screen 12 depending on whether the pixels belong to visible 121 or invisible 122 zones.
[0089] According to an additional particular embodiment, in a sixth operation, sixth data representative of dimensions of each object graph 123 of the set of graphic objects are determined based on the fourth data.
[0090] The resizing of the graphic objects 123 makes it possible, for example, to increase the number of graphic objects 123 to be displayed in a visible area 121, or even makes it possible to insert these graphic objects 123 into the narrow visible areas 121.
[0091] These dimensions are for example determined so as to insert a graphic object 123 in a visible zone 121 according to the available surface, that is to say according to a number of available pixels. It should be noted that a minimum number of pixels is for example associated with a graphic object in order to prevent the latter from being visible to the driver.
[0092] The graphic objects 123 to be displayed belong for example to a set of graphic objects permanently displayed on the screen 12, for example a graphic object 123 making it possible to indicate the speed of the vehicle 10 and then corresponding to a speedometer.
[0093] Other graphic objects 123 are for example displayed only when a driving assistance system is activated or in certain circumstances, for example a graphic object 123 can be associated with an alert and is then only displayed in the event of immediate danger.
[0094] According to a particular exemplary embodiment, in a seventh operation, seventh data representative of user parameters are received. At least one graphic object 123 from the set of graphic objects is then selected from a library of graphic objects as a function of the seventh data. Thus, the driver of the vehicle 10 is able to select graphic objects 123 associated with certain functions of the vehicle to display them on the screen 12.
[0095] In an eighth operation, the display system is controlled to display the set of graphic objects 121 on the screen 12 according to the fifth data.
[0096] According to the first configuration, three graphic objects 123 are for example positioned in an upper part of the screen 12, the upper part corresponding to a visible zone covering the entire width of the screen 12. The driver of the vehicle 10 then sees the graphic objects 123 by looking at the screen 12 over the steering wheel 11.
[0097] [Fig.5] schematically illustrates a screen of the vehicle of [Fig.l] in the second configuration, according to a particular exemplary embodiment of the present invention.
[0098] According to the second configuration, three graphic objects 123 are for example positioned in a central part of the screen 12, the central part being the largest visible area of the screen 12. The driver of the vehicle 10 then sees the graphic objects 123 by looking at the screen 12 through the steering wheel 11.
[0099] It should be noted that the implementation of the graphic objects 123 of the set of objects graphics is not necessarily symmetrical.
[0100] According to a particular embodiment, all of the operations are repeated periodically. For example, if the operations are repeated 24 or 48 times per second, then the display of the graphic objects will be dynamic, adapting in particular to the movements of the head and / or the movements of the steering wheel.
[0101] According to another particular exemplary embodiment, the second data representative of a current position of the steering wheel 11 comprise an angular position of the steering wheel 11. Thus, when the driver of the vehicle 10 turns the steering wheel 11, then graphic objects 123 visible through the steering wheel, as illustrated in the second configuration, will be moved progressively and simultaneously so as to follow the movement of the interior opening of the steering wheel 11, the visible zone 121 associated with this opening being mobile.
[0102] The automatic adjustment of the position and size of the graphic objects as a function of the position of the steering wheel and the position of the eyes of the driver of the vehicle, i.e. as a function of his size, thus allows the driver of the vehicle to benefit from an optimal display of the graphic objects on the vehicle screen.
[0103] The driver of the vehicle then does not have to move his head or lean forward to see the graphic objects displayed on the screen, making the display more ergonomic and comfortable. Such a display also prevents the driver from adjusting the position of the steering wheel according to the visibility of the screen, to the detriment of a driving position less suited to his morphology.
[0104] [Fig.7] illustrates a device configured to control a display system of a vehicle of the vehicle of [Fig.l], according to a particular and non-limiting embodiment of the present invention. The device 7 corresponds for example to the IVI computer of the vehicle.
[0105] The device 7 is for example configured for implementing the operations of the process described with regard to figures 1 to 5 or the steps of the method described with regard to [Fig.6]. Examples of such a device 7 include, but are not limited to, on-board electronic equipment such as an on-board computer of a vehicle, an electronic calculator such as an ECU (“Electronic Control Unit”), a smartphone, a tablet, a laptop. The elements of the device 7, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. The device 7 can be produced in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.
[0106] The device 7 comprises one (or more) processor(s) 70 configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software(s) embedded in the device 7. The processor 70 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 7 further comprises at least one memory 71 corresponding, for example, to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.
[0107] The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored in the memory 71.
[0108] According to various particular embodiments, the device 7 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (from the English “Telematic Control Unit” or in French “Telematic Control Unit”), for example via a communication bus or through dedicated input / output ports.
[0109] According to a particular and non-limiting embodiment, the device 7 comprises a block 72 of interface elements for communicating with external devices, for example a remote server or the “cloud”, other nodes of the ad hoc network. The interface elements of the block 72 comprise one or more of the following interfaces - RF radio frequency interface, for example Bluetooth® or Wi-Fi®, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English “Universal Serial Bus” or “Universal Serial Bus” in French); - HDMI interface (from the English “High Definition Multimedia Interface” or “High Definition Multimedia Interface” in French); - LIN interface (from the English “Local Interconnect Network”).
[0110] According to another particular embodiment, the device 7 comprises a communication interface 73 which makes it possible to establish communication with other devices (such as other computers of the on-board system) via a communication channel 730. The communication interface 73 corresponds for example to a transmitter configured to transmit and receive information and / or data via the communication channel 730. The communication interface 73 corresponds for example to a wired network of the CAN (Controller Area Network) type, CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by the ISO 17458 standard) or Ethernet (standardized by the standard ISO / IEC 802-3).
[0111] According to an additional particular embodiment, the device 7 can provide output signals to one or more external devices, such as a display screen 740, 12, one or more speakers 750 and / or other peripherals 760 via output interfaces 74, 75 and 76 respectively. According to a variant, one or other of the external devices is integrated into the device 7.
[0112] [Fig. 6] illustrates a flowchart of the different steps of a method for controlling a display system of the vehicle of [Fig. 1], according to a particular and non-limiting exemplary embodiment of the present invention. The method 6 is advantageously implemented in the vehicle, for example implemented by the device 7 of [Fig. 7] or by the computer of the IVI system.
[0113] In a step 61, first data representative of an image of a driver in the driving position of the vehicle 10 are received. The image is in particular acquired by a vision system on board the vehicle 10.
[0114] In a step 62, second data representative of a current position of the steering wheel 11 are received.
[0115] In a step 63, third data are determined as a function of the first data. The third data are representative of a position of each eye 100 of a set of eyes comprising at least one eye of the driver of the vehicle 10 relative to a position of the screen 12.
[0116] In a step 64, fourth data representative of at least one visible zone 121 of the screen 12 are determined as a function of the second and third data, the at least one visible zone being included in a field of vision of the driver.
[0117] In a step 65, fifth data representative of a position on the screen 12 of each graphic object 123 of a set of graphic objects are determined as a function of the fourth data.
[0118] In a step 66, the display system is controlled according to the fifth data to display the set of graphic objects 121 on the screen 12.
[0119] The position of each graphic object is thus determined so as to display the graphic object in an area of the screen depending on the visibility of this area for the driver of the vehicle in the driving position, an area of the screen being visible in particular when it is not masked by the steering wheel. By placing graphic objects in the driver's field of vision, they are then seen by the driver of the vehicle without him having to move his head to see them. The display is then more ergonomic and the driver does not waste time looking for certain information associated with these graphic objects, he is then more attentive to the road to drive safely.
[0120] Of course, the invention is not limited to the embodiments described above but extends to a method for controlling a position of graphic objects on an instrument cluster of a vehicle as a function of its visibility, and to the device configured for the implementation of such a method.
[0121] The invention also relates to a vehicle comprising the IVI computer or the device 7 of [Fig.7].
Claims
Claims
1. Method for controlling a display system of a vehicle (10), said display system comprising a screen (12) positioned behind a steering wheel (11) of the vehicle, said method being implemented by a computer and comprising a set of steps comprising the following steps: - reception (61) of first data representative of an image of a driver in the driving position of said vehicle (10), the image being acquired by a vision system on board the vehicle (10); - reception (62) of second data representative of a current position of the steering wheel (11); - determination (63) of third data representative of a position of each eye (100) of a set of eyes comprising at least one eye of the driver of the vehicle (10) relative to a position of said screen (12) as a function of the first data;- determination (64) of fourth data representative of at least one visible zone (121) of the screen (12) included in a field of vision of the driver as a function of the second and third data; - determination (65) of fifth data representative of a position on the screen (12) of each graphic object (123) of a set of graphic objects as a function of the fourth data; and - control (66) of said display system to display said set of graphic objects (123) on said screen (12) as a function of the fifth data.;
2. The method of claim 1, wherein said set of steps is reiterated periodically.
3. Method according to claim 1 or 2, which further comprises a step of determining sixth data representative of dimensions of each graphic object (123) of said set of graphic objects as a function of said fourth data, the control (66) of said display system being a function of the sixth data.
4. Method according to one of claims 1 to 3, which comprises a step of receiving seventh data representative of user parameters, at least one graphic object (123) of said set of graphic objects being selected from a library of graphic objects as a function of the seventh data.
5. Method according to one of claims 1 to 4, for which said assembly of eyes includes two eyes.
6. Method according to one of claims 1 to 5, for which the vision system comprises a camera belonging to a driver attention monitoring system, called DMS system, on board the vehicle (10).
7. Method according to one of claims 1 to 6, for which said screen (12) belongs to an instrument cluster of the vehicle (10).
8. Device (7) for controlling a display system of a vehicle (10), said device comprising a memory (71) associated with at least one processor (70) configured for implementing the steps of the method according to any one of claims 1 to 7.
9.
10. Vehicle (10) comprising the device (7) according to claim 8. Computer program product comprising instructions adapted for executing the steps of the method according to one of claims 1 to 7, when the computer program is executed by at least one processor.
Citation Information
Patent Citations
Vehicle control device, vehicle control procedure and vehicle control program
DE102018219967A1
Adaptive instrument display using eye tracking
US20150084764A1