Method for controlling a display based on gaze detection

Abstract

Control method, implemented in a motor vehicle, comprising a gaze analysis module (111), and a display screen (130) in a passenger compartment of the motor vehicle, characterized in that it comprises the following first steps: First detection, by the gaze analysis module (111), of a first gaze (r2), of a first person (pe2) present in the passenger compartment, from a first location (l2) in the passenger compartment, towards a first graphic element (132) displayed by the display screen (130) in a first initial appearance, the step of first detection of the first gaze comprising a step of determining a characteristic of the first gaze (r2), Upon first detection of the first gaze (r2): Determination of a first activation appearance of the first graphic element (132), different from the first initial appearance, from a characteristic of the first gaze, then Control of a display, on the display screen (130),of the first graphic element (132) in the first activation appearance. Figure for abstract: figure 1,

Description

Title of the invention: Method for controlling a display based on the detection of a gaze

[0001] The invention relates to the display on a screen of a motor vehicle.

[0002] In particular, there is a need to control such a display in a simple and intuitive manner.

[0003] For this purpose, the invention relates to a (display) control method, implemented in a motor vehicle, comprising a gaze analysis module (electronic and / or software), and a display screen in a passenger compartment of the motor vehicle, the method being characterized in that it comprises the following first steps: - First detection, by the gaze analysis module, of a first gaze, the first gaze being a gaze of a first person present in the passenger compartment, from a first location in the passenger compartment, towards a first graphic element displayed by the display screen in a first initial appearance, the step of first detection of the first gaze comprising a step of determining a characteristic of the first gaze, - On (in other words: on condition of, in the event of, following the first detection of the first glance: • Determination of a first activation appearance of the first graphic element, different from the first initial appearance, from the characteristic of the first glance, then • Command to display, on the display screen, the first graphic element in the first activation appearance.

[0004] Thanks to the invention, the first person can, thanks to the fact that the first activation appearance is determined from a characteristic of the first glance, be assured that the graphic element is indeed selected by his gaze, and not by the gaze of another person.

[0005] For example, the first graphical element is a graphical window or a graphical button.

[0006] The display screen is for example on a dashboard (in other words: part of the dashboard) of the motor vehicle located in the passenger compartment. Of course, the display screen can be located in places other than on the dashboard.

[0007] A gaze analysis module (electronic and / or software) is a module (electronic and / or software) capable of implementing, from images received from a camera, a detection of a gaze, in particular by determining its direction and / or its origin (in this case, the first location), and / or an element looked at (in this case, the first graphic element), and possibly recognizing the person looking.

[0008] Such an (electronic) gaze analysis module is a technology well known to those skilled in the art and routinely used in motor vehicles.

[0009] The method may optionally comprise, after the first steps, the following steps: - (For example, on implementation or during the first detection step) Detection of an interaction of the first person with a human-machine interface (for example a button or a human-machine interface of another type, the interaction is for example, in the case of a button, a pressing of the button by the first person) located in the passenger compartment, (then) - Upon detection of the interaction (in other words: following detection of the interaction), command of a function associated with the first graphic element.

[0010] During interaction detection, the interaction may be detected from a message from the human-machine interface.

[0011] According to one embodiment, the function associated with the first element is a display of a third element associated with the first element, for example of a third window associated with the first element.

[0012] For example, the first element comprises a window for displaying a road map, and the third element comprises a window for displaying a menu for entering a destination for route guidance.

[0013] Alternatively, the first element is a graphic button and the associated function is an activation of an electronic (or electromechanical or electro-optical) component of the motor vehicle. For example, the associated function is an activation of hazard lights of the motor vehicle.

[0014] According to one embodiment, the characteristic of the first glance is the first location, and the first activation appearance, when an image by a (geometric) projection is on a first side of the first graphic element, is different from the first activation appearance, when an image by the (geometric) projection is on a second side of the first graphic element, opposite the first side of the first graphic element, the projection being an orthogonal projection of the first location on a horizontal straight line, when the motor vehicle is traveling on a horizontal road, the horizontal straight line cutting (approximately) the first graphic element into two equal parts (if of course this straight line exists).

[0015] Thus, the determination of the first activation appearance of the first graphic element may comprise a determination of an orthogonal projection of the first location on said horizontal line.

[0016] Determining the first appearance may also include determining whether the projection is on the first side of the first graphical element or on the second side of the first graphical element.

[0017] Alternatively, the display screen comprises a planar display surface and the first glance characteristic is a tilt angle between a first glance direction and the planar display surface.

[0018] In this embodiment, the first activation appearance can be determined from this tilt angle.

[0019] For example, the first activation appearance is that of a perspective of the first graphical element seen from the first location.

[0020] According to one embodiment, the determination of the first activation appearance may comprise a step of selecting an identifier of the first activation appearance (for example from among several possible ones in memory), from: - Information that the projection is on the first side of the first graphic element or on the second side of the first graphic element, and / or - From a position of the projection, and / or - From the angle of inclination.

[0021] According to a variant where the characteristic of the first glance is the first location, the display screen comprising a flat display surface, the first activation appearance when the first location is on a first side of a plane is different from the first activation appearance when the first location is on a second side of the plane opposite the first side, the plane being vertical, when the vehicle is traveling on a horizontal roadway (in other words: the first plane being orthogonal to a floor of the motor vehicle) and cutting the display surface into two equal parts.

[0022] According to a variant, the characteristic of the first glance is an identifier of the first person. This identifier can be obtained, by a facial recognition program, from an image of the passenger compartment comprising a face of the first person received from a camera filming an interior of the passenger compartment.

[0023] According to one embodiment, the first initial appearance comprises a first geometric shape of the first graphic element and the first activation appearance comprises a second geometric shape of the first graphic element different from the first geometric shape of the first graphic element.

[0024] Alternatively or in combination, the first initial appearance comprises a first color (and / or brightness of the first element, and / or contrast of the first element, and / or line thicknesses, and / or shading) of the first element and the first activation appearance comprises a second color (and / or brightness of the first element, and / or contrast of the first element, and / or line thicknesses, and / or shading) of the first element, different from the first color (and / or brightness of the first element, and / or contrast of the first element, and / or line thicknesses, and / or shading).

[0025] According to one embodiment, the second geometric shape of the first graphic element is, with respect to the first geometric shape of the first graphic element, when the projection is of the first (and / or second) side of the first graphic element: - Contracted (in other words: constricted) on the first side of the first graphic element, and / or - Dilated (in other words: flared) on the second side of the first graphic element.

[0026] According to one embodiment, the second shape of the first graphic element is a uniform (in other words: homogeneous) expansion of the first shape of the first graphic element, for example when the projection is in the first element (and / or for example when the first element is a graphic button).

[0027] Of course, one can envisage other differences between the first form and the second form, of different natures.

[0028] According to a second embodiment, the second shape of the first graphic element has an area (in other words: surface) of at most 25 percent more or at least 25 percent less than an area (in other words: surface) of the first shape of the first graphic element.

[0029] According to one embodiment, an intersection between the first shape of the first graphical element and the second shape of the first graphical element has an area (in other words: surface) less than 25 percent of an area (in other words: surface) of the first shape of the first graphical element (for example, an area or surface less than 10 percent of the area or surface of the first shape of the first graphical element).

[0030] Thus, the disturbance of the display on the screen is limited.

[0031] Of course, one can envisage other differences in area (in other words: surface) between the first form and the second form.

[0032] According to one embodiment, the method comprises the following second steps, implemented simultaneously with the first steps: - Second detection, by the gaze analysis module, of a second gaze, of a second person present in the passenger compartment, from a second location in the passenger compartment, towards a second graphic element displayed by the display screen in a second initial appearance (at the same time as the first graphic element), the step of second detection of the second gaze comprising a step of determining a characteristic of the second gaze, - On (in other words: on condition of, in the event of, following the) second detection of the second look: • Determination of a second activation appearance of the second graphic element, different from the second initial appearance, from a characteristic of the second look, then • Commanding a display, on the display screen, of the second element in the second activation appearance (at the same time as commanding the display, on the display screen, of the first element, in the first activation appearance).

[0033] Of course, the second steps are optional.

[0034] The characteristics and advantages of the second steps are identical or analogous to those of the first steps, without it being necessary to repeat them here.

[0035] The invention also relates to a computer program comprising instructions executable by a microprocessor or a microcontroller or a computer, to implement the steps of the method according to the invention, when it is executed by the microprocessor or the microcontroller or the computer.

[0036] The method according to the invention can be implemented by an electronic device (or a motor vehicle). The invention therefore also relates to an electronic device (or a motor vehicle) configured to implement the steps of the method according to the invention, as well as a motor vehicle comprising the electronic device.

[0037] The characteristics and advantages of the computer program, the electronic device, and the vehicle are identical to those of the method according to the invention (without it being necessary to repeat them here).

[0038] When the electronic device, motor vehicle, projection device (or other element) is "configured to" (or "capable of") performing or implementing a step or operation, this implies, for example, that the element comprises means for performing the step or operation. The means preferably comprise electronic means, for example a computer program, data in memory, specialized electronic circuits, wired or wireless connections, a microprocessor and / or a microcontroller.

[0039] Other characteristics and advantages of the present invention will appear more clearly on reading the detailed description which follows, comprising embodiments of the invention given as non-limiting examples and illustrated by the appended drawings, in which: • [Fig-1] represents an electronic device according to an embodiment of the invention, • [Fig.2] and [Fig.3] represent a screen controlled by the device electronics of [Fig.l] during steps of the process [Fig.4], • [Fig.4] represents an implementation of the method according to the invention, according to a example of realization, by the electronic device of [Fig.l].

[0040] Detailed description of an exemplary embodiment of the invention, with reference to Figures 1 to 4.

[0041] [Fig.l] represents, in a motor vehicle (not shown), a microprocessor 110 connected to a screen 130 and a camera 120.

[0042] The screen 130 is for example on a dashboard (not shown) of the motor vehicle located in the passenger compartment.

[0043] The microprocessor 110 comprises for example a module 111 and a (computer) program 113. The module 111 is for example a software module capable of analyzing a look of a person in the passenger compartment from images of the passenger compartment coming from the camera 120.

[0044] With reference to [Fig.4], in step S00, the screen 130 displays the elements represented [Fig.2],

[0045] At step S10, as shown [Fig.l], the module 111 detects: • A look rl, from the person pel present in the passenger compartment, from location 11 towards the graphic button 131. • A look r2, from the person pe2 present in the passenger compartment, from location 12 towards window 132 displaying a road map.

[0046] During step S20, the program 113 determines a new shape for the graphic button 131 and for the window 132.

[0047] To do this, program 113 first determines: - The image prl by an orthogonal projection of the location 11 on the line dl, horizontal when the motor vehicle is traveling on a horizontal road, and cutting the graphic button 131 into two equal parts. - The image pr2 by an orthogonal projection of the location 12 on the line d2, horizontal when the motor vehicle is traveling on a horizontal road, and cutting the window 132 into two equal parts.

[0048] Then, still during step S20, the program 113 determines that: - Image pr2 is on the cl_132 side of window 132, and - The prl image is in the graphic button 131.

[0049] Consequently, the program 113 reads in memory 112 an identifier of an appearance of the window 132 (among several in memory 112, for example) and an identifier of an appearance of the graphic button 131 (among several in memory 112, for example).

[0050] The identifier of the appearance of the window 132 indicates that, relative to a rectangular shape, [Fig.2], the window 132 is contracted on the cl_132 side and dilated on the c2_132 side, with a rectilinear slope of 25%, as illustrated [Fig.l].

[0051] Thus, the appearance of the window 132 becomes that of a perspective view from the second location.

[0052] The identifier of an appearance of the graphic button 131 indicates that, relative to its surface, [Fig.2], the graphic button 131 is uniformly dilated by 21% in surface area.

[0053] An intersection between the graphic button 131 (in other words: the shape of the graphic button) [Fig.2] and graphic button 131 (in other words: the shape of the graphic button) [Fig.l] has an area equal to 20% of the area of ​​graphic button 131 (in other words: the shape of the graphic button) [Fig.2].

[0054] In step S30, the program 113 thus controls the display by the screen 130, as represented [Fig.2], of the window 132 in the appearance determined by the identifier of the appearance of the window 132 and a graphic button 131 in the appearance determined by the appearance of the graphic button 131.

[0055] In step S40, while the gaze rl in the direction of the graphic button 131 is still detected, the program 113 receives a message from the button bl. The program 113 can thus detect that the person pel has pressed the button bl.

[0056] In step S50, the program 113 then controls the activation of the hazard lights of the motor vehicle.

[0057] At step S60, while the gaze r2 towards the window 132 is still detected, the program 113 receives a message from the button b2. The program 113 can thus detect that the person pe2 has pressed the button b2.

[0058] In step S70, the program 113 controls the display of a window for displaying a menu for entering a destination for route guidance.

[0059] According to a variant, in step S10, as shown [Fig.3] (with the exception of the microprocessor 110 and the camera 120 which are not shown again), the module 111 detects a look r2', of the person pe2' present in the passenger compartment, from the location 12' towards the window 132' displaying a road map.

[0060] According to this variant, during step S20, the program 113 determines a new shape for the window 132'. For this, the program 113 first determines the image pr2' by an orthogonal projection of the location 12' onto said straight line d2', horizontal when the motor vehicle is traveling on a horizontal road, and cutting the 132' window into two equal parts.

[0061] Then, still during step S20, the program 113 determines that the image pr2' is on the side c2_132' of the window 132'.

[0062] Consequently, the program 113 reads in memory 112 an identifier of an appearance of the window 132' (among several in memory 112, for example).

[0063] The identifier of the appearance of the window 132' indicates that, relative to a rectangular shape, [Fig.2], the window 132' is contracted on the side c2_132' and dilated on the side opposite c2_132', with a rectilinear slope of 25%, as illustrated [Fig.3].

[0064] According to this variant, in step S30, the program 113 then commands the display by the screen 130, as represented [Fig.2], of the window 132' in the appearance determined by the identifier of the appearance of the window 132'.

Claims

1.

2. Claims Control method, implemented in a motor vehicle, comprising a gaze analysis module (111), and a display screen (130) in a passenger compartment of the motor vehicle, the method being characterized in that it comprises the following first steps: - First detection (S 10), by the analysis module of look (111), of a first look (r2), the first look (r2) being a look of a first person (pe2) present in the passenger compartment, from a first location (12) in the passenger compartment, towards a first graphic element (132) displayed by the display screen (130) in a first initial appearance, the step of first detection of the first look (r2) comprising a step of determining a characteristic of the first look (r2), - On the first detection (S 10) of the first look (r2): • Determination (S20) of a first activation appearance of the first graphic element (132), different from the first initial appearance, from the characteristic of the first look (r2), then • Control of a display (S30), on the display screen (130), of the first graphic element (132) in the first activation appearance. Control method according to the preceding claim in which the characteristic of the first glance (r2) is the first location (12), and the first activation appearance, when an image (pr2), by a projection, is on a first side (cl_132) of the first graphic element (132), is different from the first activation appearance, when an image (pr2'), by the projection, is on a second side (c2_132') of the first graphic element (132), opposite the first side (cl_132) of the first graphic element (132), the projection being an orthogonal projection of the first location (12) on a horizontal line (d2), when the motor vehicle is traveling on a horizontal road, the horizontal line (d2) cutting the first graphic element (132) into two equal parts.

3. A control method according to claim 1 or 2 wherein the first initial appearance comprises a first geometric shape of the first graphical element (132) and the first activation appearance comprises a second geometric shape of the first graphical element (132) different from the first geometric shape of the first graphical element (132).

4. Control method according to the preceding claim, taken as a dependency of claim 2, in which the second geometric shape of the first graphic element is, relative to the first geometric shape of the first graphic element (132), when the projection (pr2) is on the first side (cl_132) of the first graphic element (132): - Contracted on the first side (c 1_ 132) of the first graphic element (132), and / or - Dilated on the second side (c2_132) of the first graphic element (132).

5. The control method of claim 3 wherein the second shape of the first graphical element (132) is a uniform expansion of the first shape of the first graphical element (132).

6. A control method according to any one of claims 3 to 5 wherein the second shape of the first graphical element (132) has an area of ​​at most 25 percent greater than an area of ​​the first shape of the first graphical element (132).

7. The control method of claim 3 wherein an intersection between the first shape of the first graphical element (132) and the second shape of the first graphical element (132) has an area less than 25 percent of an area of ​​the first shape of the first graphical element (132).

8. Computer program comprising instructions, executable by a microprocessor or a microcontroller, for implementing the method according to any one of claims 1 to 7, when executed by the microprocessor or the microcontroller.

9. Electronic device (110) configured to implement the steps of the method according to any one of claims 1 to 7.

10. Motor vehicle (100) comprising the electronic device (110) according to the preceding claim.

Images