Electronic device and method for displaying data on a display screen, display system, vehicle and associated computer program
The electronic device enhances icon selection on display screens by detecting finger movement and progressively enlarging the relevant area, addressing suboptimal interaction and reducing cognitive load and accident risks, particularly for vehicle drivers.
Patent Information
- Application Number
- FR2021007196
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-07-02
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2041-07-02
AI Technical Summary
Existing display devices, such as those with capacitive touch screens, often require suboptimal user interaction for selecting icons, leading to cognitive load and increased risk of accidents, especially when used by vehicle drivers.
An electronic device connected to a display screen and an image sensor that captures multiple images to detect finger movement, calculates the direction of movement, and controls the enlargement of the corresponding screen area with increasing intensity as the finger approaches, facilitating icon selection.
Early detection and progressive enlargement of the screen area based on finger movement reduces cognitive load and minimizes the risk of accidental selections, thereby lowering the risk of vehicle accidents.
Smart Images

Figure 00000019_0000 
Figure 00000020_0000 
Figure 00000021_0000
Abstract
Description
Title of the invention: Electronic device and method for displaying data on a display screen, associated display system, vehicle and computer program
[0001] The present invention relates to an electronic device for displaying data on a display screen, the device being capable of being connected to the display screen and to an image sensor, the image sensor being adapted to take at least two images of a user of the display screen. The device comprises a display module configured to display the data, in particular icons, on the display screen.
[0002] The invention also relates to an electronic data display system, the system comprising a display screen, an image sensor adapted to take at least two images of a user of the display screen, and such an electronic device for displaying data on the display screen.
[0003] The invention also relates to a vehicle, in particular a motor vehicle, comprising such an electronic data display system.
[0004] The invention also relates to a method of displaying data on a display screen, the method being implemented by such an electronic display device; as well as a computer program comprising software instructions which, when executed by a computer, implement such a display method.
[0005] The invention relates to the field of human-machine interfaces, also called HMI or MMI (from the English Man Machine Interface), and in particular electronic systems for displaying data intended for the user.
[0006] The invention also relates to the field of vehicles, in particular automobiles, the electronic display system which is the subject of the invention being more particularly configured to be installed on board a vehicle, such as a motor vehicle, and the user then typically being the driver of the vehicle.
[0007] Document EP 2 474 885 A1 discloses an information display device including a screen with a capacitive touch screen function, in which a sensor measures a variation in capacitance of the screen, then provides the measured variation in capacitance and position information of the variation in capacitance, to a controller which then determines whether a finger is in proximity to the screen or not on the basis of the variation in capacitance provided by the sensor. If it is determined that the finger is in proximity to the screen, the coordinates on the screen corresponding to the position of the finger are determined on the basis of the position information provided by the measuring sensor, and an area displayed on the screen, centered on these determined coordinates, is then enlarged, so as to facilitate the selection of the object located under the finger, this enlargement being maintained as long as the finger is detected as being close to the screen.
[0008] Document US 9,772,757 B2 also describes a display device with a touch screen, in which an area displayed on the screen is enlarged when the presence of a user's finger near the screen is detected. This document also teaches modifying the enlarged area when the user's finger moves parallel to the touch screen.
[0009] However, with such display devices, the interaction between the user and the display device is not always optimal, and a tactile selection of an icon displayed on the screen sometimes remains delicate, thus causing a cognitive load for the user.
[0010] The aim of the invention is then to propose an electronic device, and an associated method, for displaying data on a display screen, making it possible to facilitate the selection of an icon displayed on the screen, and thus to reduce the cognitive load for the user, which makes it possible to reduce the risks of a vehicle accident when the electronic display device is on board this vehicle and the user is then typically the driver of said vehicle.
[0011] To this end, the invention relates to an electronic device for displaying data on a display screen, the device being capable of being connected to the display screen and to an image sensor, the image sensor being adapted to take at least two images of a user of the display screen, the device comprising:
[0012] - a display module configured to display data, including icons, on the display screen;
[0013] - a detection module configured to detect, via the at least two images taken, a movement towards said screen of at least one finger of the user, then to calculate a direction of the movement;
[0014] - a determination module configured to determine, from a page displayed on the screen and depending on the direction of movement, an area of the screen corresponding to said direction; and
[0015] - a control module configured to control an enlargement of said area when said at least one finger approaches the screen.
[0016] With the electronic display device according to the invention, the detection module makes it possible, via the at least two images taken by the image sensor, to detect when the user approaches at least one of his fingers to the display screen, and in particular to detect the movement of the at least one finger in the direction of the screen, then to calculate the direction of said movement. The determination module makes it possible then to determine an area displayed on the screen from the direction of movement calculated via the at least two images taken; and the control module then makes it possible to modify the appearance of said area, in particular to enlarge said area, when said at least one finger approaches the screen, in order to facilitate the subsequent selection by the user of an element included in this area, such as an icon.
[0017] Those skilled in the art will understand in particular that this detection of the movement of at least one finger towards the screen, carried out from the at least two images taken by the image sensor, allows for early detection, compared to detection carried out via a capacitive sensor with the display device of the state of the art.
[0018] Preferably, the movement detection is carried out as soon as a distance between the at least one finger of the user and the display screen is less than a predefined detection threshold, this detection threshold being for example less than 10 cm, and preferably less than 5 cm.
[0019] More preferably, the enlargement of the area pointed at by the at least one finger of the user, that is to say in the direction of the movement of the at least one finger, is carried out with increasing intensity as the distance between the at least one detected finger and the display screen decreases, which then makes it possible to indicate to the user the area towards which his finger is pointing, and this in an increasingly distinct manner as his finger approaches the screen. If this area does not correspond to what he wishes to select, the user can then easily shift his finger laterally, so that his finger points towards another area, which will then cause an enlargement of this other area, corresponding to the new direction of the movement of the at least one finger.The enlargement of said zone is then progressive with an increasing amplification of said enlargement of the zone when said at least one finger approaches more and more the screen, that is to say when the distance between the at least one detected finger and the display screen decreases.
[0020] According to other advantageous aspects of the invention, the electronic display device comprises one or more of the following characteristics, taken individually or in all technically possible combinations:
[0021] - the detection module is configured to detect a distance between said at least a finger and said screen, and the control module is configured to control the enlargement of said area when said distance is less than a predefined threshold;
[0022] - the movement is a substantially rectilinear movement;
[0023] - the control module is configured to control the enlargement of said area with increasing intensity as said at least one finger approaches the screen more and more;
[0024] - the control module is configured to further control a setting in brightness and / or a colorimetric modification of said area; and
[0025] - the display screen is a touch screen, and the device further comprises a module acquisition configured to acquire a touch selection, from the user, of an icon displayed in said area;
[0026] the acquisition module preferably being further configured to generate, for the user, a signal confirming acquisition of the selection;
[0027] the acquisition confirmation signal being preferably still chosen from the group consisting of: a vibratory signal, a visual signal and an audible signal.
[0028] The invention also relates to an electronic data display system, the system comprising a display screen, an image sensor adapted to take at least two images of a user of the display screen, and an electronic device for displaying data on the display screen, the electronic display device being as defined above, the electronic display device being connected to the display screen and to the image sensor.
[0029] According to other advantageous aspects of the invention, the electronic display system comprises one or more of the following characteristics, taken individually or in all technically possible combinations:
[0030] - the system is configured to be on board a vehicle; the vehicle being preferably a motor vehicle; and
[0031] - the user is a driver of the vehicle.
[0032] The invention also relates to a vehicle, in particular a motor vehicle, comprising an electronic data display system, the electronic display system being as defined above.
[0033] The invention also relates to a method for displaying data on a display screen, the method being implemented by an electronic display device capable of being connected to the display screen and to an image sensor, the image sensor being adapted to take at least two images of a user of the display screen, the method comprising:
[0034] - displaying data, including icons, on the display screen;
[0035] - detect, via the at least two images taken, a movement towards said screen of at least minus one finger of the user, then calculate a direction of movement;
[0036] - determine, from a page displayed on the screen and depending on the direction of the movement, an area of the screen corresponding to said direction; and
[0037] - ordering an enlargement of said zone when said at least one finger approaches the screen.
[0038] The invention also relates to a computer program comprising software instructions which, when executed by a computer, implement implements a display method as defined above.
[0039] These characteristics and advantages of the invention will appear more clearly on reading the description which follows, given solely by way of non-limiting example, and made with reference to the appended drawings, in which:
[0040] [Fig-1] [Fig.l] is a schematic representation of a vehicle, in particular at car, comprising an electronic data display system according to the invention, the display system comprising a display screen, an image sensor of a user of the display screen, and an electronic device for displaying data on the display screen, said device being connected to the screen and to the image sensor;
[0041] [Fig.2] [Fig.2] represents a schematic perspective view of the interior of the passenger compartment of the vehicle of [Fig.l], with the display screen facing a user, such as the driver of the vehicle, and the image sensor adapted to take at least two images of the user, in particular when he extends one of his hands towards the screen;
[0042] [Fig.3] [Fig.3] is a schematic representation of four situations interaction between the electronic display system of [Fig.l] and a finger of the user; and
[0043] [Fig.4] [Fig.4] is a flowchart of a method, according to the invention, for displaying of data on the display screen, the method being implemented by the electronic display device of [Fig.l].
[0044] In the remainder of the description, the expression “substantially equal to” defines a relationship of equality to plus or minus 10%, more preferably to plus or minus 5%.
[0045] In Figures 1 and 2, a vehicle 10 comprises a passenger compartment 12, and inside the passenger compartment 12, a seat 14 for a user 16, such as a driver, as well as a steering wheel 18 for driving the vehicle, as known per se.
[0046] According to the invention, the vehicle 10 further comprises an electronic system 20 for displaying data intended for the user 16, the display system 20 being adapted to be carried on board the vehicle 10.
[0047] Those skilled in the art will understand that the vehicle 10 is understood in the broad sense as a vehicle allowing a driver, also called a pilot, as well as in addition one or more passengers, to move. The vehicle 10 is then typically chosen from the group consisting of: a motor vehicle, such as a car, a bus or a truck; a railway vehicle, such as a train or a tram; a naval vehicle, such as a boat; and an aeronautical vehicle, such as an aircraft.
[0048] The electronic display system 20 comprises a display screen 22, an image sensor 24 adapted to take at least two images of the user 16, and an electronic device 30 for displaying data on the display screen 22, the display device 30 being connected to the screen 22 and to the image sensor 24.
[0049] The display screen 22 is adapted to display data intended for the user 16, in particular icons 32, visible in FIGS. 2 and 3. The display screen 22 is typically a touch screen, and is then configured to detect a touch pressure against the screen from the user 16, and typically a pressure of at least one finger 34 of the user against a portion of the surface of the screen 22, such as a surface portion where a respective icon 32 is displayed. The touch screen is for example a capacitive touch screen or a resistive touch screen, as known per se.
[0050] The image sensor 24 is known per se, and is configured to acquire at least two images of the user 16, in particular of one of his hands 36, and typically of at least one of his fingers 34, in particular when the user 16 extends his hand 36 in the direction of the display screen 22.
[0051] The image sensor 24 is for example positioned facing the screen 22, in order to be able to take at least two images of the hand 36 when it is close to the screen 22, and in order to be able to determine, via the at least two images taken, what is the direction of the approach movement of the hand 36, and in particular of the at least one finger 34, towards the screen 22.
[0052] The image sensor 24 is typically positioned substantially parallel to the screen 22, a line of sight of the image sensor 24 then being substantially perpendicular to the surface of the screen 22, the line of sight itself being substantially perpendicular relative to an active surface, not shown, of the image sensor 24.
[0053] The electronic display device 30, visible in [Fig. 1], is configured to display data on the display screen 22 for the user 16. The electronic display device 30 comprises a module 40 for displaying data, in particular icons 32, on the display screen 22.
[0054] According to the invention, the electronic display device 30 further comprises a module 42 for detecting, via the at least two images taken by the image sensor 24, a movement towards the screen 22 of the at least one finger 34 of the user, the detection module 42 then being configured to calculate a direction M of the detected movement; a module 44 for determining a zone 48, from among a page 46 displayed on the screen 22 and as a function of the direction M of the movement, the zone 48 typically including at least one icon 32; and a module 50 for controlling a modification of the appearance of the determined zone 48.
[0055] As an optional addition, the electronic display device 30 further comprises a module 52 for acquiring a tactile selection, from the user 16, of an icon 32 displayed on the screen 22.
[0056] In the example of [Fig.l], the electronic display device 30 comprises an information processing unit 60 formed for example of a memory 62 and a processor 64 associated with memory 62.
[0057] In the example of [Fig.l], the display module 40, the detection module 42, the determination module 44 and the control module 50, as well as optionally the acquisition module 52, are each produced in the form of software, or a software brick, executable by the processor 64. The memory 62 of the display device 30 is then capable of storing software for displaying data on the display screen 22; software for detecting, via the at least two images taken by the sensor 24, the movement towards the screen 22 of the at least one respective finger 34 of the user, then calculating the direction M of said movement; software for determining, from the page 46 displayed on the screen 22 and as a function of the direction M of said movement, a respective zone 48; and software for controlling a modification of the appearance of the determined zone 48.As an optional addition, the memory 62 of the display device 30 is capable of storing software for acquiring a touch selection, by the user 16, of a respective icon 32 displayed on the display screen 22. The processor 64 is then capable of executing each of the software among the display software, the detection software, the determination software and the control software, as well as, as an optional addition, the acquisition software.
[0058] In a variant not shown, the display module 40, the detection module 42, the determination module 44 and the control module 50, as well as the optional addition the acquisition module 52, are each produced in the form of a programmable logic component, such as an FPGA (Field Programmable Gate Array), or an integrated circuit, such as an ASIC (Application Specific Integrated Circuit).
[0059] When the display device 30 is produced in the form of one or more software programs, that is to say in the form of a computer program, also called a computer program product, it is furthermore capable of being recorded on a medium, not shown, that is readable by a computer. The computer-readable medium is, for example, a medium capable of storing electronic instructions and of being coupled to a bus of a computer system. By way of example, the readable medium is an optical disk, a magneto-optical disk, a ROM memory, a RAM memory, any type of non-volatile memory (for example EPROM, EEPROM, FLASH, NVRAM), a magnetic card or an optical card. A computer program comprising software instructions is then stored on the readable medium.
[0060] Those skilled in the art will understand that by icon, designated by the general reference 32, is meant any graphic object intended to be displayed on the display screen 22, and in particular any graphic object capable of being selected in a tactile manner by the user 16. In the examples of figures 2 and 3, the icons 32 are - schematically and for the sake of simplification of the drawing - represented with a rectangular shape. tangular, and those skilled in the art will of course understand that each icon 32 has any geometric shape, not necessarily rectangular.
[0061] The display module 40 is configured to display the data, in particular the icons 32, on the display screen 22. The display module 40 is known per se, and is capable of generating the graphic information corresponding to the data to be displayed, then transmitting it to the display screen 22 for display on said screen.
[0062] The detection module 42 is configured to detect, via the at least two images of the user 16, and in particular of his hand 34, taken by the image sensor 24, a movement towards the screen 22 of the hand 36 of the user 16, and in particular of at least one of his fingers 34. The detection module 42 is then configured to calculate the direction M of the movement of the hand 36, and in particular of the at least one finger 34, towards the display screen 22.
[0063] As an optional addition, the detection module 42 is configured to detect the movement of the at least one finger 34 of the user 16 towards the screen 22 only if a distance between the finger 34 and the screen 22 is less than a predefined detection threshold. The detection threshold is for example less than or equal to ten centimeters, or even less than or equal to five centimeters, the detection threshold typically being equal to an integer number of centimeters less than or equal to the aforementioned values.
[0064] The detection module 42 is for example configured to calculate the distance between at least one finger 34 and a reference point as a function of a number of pixels between the at least one finger 34 and the reference point in a corresponding image, a predefined distance for two known points being associated, or even correlated, with a predefined number of pixels, this as a reference or even as a correspondence relationship.
[0065] As an optional addition, at least three reference points are taken into account for the calculation of said distance to perform the analysis, according to the respective numbers of pixels for the same object, such as the same finger 34, relative to the different reference points, a 3-dimensional coordination system is created. According to this optional addition, the detection module 42 is then configured to determine, via said 3-dimensional coordination system, the direction of movement of the object, in particular of the at least one finger 34, relative to the reference mark, typically associated with the screen 22. According to this optional addition, the detection module 42 is also configured to determine, via said 3-dimensional coordination system, the distance of the object, in particular of the at least one finger 34, relative to the reference mark, typically associated with the screen 22.
[0066] The determination module 44 is configured to determine a respective zone 48 from the page 46 displayed on the display screen 22, the zone 48 typically including at least one icon 32, this depending on the direction M of the movement, previously calculated by the detection module 42.
[0067] The movement is for example a substantially rectilinear movement. Those skilled in the art will observe in particular that the movement is distinct from conventional hand or multi-finger gestures, such as a pinch-to-zoom gesture, a swipe gesture, etc.
[0068] The control module 50 is then configured to command a modification of an appearance of the zone 48 when said at least one finger 34 approaches the screen 22.
[0069] The modification of appearance of the area 48 is typically an enlargement of said area 48.
[0070] As an optional addition, the modification of the appearance of the zone 48 further comprises highlighting and / or a colorimetric modification of said zone 48.
[0071] The appearance modification of the area 48 is then typically chosen from the group consisting of: an enlargement of the area 48, a highlighting of the area 48, and a colorimetric modification of the area 48.
[0072] In the example of [Fig.3], the control module 50 is configured to ordering a modification of the size, and preferably an enlargement, of the area 48, and typically of the at least one icon 32 included in the area 48. The enlargement of the area 48 is preferably a homothety relative to a center of the area 48. In other words, the size of the area 48 is then increased in all directions. Alternatively, only one dimension of the area 48 in a single direction is increased.
[0073] In addition, the enlargement of each icon 32 is preferably a homothety relative to a center of said icon 32. In other words, the size of the icon 32 is then increased in all directions. Alternatively, only one dimension of the icon 32 in a single direction is increased.
[0074] As an optional addition, the control module 50 is configured to control said modification of appearance with an increasing intensity when a distance between the detected finger 34 and the display screen 22 decreases. In other words, according to this optional addition, the control module 50 is configured to control the modification of appearance with an intensity that increases as the distance between the finger 34 and the screen 22 decreases.
[0075] According to this optional addition, the person skilled in the art will understand that when the appearance modification is an enlargement, the intensity corresponds to an enlargement ratio, that is to say a ratio between the dimensions of the icon 32 after enlargement and those before enlargement. When the appearance modification is a highlighting, the intensity corresponds to a highlighting level, or even to a light intensity. When the appearance modification is a colorimetric modification, the intensity corresponds for example to a colorimetric tone, an intensity higher being typically associated with bright colors, and lower intensity with pastel colors.
[0076] As an optional addition, the control module 50 is configured to control the appearance modification with a greater intensity for an icon 32 located near the center of the determined zone 48, than for an icon far from said center, and then located closer to a peripheral edge of said determined zone 48.
[0077] According to this optional addition, the control module 50 is then configured to control the modification of appearance with a greater intensity for an icon 32 located directly opposite the at least one finger 34 detected, that is to say in a pointing direction P of said finger 34, than for icons 32 located on either side of said icon 32 targeted by the finger 34. The icons 32 located on either side of said icon 32 targeted by the finger 34, while being included within the determined zone 48, also have a modified appearance compared to the icons 32 located outside said zone 48.
[0078] As an optional addition, the control module 50 is configured to control said appearance modification temporarily, for example for a predefined duration. The predefined duration is for example between one tenth of a second and one second.
[0079] Alternatively, the control module 50 is configured to control said appearance modification as long as a distance between the detected finger 34 and the display screen 22 is less than a predefined holding threshold. The holding threshold is for example less than or equal to ten centimeters, or even less than or equal to five centimeters, the holding threshold typically being equal to an integer number of centimeters less than or equal to the aforementioned values.
[0080] As an optional addition, the acquisition module 52 is configured to acquire a tactile selection of a respective icon 32 displayed on the screen 22, in particular of an icon 32 whose appearance is modified via the control module 50, the tactile selection, typically via a tactile press against the screen 22, having been carried out by the user 16, in particular following said modification of appearance.
[0081] As an optional addition, the acquisition module 52 is configured to, following the acquisition of said tactile selection, generate an acquisition confirmation signal for the user 16. The acquisition confirmation signal is for example a vibratory signal, such as a haptic signal or a mechanical vibration; a visual signal; or even an audible signal. The confirmation signal then makes it possible to inform the user 16 that his or her tactile selection has been acquired, and therefore taken into account by the electronic display device 30.
[0082] The operation of the electronic display system 20, and in particular of the electronic display device 30, according to the invention will now be described with reference to [Fig.4] representing a flowchart of the method, according to the invention, of displaying data on the display screen 22 for the user 16.
[0083] During an initial and recurring step 100, the display device 30 displays, via its display module 40, the data, and in particular the icons 32, on the display screen 22. As known per se, during this display step 100, the display module 40 generates graphic information corresponding to said data, and transmits them to the display screen 22, with a view to their display.
[0084] When the user 16 makes an approach movement towards the screen 22, in particular with one of his hands 36, and in particular with one of his fingers 34, the display device 30 then detects, during the following step 110 and via its detection module 42, this movement of the user 16 towards the display screen 22, this detection being carried out from the at least two images acquired by the image sensor 24.
[0085] As an optional addition, the detection module 42 detects the movement of the at least one finger 34 of the user 16 towards the screen 22 only if the distance between the finger 34 and the screen 22 is less than the predefined detection threshold.
[0086] During this step 110, the detection module 42 then calculates the direction M of this movement, also from the at least two images taken by the hnage sensor(s) 24.
[0087] The detection module 42 calculates for example the distance between at least one finger 34 and a respective reference point, as a function of a number of pixels between the at least one finger 34 and the reference point in a corresponding image.
[0088] As an optional addition, at least three reference points are taken into account for the calculation of said distance to perform the analysis, according to the respective numbers of pixels for the same object, such as the same finger 34, relative to the different reference points, a 3-dimensional coordination system is created. According to this optional addition, the detection module 42 then determines, via said 3-dimensional coordination system, the direction of movement of the object, in particular of the at least one finger 34, and the distance of the object, in particular of the at least one finger 34, relative to the reference point, typically associated with the screen 22.
[0089] After calculating the direction M, the display device 30 moves on to the next step 120, during which it determines, via its determination module 44, the zone 48 as a function of the direction M of the movement of the at least one finger 34 towards the screen 22, said zone 48 typically including at least one icon 32. The determined zone 48 is for example a zone centered on the intersection between the direction M of the movement and the surface of the display screen 22.
[0090] At the end of the determination step 120, the display device 30 commands, via its control module 50, a modification of appearance of the zone 48 determined during the previous determination step 120. The modification of appearance is typically an enlargement of the zone 48, and optionally a highlighting and / or a colorimetric modification of the zone 48.
[0091] During this control step 130, the appearance modification is preferably controlled with increasing intensity when the distance between the display screen 22 and the user's hand 36, in particular his finger 34, decreases.
[0092] More preferably, this modification of appearance is carried out with a greater intensity for the icon 32 which is closest to the center of the zone 48, determined during the previous determination step 120.
[0093] During this control step 130, the controlled appearance modification is for example temporary, this appearance modification being typically controlled as long as the distance between the display screen 22 and the detected finger 34, in particular the end of this finger 34 which is closest to the display screen 22, is less than the predefined holding threshold, described previously. Alternatively, this appearance modification is temporary by being controlled for the predefined duration, described previously.
[0094] At the end of the control step 130, if the user 16 has made a tactile selection of a respective icon 32 displayed on the display screen 22, in particular of an icon 32 whose appearance is modified following the control step 130, then the display device 30 goes to the next step 140 during which it acquires, via its acquisition module 52, said tactile selection.
[0095] In addition, during this acquisition step 140, the acquisition module 52 also generates an acquisition confirmation signal for the user 16, in order to inform him that his tactile selection of the icon 32 has been taken into account by the display device 30. This acquisition confirmation signal is for example a vibratory signal, such as a haptic signal or a mechanical vibration; a visual signal; or even an audible signal.
[0096] At the end of the acquisition step 40, the display device 30 returns to the display step 100.
[0097] Furthermore, if at the end of the control step 130, no touch selection is made by the user 16, then the display device 30 returns directly to the display step 100.
[0098] In the example of [Fig. 3], schematically representing four situations of interaction between the display system 20 and a finger 34 of the user 16, namely a first situation S1, a second situation S2, a third situation S3 and a fourth situation S4, the first situation S1 corresponds to the case where the hand 36 of the user 16 is too far from the display screen 22, so that no approach movement towards the screen 22 is not detected by the detection module 42 during the detection step 110.
[0099] In the second situation S2, the user 16 approaches his hand 36 to the display screen 22 in the direction M. In [Fig. 3], the final position of the hand 36 is represented by a solid line, and the initial position of this hand 36 is represented by a dotted line. In this second situation S2, the detection module 42 detects this approach movement of the hand 36, then calculates the direction M of this movement. The determination module 44 then determines that the zone 48, calculated as a function of the direction M and corresponding to this approach movement, is that comprising the two icons 32 at the bottom left of the page 46. Then, the control module 50 commands a modification of the appearance of the two icons 32 included in the determined zone 48, the modification of appearance illustrated in [Fig. 3] for the second situation S2 being an enlargement of said icons 32.Furthermore, the appearance modification is carried out with greater intensity for the icon 32 located near the lower left corner of page 46 than for the other icon included in the area 48, this icon 32 at the bottom left being the one which is closest to the center of the area 48, in particular to a point of intersection between the direction M of the movement and the surface of the display screen 22.
[0100] In the third situation S3, the user 16 then makes a lateral movement with his hand 36 in the direction M which is then substantially parallel to the display screen 22. In this third situation S3, the detection module 42 detects that the hand 36 is still close to the screen 22, then calculates the direction M of the movement made by the hand 36, in particular by the finger 34. The determination module 44 then determines a new zone 48 as a function of the direction M of the movement. In the example of [Fig. 3], the determination module 44 determines that, in the third situation S3, the direction M of the movement is substantially parallel to the screen 22 and is lateral, so that the new zone 48 determined is offset laterally, here to the right, relative to the zone 48 determined in the second situation S2.The control module 50 then commands a modification of appearance of the three icons 32 included in the zone 48 determined in this third situation S3. This modification of appearance is preferably also carried out with a greater intensity for the icon 32 located in the center of the determined zone 48. In this third situation S3, the modification of appearance is also an enlargement of the three icons 32 inside the determined zone 48, and the enlargement is then greater for the icon 32 located in the center of this zone 48.
[0101] The fourth situation S4 corresponds to the case where the user, after having shifted his hand 36 laterally to the left, brings it closer to the screen 22, according to the direction M, to perform at the end of the movement a tactile selection of the icon 32 having the most significant change in appearance. In this fourth situation S4, the detection module 42 then detects this additional movement of approach of the hand 36, and in particular of the at least one finger 34, towards the screen 22; then calculates the direction M of said movement. The determination module 44 then determines, as a function of the direction M of the detected movement, the zone 48 including at least one icon 32, and in particular three icons 32 in the example of this [Fig. 3]. The control module 50 then controls the modification of appearance of the icon(s) 32 included in the determined zone 48. The modification of appearance is preferably also all the more intense as the distance between the screen 22 and the hand 36, and in particular the finger 34, decreases. In the example of [Fig.3], and in the fourth situation S4, the dimensions of the icon(s) 32 included in the zone 48 then increase as the user 16 approaches his hand 36, and in particular his finger 34, to the display screen 22.
[0102] In this fourth situation S4, the user 16 also makes a tactile press at the end of his movement on the icon 32 in the center of the zone 48, and the acquisition module 52 then acquires the tactile selection of this icon 32, made by the user 16. The icon 32 selected by the user 16 is then typically the one whose appearance is modified, this modification of appearance making it possible to highlight this icon 32, and to facilitate its selection by the user 16, which then makes it possible to reduce the cognitive load for the user 16.
[0103] Thus, the display system 20 according to the invention, and in particular the display device 30, makes it possible to help the user 16 to identify, then to select more easily the icon 32 corresponding to a function, or functionality, that he wishes to control, that is to say to activate or launch.
[0104] This further reduces the safety risk due to distraction of the user 16, particularly when the display system 20 is on board the vehicle 10 and the user 16 is the driver of said vehicle 10.
[0105] With the display device 30 according to the invention, the detection of the movement of the at least one finger 34 towards the screen 22 is carried out from the at least two images taken by the image sensor 24, which allows early detection, compared to that carried out via a capacitive sensor with the display device of the state of the art.
[0106] Preferably, the movement is detected as soon as the distance between the user's finger 34 and the display screen 22 is less than the predefined detection threshold, this detection threshold being of the order of a few centimeters.
[0107] More preferably, the modification of appearance of the zone 48 pointed by the finger 34 of the user 16, that is to say of the zone 48 located in the direction of the movement of the at least one finger 34, is carried out with increasing intensity as the distance between the finger 34 and the screen 22 decreases, which then makes it possible to indicate to the user 16 even better the area 48 towards which his finger 34 is pointing, this indication being increasingly distinct as the finger 34 approaches the screen 22. If this area 48 does not correspond to what the user 16 wishes to select, he can then easily shift his finger 34 laterally, so that it points towards another area 48, which will then cause a change in the appearance of this other area 48, corresponding to the new direction of the movement of the at least one finger 34.
[0108] The display device 30 and the display method according to the invention also make it possible to reduce the risk of an erroneous selection of an icon 32, for example due to a deformation of the roadway on which the vehicle 10 is traveling at the moment when the user 16 selects the icon 32. This reduction in the risk of erroneous selection is particularly effective when the modification of appearance is an enlargement of the icon 32, and this is all the more so since the modification of appearance is of increasing intensity when the distance between the finger 34 and the display screen 22 decreases.
[0109] It is thus understood that the electronic display device 30 and the display method according to the invention make it possible to facilitate the selection of an icon 32 displayed on the screen 22, and thus to reduce the cognitive load for the user 16, which limits the risks of an accident to the vehicle 10 when the electronic display device 30 is on board the vehicle 10 and the user 16 is typically the driver of said vehicle.
Claims
Claims
1. Electronic device (30) for displaying data on a display screen (22), the device (30) being able to be connected to the display screen (22) and to an image sensor (24), the image sensor (24) being adapted to take at least two images of a user (16) of the display screen (22), the device (30) comprising: - a display module (40) configured to display the data, in particular icons (32), on the display screen (22); characterized in that it further comprises: - a detection module (42) configured to detect, via the at least two images taken, a movement towards said screen (22) of at least one finger (34) of the user (16), then to calculate a direction (M) of the movement; - a determination module (44) configured to determine, from a page (46) displayed on the screen (22) and depending on the direction (M) of the movement, an area (48) of the screen corresponding to said direction (M);and - a control module (50) configured to control an enlargement of said area (48) when said at least one finger (34) approaches the screen (22), the control module (50) being configured to control the enlargement of said area (48) with increasing intensity when said at least one finger approaches more and more the screen (22).;
2. Device (30) according to claim 1, wherein the detection module (42) is configured to detect a distance between said at least one finger (34) and said screen (22), and the control module (50) is configured to control the enlargement of said area when said distance is less than a predefined threshold.
3. A device (30) according to any preceding claim, wherein the movement is a substantially rectilinear movement.
4. Device (30) according to any one of the preceding claims, wherein the control module (50) is configured to further control a highlighting and / or a colorimetric modification of said zone (48).
5. A device (30) according to any preceding claim, wherein the display screen (22) is a touch screen, and the device (30) further comprises an acquisition module (52) configured to acquiring a tactile selection, from the user (16), of an icon (32) displayed in said area (48); the acquisition module (52) preferably being further configured to generate, intended for the user (16), a signal confirming acquisition of the selection; the acquisition confirmation signal preferably being further chosen from the group consisting of: a vibratory signal, a visual signal and an audible signal.
6. An electronic system (20) for displaying data, the system (20) comprising a display screen (22), an image sensor (24) adapted to take at least two images of a user (16) of the display screen (22), and an electronic device (30) for displaying data on the display screen (22), characterized in that the electronic display device (30) is according to any one of the preceding claims, and the electronic display device (30) is connected to the display screen (22) and to the image sensor (24).
7. Vehicle (10), in particular a motor vehicle, comprising an electronic data display system (20), characterized in that the electronic display system (20) is according to the preceding claim.
8. A method of displaying data on a display screen (22), the method being implemented by an electronic display device (30) capable of being connected to the display screen (22) and to an image sensor (24), the image sensor (24) being adapted to take at least two images of a user (16) of the display screen (22), the method comprising the following step: - displaying (100) the data, in particular icons (32), on the display screen (22); characterized in that it further comprises the following steps: - detecting (110), via the at least two images taken, a movement towards said screen (22) of at least one finger (34) of the user (16), then calculating (110) a direction (M) of the movement; - determining (120), from a page (46) displayed on the screen (22) and depending on the direction (M) of the movement, an area (48) of the screen corresponding to said direction (M);- controlling (130) an enlargement of said zone (48) when said at least one finger (34) approaches the screen (22);
9. the enlargement of said area (48) being controlled with increasing intensity as said at least one finger approaches the screen (22) more and more. Computer program comprising software instructions which, when executed by a computer, implement a method according to the preceding claim.
