Method and device for controlling a vehicle display system by swipe gesture on the lenses of cameras integrated into a touch screen
Patent Information
- Application Number
- PCT/FR2025/000238
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-02-21
- Filing Date
- 2025-12-08
- Publication Date
- 2026-08-27
Smart Images

Figure FR2025000238_27082026_PF_FP_ABST
Abstract
Description
DESCRIPTION Title: Method and device for controlling a vehicle display system by swiping motion on camera lenses integrated into a touchscreen The present invention claims priority from French application No. 2501824 filed on 21.02.2025, the content of which (text, drawings and claims) is incorporated herein by reference. technical field
[0001] The invention relates to methods and devices for controlling a vehicle display system, particularly, but not exclusively, for a motor vehicle. Specifically, the invention relates to a method and device for controlling the display of graphic content by a user's finger swiping across the lenses of cameras integrated into a touchscreen in the vehicle. Technological background
[0002] Contemporary vehicles, for some of them, carry several screens to display information useful to the driver for driving the vehicle as well as comfort information, such as information to interact with the infotainment system, also called IVI (In-Vehicle Infotainment) system, of the vehicle.
[0003] Among these screens, it is known to include one or more LCD type screens (from the English "Liquid Crystal Display" or in French "Affichage à cristals liquides"), for example of type TFT (from the English "Thin-Film Transistor" or in French "Transistor en film mince"), or OLED (from the English "Organic Light-Emitting Diode" or in French "Diode électroluminescente organique").
[0004] The integration of such screens allows, for example, the control, via a graphical Human-Machine Interface (HMI) displayed on such screens, of the operating status of the systems on board the vehicle, for example ADAS systems (from the English "Advanced Driver-Assistance System" or in French "Système d'aide à la conduite avancé").
[0005] In parallel, many vehicles are now equipped with integrated monitoring systems, notably through strategically positioned cameras in areas such as the dashboard, the rearview mirror, or even in concealed locations near the steering column. These cameras analyze gaze position, head movements, and facial expressions in real time to detect any signs of distraction or fatigue, thus triggering alerts designed to prevent accidents. These systems are also used for occupant identity recognition and verification, enabling automatic adjustment of the cabin's ergonomic parameters, personalization of the touchscreen user interface, and conditional activation of safety systems such as differentiated airbag deployment based on passenger presence and position.
[0006] This convergence between digital imaging, real-time processing of visual data and integration into interactive display systems also paves the way for next-generation human-machine interfaces, capable of interpreting gestures or enabling enhanced voice interaction.
[0007] Thus, the state of the art in the automotive industry illustrates a trend towards ever-greater integration of imaging technologies, with the aim not only of improving safety through driver assistance systems, but also of personalizing and securing the user experience through multimodal and adaptive interfaces.
[0008] Similar to mobile phones, interactive touchscreen displays in vehicles are expected to increasingly integrate cameras. The discreet nature of such integration allows for a cleaner cockpit and maintains visual harmony within the cabin. By integrating the image capture device almost invisibly—for example, within an inset at the edge of the touchscreen interface—it is possible to reduce visual clutter and preserve a minimalist aesthetic.
[0009] While integrating the camera into the touchscreen interface offers advantages in terms of discretion and a clean aesthetic, it has the technical disadvantage of reducing the available surface area for the touchscreen display, as well as the space dedicated to displaying useful and / or critical information. Indeed, placing the lens within the display area reduces the screen's active area, potentially compromising data readability and ease of access to user controls. Summary of the present invention
[0010] One object of the present invention is to solve at least one of the problems of the technological background described above.
[0011] Another object of the present invention is, for example, to improve the user experience with respect to a touch interface of a vehicle display screen.
[0012] Another object of the present invention is to mitigate the disadvantage associated with the reduction of the touch surface and display space.
[0013] An additional object of the present invention is to balance the clean aesthetics of the vehicle's interior design with the need to provide important information to the user.
[0014] Another object of the present invention is to minimize driver distraction and improve vehicle safety.
[0015] According to a first aspect, the present invention relates to a method for controlling a vehicle display system, said display system comprising a touchscreen interface, said touchscreen comprising at least two image acquisition devices, said method being implemented by at least one processor and comprising the following steps: - receipt of initial data representative of at least partial shuttering, by a user, of a lens of a first image acquisition device; - reception of second data representing at least partial shuttering, by said user, of a lens of a second image acquisition device; - control of display, on said touch screen, of a set of graphic content as a function of said first and second data and of a sequential order of reception of said first and second data.
[0016] Displaying a graphic object representing important information related to one of the vehicle's onboard systems through a simple gesture, leveraging the necessary presence of image acquisition devices integrated into the touchscreen interface, has the advantage of enabling dynamic optimization of the display space. Indeed, the control process intelligently utilizes the image acquisition device and mitigates the negative effects associated with reducing the touchscreen area available for displaying information. This adaptive management allows for a harmonious distribution of interactive areas and visual elements, thus ensuring optimal readability and efficient screen use under various operating conditions.
[0017] Another advantage lies in a significant improvement in ergonomics and ease of use. By adopting a control method based on intuitive touch gestures and contextual recognition of interactions, the user benefits from a responsive and easy-to-understand interface. This approach reduces cognitive load by streamlining operations, which is particularly valuable in the demanding environment of driving.
[0018] According to one variant, when said first data are received before said second data, said set of graphic content includes a first graphic content comprising a first graphic object representing an activation state of a function of said vehicle.
[0019] According to another variant, when said first data are received after said second data, said set of graphic content includes a second graphic content comprising a second graphic object representing a deactivation state of a function of said vehicle.
[0020] According to yet another variant, the said sequential order of reception is subsequent to a scanning movement performed by a user.
[0021] According to a further variant, said first and second graphic contents each comprise a plurality of graphic objects each individually representing an activation or deactivation state of a function of said vehicle.
[0022] According to yet another variant, the process further includes the following steps: - reception of third data representing at least partial shuttering of at least one objective of said at least two image acquisition devices after the reception of said first and second data; - control of stopping the display of said graphic objects.
[0023] According to an additional variant, said touch screen includes a non-touch insert (or inclusion) comprising said at least two image acquisition devices, located at the edge of said touch screen.
[0024] According to a second aspect, the present invention relates to a control device for a vehicle display system, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the first aspect of the present invention.
[0025] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention or a system as described above according to the third aspect of the present invention.
[0026] According to a fourth aspect, the present invention also relates to a computer program which includes instructions adapted for carrying out the steps of the process according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.
[0027] Such a computer program can use any programming language, and be in the form of source code, object code, or an intermediate form between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0028] The present invention further relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the present invention.
[0029] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard drive.
[0030] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from a network such as the Internet.
[0031] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures
[0032] Other features and advantages of the present invention will become apparent from the description of the specific and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 7, in which:
[0033] [Fig. 1] schematically illustrates part of a vehicle's passenger compartment, according to a particular embodiment of the present invention;
[0034] [Fig. 2] schematically illustrates a method of controlling the display, on a display device of the vehicle of figure 1, of a set of graphic contents representing an activation state of a function of the vehicle, at different time moments, according to a particular and non-limiting embodiment of the present invention;
[0035] [Fig. 3] schematically illustrates a method of controlling the display, on a display device of the vehicle of figure 1, of a set of graphic contents representing a deactivation state of a vehicle function, at different time moments, according to a particular and non-limiting embodiment of the present invention;
[0036] [Fig. 4] schematically illustrates a display control method implementing three image acquisition devices, according to a particular and non-limiting embodiment of the present invention;
[0037] [Fig. 5] schematically illustrates the step of a display control method allowing the display of a graphic object to be stopped at different times, according to a particular and non-limiting embodiment of the present invention;
[0038] [Fig. 6] illustrates a device configured to control a vehicle display system of Figure 1, according to a particular and non-limiting embodiment of the present invention.
[0039] [Fig. 7] illustrates a flowchart of the different steps of a process for controlling a display system of the vehicle of figure 1, according to a particular and non-limiting embodiment of the present invention. Description of examples of achievements
[0040] A method and device for controlling a vehicle display system will now be described in what follows with joint reference to Figures 1 to 7. The same elements are identified with the same reference symbols throughout the description that follows.
[0041] The terms "first(s)", "second(s)" (or "first(s)", The terms "second(s)" and "etc." are used in this document by arbitrary convention to allow for the identification and distinction of different elements (such as operations, means, etc.) implemented in the embodiments described below. Such elements may be distinct or correspond to a single element, depending on the embodiment.
[0042] According to a particular and non-limiting example of an embodiment of the present invention, the control of a display system embedded in a vehicle is, for example, implemented by one or more vehicle computers, for example via one or more processors.
[0043] To this end, initial data representing a command corresponding to the at least partial shuttering of a lens of a first image acquisition device by one or more fingers of a user (passenger or driver) is received. This at least partial shuttering can be triggered by the user initiating a sweeping or sliding movement, for example with one of their fingers, on the display system within the inclusion zone of the image acquisition devices.
[0044] Following the sweeping or sliding motion initiated by the user, a second set of data is received, representing a command corresponding to the at least partial shuttering of a lens on a second image acquisition device by one or more fingers of a user (passenger or driver). This at least partial shuttering of a second image acquisition device can result from the continuation of a sweeping or sliding motion performed by the user with one of their fingers, for example, on the display system within the inclusion zone of the image acquisition devices, this motion having previously already at least partially shuttered a first image acquisition device.
[0045] A swipe or glide corresponds to a continuous and prolonged press of one or more fingers on a part of the display system, in particular that including the image acquisition devices, the continuous and prolonged press forming a trace of a segment (from 1 to several centimeters for example) in a determined direction and sense, the direction being any, for example horizontal, vertical or oblique.
[0046] In the context of the present invention, the term "sequential" refers to the successive execution of at least two steps, where the second step can only be initiated after the first step has been fully or almost fully completed. Obviously, the shuttering of a first image acquisition device may not be completely finished when the shuttering of a second image acquisition device occurs, depending in particular on the size of the finger used and the spacing between the successive image acquisition devices. This ordered execution requires a temporal hierarchy of operations, ensuring that each step is carried out in a defined order and without simultaneity or near-simultaneity, so as to guarantee the synchronization and overall integrity of the process.
[0047] The display of a set of graphic content is then controlled in response to a scan or slide combining the at least partial and sequential shuttering of at least two image acquisition devices integrated into the touch screen, for example in an inclusion of the touch screen positioned at the edge of said screen, the display of said set of graphic content being a function of a sequential order of reception of said first and second data.
[0048] The order in which the shutters are performed determines the type or nature of the graphic objects that will be displayed in response to the user's swipe / drag movement.
[0049] The received data characterizing the scan or glide allows the processor(s) to determine a set of graphic content from a vehicle human-machine interface (HMI) to be displayed in response to the scan, as well as the function(s) or function indicators associated with each graphic content to be executed or simply displayed in response to the scan.
[0050] Figure 1 schematically illustrates part of the passenger compartment of a vehicle 10, according to a particular and non-limiting embodiment of the present invention.
[0051] Vehicle 10 corresponds, for example, to a vehicle with an internal combustion engine or a hybrid vehicle with an internal combustion engine and one or more electric motors. Vehicle 10 thus corresponds, for example, to a land vehicle, such as a car, a truck, or a bus.
[0052] Vehicle 10 advantageously incorporates a display system including a touchscreen 13 and a computer configured to control the display of content(s) from a graphic HMI on the touchscreen 13. The computer corresponds, for example, to the computer of the infotainment system, called the IVI computer (from the English "In-Vehicle Infotainment" or in French "Infodivertissement étoilé") of vehicle 10.
[0053] The 13-inch touchscreen corresponds, for example, to an LCD type screen (from the English "Liquid Crystal Display" or in French "Affichage à cristals liquide"), for example of the TFT type type (from the English "Thin-Film Transistor" or in French "Transistor en film mince"), or OLED (from the English "Organic Light-Emitting Diode" or in French "Diode électroluminescente organique").
[0054] The touchscreen 13 is configured to display content for the driver and passengers of vehicle 10. The touchscreen 13 is also configured to allow the driver and / or passengers of the vehicle to interact with one or more on-board systems in the vehicle via a human-machine interface (HMI) displayed on the touchscreen 13. For example, the screen 13 is configured to interact with any on-board system of vehicle 10, for example with one or more of the following systems, the list below being provided for illustrative purposes only and not exhaustively: - an infotainment system, known as an IVI system; and / or - a vehicle navigation and geolocation system 10; and / or - a vehicle air conditioning system 10; and / or - a vehicle seat adjustment control system 10; and / or - a vehicle speed control system; and / or - a vehicle trajectory control and / or lane keeping system 10; - etc.
[0055] The vehicle display system includes a touch screen 13 for providing an interactive user interface and an embedded non-touch insert or inclusion (or integration, or even an inset) 18, which insert contains at least two image acquisition devices 16, 17 for capturing real-time images.
[0056] In a first variant, the non-touch insert 18 is positioned on the periphery 19 of the touch screen 13, for example on one of the lateral sides or in the upper or lower part, so as to preserve the integrity of the touch contact area while allowing the discreet integration of the image acquisition devices 16, 17.
[0057] In a second variant, the non-touch insert 18 is hybrid-integrated into the touch screen 13 via optical cutting or partial overlay; this configuration makes it possible to give a portion of the screen sufficient optical transparency for the transmission of light to the image acquisition devices 16 while keeping the rest of the touch interface intact.
[0058] A third variant envisages that the non-touch insert 18 is incorporated into a common platform with the touch screen 13, dynamically dividing the display surface into distinct areas dedicated respectively to touch interaction and image acquisition, this separation being achieved by physical barriers or display control software configurations.
[0059] According to a particular embodiment, the display system including the touch screen 13 is for example provided or configured to reduce the number of screens present in the vehicle 10, allowing for example the removal of the display screen(s) called instrument cluster or instrument panel.
[0060] In a particular embodiment, the vehicle 10 incorporates one or more embedded systems, each controlled by one or more computers. These computers, together with computer I VI, form, for example, a multiplexed architecture for providing various services essential for the proper functioning of the vehicle and for assisting the driver and / or passengers in controlling the vehicle 10 through the control of the embedded system(s) within the vehicle 10.Computers communicate and exchange data with each other via one or more computer buses, for example a CAN data bus (from the English "Controller Area Network" or in French "Réseau de contrôlers"), CAN FD (from the English "Controller Area Network Flexible Data-Rate" or in French "Réseau de contrôlers à débit de données flexible"), FlexRay (according to the ISO 17458 standard), LIN (from the English "Local Interconnect Network" or in French "Réseau interconnecté local") or Ethernet (according to the ISO / IEC 802-3 standard).
[0061] The detection of a total or partial obstruction of an image acquisition device 16, 17 by a user's finger(s) is coordinated through mechanical, electronic, and computer interactions integrated within the vehicle. Mechanically, the image acquisition module 16, 17 can be housed in a non-touch inclusion of the touchscreen 13, the design of which allows the lens to be partially exposed to the environment while providing physical protection. The structure of this inclusion is designed such that direct contact, such as a finger touching the lens, causes a change in optical transmission through a slight shift in alignment or a variation in the reflectivity of the covering surface, thus making the obstruction easily identifiable.
[0062] The user's finger(s) can cover the lens surface in whole or in part, namely covering 100% of the surface or between 1% and 100%, in particular between 10% and 100%, and in particular again between 50% and 100% of the total lens surface.
[0063] At the electronic level, the image acquisition device 16, 17 can easily integrate an optoelectronic sensor, for example a CMOS sensor, whose analog signal is converted into digital data via a high-precision analog-to-digital converter (ADC). This data is then transmitted to a dedicated processing unit, such as an embedded microcontroller or a digital signal processor (DSP), which manages the signals from the sensor. When a finger obstructs the lens, at least partially, the image capture reveals a localized decrease in light intensity as well as an alteration in the spectral distribution of colors and edges. These alterations, which differ from the reference image acquired under conditions of minimal or no obstruction, are immediately detected by the signal processing circuit, which quantifies the deviation from pre-established thresholds.
[0064] From a computing perspective, the processed data can then be analyzed in real time by a sophisticated image processing algorithm, running on a central processing unit embedded in the vehicle—for example, an infotainment computer or a hardware acceleration module such as an embedded GPU or a dedicated AI accelerator. This algorithm may rely on pattern recognition and anomaly detection techniques, allowing the acquired images to be compared to an internal database or a predefined model of an unobstructed image. As soon as the algorithm identifies, based on spatial and temporal filtering, an area exhibiting the characteristics of an obstruction (in particular, a significant reduction in brightness with or without the presence of a contour corresponding to the shape of a finger), it generates a control signal indicating that the image acquisition device 16 is at least partially obstructed.This signal can then be used by the present control method.
[0065] A control process for an on-board display system in the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by a computer of an on-board system of the vehicle 10 such as the IVI system.
[0066] The control process is described in support of figures 2 to 5, each of which illustrates the result of displaying one or more graphic objects on the touch screen 13, according to different implementation examples.
[0067] In the first operation of the process, initial data representative of at least partial obliteration of a lens of a first image acquisition device 16 are received.
[0068] According to an example of an embodiment of the invention, as illustrated in Figure 2, at least one finger of a user's hand 20 (driver or passenger) initiates a sweeping or sliding movement by approaching, at time t1, the lens of a first image acquisition device 16, such as a camera, positioned in the non-touch insert (or camera bar) 18 of the touch screen 13. The direction of the movement is in no way limiting and is a function of the positioning of the lenses which can be positioned horizontally (one next to the other), vertically (one above the other), or obliquely (along a line inclined with respect to an axis of symmetry of the screen 13).
[0069] In one variant, the scanning movement is initiated from the left of the lens 16 towards its right in a direction of trajectory 24 and extends over a certain distance, for example 1, 2, 3, 4, or 5 cm, during the times t2, t3, and t4.
[0070] At time t3, when the finger 22 passes in front of or over the lens of a first image acquisition device 16 along a substantially horizontal trajectory (due to the horizontal alignment of the cameras 16 in the example of Figure 2) in a direction 24, initial data representing the at least partial shuttering of a first camera 16 are received. If the finger does not continue its movement and the user removes it from the screen, for example, then the display process ends.
[0071] In a second operation of the process, second data representative of at least partial shuttering of a lens of a second image acquisition device 17 are received when the finger 22 passes in front of or over the second camera lens at time t4.
[0072] The sweeping or sliding movement initiated earlier at time t2 by the user's finger 22 and ending at time t4, having had the effect of successively closing the lenses of cameras 16 and 17 in a defined sequential order, triggers the control of the display of a set of particular graphic content.
[0073] In a third operation of the process, the display of a set of graphic contents 200 of a human-machine interface of the vehicle 10 is therefore controlled according to the said first and second data and a sequential order of reception of the said first and second data received and, therefore, according to the direction of the scanning movement 24, as illustrated, for example, at time t5 of figure 2.
[0074] According to one variant, said graphic content set 200 comprises a first graphic content 202 including a first graphic object 212 representing an activation state (or activation indicator T1) of a function of said vehicle 10 when said first data is received before said second data. For example, a swipe in one direction 24 (from left to right when positioned in front of the touchscreen 13), covering the lens of the camera 16 before that of the camera 17, allows the display of graphic objects 212, 214, and / or 216 representing indicators allowing the user to quickly be informed about the functions of the vehicle 10 that are activated T1, T2, and T3, for example.
[0075] There are no specific limitations regarding the visual appearance of graphical objects representing indicators of activated functions, but colors, shapes, and / or symbols designed for quick and intuitive user understanding will be preferred, such as green, with or without lighting effects, and square or rounded shapes. In another example, a recognizable pictogram, such as an icon symbolizing the function in question, can be accompanied by a short label such as "Active" or "ON".
[0076] According to an example illustrated in Figure 3, said scanning movement can also begin to the right 32 of the lens of the camera 17 on the non-touch part of the display system (in the area of the non-touch insert 18 or directly on part or all of the lens 17) by at least partially closing the lens of the camera 17 (at time t3), and continue its course to its left following the direction of the movement 34 by at least partially closing the lens of the camera 16 (at time t4).
[0077] The sweeping or sliding movement initiated earlier at time t2 by the user's finger 22 and ending at time t4, having had the effect of successively closing the lenses of cameras 17 and 16 in a second defined sequential order (17 then 16), triggers the control of the display of a particular set of graphic content distinct from the set of graphic content displayed in response to the sweeping or sliding movement initiated earlier at time t2 of figure 2 by the user's finger 22 and ending at time t4 of figure 2, having had the effect of successively closing the lenses of cameras 16 and 17 in a first defined sequential order (16 then 17).
[0078] In a third operation of the process, the display of a set of graphic contents 200 of a human-machine interface of the vehicle 10 is therefore controlled according to the said first and second data and a sequential order of reception of the said first and second data received and, therefore, according to the direction of the scanning movement 34, as illustrated, for example, at time t5 of figure 3.
[0079] According to one variant, said graphic content set 200 includes a second graphic content 302 comprising a second graphic object 312 representing an activation state (or activation indicator T4) of a function of said vehicle 10 when said first data is received before said second data. For example, a swipe in one direction 34 (from right to left, when positioned in front of the touchscreen 13), covering the lens of the camera 17 before that of the camera 16, allows graphic objects 312, 314, and / or 316 to be displayed, representing indicators that quickly inform the user about the functions of the vehicle 10 that are deactivated, for example T4, T5, and T6.
[0080] There are no specific limitations regarding the visual appearance of graphical objects representing indicators of deactivated functions, but colors, shapes, and / or symbols designed for quick and intuitive user understanding will be preferred. For example, a predominantly red color, with or without lighting effects, square or rounded shapes, and / or crossed or slashed across them. In another example, a recognizable pictogram, such as an icon symbolizing the function in question, can be accompanied by a short label such as "Inactive" or "OFF."
[0081] According to another embodiment of the invention, said first and second graphic contents 202, 302 each comprise a plurality of graphic objects 212, 214, 216, 312, 314, 316 each individually representative of an activation or deactivation state of a function of said vehicle 10.
[0082] The display of said graphic objects can be controlled on the part of the touch screen 13 with a fluid effect such as scrolling or sliding, where the graphic objects appear successively in a direction and sense identical to that of the swiping movement.
[0083] According to one variant, the vehicle display system 10 comprises a touchscreen 13 and a plurality of image acquisition devices 16, 17, 41 integrated with or combined with said touchscreen 13, for example, grouped within a non-touch camera inset, inclusion, overlay, or bar 18. Figure 4 illustrates an embodiment in which the vehicle display system 10 comprises 3 acquisition devices Y1 of images 16, 17 and 41. In such a case, when the lens of a first image acquisition device 16 (or 41) is at least partially closed by the initiation of a sweeping movement of a user's finger, thus resulting in the reception of first shutter data, continues its course by at least partially closing the lens of a second image acquisition device 17, thus resulting in the successive reception of second shutter data, and ends it by at least partially closing the lens of a third image acquisition device 41 (or 16), thus resulting in the successive reception of fourth shutter data, the display of graphic objects representing the activated or deactivated functions is controlled.
[0084] For example, the computer in charge of the process identifies the type of scan performed based on said first and second data and a sequential order of reception of said first and second data.
[0085] For example, when the computer receives data representing the shuttering of the camera lens 16 before that representing the shuttering of the camera lens 17 (example in Figure 2), it controls the display of indicators of the vehicle functions 10 activated at the time the process is implemented by the user.
[0086] According to another example, when the computer receives data representing the shuttering of the camera lens 17 before that representing the shuttering of the camera lens 16 (example in Figure 3), it controls the display of indicators for vehicle functions 10 that are deactivated at the time the process is implemented by the user.
[0087] A display control of a graphic object (text, pictogram, icon, etc.) or graphic content includes a rendering of the graphic content or graphic object, such rendering corresponding to a set of operations performed by one or more processors on the pixels of one or more images of the graphic content to be displayed on the screen 13. For example, rendering consists of associating to a set of pixels of an image pixel data (for example color data expressed in an RGB (Red, Green, Blue) type space) associated with each graphic object.
[0088] The display control of a graphic object thus includes the transmission of control signals to the touch screen 13 to modify the values associated with the pixels of the touch screen 13 at the location intended to display the graphic object, i.e. at a determined position on the touch screen 13.
[0089] The display of the graphic object is triggered by the reception of data representing the shutter state of the image acquisition devices and the sequential order of their reception.
[0090] Figure 5 illustrates the result of the display caused by the at least partial obstruction of at least one lens of said at least two image acquisition devices 16, 17 by at least part of a user's hand 20 when a set of graphic content 200 is displayed.
[0091] According to another variant the display control process further includes the steps of receiving 74 third data representing at least partial shuttering of at least one objective of said at least two image acquisition devices 16, 17 after the reception of said first and second data, and of checking 75 the display stoppage of said graphic objects.
[0092] The first time instant t1 corresponds to a time instant associated with the initiation of the user's movement towards the lenses of cameras 16 and 17. The time instant t2 corresponds to a time instant associated with the at least partial shuttering of at least one lens of cameras 16, 17 by a finger 22 of the user at the level of the area 50, while the time instant t3 corresponds to a time instant associated with the withdrawal of said finger 22 ending said shuttering and the display of the graphic objects 312, 314, 316 present at that moment.
[0093] The shutter sequence used to stop the display of a graphic object must obviously not correspond to a swiping or sweeping movement similar to the movement that displays said graphic object. For example, a movement illustrated in Figure 5 corresponds to a brief touch of the user's finger on or within an area 50 that allows at least one of the camera lenses incorporated into the touchscreen 13 to be at least partially shuttered for a short time or a short press.
[0094] In the context of the present invention, a "short duration" refers to a time interval during which the user's finger remains in contact with the screen, this interval being sufficiently brief to be interpreted as a tap-type interaction and not as a sustained command or swipe. More precisely, this short duration corresponds to a period between a lower threshold, for example on the order of 50 milliseconds, and an upper threshold, for example on the order of 500 milliseconds, these values being adjustable according to ergonomic requirements and the interface's sensitivity settings.Control of this interval can be achieved by an embedded processor or a dedicated microcontroller, which analyzes the contact signals in real time via an analog-to-digital converter associated with the display or image acquisition system, thus making it possible to differentiate between a brief contact intended to trigger an immediate command and a prolonged contact likely to initiate other interaction functions.
[0095] In a particular embodiment, the at least partial shuttering of a lens within the framework of the present invention is achieved by physical contact between the user's finger(s) or, in the absence of physical contact, by detection of the scanning or pressing movement near the cameras 16, 17, by at least one of them.
[0096] Figure 6 schematically illustrates a device 6 configured for controlling a vehicle display system, for example vehicle 10, according to specific and non-limiting embodiments of the present invention. The device 6 corresponds, for example, to a device embedded in the vehicle 10, such as a computer.
[0097] Device 6 is, for example, configured to carry out the operations described opposite Figures 1 to 5 and / or the steps of the process described opposite Figure 7. Examples of such a device 6 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a smartphone, a tablet, or a laptop computer. The elements of device 6, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. Device 6 can be implemented as electronic circuits or software (or computer) modules, or a combination of electronic circuits and software modules.
[0098] The device 6 includes one (or more) processor(s) 60 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 6. The processor 60 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 6 further includes at least one memory 61, for example, volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.
[0099] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is, for example, stored on memory 61.
[0100] According to various specific and non-limiting embodiments, device 6 is coupled in communication with other similar devices or systems and / or with image processing devices, for example a CCU (from the English "Camera Control Unit" or in French "Embedded Image Processing Unit"), for example via a communication bus or through dedicated input / output ports.
[0101] According to a specific and non-limiting embodiment, the device 6 includes an embedded image processing block 62, intended to perform in real time the reception, optimization and analysis of the images captured by the image acquisition device(s) 16, 17, 41. The block 62 integrates, for example, one or more of the following configurations: - a high-precision analog-to-digital converter (ADC), enabling the digitization of analog signals from image sensors to generate digital data suitable for further processing; - a digital signal processor (DSP) or a dedicated image processing processor, such as an ARM® Cortex-A type processor, performing correction, filtering and noise reduction operations, as well as the extraction of relevant features from the acquired images; - an integrated graphics processing unit (GPU), facilitating the execution in high definition of advanced processing such as edge detection, image segmentation and pattern recognition, particularly in attention tracking or facial recognition applications; - a buffer memory and a temporary storage unit, intended for managing visual data flows during continuous and real-time processing, ensuring synchronization and fluidity of the process.
[0102] The embedded image processing block 62 can be implemented either as a specific integrated circuit (ASIC), or via a programmable solution such as an FPGA (Field-Programmable Gate Array), or by a combination of general-purpose processors and dedicated accelerators, thus offering maximum flexibility in adapting to the performance and energy optimization requirements of the vehicle's on-board display systems.
[0103] According to a particular and non-limiting embodiment, the camera system integrates a communication interface 63 for establishing communication with other vehicle modules, such as an on-board image processing unit or a central computer, via a communication channel 630. The interface 63 is configured to transmit and receive image data as well as diagnostic information relating to the performance of the image acquisition device(s) 16, 17. In one variant, this interface relies on a wired network of the CAN, CAN FD, FlexRay or Ethernet type, thus ensuring real-time transmission of image streams and optimal synchronization with the overall vehicle architecture.
[0104] According to another particular and non-limiting embodiment, the camera system is designed to provide output signals to one or more external devices, such as a display screen 640 dedicated to viewing processed images or disseminating information from analyses, via a digital output interface 64. According to one variant, either of these external devices can be integrated directly into the camera system, allowing optimized integration into the vehicle architecture and thus minimizing the need for additional wired connections.
[0105] Figure 7 illustrates a flowchart of the different steps in a method for controlling a display system embedded in a vehicle, for example vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is implemented, for example, by a device embedded in vehicle 10 or by device 6 of Figure 6.
[0106] In a first step 71, representative data of at least partial shuttering, by a user, of a lens of a first image acquisition device are received.
[0107] In a second step 72, data representative of at least partial shuttering, by said user, of a lens of a second image acquisition device are also received.
[0108] In a third step 73, the display of a set of graphic content based on said first and second data and a sequential order of reception of said first and second data is controlled on the touch screen.
[0109] In a fourth step 74, data representing at least partial shuttering, by said user, of at least one objective of said at least two image acquisition devices are received after the receipt of said first and second data.
[0110] In a fifth step 75, the display of one or more graphic objects is completed.
[0111] According to one variant, the variants and examples of the operations described in relation to one of Figures 1 to 5 apply to the steps of the process in Figure 7.
[0112] Of course, the present invention is not limited to the embodiments described above but extends to a method for controlling the execution of instructions representing functions or actions implemented by at least one system embedded in a vehicle, which would include secondary steps without falling outside the scope of the present invention. The same would apply to a device configured for implementing such a method.
[0113] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-powered vehicle, comprising the device 6 of figure 6 or a display system comprising the device 6 of figure 6 connected in communication to a touch screen 13 comprising at least two image acquisition devices 16, 17.
Claims
DEMANDS 1. Method for controlling a vehicle display system (10), said display system comprising a touchscreen interface, said touchscreen (13), said touchscreen (13) comprising at least two image acquisition devices (16, 17), said method being implemented by at least one processor and comprising the following steps: - receipt (71) of first data representative of at least partial shuttering, by a user, of a lens of a first image acquisition device (16); - reception (72) of second data representative of at least partial shuttering, by said user, of a lens of a second image acquisition device (17); - control (73) of display, on said touch screen (13), of a set of graphic contents (200) function of said first and second data and of a sequential order of reception of said first and second data.
2. Method according to claim 1, wherein when said first data are received before said second data, said graphic content set (200) comprises a first graphic content (202) comprising a first graphic object (212) representative of an activation state of a function of said vehicle (10).
3. A method according to any one of the preceding claims, wherein when said first data are received after said second data, said graphic content set (200) includes a second graphic content (302) comprising a second graphic object (312) representative of a deactivation state of a function of said vehicle (10).
4. A method according to any one of the preceding claims, wherein said sequential receiving order is a consequence of a swiping movement performed by a user.
5. A method according to claims 3 or 4, wherein said first and second graphic contents (202, 302) each comprise a plurality of graphic objects (212, 214, 216, 312, 314, 316) each individually representative of an activation or deactivation state of a function of said vehicle (10).
6. A method according to any one of the preceding claims, further comprising the following steps: - reception (74) of third data representing at least partial occlusion of at least one objective of said at least two image acquisition devices (16, 17) subsequent to the reception of said first and second data; - control (75) of the display stoppage of said graphic objects.
7. A method according to any one of the preceding claims, wherein said touch screen (13) comprises a non-touch insert (18) comprising said at least two image acquisition devices (16, 17), located at the edge (19) of said touch screen (13).
8. Computer program comprising instructions for carrying out the method according to any one of claims 1 to 7, when such instructions are executed by at least one processor.
9. Device (6) for controlling a display system of a vehicle (10), said device (6) comprising a memory (61) associated with at least one processor (60) configured for carrying out the steps of the method according to any one of claims 1 to 7.
10. Vehicle (10) comprising the device (6) according to claim 9.