Display system for motor vehicle interior, associated display method and associated computer program
The display system addresses the challenge of adapting to varying content sources and display surfaces by combining and dividing images across multiple surfaces, optimizing visibility and energy use through intelligent lighting and image processing.
Patent Information
- Application Number
- FR2022013756
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-12-19
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2042-12-19
AI Technical Summary
Existing motor vehicle display systems face challenges in efficiently adapting to varying numbers of content sources and display surfaces while minimizing cost and energy consumption.
A display system comprising a programmable electronic device that combines and divides digital images across multiple activatable display surfaces, adjusts lighting based on user gaze direction, and optimizes image dimensions and resolution to create a seamless display experience with reduced energy consumption.
The system efficiently adapts to any number of display surfaces and sources, optimizing visibility and reducing energy consumption by intelligently managing lighting and display areas based on user gaze direction.
Smart Images

Figure 00000012_0000 
Figure 00000013_0000 
Figure 00000014_0000
Abstract
Description
Title of the invention: Display system for a motor vehicle interior, associated display method and associated computer program
[0001] The present invention relates to a display system for a passenger compartment of a motor vehicle, an associated display method and an associated computer program.
[0002] The invention lies in the field of systems for displaying content, e.g. information and images / videos, on a display surface of a motor vehicle interior.
[0003] Nowadays, motor vehicles are equipped with numerous sensors (cameras, radars) and a sophisticated on-board system, including in particular one or more information display surfaces, but also images or videos including a succession of images, in particular transmitted by the on-board sensors.
[0004] The display surfaces are composed, depending on the case, of liquid crystal or LCD (for "Liquid Crystal Display") screen surfaces, and of surfaces integrated into a vehicle trim element, and backlit by controllable lighting units, for example light-emitting diode (LED) matrices.
[0005] The on-board system comprises at least one central control unit (or ECU) configured to control the displays on the available display surfaces.
[0006] The number of content sources to be displayed is likely to vary and increase, depending on the various options of the vehicles, in particular the number of on-board sensors and information to be displayed provided by the central control unit is variable.
[0007] To display the maximum amount of available content, it would be necessary to provide a very large display area, for example an LCD screen having a very large liquid crystal display area. However, this type of screen is expensive, and constant display on such a screen also consumes a large amount of electrical energy.
[0008] There is therefore a need to propose a display solution that is adaptable depending on the number of sources and the number of display surfaces, which is more economical and / or consumes less electrical energy.
[0009] To this end, the invention proposes, according to one aspect, a display system for a passenger compartment of a motor vehicle, comprising a number N of activatable display surfaces, each display surface being activatable by a lighting control of at least one associated lighting unit, and a programmable electronic device configured to control a display on each display surface, the programmable electronic device comprising a processor configured to execute, at a given rate: - a module for receiving a number P greater than 1 of digital images to be displayed at a given time, said P digital images to be displayed being supplied by at least two separate sources, - a module for combining the P digital images to be displayed at a given time into a single complete digital image, - in the case where the number N of activatable display surfaces is greater than 1, a module for cutting said complete digital image into a number less than or equal to N of digital sub-images to be displayed, each of the digital sub-images to be displayed being intended to be displayed on a corresponding activatable display surface,
[0010] a module for controlling the display of each of the digital sub-images on the corresponding activatable display surface.
[0011] Advantageously, the proposed display system implements a combination of the digital images received from a plurality of sources into a complete digital image, which then makes it possible to adapt to any number N of display surfaces.
[0012] The display system according to the invention may also have one or more of the characteristics below, taken independently or in any technically conceivable combination.
[0013] It further comprises a unit for detecting a direction of gaze of a user present in the passenger compartment of the motor vehicle, the processor being further configured to, depending on the direction of gaze of the user, implement a module for determining a main display area or a main display surface.
[0014] The processor is configured to control an increase in illumination of said main display area or surface and a decrease in illumination of the other display areas or surfaces.
[0015] The processor is configured to implement processing for changing the dimensions and / or resolution of digital images, in order to form a complete digital image of predetermined dimensions and resolution.
[0016] The processor is configured to implement an image analysis in the digital sub-image cutting module.
[0017] Image analysis is a semantic analysis for determining at least one low entropy zone, the cutting being carried out in said low entropy zone.
[0018] In the case where the number N of activatable display surfaces is equal to 1, the module
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025] control is configured to control the display of the complete digital image on the display surface. According to another aspect, the invention relates to a display method for a passenger compartment of a motor vehicle, implemented by a processor of a programmable electronic device of a display system for a passenger compartment of a motor vehicle, comprising a number N of activatable display surfaces, each display surface being activatable by a lighting control of at least one associated lighting unit. This method of the steps, repeated at a given rate, comprising: - receiving a number P greater than 1 of digital images to be displayed at a given time, said digital images to be displayed being provided by at least two distinct sources, - combine the P digital images to be displayed at the given time into a single complete digital image, - in the case where the number N of activatable display surfaces is greater than 1, cutting said complete digital image into a number less than or equal to N of digital sub-images to be displayed, each of the digital sub-images to be displayed being intended to be displayed on a corresponding activatable display surface, - control the display of each of the digital sub-images on the corresponding activatable display surface. The method further comprises obtaining a direction of gaze of a user present in the passenger compartment of the motor vehicle, determining a main display area or a main display surface as a function of the direction of gaze of the user, and adjusting the lighting of said main display area or surface. The advantages of the display method are similar to the advantages of the display system recalled above. According to another aspect, the invention relates to a computer program comprising program code instructions which, when executed by a programmable electronic device, implement a display method as briefly described above. Other characteristics and advantages of the invention will emerge from the description given below, for information purposes only and in no way limiting, with reference to the appended figures, among which: [Fig.l] [Fig.l] schematically represents a system for displaying images in a passenger compartment of a motor vehicle according to one embodiment; [Fig.2] [Fig.2] is a schematic example of a complete digital image and sub-images obtained after cutting the complete digital image;
[0026] [Fig.3] [Fig.3] is a synopsis of the main stages of a display process according to one embodiment.
[0027] [Fig.l] schematically represents an image display system 2, installed in a motor vehicle interior (not shown).
[0028] The system 2 comprises a plurality of image sources to be displayed, the sources being respectively on-board sensors and / or one or more electronic control units providing information relating to the vehicle, for example the speed, the interior temperature of the passenger compartment, the exterior temperature, etc.
[0029] In the example illustrated, we consider digital image sensors of the on-board camera type 4, 6, respectively providing digital images Ib I2 corresponding to the side mirrors of the vehicle, and other on-board sensors providing information to be displayed, to calculation units 8, 10 which digitize the information to form digital images I3, 14.
[0030] As a simple non-limiting example, image I3 contains information on the speed of the vehicle, and image L contains information on the consumption of electrical energy for an electric vehicle.
[0031] The set of digital images L, I2, I3, L form contents to be displayed.
[0032] Each digital image is represented by a matrix of pixels, also called image data, defined by its respective dimensions, which are a number of rows and a number of columns.
[0033] The images to be displayed are provided at a given rate, corresponding to the display refresh rate to be applied.
[0034] In the case where the image sensors and other content-providing equipment have distinct refresh rates, a display rate is chosen.
[0035] For example, the display rate corresponds to the highest frequency among the sequences of images (or videos) received, for example 60 frames per second (or Fps for “Frames per Second” in English), if a first video to be displayed comprises 60 frames per second and a second video to be displayed comprises 30 frames per second (Fps). The system 2 further comprises a programmable electronic device 12, for example an on-board computer, comprising a calculation processor 14 and an electronic memory unit 16, connected by a communication bus 15.
[0036] The programmable electronic device 12 may comprise other elements, in particular communication interfaces with the on-board equipment, which are not shown here.
[0037] The on-board system further comprises N activatable display surfaces 20.
[0038] For example N=3 in [Fig.l], and the display surfaces are respectively referenced 20i, 202 and 203, for example two LCD screen surfaces 20i, 202 and one peripheral display surface 203, attached to a lateral edge of the display surface 20i. For example, the peripheral display surface 203 is backlit by lighting units forming a sheet of light-emitting diodes (or LEDs).
[0039] Such a backlit display surface makes it possible to produce an extended display surface at lower cost.
[0040] The programmable electronic device 12 is configured to execute: - a module 30 for receiving a number P greater than 1 of digital images to be displayed at a given time, said digital images to be displayed being supplied by at least two separate sources, - a module 32 for combining the P digital images to be displayed at a given time into a single complete digital image, - a module 34 for dividing said complete digital image into a number less than or equal to N of digital sub-images to be displayed, each of the digital sub-images to be displayed being intended to be displayed on one of the activatable display surfaces, implemented in the case where the number N of activatable display surfaces is greater than 1; - a module 36 for controlling the display of each of the digital sub-images on the corresponding activatable display surface.
[0041] A digital sub-image is a digital image formed by a matrix of pixels cut out of the complete digital image. In other words, a digital sub-image is also a digital image.
[0042] Furthermore, the system 2 comprises a unit 38 for detecting a direction of gaze of a user present in the passenger compartment of the motor vehicle, typically the driver of the vehicle, which is configured to detect a direction of gaze sustained over a predetermined time duration, for example of the order of a millisecond.
[0043] The programmable electronic device 12 is configured to execute a module 40 for determining a main display area or a main display surface and adjusting the lighting (or brightness level) of said main display area or surface.
[0044] The term display area is used herein to denote a portion of a display surface, having an area smaller than the display surface in which it is included.
[0045] In some embodiments, the display of such a display area can be controlled, in particular in terms of illumination / contrast separately, i.e. it is possible to increase or decrease the illumination in such a display area without performing the same increase or decrease in the entire display surface.
[0046] Then the control module 36 is configured to adjust the lighting according to of the determined main display area or main display surface, for example to increase the illumination of said main display area or surface and to decrease the illumination of other display areas and / or surfaces.
[0047] The combination module 32 is notably configured to implement digital image processing, for example processing to change the dimensions and / or resolution of the digital images.
[0048] The cutting module 34 is configured to implement a semantic analysis of images allowing an adequate cutting of the complete digital image into N sub-images.
[0049] For example, the cutting is carried out in low-entropy image areas, detected by semantic analysis on a chosen number of consecutive images, for example on 20 consecutive images. A low-entropy area is for example defined by a number of contiguous pixel columns with fixed values or whose difference is less than a given threshold between two successive images.
[0050] In one embodiment, the modules 30, 32, 34, 36 and 40 are produced in the form of software instructions forming a computer program, which, when executed by a computer, implements a display method according to the invention.
[0051] The computer program comprising software instructions is further capable of being recorded on a non-transitory computer-readable medium. The computer-readable medium is, for example, a medium capable of storing the electronic instructions and of being coupled to a bus of a computer system. For example, the readable medium is an optical disk, a magneto-optical disk, a ROM memory, a RAM memory, any type of non-volatile memory (for example EPROM, EEPROM, FLASH, NVRAM), a magnetic card or an optical card.
[0052] In a variant not shown, the modules 30, 32, 34, 36 and 40 are each produced in the form of programmable logic components, such as FPGAs (Field Programmable Gate Arrays), microprocessors, GPGPU components (General-purpose processing on graphics processing), or even dedicated integrated circuits, such as ASICs (Application Specific Integrated Circuits)•
[0053] [Fig.2] schematically illustrates an example of a complete digital image hng_C obtained by combining the images Ib, I2, I3 and U, and the sub-images S_IMGi and S_IMG2 obtained by cutting out the complete digital image, with a view to their display respectively on the display surfaces 20i and 202.
[0054] Thus, in this schematic example, the four initial digital images are combined into a single complete digital image, the combination consisting of concatenating the images, into a rectangular image comprising L rows and C columns.
[0055] The digital images to be displayed are, where appropriate, processed, for example by enlarging or reducing, in particular to obtain the desired number of lines of pixels per image.
[0056] For example, techniques for changing the resolution / size of images (in English "scaling"), storing images in a buffer memory and synchronizing between images to achieve a display without loss perceptible by a user ("seamless") are applied. Such techniques are known to those skilled in the art.
[0057] The division into two sub-images is advantageously carried out as a function of the initial digital images and the available display surfaces.
[0058] [Fig.3] is a flowchart of the main steps of a method for displaying images according to one embodiment.
[0059] The method comprises a step 50 of receiving the P digital images to be displayed at a given time instant, L to IP.
[0060] The number P of digital images can vary over time, but it is fixed at a given iteration of the method.
[0061] The digital images to be displayed come, for example, from different sources, and the image Ik has respective dimensions of Lk lines and Ck columns.
[0062] The method then comprises a step 52 of combining the P digital images to be displayed, L to IP into a single complete digital image hng_C.
[0063] For example, the digital images to be concatenated are analyzed, and an image size / resolution change ratio is determined and then applied.
[0064] The concatenation order is for example a predefined order, depending on the sources of the digital images.
[0065] If the number of display surfaces N is strictly equal to 1 (condition 54 = True), the method then comprises a display 56 of the complete digital image on the display surface. If necessary, the resolution of the image is updated for compatibility with the display surface.
[0066] If the number of display surfaces N is strictly greater than 1 (condition 54 = False), the method comprises a step 58 of cutting the complete digital image into N sub-images.
[0067] In one embodiment, in addition to the number of available display surfaces, the dimension (eg the area available for display) or the resolution of each of the available display surfaces is taken into consideration in this cutting step.
[0068] Alternatively, the division into N digital sub-images of identical dimensions (in number of lines and columns of pixels) is carried out.
[0069] In another variant, the cutting uses a semantic analysis of the content of so as to avoid a cut-out which would be inconvenient for the user's understanding.
[0070] The N digital sub-images obtained are then displayed on the N display surfaces in step 60, for example by applying a control of the backlighting units of these surfaces as a function of the pixels of the digital sub-images to be displayed.
[0071] In one embodiment, the method further comprises a step 62 of obtaining a direction of gaze of a designated user of the vehicle, for example the driver.
[0072] This step 62 is carried out continuously, in parallel with the other steps.
[0073] The method then comprises a determination 64 of a main display area or surface as a function of the determined direction of gaze. For example, the main display area is the display area intersected by the direction of gaze, or an area of chosen dimensions centered on the direction is chosen as the main display area.
[0074] The main display area or surface obtained in step 64 is then used in a step 68 of adjusting the lighting of the main display area or surface.
[0075] For example, the lighting of the main area or surface is increased, and in addition, the lighting of the other display surfaces is reduced.
[0076] Advantageously, this makes it possible to improve the user's visibility while optimizing the quantity of electrical energy consumed.
[0077] The adjustment of the lighting can for example be carried out by controlling the backlighting units of these display surfaces.
[0078] The steps of the method are repeated at a given rate, which is the display rate.
[0079] The display method has been described above for a division of the single complete image into N sub-images, N being the number of available surfaces.
[0080] According to a variant, a number M less than N of display surfaces is chosen for the effective display, in which case a division into M <N sous-images numériques est .effectué. L’affichage est alors effectué sur les M surfaces d’affichage choisies. Bien entendu, le nombre M peut varier au cours du temps.
[0081] Advantageously, the proposed system and method allow easy adaptation to any number of image sources and display surfaces, thus allowing the use of a plurality of "small" display surfaces instead of a single "large" display surface, and thus reducing the cost of the displays.
[0082] Advantageously, the proposed system and method make it possible to improve the user's visualization while reducing the consumption of electrical energy thanks to the management of the lighting / darkening of the display surfaces according to the direction of the user's gaze.
Claims
Claims
1. Display system for a passenger compartment of a motor vehicle, comprising a number N of activatable display surfaces (20i, 202, 203), each display surface being activatable by a lighting control of at least one associated lighting unit, and a programmable electronic device configured to control a display on each display surface, the programmable electronic device comprising a processor (14) characterized in that it is configured to execute, at a given rate: - a module (30) for receiving a number P greater than 1 of digital images to be displayed at a given instant, said P digital images to be displayed being supplied by at least two distinct sources (4, 6, 8, 10), - a module (32) for combining the P digital images to be displayed at the given instant into a single complete digital image, - in the case where the number N of activatable display surfaces is greater than 1,a module (34) for dividing said complete digital image into a number less than or equal to N of digital sub-images to be displayed, each of the digital sub-images to be displayed being intended to be displayed on a corresponding activatable display surface, - a module (36) for controlling the display of each of the digital sub-images on the corresponding activatable display surface.,
2. Display system according to claim 1, further comprising a unit (38) for detecting a direction of gaze of a user present in the passenger compartment of the motor vehicle, in which the processor is further configured to, depending on the direction of gaze of the user, implement a module (40) for determining a main display area or a main display surface.
3. A display system according to claim 2, wherein the processor (14) is configured to control an increase in illumination of said main display area or surface and a decrease in illumination of the other display areas or surfaces.
4. Display system according to one of claims 1 to 3, in which the processor (14) is configured to implement processing for changing the dimensions and / or resolution of digital images, in order to form a complete digital image of predetermined dimensions and resolution.
5. Display system according to one of claims 1 to 4, in which the cutting module (34) is configured to implement a semantic analysis of images allowing a cutting of the complete digital image into N digital sub-images.
6. A display system according to claim 5, wherein the image analysis is a semantic analysis for determining at least one low entropy area, the clipping being performed in said low entropy area.
7. System according to any one of claims 1 to 6, wherein, in the case where the number N of activatable display surfaces is equal to 1, the control module (36) is configured to control the display of the complete digital image on the display surface.
8. Display method for a passenger compartment of a motor vehicle, implemented by a processor of a programmable electronic device of a display system for a passenger compartment of a motor vehicle, comprising a number N of activatable display surfaces, each display surface being activatable by a lighting control of at least one associated lighting unit, characterized in that it comprises steps, repeated at a given rate, comprising: - receiving (50) a number P greater than 1 of digital images to be displayed at a given instant, said digital images to be displayed being supplied by at least two distinct sources, - combining (52) the P digital images to be displayed at the given instant into a single complete digital image, - in the case where the number N of activatable display surfaces is greater than 1, cutting (58) said complete digital image into a number less than or equal to N of digital sub-images to be displayed,each of the digital sub-images to be displayed being intended to be displayed on a corresponding activatable display surface, - controlling (60) the display of each of the digital sub-images on the corresponding activatable display surface.,
9. Method according to claim 8, further comprising obtaining (62) a direction of gaze of a user present in the passenger compartment of the motor vehicle, determining (64) a main display area or a main display surface as a function of the direction of gaze of the user, and adjusting the lighting of said main display area or surface.
10. A computer program comprising software instructions which, when executed by a programmable electronic device, implement a method according to claims 8 to 9.
