Display system for vehicle and control method for it

The vehicle display system dynamically adjusts display tilt based on driver conditions using multiple camera modules and sensors, addressing the fixed-camera issue in conventional systems to enhance visibility.

DE102018105169B4Active Publication Date: 2026-03-26HL KLEMOVE CORP
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2018-03-07
Publication Date
2026-03-26

AI Technical Summary

Technical Problem

Conventional vehicle display systems with fixed camera modules for side mirrors fail to adapt to the driver's condition, leading to deteriorated vehicle visibility.

Method used

A vehicle display system with multiple camera modules, driver pupil and posture detection sensors, and a computing unit to calculate and adjust the tilt of display fields based on the driver's field of vision, posture, and position, enhancing visibility by automatically correcting the display device's tilt.

Benefits of technology

Improves vehicle visibility by dynamically adjusting the tilt of display fields according to the driver's condition, thereby optimizing the viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Vehicle display system, including: multiple camera modules configured to record a front, a rear, a rear left side and a rear right side relative to the vehicle and generate image data; multiple display modules configured to receive image data and display a front side image, a rear side image, a rear left side image, and a rear right side image relative to the vehicle; a driver pupil detection sensor configured to detect a driver's pupil and generate pupil position data; a driver posture detection sensor configured to detect the driver's position, body orientation and head height, and to generate posture data; a calculation unit configured to calculate the position of the driver's field of vision based on pupil position data and posture data, and to generate a display correction value based on the position of the field of vision; and a display correction device configured to adjust a horizontal skew and a vertical skew of each of the multiple display fields based on the display correction value.
Need to check novelty before this filing date? Find Prior Art

Description

GENERAL STATE OF THE ART 1. Area

[0001] Embodiments of the present disclosure relate to a vehicle display system and a method for controlling it, in particular a vehicle system capable of improving the visibility of a vehicle's surroundings by automatically correcting a tilt of a display device configured to replace or assist a side mirror, and a control method therefor. 2. Description of the state of the art

[0002] Side mirrors are typically mounted on both outer sides of a vehicle to monitor traffic conditions at the left and right rear. They are positioned so that they protrude considerably towards the outside of the vehicle to provide sufficient visibility of both the left and right rear sides.

[0003] A method has recently been proposed in which a display module, such as a liquid crystal display (LCD), is additionally equipped with a side mirror to display camera images. However, a conventional electric mirror system has the problem that a display module for showing images of the left and right rear sides, captured by a camera, is fixed in place regardless of the driver's condition, thus causing a deterioration of the vehicle's visibility.

[0004] US 2014 / 0097748A1 discloses a system for detecting the environmental conditions of moving bodies, the system disclosing multiple cameras oriented forward, backward and sideways from the vehicle.

[0005] DE 10 2013 013 227 A1 discloses a motor vehicle with a display unit and protection against driver distraction, wherein a camera records the interior of a vehicle, a screen displays content to a passenger, the attitude of a driver is recorded by a monitoring device and a field of vision of the driver is determined.

[0006] US 2016 / 0139409A1 discloses a head-up display and a vehicle using this display, wherein a camera records the interior of a vehicle, a screen displays content, a monitoring device records the posture of a driver, and a horizontal tilt and vertical tilt of a display field are adjusted by correction data.

[0007] DE 10 2013 202 219 A1 discloses a conventional method and a device for operating a head-up display unit, wherein a pupil size is detected.

[0008] DE 10 2014 016 225 B4, US 2010 / 0 066 832 A1 and US 2002 / 0 175 564 A1 disclose further conventional methods for operating a display device of a motor vehicle and display systems for a motor vehicle and motor vehicles with a display system. SUMMARY

[0009] Therefore, a key focus of the present disclosure is to provide a vehicle display system capable of automatically correcting the tilt of a display device according to the driver's condition, and a method for controlling it.

[0010] Additional aspects of the present revelation are partly set forth in the following description, and partly become apparent from the description or can be learned through the practice of the revelation.

[0011] According to one aspect of the present disclosure, a vehicle display system includes several camera modules configured to capture and generate image data of a front, rear, left rear, and right rear relative to the vehicle; several display panels configured to receive the image data and display front-side images, rear-side images, left rear images, and right rear images relative to the vehicle; a driver pupil detection sensor configured to detect a driver's pupil and generate pupil position data; a driver posture detection sensor configured to detect the driver's position, body orientation, and head height and generate posture data; and a computing unit configured toto calculate the position of the driver's field of vision based on pupil position data and posture data, and to generate display correction values ​​based on the position of the field of vision, and a display correction device configured to adjust horizontal and vertical tilt of the multiple display fields based on the display correction values.

[0012] The multiple display fields can include a first display field configured to show the front side images relative to the vehicle, a second display field configured to show the rear side images relative to the vehicle, a third display field configured to show the rear left side images relative to the vehicle, and a fourth display field configured to show the rear right side images relative to the vehicle.

[0013] The display correction device can adjust the vertical tilt of each of the first to fourth display fields in an upward or downward direction based on the display correction values.

[0014] The display correction device can adjust the horizontal tilt of each of the first to fourth display fields in a leftward or rightward direction based on the display correction values.

[0015] The computing unit may include a memory configured to store driver analysis result data, obtained by determining the size, build, posture, face size, interorbital width, and eye shape of each of several people, and to calculate an absolute position of the driver's field of vision based on the analysis result data.

[0016] According to another aspect of the present disclosure, a vehicle display system includes a camera module configured to record a vehicle environment, a display field configured to display images captured by the camera module, a driver pupil detection sensor configured to detect a driver's pupil, a driver posture detection sensor configured to detect the driver's posture, a computation unit configured to calculate display correction values ​​of the display field based on the detected pupil and the detected driver posture, and a display correction device configured to adjust the horizontal skew and vertical skew of the display field according to the calculated display correction values.

[0017] According to yet another aspect of the present disclosure, a control method of a vehicle display system includes detecting a driver's pupil and generating pupil position data, detecting a driver's posture, body orientation and head height and generating driver posture data, calculating a position of the driver's field of vision based on the pupil position data and the driver posture data, generating display correction values ​​based on the position of the driver's field of vision, and adjusting the horizontal tilt and vertical tilt of each of several display fields based on the display correction values.

[0018] The procedure may also include adjusting the vertical tilt of each of the multiple display fields in an upward or downward direction based on the display correction values.

[0019] The procedure may also include adjusting the horizontal tilt of each of the multiple display fields in a leftward or rightward direction based on the display correction values.

[0020] The procedure may further include storing driver analysis result data, obtained by determining the size, build, posture, face size, interorbital width, and eye shape of each of several people, in a memory and calculating an absolute position of the driver's field of vision based on the driver analysis result data.

[0021] According to yet another aspect of the present disclosure of a method for controlling a vehicle display system, the method includes detecting a driver's pupil position, detecting the driver's posture, and adjusting at least one horizontal tilt and one vertical tilt of a display device based on the detected pupil position of the driver and the posture detected by him. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] These and / or other aspects of the present disclosure will become apparent and more readily understandable from the following description of the embodiments in conjunction with the accompanying drawings, wherein: Fig. 1 shows a graphic representation illustrating a display system of a vehicle according to an embodiment of the present disclosure; Fig. 2 a graphic representation showing a display device that is in Fig. 1 is shown, illustrated; Fig. 3 and Fig. Four graphical representations illustrate a case in which a vertical tilt is set by both a left-hand display field and a right-hand display field; Fig. 5 and Fig. Six graphical representations illustrate a case in which a horizontal tilt is set for both the left-hand display field and the right-hand display field; and Fig. Figure 7 shows a flowchart illustrating a control procedure of a vehicle display system according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] Embodiments of the present disclosure are described below in full detail, suitable for implementation by a person skilled in the art with reference to the accompanying drawings. The present disclosure can be implemented in several different forms and is therefore not limited to the embodiments described herein.

[0024] In order to clearly describe the present revelation, some sections that do not relate to the description are omitted and not shown, and throughout the revelation, identical or similar components are assigned the same reference signs.

[0025] When the revelation describes a section as being “connected” to another section, this includes both a case where the section is “directly connected” to another section and a case where the section is “electrically connected” to the other section by the insertion of another element. Furthermore, when a component is described as “included in” a section, this does not mean that the component is excluded, but rather that other components are contained within it.

[0026] When a section is described as "at" another section, it can be directly adjacent to the other section, or another section can be inserted between them. Conversely, when a section is described as "directly above" another section, no other section can be inserted between them.

[0027] The terms first, second, third, and similar terms are used to describe different sections, components, regions, layers, and / or subsections, but are not limited to doing so. These terms are used merely to distinguish one section, component, region, layer, or subsection from another. Therefore, a first section, first component, first region, first layer, or first subsection described herein may be referred to as a second section, second component, second region, second layer, or second subsection without altering the scope of this disclosure.

[0028] The technical terms used herein are intended to describe only certain embodiments and are not intended to limit the present disclosure. As used herein, singular forms include the plural forms unless the context clearly indicates otherwise. The meaning of "including" is used here to further specify a particular feature, area, integer, step, action, element, and / or component and is not intended to preclude the presence or addition of any other feature, area, integer, step, action, element, and / or component.

[0029] Terms indicating relative space, such as "below," "above," and the like, can be used to more easily describe the relationship of one section shown in the drawing to another. These terms encompass alternative meanings or modes of operation of a fixture used, as well as its intended meanings in the drawings. For example, if a fixture shown in the drawings is inverted, some sections described as "below" other sections will be described as "above" them. Therefore, an example term "below" includes both upward and downward directions. A fixture can be rotated by 90° or various other angles, and thus expressions indicating relative space should be interpreted according to the rotation of the fixture.

[0030] Unless otherwise defined, all terms used herein that include technical or scientific terms have the same meanings as they are generally understood by a person skilled in the art to whom the present invention is relevant. Furthermore, terms that are commonly used and defined in a dictionary should be interpreted to have meanings consistent with the relevant technical documents and the present disclosure, and, unless otherwise defined, should not be interpreted as ideal or strictly formal meanings.

[0031] Embodiments of the present disclosure are described below in full detail, suitable for application by a person skilled in the art with reference to the accompanying drawings. However, the present disclosure can be implemented in several different forms and is therefore not limited to the embodiments described herein.

[0032] Fig. Figure 1 shows a graphic representation illustrating a display system of a vehicle according to an embodiment of the present disclosure.

[0033] With reference to Fig. 1, a display system 100 of a vehicle according to the embodiment of the present disclosure comprises a driver pupil detection sensor 110, a driver posture detection sensor 120, a calculation unit 130, a display correction device 140, a display device 150, a first camera module 160, a second camera module 170, a third camera module 180 and a fourth camera module 190.

[0034] The driver pupil detection sensor 110 is positioned inside the vehicle, pointed towards the driver, and detects the driver's pupil to determine its position. A camera can be used as the driver pupil detection sensor 110, which uses infrared beams to detect the pupil's position. The driver pupil detection sensor 110 can detect the position of both the driver's left and right pupils to generate pupil position data. This data can include pupil position, pupil coordinates, gaze, and other facial features of the driver.

[0035] The driver pupil detection sensor 110 transmits the pupil position data to the calculation unit 130.

[0036] The driver posture detection sensor 120 detects the driver's posture.

[0037] The driver posture detection sensor 120 can include multiple weight detection sensors located inside a driver's seat and a camera sensor located in front of the driver.

[0038] The multiple weight sensors that comprise the driver posture sensor 120 detect the driver's weight. The driver's posture is then determined based on this weight, as detected by the multiple weight sensors 120 located at various points on the driver's seat. Furthermore, the camera sensor, which forms the driver posture sensor 120, captures the driver seated in the driver's seat. The driver posture sensor 120 then detects the height and size of the driver's head while seated and determines whether the driver's body is facing forward or tilted to the left or right. If the driver's body is tilted to the left or right, the driver posture sensor 120, based on the front view, detects the degree of tilt.The driver posture detection sensor 120 generates posture data that includes information about the driver's posture, body orientation and head height, and transmits the generated posture data to the calculation unit 130.

[0039] The calculation unit 130 can calculate display correction values ​​for the display device 150 to improve the driver's vision using pupil position and posture data. Based on the pupil position data received from the driver pupil detection sensor 110 and the posture data received from the driver posture detection sensor 120, the calculation unit 130 calculates the driver's field of vision. The driver's field of vision can include a position within that field of vision. This position can be either relative or absolute.

[0040] Since height, build, posture, face size, interorbital width, and eye shape vary from person to person, the height, build, posture, face size, interorbital width, and eye shape of each of several individuals were previously studied using a neural network algorithm, such as deep learning, and the resulting analysis data was stored in a memory of the computational unit 130 for the driver. The computational unit 130 then calculates the driver's field of vision position using this analysis data for build, posture, face size, interorbital width, and eye shape from each of the several individuals.

[0041] The calculation unit 130 can calculate the display correction values ​​of the display device 150 using the driver's field of vision. The calculation unit 130 can calculate the display correction values ​​of the display device 150 using the driver's field of vision and the current position and tilt values ​​of the display device 150 in order to improve the driver's visibility.

[0042] The calculation unit 130 calculates the display correction values ​​of the display device 150 using position values ​​of the driver's field of vision. The calculation unit 130 can calculate the display correction values ​​of the display device 150 using the position values ​​of the driver's field of vision and the current position and tilt values ​​of the display device 150.

[0043] The calculation unit 130 transmits the calculated display correction values ​​to the display correction device 140. Using these values, the vertical and horizontal skew of each of the multiple display fields that make up the display device 150 can be adjusted. This means that the display correction values ​​contain data about the extent to which the vertical and horizontal skew of each of the multiple display fields is adjusted.

[0044] The first camera module 160 is located inside or outside the vehicle to capture images of the front of the vehicle in front of it and to generate front-side image data. The front-side image data generated in the first camera module 160 is transmitted to the display device 150.

[0045] The second camera module 170 is located inside or outside the vehicle to capture images of the rear side behind the vehicle and to generate rear-side image data. The rear-side image data generated in the second camera module 170 is transmitted to the display device 150.

[0046] The third camera module 180 is located inside or outside the vehicle to capture images of the rear left side next to the vehicle and to generate image data of the rear left side. The image data of the rear left side generated in the third camera module 180 is transmitted to the display device 150.

[0047] The fourth camera module 190 is located inside or outside the vehicle to capture images of the rear right side next to the vehicle and to generate image data of the rear right side. The image data of the rear right side generated in the fourth camera module 190 is transmitted to the display device 150.

[0048] Fig. Figure 2 shows a graphic representation of a display device 150, which is in Fig. Figure 1 illustrates this.

[0049] With reference to Fig. 2. The display device 150 is arranged inside the vehicle and, for example, can be integrated into a dashboard. The display device 150 includes a first display module 152, a second display module 154, a third display module 156, a fourth display module 158, and a control circuit (not shown) configured to control the first through fourth display modules 152, 154, 156, and 158.

[0050] The first display module 152 displays front-side images in front of the vehicle using the front-side image data received from the first camera module 160.

[0051] The second display module 154 displays rear-side images behind the vehicle using the rear-side image data received from the second camera module 170.

[0052] The third display module 156 displays images of the rear left side next to the vehicle using the image data of the rear left side received from the third camera module 180.

[0053] The fourth display module 158 displays images of the rear right side next to the vehicle using the image data of the rear right side received from the fourth camera module 190.

[0054] Referring back to Fig. 1, the display correction device 140 provides a vertical skew and a horizontal skew of both the first display module 152, which is configured to display the front side images, the second display module 154, which is configured to display the rear side images, the third display module 156, which is configured to display the rear left side images, and the fourth display module 158, which is configured to display the rear right side images.

[0055] Fig. 3 and Fig. Figure 4 are graphical representations illustrating a case in which a vertical tilt is set by both a left-hand display field and a right-hand display field. Fig. 3 and Fig. 4 illustrate and describe an example in which a vertical tilt is set for both the third display module 156, which is configured to display the images of the rear left side, and the fourth display module 158, which is configured to display the images of the rear right side.

[0056] With reference to Fig. 3, the display correction device 140 can adjust the vertical tilt of both the third display module 156, which is configured to display the rear left images, and the fourth display module 158, which is configured to display the rear right images, based on the received display correction values ​​in a downward direction (e.g. a negative direction).

[0057] The display correction device 140 can adjust the vertical tilt of the third display module 156 in the downward direction such that the third display module 156, which is in Fig. 3(a) is shown, which is in Fig. 3(b) can be set.

[0058] The display correction device 140 can adjust the vertical tilt of the fourth display module 158 in the downward direction such that the fourth display module 158, which is in Fig. 3(c) is shown, which is in Fig. 3(d) can be set.

[0059] With reference to Fig. 4, the display correction device 140 can adjust the vertical tilt of both the third display module 156, which is configured to display the rear left images, and the fourth display module 158, which is configured to display the rear right images, based on the received display correction values ​​in an upward direction (e.g. a positive direction).

[0060] The display correction device 140 can adjust the vertical tilt of the third display module 156 in the upward direction such that the third display module 156, which is in Fig. 4(a) is shown, which is in Fig. 4(b) can be set.

[0061] The display correction device 140 can adjust the vertical tilt of the fourth display module 158 in the upward direction such that the fourth display module 158, which is in Fig. 4(c) is shown, which is in Fig. 4(d) can be set.

[0062] Although in the Fig. 3 and Fig. 4 not shown, the display correction device 140 can adjust the vertical tilt of both the first display module 152, which is configured to display the front side images, and the second display module 154, which is configured to display the rear side images, based on the received display correction values.

[0063] Fig. 5 and Fig. Figure 6 shows illustrations that demonstrate a case in which a horizontal tilt is set for both the left-hand display field and the right-hand display field. Fig. 5 and Fig. 6 illustrate and describe an example in which the horizontal tilt is set by both the third display module 156, which is configured to display the images of the rear left side, and the fourth display module 158, which is configured to display the images of the rear right side.

[0064] With reference to Fig. 5, the display correction device 140 can adjust the horizontal tilt of both the third display module 156, which is configured to display the images of the rear left side, and the fourth display module 158, which is configured to display the images of the rear right side, based on the received display correction values ​​in a leftward direction (e.g. a negative direction).

[0065] The display correction device 140 can adjust the horizontal tilt of the third display module 156 in the left direction such that the third display module 156, which is in Fig. 5(a) is shown, which is in Fig. 5(b) can be set.

[0066] The display correction device 140 can adjust the horizontal tilt of the fourth display module 158 in the clockwise direction such that the fourth display module 158, which is in Fig. 5(c) is shown, which is in Fig. 5(d) can be set.

[0067] With reference to Fig. 6, the display correction device 140 can adjust the horizontal skew of both the third display module 156, which is configured to display the rear left images, and the fourth display module 158, which is configured to display the rear right images, based on the received display correction values ​​in a clockwise direction (e.g. a positive direction).

[0068] The display correction device 140 can adjust the horizontal tilt of the third display module 156 in the right-hand direction such that the third display module 156, which is in Fig. 6(a) is shown, which is in Fig. 6(b) can be set.

[0069] The display correction device 140 can adjust the horizontal tilt of the fourth display module 158 in the clockwise direction such that the fourth display module 158, which is in Fig. 6(c) is shown, which is in Fig. 6(d) can be set.

[0070] Although in the Fig. 5 and Fig. 6 not shown, the display correction device 140 can adjust the horizontal tilt of both the first display module 152, which is configured to display the front side images, and the second display module 154, which is configured to display the rear side images, based on the received display correction values.

[0071] As described above, the display system 100 of a vehicle, according to the embodiment of the present disclosure, automatically corrects the vertical and horizontal tilt of each of the multiple display modules that form the display device 150 according to the driver's height, thus improving the visibility of the vehicle's surroundings. Furthermore, the display system 100 automatically corrects the vertical and horizontal tilt of each of the multiple display modules that form the display device 150 according to the driver's posture, thus improving the visibility of the vehicle's surroundings. Finally, the display system 100 automatically corrects the vertical and horizontal tilt of each of the multiple display modules that form the display device 150 according to the driver's field of vision, thus improving the visibility of the vehicle's surroundings.

[0072] Fig. Figure 7 shows a flowchart illustrating a control procedure of a vehicle display system according to an embodiment of the present disclosure.

[0073] With reference to Fig. 7. The driver's pupil is detected by the driver pupil detection sensor 110 (process 10). A camera can be used as the driver pupil detection sensor 110, which can detect the position of the pupil by emitting infrared beams towards the pupil. The driver pupil detection sensor 110 can detect the position of each of the driver's left and right pupils and generate pupil position data. The driver pupil detection sensor 110 transmits the pupil position data to the processing unit 130.

[0074] The driver posture sensor 120 then detects the driver's weight, and the driver's posture is determined according to the weight detected by the multiple weight sensors 120 located at different points in the driver's seat. Furthermore, the camera sensor forming the driver posture sensor 120 captures the driver seated in the driver's seat, and the driver posture sensor 120 then detects the height of the driver's head and seat height and assesses whether the driver's body is facing forward or tilted to the left or right in order to detect the driver's posture (process 20).

[0075] If the rider's body is tilted to the left or right, the rider posture sensor 120 detects the degree of tilt based on the front view. The rider posture sensor 120 generates posture data, including information about the rider's posture, body orientation, and head height, and transmits this data to the processing unit 130.

[0076] Subsequently, the calculation unit 130 calculates a field of vision of the driver based on the pupil position data received from the driver pupil detection sensor 110, and the posture data received from the driver posture detection sensor 120 (process 30).

[0077] The calculation unit 130 calculates the driver's field of vision using the analysis result data about body type, posture, face size, interorbital width and eye shape of each of several people.

[0078] Next, the calculation unit 130 calculates display correction values ​​using the driver's field of vision (process 40).

[0079] The calculation unit 130 then transmits the calculated display correction values ​​to the display correction device 140. Using these values, a vertical and a horizontal tilt can be set for each of the multiple display fields that make up the display device 150. In other words, the display correction values ​​contain data about the extent to which the vertical and horizontal tilt of each of the multiple display fields is adjusted.

[0080] Subsequently, the display correction device 140 sets the vertical skew and the horizontal skew of both the first display module 152, which is configured to display front side images, the second display module 154, which is configured to display rear side images, the third display module 156, which is configured to display rear left side images, and the fourth display module 158, which is configured to display rear right side images (operation 50).

[0081] As in Fig. 3 and Fig. As shown in Figure 4, the display correction device 140 can adjust the vertical tilt of both the third display module 156, which is configured to display the rear left images, and the fourth display module 158, which is configured to display the rear right images, based on the received display correction values ​​in a downward direction (e.g. a negative direction) or an upward direction (e.g. a positive direction).

[0082] As in Fig. 5 and Fig.As shown in Figure 6, the display correction device 140 can adjust the horizontal tilt of both the third display module 156, which is configured to display the images of the rear left side, and the fourth display module 158, which is configured to display the images of the rear right side, based on the received display correction values ​​in a left direction (e.g. a negative direction) or a right direction (e.g. a positive direction).

[0083] As described above, the method for controlling a vehicle display system according to the embodiment of the present disclosure automatically corrects the vertical tilt and the horizontal tilt of each of the multiple display modules forming the display device 150 according to a condition of the driver, such as the size of the driver, his position, his field of vision and the like, so that the visibility of a vehicle environment can be improved.

[0084] As can be seen from the above description, the vertical tilt and the horizontal tilt of the display device can be automatically corrected according to the size of the driver, so that the visibility of a vehicle's surroundings can be improved.

[0085] Furthermore, the vertical tilt and the horizontal tilt of the display device can be automatically corrected according to the driver's position in accordance with the embodiments of the present disclosure, so that the visibility of the vehicle's surroundings can be improved.

[0086] Furthermore, the vertical tilt and the horizontal tilt of the display device can be automatically corrected in accordance with the embodiments of the present disclosure according to the driver's field of vision, so that the visibility of the vehicle environment can be improved.

[0087] In one or more embodiments, the described functions can be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, these functions can be stored as one or more commands or codes on or transmitted to a computer-readable medium. Computer-readable media include both a communication medium and a storage medium, which can be any medium capable of transferring a computer program from one location to another. The storage medium can be any usable medium accessible by a computer.As an example, and not as a limitation, such a computer-readable medium may include working memory (RAM), read-only memory (ROM), electrically erasable and programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM), other optical storage media, magnetic disk storage, other magnetic storage devices, or any other medium that can be used to transmit or store a desired program code in the form of an instruction or a data structure and that is accessible by a computer. Likewise, any connection is properly referred to as a computer-readable medium.For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair cable, digital subscriber line (DSL), or wireless technologies using infrared, radio, and ultra-high frequencies, the definition of a computer-readable medium includes the coaxial cable, fiber optic cable, twisted pair cable, DSL, or wireless technologies such as infrared, radio, and ultra-high frequencies. Disks and discs include a compact disc (CD), a laserdisc, an optical disc, a digital versatile disc (DVD), a floppy disk, and a Blu-ray disc, and disks reproduce data magnetically, while discs reproduce data optically. A combination of the disks and discs described above should also be included in the scope of the computer-readable medium.

[0088] When the embodiments are implemented in program code or code segments, the code segment should be recognized as representing a procedure, function, subroutine, program, routine, module, software package, class, commands, data structures, or any combination of program instructions. The code segment may be connected to another code segment or hardware circuitry by transmitting and / or receiving information, data, arguments, parameters, or memory contents. The information, arguments, parameters, and data may be delivered, sent, or transmitted using any suitable means, including memory sharing, message transmission, token passing, network transmission, and the like.Alternatively, steps and / or operations of a procedure or algorithm relating to certain aspects may be located on a machine-readable and / or computer-readable medium that can be integrated as a computer program object as one of codes and / or commands or any combination or set of codes and / or commands.

[0089] In software implementation, the techniques described here can be implemented using modules (for example, procedures, functions, and the like) that execute the functions described here. Software code can be stored in memory units and executed by processors. The memory units can be implemented internally or externally within the processor, and in the latter case, the memory units can be communicatively connected to the processor by various known means.

[0090] In a hardware implementation, processing units can be implemented in one or more user-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, other electronic units designed to perform the functions described above, or a combination thereof.

[0091] Furthermore, the terms "component," "module," "system," and similar terms, as used in this application, include, but are not limited to, computer-related entities such as hardware, firmware, a combination of hardware and software, software, or software that is executed. For example, a component may be a process running on a processor, a processor, an object, an executable execution thread, a program, and / or a computer, without limitation. For example, both a computer device and an application running on the computer device may be components. One or more components may reside in a process and / or execution thread, and the components may be aggregated on a single computer and / or distributed among two or more computers.Furthermore, these components can be executed from various computer-readable media that store different data structures. The components can be transmitted by a local and / or remote process according to a signal that contains one or more data packets (e.g., data sent by any component and interacting with another system over a network, such as the internet, through another component and / or another signal from a local or distributed system).

Claims

[1] Display system of a vehicle, comprising: multiple camera modules configured to record a front, a rear, a rear left side and a rear right side relative to the vehicle and generate image data; multiple display modules configured to receive image data and display a front side image, a rear side image, a rear left side image, and a rear right side image relative to the vehicle; a driver pupil detection sensor configured to detect a driver's pupil and generate pupil position data; a driver posture detection sensor configured to detect the driver's position, body orientation and head height, and to generate posture data; a calculation unit configured to calculate the position of the driver's field of vision based on pupil position data and posture data, and to generate a display correction value based on the position of the field of vision; and a display correction device configured to adjust a horizontal skew and a vertical skew of each of the multiple display fields based on the display correction value. [2] System according to claim 1, wherein the multiple display fields comprise the following: a first display field that is configured to show the front side image relative to the vehicle; a second display field configured to show the rear side image relative to the vehicle; a third display field configured to show the image of the rear left side relative to the vehicle; and a fourth display field that is configured to show the image of the rear right side relative to the vehicle. [3] System according to claim 2, wherein the display correction device sets a vertical tilt of each of the first to fourth display fields in an upward direction or a downward direction based on the display correction value. [4] System according to claim 2, wherein the display correction device sets a horizontal tilt of each of the first to fourth display fields in a left direction or a right direction based on the display correction value. [5] System according to claim 1, wherein the computation unit includes a memory configured to store driver analysis result data obtained by determining a size, physique, posture, face size, interorbital width, and eye shape of each of several persons, and calculates an absolute position of the driver's field of vision based on the analysis result data. [6] Display system of a vehicle, comprising: a camera module for recording the vehicle's surroundings; a display field configured to show an image captured by the camera module; a driver pupil detection sensor configured to detect a driver's pupil; a driver posture detection sensor configured to detect the driver's posture; a calculation unit configured to calculate a display correction value based on the driver's detected pupil and posture; and a display correction device configured to adjust a horizontal skew and a vertical skew of the display field according to the calculated display correction value. [7] Method for controlling a vehicle display system comprising: Capturing a driver's pupil and generating pupil position data; Capturing the driver's position, body orientation, and head height, and generating driver posture data; Calculating the position of the driver's field of vision based on pupil position data and driver posture data; Generating a display correction value based on the driver's field of vision position; and based on the display correction value, setting a horizontal tilt and a vertical tilt of each of the multiple display fields arranged on the vehicle. [8] Method according to claim 7, further comprising adjusting the vertical tilt of each of the multiple display fields in an upward direction or a downward direction based on the display correction value. [9] Method according to claim 7, further comprising adjusting the horizontal tilt of each of the multiple display fields in a left-hand direction or a right-hand direction based on the display correction value. [10] The method of claim 7, further comprising: Storing driver analytics result data, obtained by learning a size, build, posture, face size, interorbital width, and face shape from each of several people, in a memory; and Calculating the absolute position of the driver's field of vision based on driver analysis result data. [11] Method for controlling a vehicle display system, comprising: Capturing a driver's pupil position; Detecting the driver's posture; and Adjusting at least one horizontal tilt and one vertical tilt of a display device based on the detected pupil position of the driver and his detected posture.

Citation Information

Patent Citations

  • Motor vehicles with display unit and safety device to prevent driver distraction

    DE102013013227A1

  • Method and apparatus for operating a head-up display unit

    DE102013202219A1

  • Method for operating a display device of a motor vehicle and display system for a motor vehicle and motor vehicle with a display system

    DE102014016225B4

  • Input / output device for mounting in vehicle

    US20020175564A1

  • Head up display

    US20100066832A1