Display system and vehicle

Abstract

The invention provides a display system which can be applied to a vehicle. The display system provided by the invention not only can provide intelligent visual experience for passengers in the cabin, but also can give consideration to the aesthetics of the cabin. The display system comprises a display device and a first driving device. The display device is installed in an instrument desk of a cabin and comprises an image generation unit, an image amplification unit, a window unit and a shell. The image generation unit, the image amplification unit and the window unit are used for generating a virtual image watched by human eyes. The shell is used for wrapping the image generation unit and the image amplification unit. Wherein the end, away from the fourth surface, of the third surface is connected with the upper edge of the window unit, and the end, away from the third surface, of the fourth surface is connected with the lower edge of the window unit, so that the display device forms a closed whole with an internal space, and meanwhile, the first surface is wrapped in the internal space. The first driving device is used for adjusting the state of the display device to be a storage state or a display state.

Description

Technical Field

[0001] The embodiments of the present application relate to the fields of display technology and intelligent automobile driving technology, and more specifically, to a display system and a vehicle. Background Art

[0002] Cars have become an indispensable means of transportation in people's daily lives. With the development of intelligent cars, people's application needs for cars have been upgraded from simple transportation to living spaces with certain information acquisition and entertainment enjoyment. Among them, in-vehicle display technology has become a hot research direction. By installing in-vehicle display devices in cars, passengers in the car can obtain information or watch entertainment and other activities through the in-vehicle display devices, thus providing intelligent application scenarios for the cockpit space.

[0003] In some cockpits, the display device is installed on the car dashboard. How to balance the aesthetics of the dashboard and ensure the functionality of the display device to enhance the user's viewing experience is a problem that needs to be solved. Summary of the invention

[0004] The present application provides a display system and a vehicle. The display system provided by the present application can not only provide an intelligent visual experience for passengers in the cabin, but also take into account the aesthetics of the cabin.

[0005] In a first aspect, an embodiment of the present application provides a display system. It includes: a display device and a first driving device, wherein the display device is installed in the instrument panel of the cockpit, the display device includes an image generating unit, an image magnifying unit, a window unit and a housing, the window unit includes a first surface and a second surface, the housing includes a third surface and a fourth surface, and an end of the third surface close to the fourth surface is tightly connected to an end of the fourth surface close to the third surface, wherein: the image generating unit is used to emit a first imaging light to the window unit, and the first imaging light is used to generate a first virtual image; the window unit is used to reflect the first imaging light from the image generating unit to the image magnifying unit on the first surface, and transmit the first imaging light from the image magnifying unit from the first surface to the second surface, so that the human eye can view the first virtual image through the first imaging light emitted from the second surface; the image magnifying unit is used to reflect the first imaging light from the window unit The first imaging light is directed to the window unit; the outer shell is used to wrap the image generating unit and the image magnifying unit, wherein an end of the third surface away from the fourth surface is connected to the upper edge of the window unit, and an end of the fourth surface away from the third surface is connected to the lower edge of the window unit, so that the display device constitutes a closed whole with an internal space, and the first surface of the window unit is wrapped in the internal space; the first driving device is used to adjust the state of the display device to a storage state or a display state, wherein the storage state is that the second surface is embedded in the instrument panel, so that the third surface constitutes a part of the knee guard of the instrument panel, and the fourth surface constitutes a part of the table top of the instrument panel, and the display state is that the third surface is separated from the knee guard of the instrument panel, and the fourth surface is separated from the table top of the instrument panel, so that the second surface is opposite to the human eye.

[0006] It should be noted that in the present application, the display device can be installed in the main driver's instrument panel, or in the co-pilot's instrument panel, or in both the main driver's instrument panel and the co-pilot's instrument panel, and this application does not limit it.

[0007] It should also be noted that the display system provided in the present application can automatically switch the state of the display device, or it can switch the state of the display device based on the manual operation of the user. Exemplarily, when the display system automatically switches the state of the display device, the first drive device can be implemented by electric, magnetic, etc. At this time, the first drive device can be a motor or a magnet. For example, when some detectors detect that a user is sitting on the seat, the first drive device starts automatic switching, so that the display device stored in the driving console is moved out of the driving console, and the state is changed to the display state. When the display system manually switches the state of the display device, the first drive device can be a manual rocker, a manual rotary valve, etc.

[0008] It should be noted that in the present application, when the display device is in the display state, it does not necessarily provide a display image to the user, which depends on whether the display device is loaded with an image source or a video source, or whether the user needs to watch, etc. For example, in some scenarios, when it is detected that a user is sitting on a seat, the display system automatically changes the state of the display device to the display state. When the user wants to watch an image or video, the user provides a video source to the display device, or the user turns on the video source connected to the display device, etc. At this time, the display device provides a display image to the user.

[0009] Based on the above scheme, the display system provided by the present application, when the display device is in the storage state, the user does not use the display device to watch videos and images, and the display device is stored in the instrument panel, thereby saving the space of the instrument panel. At the same time, when stored in the instrument panel, the window unit of the display device is further protected to avoid scratches and other damages. At the same time, the display device in the storage state can also not cause secondary harm to the user in the event of a safety accident. When the display device is in the display state, the user watches the video image through the imaging light emitted from the second surface of the window unit to meet the user's intelligent cockpit experience.

[0010] In combination with the first aspect, in certain implementations of the first aspect, when the display device is in a retracted state, the curvature of the connection between the third surface and the fourth surface is the same as the curvature of the knee guard to the table top.

[0011] Based on the above solution, the third surface and the fourth surface of the display device can be made to form a seamless effect with the knee guard and the instrument panel surface respectively, thereby improving the aesthetics of the cockpit system.

[0012] In combination with the first aspect, in certain implementations of the first aspect, when the display device is in a display state, the table top and a position for storing the display device present a stepped surface.

[0013] In combination with the first aspect, in some implementations of the first aspect, the first driving device is installed inside the display device or in the instrument panel.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the display device also includes a connecting unit, which is connected to the first driving device, and the first driving device is specifically used to drive the connecting unit to work; the connecting unit is used to adjust the state of the display device to a storage state or a display state when working.

[0015] In combination with the first aspect, in some implementations of the first aspect, the first driving device is further used to adjust the first angle of the display device to a second angle, so that the user views the first virtual image at the second angle through the window unit.

[0016] It should be noted that, in the present application, the angle of the display device (including the first angle and the second angle) can be the pitch angle of the display device. When the display device is adjusted from the first angle to the second angle, the display device can be shaken up and down in the vertical direction, similar to the "nodding" effect; or, the angle of the display device can be the swing angle of the display device (or called the horizontal deflection angle). When the display device is adjusted from the first angle to the second angle, the display device can be shaken left and right in the horizontal direction, similar to the "shaking head" effect; or, the angle of the display device can be the pitch angle and the swing angle of the display device that change simultaneously. When the display device is adjusted from the first angle to the second angle, the display device can be adjusted in the entire spatial angle.

[0017] In the present application, the angle of the display device can be automatically or manually adjusted according to the function of the first driving device. When the angle of the display device is automatically adjusted, the intelligent performance of the vehicle display system can be improved, thereby providing users with a smarter experience.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the display system also includes a first acquisition device and a processing device, the first acquisition device and the processing device are connected, the first acquisition device is used to acquire one or more first images containing the human eye when the display device is at the first angle, and send the one or more first images to the processing device; the processing device generates a first adjustment amount based on the one or more first images, and sends the first adjustment amount to the first driving device; the first driving device is specifically used to adjust the first angle to the second angle according to the first adjustment amount.

[0019] The display system provided in the present application can generate an angle adjustment amount according to one or more images including the human eye, so that the display system provided in the present application can achieve an automatic adjustment effect according to the human eye.

[0020] In combination with the first aspect, in certain implementations of the first aspect, the first acquisition device is further used to acquire one or more second images including the human eye when the display device is at a second angle, and send the one or more second images to the processing device; the processing device also generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit; the image generation unit is used to generate an image of corresponding size according to the second adjustment amount, and emit second imaging light; the window unit is used to reflect the second imaging light from the image generation unit to the image magnification unit, and transmit the second imaging light from the image magnification unit, so that the user can view the second virtual image formed by the second imaging light at the second angle through the window unit; the image magnification unit is used to reflect the second imaging light from the window unit to the window unit.

[0021] Based on the above scheme, the display system provided in the embodiment of the present application can not only adjust the angle of the display device, but also further calculate the size of the virtual image based on one or more second images, thereby ensuring that the user can view the complete virtual image when the angle cannot be adjusted (for example, reaching the limit of the angle adjustment of the display device), thereby further improving the reliability of the display system performance.

[0022] In combination with the first aspect, in some implementations of the first aspect, the display system further includes: a second acquisition device, a seat, and a second drive device, a user sits on the seat to view the first virtual image, the second drive device is connected to the seat, and the second drive device is connected to the processing device. The second acquisition device is used to acquire user information and send the user information to the processing device; the processing device is used to generate a third adjustment amount according to the user information and the relative height between the height of the display device and the height of the human eye, and send the third adjustment amount to the second drive device, wherein the height of the display device is the height of the center of the window unit of the display device relative to the ground of the cabin, the height of the human eye is the height of the human eye relative to the ground of the cabin, and the relative height between the height of the display device and the height of the human eye satisfies that the user is within the viewing angle range when viewing the first virtual image; the second drive device is used to adjust the height of the seat according to the third adjustment amount. In combination with the first aspect, in some implementations of the first aspect, the viewing angle θ has a value range of -1.5°≤θ1≤0°.

[0023] Based on the above scheme, the present application provides a display system that can adjust the height of the display device relative to the height of the human eye by adjusting the height of the seat, thereby satisfying the user's need to be within the viewing angle range when viewing the virtual image of the display device, thereby improving the user experience.

[0024] In combination with the first aspect, in certain implementations of the first aspect, the user information includes at least one of the following: the height of the human eye, the height of the user, the position of the human eye in the image, and the weight of the user.

[0025] In a second aspect, an embodiment of the present application provides a processing device. Applicable to the display system provided by the above-mentioned first aspect and any one of the implementations of the first aspect. The processing device may include one or more units and / or modules. The processing device may include an input / output interface. Optionally, the input / output interface may be an input / output circuit.

[0026] Alternatively, the processing device may be a chip, a chip system or a processor, a processing circuit or a logic circuit, etc.

[0027] For the acquisition and other operations involved in the processing device, if there is no special explanation, or if they do not conflict with their actual function or internal logic in the relevant description, they can be understood as processor reception, input and other operations, and this application does not limit this.

[0028] In a third aspect, an embodiment of the present application provides a chip, which includes the processing device and the communication interface described in the second aspect, and the processor obtains user information through the communication interface.

[0029] In a fourth aspect, an embodiment of the present application provides a cockpit system, which includes a display system provided by the above-mentioned first aspect and any one of the implementation methods of the first aspect.

[0030] In a fifth aspect, an embodiment of the present application provides a means of transportation, including the system provided by the above-mentioned first aspect and any one of the implementation methods of the first aspect.

[0031] The beneficial effects brought about by the second to fifth aspects mentioned above can be specifically referred to the description of the beneficial effects in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic diagram of an application scenario of the first display system 100 provided in this application.

[0033] Figure 2 FIG. 1 is a schematic diagram of a display device 101 suitable for use in an embodiment of the present application.

[0034] Figure 3This is a schematic diagram of the display device 101 provided in an embodiment of the present application in a storage state.

[0035] Figure 4 This is a schematic diagram of the display device 101 provided in an embodiment of the present application when in a display state.

[0036] Figure 5 A schematic structural diagram of a second display system 500 provided in an embodiment of the present application.

[0037] Figure 6 A schematic diagram of adjusting the first eye position and the ideal eye position in the vertical direction provided in an embodiment of the present application.

[0038] Figure 7 This is a diagram showing the effect of adjusting the first eye position and rotating the display device 101 according to an embodiment of the present application.

[0039] Figure 8 A schematic diagram of adjusting the first eye position and the ideal eye position in the horizontal direction provided in an embodiment of the present application.

[0040] Fig. 9 A schematic diagram of simultaneously adjusting the first eye position and the ideal eye position in the vertical direction and the horizontal direction provided in an embodiment of the present application.

[0041] Fig.10 A schematic diagram of the depth of the human eye provided in an embodiment of the present application.

[0042] Fig.11 A schematic diagram of a third display system 1100 provided in an embodiment of the present application.

[0043] Fig.12 A circuit diagram of a display device provided in an embodiment of the present application.

[0044] Fig.13 A schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0046] In order to facilitate understanding of the embodiments of the present application, the following explanation is made.

[0047] First, the terms "first", "second", etc. and various numerical numbers in the text description or drawings of the embodiments of the present application shown below are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application. For example, the first virtual image and the second virtual image are virtual images generated by different imaging lights, and for example, the first adjustment amount, the second adjustment amount and the third adjustment amount are used to distinguish the adjustment amount under angle adjustment, the adjustment amount under frame adjustment and the adjustment amount of seat height, respectively.

[0048] Second, the terms "including" and "having" and any variations thereof in the embodiments of the present application shown below are intended to cover non-exclusive inclusions. For example, a system, product or device comprising a series of units is not necessarily limited to those units explicitly listed, but may include other units that are not explicitly listed or inherent to these products or devices.

[0049] Third, in the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or descriptions, and the embodiments or designs described as "exemplarily" or "for example" should not be interpreted as being more preferred or more advantageous than other embodiments or designs. The use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way for easy understanding.

[0050] Fourth, in the embodiments of the present application, imaging light refers to light that carries an image (or image information) and is used to generate an image, and may also be referred to as image light, etc.

[0051] Fifth, in the drawings of the present application, the thickness, size and shape of each optical element have been slightly exaggerated for the sake of convenience. Specifically, the shapes of the optical elements shown in the drawings are shown by way of example, and the drawings are only examples and not drawn strictly to scale.

[0052] Sixth, unless otherwise defined, all terms (including technical terms and scientific terms) used in this application have the same meaning as commonly understood by a person of ordinary skill in the art to which this application belongs. It should also be understood that terms (such as terms defined in commonly used dictionaries) should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined in this article.

[0053] With the rapid development of smart cars, cars play more and more roles in people's lives, and the demand for in-car displays is gradually increasing. For example, providing entertainment services such as games and movies for passengers who spend a long time in the car, or providing a private office display environment for office workers.

[0054] In order to provide in-vehicle display functions, directly installing the display screen is a common solution. For example, a liquid crystal display (LCD) can be installed on the cockpit instrument panel for use by people in the car. However, the image viewed by such a display device is related to the screen size of the display device. To achieve a large-size viewing experience, the screen size of the display device needs to be larger, which is not only costly but also causes congestion in the car.

[0055] In view of this, an embodiment of the present application provides a display system that can not only provide users with a large-format, long-distance visual experience, but also, due to its small size, can be hidden in the internal space of the dashboard when not in use, thereby saving space inside the vehicle.

[0056] Figure 1 Schematic diagram of the first application scenario of the display system 100 provided in this application. Figure 1 As shown, the display system 100 includes a display device 101 and a driving device 103 arranged on a dashboard 102. Among them, the display device 101 can generate a long-distance enlarged virtual image through the input of an external video signal (also referred to as a signal source), providing viewers with a large-format, long-distance visual experience, and meeting the needs of users in various application scenarios such as leisure and entertainment, business office, etc. Among them, the display device 101 can be installed on the dashboard before leaving the factory. Alternatively, it can also be installed on the dashboard after the dashboard is modified after leaving the factory, which is not limited in this application.

[0057] It is to be understood that the display system 100 may be applied to vehicles including but not limited to the following: cars, trucks, buses, ships, airplanes, helicopters, recreational vehicles, trains, and the like.

[0058] In the present application, the display device 101 can be arranged on the dashboard of the main driver, or on the dashboard of the co-driver, or on both the dashboard of the main driver and the dashboard of the co-driver, and the present application does not limit it. It can be understood that for the dashboard extending from the main driver to the co-driver, the display device 101 is arranged on the dashboard of the main driver, or on the dashboard of the co-driver, which means that the display device 101 is installed in the dashboard near the main driver or the co-driver.

[0059] In some embodiments, Figure 2 Schematic diagram of a display device 101 applicable to an embodiment of the present application. Figure 2 (a) is a side structural perspective view of the display device 101. Figure 2 (b) is a front view of the display device 101. Figure 2 (c) is a schematic diagram of another viewing angle of the display device 101. Figure 2As shown, the display device 101 includes an image generating unit 201, a window unit 202, an image magnifying unit 203, and a housing 204 (also referred to as a protective shell, an external housing, etc.). The window unit 202 includes a first surface 212 and a second surface 222, and the housing 204 includes a third surface 214 and a fourth surface 224. One end of the third surface 214 is connected to the upper edge of the window unit 202, and the other end of the third surface 214 is tightly connected to one end of the fourth surface 224 (i.e., at the Figure 2 The other end of the fourth surface 224 is connected to the lower edge of the window unit 202, so that the second surface 222 of the window unit 202 and the third surface 214 and the fourth surface 224 form a closed internal space, and the image generating unit 201 and the image magnifying unit 203 are arranged in the internal space. Specifically, when the display device 101 is working, the image generating unit 201 is used to emit imaging light to the first surface 212 of the window unit 202. After being reflected by the first surface 212 of the window unit 202, the imaging light is transmitted to the surface of the image magnifying unit 203, and after being reflected by the image magnifying unit 203, it reaches the first surface 212 again, and enters the human eye after transmitting the first surface 212 and the second surface 222, so that the human eye can see the virtual image located at the image plane.

[0060] It should be noted that, in the present application, the third surface 214 and the fourth surface 224 may be two surfaces of the shell 204, in which case the shell 204 is a complete shell, such as a structural member integrally formed by an injection molding process. Alternatively, the third surface 214 and the fourth surface 224 are respectively surfaces of a partial shell of the shell 204, in which case the shell 204 can be split into a part corresponding to the third surface 214 and another part corresponding to the fourth surface 224, that is, the shell 204 is no longer a complete shell. When the third surface 214 and the fourth surface 224 are respectively surfaces corresponding to a partial shell, the third surface 214 and the fourth surface 224 are closely connected, which may mean that a part of the shell corresponding to the third surface 214 and another part of the shell corresponding to the fourth surface 224 are closely connected, for example, they are glued together by a specific glue, in which case there is no other connection structure between a part of the shell corresponding to the third surface 214 and another part of the shell corresponding to the fourth surface 224. In other words, Figure 2The connection point is only used to indicate the position where a portion of the shell corresponding to the third surface 214 and another portion of the shell corresponding to the fourth surface 224 are closely connected, and can also be understood as the boundary between the third surface and the fourth surface. Alternatively, the third surface 214 and the fourth surface 224 are closely connected, which can mean that a portion of the shell corresponding to the third surface 214 and another portion of the shell corresponding to the fourth surface 224 are closely connected through other connection structures, such as a decorative strip, or another small portion of the shell as the shell 204, to fix a portion of the shell corresponding to the third surface 214 and another portion of the shell corresponding to the fourth surface 224 together. In this case, Figure 2 The connection in the figure is used to indicate a connection structure connecting a portion of the shell corresponding to the third surface 214 and another portion of the shell corresponding to the fourth surface 224 .

[0061] In the embodiment of the present application, the state of the display device 101 includes a storage state and a display state. The first driving device 103 is used to adjust the display device 101 from the storage state to the display state, or from the display state to the storage state.

[0062] Specifically, when the display device 101 is in the storage state, the second surface 222 of the window unit 202 is embedded in the instrument panel 102, so that the third surface 214 constitutes a part of the knee guard of the instrument panel 102, and the fourth surface 224 constitutes a part of the table top of the instrument panel 102. Exemplarily, when the user does not use the display device 101 to view images, the display device 101 can be controlled to adjust from the display state to the storage state through an operating system, such as a mobile phone application, or by operating a control button located on the instrument panel 102. Alternatively, when the human eye or user cannot be detected for a long time, the display system 100 controls the first driving device 103 (for example, through the control of instructions sent by the processing device) to automatically adjust from the display state to the storage state.

[0063] It is understandable that when the display device 101 is in the storage state, in some embodiments, at least one portion of the third surface 214 and the fourth surface 224 may not completely fit with the surface of the corresponding instrument panel 102. In other words, the third surface 214 may not completely fit with the knee guard of the instrument panel 102, or the fourth surface 224 may not completely fit with the table top of the instrument panel 102, or the third surface 214 may not completely fit with the knee guard of the instrument panel 102, and the fourth surface 224 may not completely fit with the table top of the instrument panel 102. In other embodiments, it can be designed that when the display device 101 is in the storage state, the third surface 214 can completely fit with the knee guard of the instrument panel 102, and the fourth surface 224 can completely fit with the table top of the instrument panel 102. At this time, the curvature of the connection between the third surface 214 and the fourth surface 224 is the same as the curvature from the knee guard of the instrument panel 102 to the table top of the instrument panel 102, such as Figure 3 Compared with the case of incomplete fitting, when the display device 101 is completely embedded, the shape of the display device 101 can be coupled with the design of the instrument panel 102, so as to achieve perfect unification of the shape inside the vehicle.

[0064] When the display device 101 is in the display state, the third surface 214 is separated from the knee guard of the instrument panel 102, and the fourth surface 224 is separated from the surface of the instrument panel, so that the second surface 222 is opposite to the human eye. For example, when the user needs to use the display device 101 to view images, the display device 101 can be controlled to adjust from the storage state to the display state through the operating system or control buttons. Alternatively, when the human eye or user is detected (the user does not use the display device at this time), the display system 100 controls the first drive device 103 to automatically adjust from the storage state to the display state.

[0065] It is understandable that, since the display device 101 occupies the internal space of the instrument panel 102 when in the storage state, when the display device 101 is in the display state, the display device 101 is moved out of the instrument panel 102, so that the surface of the instrument panel 102 and the position for storing the display device 101 present a stepped surface, such as Figure 4 shown.

[0066] It should be noted that in the present application, the storage state and the display state are only used to define the spatial state of the display device 101, and should not be narrowly understood as the display state will definitely provide the user with a viewable image. In other words, even if the display device 101 is in the storage state, the display device 101 can still continue to work; or even if the display device 101 is in the display state, the display device 101 may not work, but only appear to be unfolded from the instrument panel, thereby leaking out into the cabin.

[0067] In some embodiments, the state adjustment of the display device 101 by the first driving device 103 can be implemented based on the connection unit 205. In this case, the display device 101 also includes a connection unit 205. Optionally, the connection unit 205 can be at least one of a rotating component (including but not limited to one or more rotating shafts, one or more rotating brackets, one or more rotating gears, etc.) and a moving component (including but not limited to a slide rail, a lifting platform, etc.), which can adjust the state of the display device 200 as a whole under the adjustment of the first driving device 103. Exemplarily, when the first driving device 103 adjusts the display device 101 from the storage state to the display state, if the connection unit 205 is a rotating component, at this time, the display device 101 rotates out of the instrument panel 102 until it rotates to a suitable angle and stops. If the connection unit 205 is a rotating component and a moving component, the first driving device 103 can first drive the moving component to move the display device 101 out of the instrument panel (for example, slide out or rise), and then drive the rotating component to rotate the display device 101 to a suitable angle and stop.

[0068] Optionally, the first drive device 103 is connected to the connection unit 205 through a damping structure, wherein the damping structure may include but is not limited to a hinge, a damper, a gear, etc. Alternatively, the first drive device 103 is connected to the connection unit 205 through a magnetic connection. Optionally, the first drive device 103 may be an automatic device (e.g., electric, magnetic, etc.) or a manual device. Exemplarily, when the first drive device 103 is connected to the connection unit 205 through a damping structure, and the first drive device 103 is an automatic device, the first drive device 103 may be a motor, and the motor drives the connection unit 205 to work, thereby adjusting the state of the display device 101. Alternatively, the first drive device 103 may be a permanent magnet, and the permanent magnet drives the connection unit 205 (e.g., a magnetic coil) to work, thereby adjusting the state of the display device 101. Alternatively, when the first drive device 103 is a manual device, the first drive device 103 may adjust the state of the display device 101 by operating the connection unit 205 by a user.

[0069] When the first driving device 103 is an automatic device, the automatic device can be arranged in the internal space of the display device 101, or arranged outside the display device 101, such as in the instrument panel, or on the surface outside the shell of the display device 101, which is not limited in this application.

[0070] It should be noted that, in some embodiments, the display system 100 provided in the present application may not include the first driving device 103. For example, the user manually presses the housing of the display device 101 to realize the rotation of the display device 101. Exemplarily, when the user needs to adjust the display device 103 from the storage state to the display state, the user presses the fourth surface 224 downward. At this time, the downward pressing force drives the connecting component 205 to rotate, so that the third surface 214 and the window unit 202 are tilted. Subsequently, the display device 101 is fixed to a fixing device such as a card slot with the assistance of both hands or one hand for the user to use.

[0071] Alternatively, in other embodiments, there is no obvious connection relationship between the first driving device 103 and the connecting unit 205. For example, when the connecting unit 205 is a rotating component, the first driving device 103 can be a rotating handle or a rotating gear of the connecting unit 205. In this case, it can be regarded that the first driving device 103 directly drives the display device 101 to rotate, or it can be regarded that the connecting unit 205 directly drives the display device 101 to rotate.

[0072] Optionally, the image generation unit 201 can adopt a liquid crystal display (LCD) display, a liquid crystal on silicon (LCOS) display, an organic light-emitting diode (OLED) display, a micro light-emitting diode (Micro-LED) display, a display using miniLED display technology, a digital light processing (DLP) display or a micro-electro-mechanical systems (MEMS) display, etc., which is not limited in this application.

[0073] Optionally, the image magnifying unit 203 is a free-form surface mirror, or a non-free-form surface mirror, such as a spherical mirror.

[0074] It should be noted that Figure 2 This is only an example of a display device applicable to the display system embodiment of the present application, that is, the structure of the display device applicable to the embodiment of the present application is not limited to Figure 2In other embodiments, the image generating unit 201 in the display device 200 may be arranged at other positions, for example, behind the image magnifying unit 203. In this case, the imaging light emitted by the image generating unit 201 passes through the image magnifying unit 203 and is incident on the surface of the window unit 202. After being reflected by the window unit 202, it is incident on the image magnifying unit 203, and then is reflected by the image magnifying unit 203 again to the window unit 202 and passes through the window unit 202 before entering the human eye.

[0075] Figure 5 This is a schematic structural diagram of a second display system 500 provided in an embodiment of the present application. It should be noted that: Figure 5 The display system 500 shown is based on the above Figure 2 The display device 101 shown in FIG. Figure 5 As shown, the display system 500 includes a display device 101, a first driving device 103, a first acquisition device 510 and a processing device 520. The first acquisition device 510 is connected to the processing device 520, and the processing device 520 is connected to the first driving device 103. Specifically, the first acquisition device 510 is used to acquire one or more first images containing the user's eyes when the display device 101 is at a first angle, and send the one or more first images to the processing device 520. The processing device 520 generates a first adjustment amount based on the received one or more first images, and sends the first adjustment amount to the first driving device 103. The description of the display device 101 and the first driving device 103 can refer to the above Figure 2 The relevant parts of are not repeated here.

[0076] Optionally, the first acquisition device 510 may be a sensor in the cabin, for example, the first acquisition device 510 may be an image sensor arranged on the top of the cabin or on the housing of the display device 101. When the first acquisition device 510 is an image sensor arranged on the top of the cabin, the first acquisition device 510 may be arranged in front of the user's eyes to capture one or more first images including the front view of the eyes; or the first acquisition device 510 may be arranged in the side face direction of the user to capture one or more first images including the side view of the eyes. When the first acquisition device 510 is an image sensor arranged on the housing of the display device 101, the first acquisition device 510 may be arranged on the housing above the window unit 202 (such as Figure 5 ), used to capture one or more first images containing the front of the human eye.

[0077] Optionally, the processing device 520 may be a processor disposed in the cockpit or disposed on the housing of the display device 101. When the processing device 520 is a processor disposed in the cockpit, the processor may be a central processor for controlling the cockpit system. When the processing device 520 is located on the housing of the display device 101, it may be disposed next to the first acquisition device 510 located on the housing, such as Figure 5 shown.

[0078] It should be noted that the present application does not limit the connection method between the processing device 520 and the first acquisition device 510, and the connection method between the processing device 520 and the first drive device 103. Both can be connected through a wired link or a wireless link, either directly or indirectly through other network devices, controllers, etc., so that the processing device 520 can exchange information with the first acquisition device 510 or the first drive device 103 through the connected link.

[0079] In some embodiments, when the first acquisition device 510 acquires a first image, the processing device 520 determines a first human eye position and an ideal human eye position based on the received first image, and generates a first adjustment amount based on the first human eye position and the ideal human eye position, wherein the first human eye position is the distance of the human eye in the first image relative to the image edge in the vertical direction and / or horizontal direction.

[0080] Specifically, when the first eye position is a distance in the vertical direction relative to the edge of the first image, Figure 6 (a) in FIG. 1 shows a schematic diagram of a first eye position in a first image being located above and below an ideal eye position, wherein the vertical direction is Figure 6 In the y direction shown, at this time, the processing device 520 can determine the distance d or distance d' between the first human eye position and the ideal human eye position in the vertical direction (that is, the difference between the y coordinate of the first human eye position and the y coordinate of the ideal human eye position) through an image processing algorithm, and generate a first adjustment amount Δθ of the angle of the display device 101 according to the distance d or the distance d', and send the first adjustment amount Δθ to the first driving device 103. The first driving device 103 drives the connecting unit 205 to rotate Δθ according to the first adjustment amount Δθ to complete the angle adjustment of the display device 101, so that the human eye position in the image after the angle adjustment is basically coincident with the ideal human eye position, as shown in FIG. Figure 6As shown in (b) in . When the first eye position is the distance in the vertical direction relative to the edge of the first image, if the ideal eye position is used as the coordinate axis with a distance of 0, when the first eye position is above the ideal eye position, the distance d can be set to a positive value, and the display device 101 achieves a "head-up" effect when adjusting the angle. When the first eye position is below the ideal eye position, the distance d' is set to a negative value, and the display device 101 achieves a "head-down" effect when adjusting the angle. For example, Figure 7 As shown, when the first eye position is adjusted from position 1 to position 2, since the first eye position is upward relative to the ideal eye position, the display device 101 achieves a head-up effect.

[0081] When the first eye position is the distance in the horizontal direction relative to the edge of the first image, Figure 8 (a) in FIG. 1 shows a schematic diagram of a first eye position located to the left and right of an ideal eye position, wherein the horizontal direction is Figure 8 In the x direction shown, at this time, the processing device 520 can determine the distance d or distance d' between the first human eye position and the ideal human eye position in the horizontal direction (that is, the difference between the x coordinate of the first human eye position and the x coordinate of the ideal human eye position) through an image processing algorithm, and calculate and generate a first adjustment amount Δθ of the angle of the display device 101 according to the distance d, and send the first adjustment amount Δθ to the first driving device 103. The first driving device 103 drives the connecting unit 205 to rotate Δθ according to the first adjustment amount Δθ to complete the angle adjustment of the display device 101, so that the human eye position in the image after the angle adjustment is basically coincident with the ideal human eye position, as shown in FIG. Figure 8 As shown in (b) in FIG. 1 . When the first eye position is the distance in the horizontal direction relative to the edge of the first image, the left side of the ideal eye position can be set to be negative, and the left side of the ideal eye position can be set to be positive. That is, when the first eye position is to the left of the ideal eye position, the distance d is a negative value, and the display device 101 achieves a "shaking head" effect to the left when adjusting the angle. When the first eye position is to the right of the ideal eye position, the distance d' is a positive value, and the display device 101 achieves a "shaking head" effect to the right when adjusting the angle.

[0082] When the first eye position in a first image acquired by the first acquisition device 510 changes relative to the ideal eye position in both the vertical and horizontal directions, for example, Fig. 9As shown in (a) in FIG. 1 , when the first eye position is located at the upper left of the ideal eye position, the processing device 520 can determine the distance d1 in the vertical direction and the distance d2 in the horizontal direction between the first eye position and the ideal eye position through an image processing algorithm, and calculate and generate a first adjustment amount Δθ of the angle of the display device 101 according to the distances d1 and d2, and send the first adjustment amount Δθ to the first driving device 103. The first driving device 103 drives the connecting unit 205 to rotate Δθ according to the first adjustment amount Δθ to complete the angle adjustment of the display device 101, so that the eye position in the image after the angle adjustment is substantially coincident with the ideal eye position, as shown in FIG. Fig. 9 As shown in (b) in .

[0083] Generally speaking, in the actual angle adjustment process, due to the rotation process of the connection unit 205, or the calculation process of the processing device 520, or the process of the first acquisition device 510 acquiring the first image, there are errors. Therefore, the human eye position in the image after the angle adjustment described in the present application basically coincides with the ideal human eye position, which means that the distance between the human eye position after the angle adjustment and the ideal human eye position (including at least one of the vertical distance and the horizontal distance mentioned above) is within the allowable error range.

[0084] It is understandable that in the above Figure 6 In the example, since the first eye position changes only in the vertical direction relative to the ideal eye position, the first eye position obtained by the processing device 520 is the vertical coordinate value of the eye in the first image relative to the edge of the first image. When the first image is a rectangle, the vertical direction can be understood as the short side direction of the rectangle. Figure 8 In the image, the first eye position changes only in the horizontal coordinate relative to the ideal eye position. Therefore, the first eye position obtained by the processing device 520 is the horizontal coordinate value of the eye in the first image relative to the edge of the first image. When the first image is a rectangle, the horizontal direction can be understood as the direction along the long side of the rectangle. Fig. 9 In the embodiment, the coordinates of the first eye position relative to the ideal eye position in both the vertical and horizontal directions are changed. Therefore, the first eye position obtained by the processing device 520 is determined by the coordinate values ​​of the eye in the first image relative to the edge of the first image in the horizontal and vertical directions. In addition, in the present application, the ideal eye position is the center position of the first image. That is, the distance between the ideal eye position and the upper and lower edges of the first image is the same, and at the same time, the distance between the ideal eye position and the left and right edges of the first image is the same.

[0085] It is also understandable that in Figure 6 , Figure 8 and Fig. 9In the figure, the lower edge of the first image is the axis of y=0, and the left edge of the first image is the axis of x=0, but the present application is not limited to this. In other words, in the description of the present application, the long side of the rectangle is used as the horizontal direction, and the short side of the rectangular image is used as the vertical direction for explanation. The horizontal direction and the vertical direction are only for the convenience of explanation, and can also be called the first direction and the second direction. The first direction and the second direction are perpendicular to each other. Therefore, the present application does not limit the positioning of the coordinate axis to be strictly the same as the above-mentioned example figure, as long as the first eye position in the first image and the ideal eye position are calculated using the same image coordinate.

[0086] It should be noted that, in the embodiment of the present application, when the image acquired 510 by the first acquisition device (including the above-mentioned one or more first images, and the following one or more second images, and one or more third images) is a front view of the user, for example, when the image contains both eyes of the user, the eye position (including the above-mentioned first eye position, and the following second eye position) can be understood as the midpoint of the line connecting the two eyes, or the position of the user's eyebrow, etc., which is not limited in the present application. When the image acquired by the first acquisition device 510 (including the above-mentioned one or more first images, and the following one or more second images, and one or more third images) is a side view of the user, the eye position can be understood as the distance of the eye relative to the edge of the image in the vertical direction and / or horizontal direction in the side view. It can be understood that the above-mentioned Figure 6 , Figure 8 and Fig. 9 The description is made by taking the front view of the user obtained by the first obtaining means 510 as an example.

[0087] In other embodiments, when the first acquisition device 510 acquires multiple first images, the processing device 520 determines the second eye position and the ideal eye position based on the received multiple first images, and generates a first adjustment amount based on the second eye position and the ideal eye position, wherein the second eye position is determined according to the distance of the eye in each of the multiple first images relative to the edge of the corresponding image in the vertical direction and / or horizontal direction. Optionally, the second eye position can be the average value, variance, mean square error, median, etc. of the distance of the eye in the multiple first images relative to the edge of the corresponding image in the vertical direction and / or horizontal direction, which is not limited in this application. Exemplarily, when the first acquisition device 510 sends 10 first images to the processing device 520, and the second eye position is represented by an average value, the processing device 520 calculates the eye position in each first image, and then calculates the average value of the 10 eye positions of the 10 first images to obtain the second eye position.

[0088] It is understandable that the position of the human eye in each of the plurality of first images may be the above Figure 6The vertical change relative to the ideal eye position as shown in Figure 8 The horizontal change relative to the ideal eye position as shown, or Fig. 9 The vertical and horizontal changes relative to the ideal eye position are shown, and are not described in detail here. In addition, when calculating the difference between the eye position in the plurality of first images and the ideal eye position, it is always calculated by subtracting the ideal eye position from the actual eye position in the first image or by subtracting the actual eye position from the ideal eye position.

[0089] In addition, since the display system provided by the present application is installed in the instrument panel of a vehicle, when the vehicle is driving, there are usually bumps, such as when a car is driving on a road with poor road conditions, or when an airplane passes through an air flow layer. In order to prevent the display device 101 from frequently adjusting the angle, causing dizziness and fatigue in the user, in some other embodiments, only when the processing device 520 determines that the distance between the second eye position and the ideal eye position is greater than the first threshold, and at the same time determines that the second eye position is the eye position actively adjusted by the user, the display system triggers the angle adjustment process, and the processing device 520 generates the first adjustment amount Δθ, or sends the first adjustment amount Δθ to the first driving device 103. Among them, the processing device 520 determines that the distance between the second eye position and the ideal eye position is greater than the first threshold, that is, the difference between the second eye position and the ideal eye position is greater than the first threshold; the processing device 520 determines that the second eye position is the eye position actively adjusted by the user, which means that the multiple first images are acquired in a stable state. Among them, the stable state is defined as a plurality of first images acquired within a first preset time, and at the same time, the distance of the human eye in each first image relative to the edge of the corresponding image in the vertical direction and / or horizontal direction is within a first preset range. In other words, the position of the human eye in the plurality of first images acquired by the first acquisition device within the first preset time is within the first preset range. It should be noted that the first preset range refers to a preset range of variation of the position of the human eye (e.g., the change value of the coordinates) within the first preset time. Exemplarily, it can be understood that among the plurality of first images acquired in chronological order, the change of the position of the human eye in the first image acquired later in two adjacent first images relative to the position of the human eye in the previous first image is within the first preset range, or it can be understood that the difference between the maximum and minimum values ​​of the position of the human eye in the plurality of first images is within the first preset range, etc., and this application does not make any limitation.

[0090] Specifically, after the first image acquisition unit 510 sends the first image acquired in real time to the processing device 520, the processing device 520 first determines that the eye positions corresponding to the multiple first images acquired within the first preset time are within the first preset range, and then the processing device 520 determines that the eye position in the first preset time period is a position actively adjusted by the user, for example, the eye position changes after the user changes the sitting posture, rather than passive shaking caused by the cabin. If the processing device 520 continues to determine that the difference between the generated second eye position and the ideal eye position is greater than the first threshold, the processing device 520 generates a first adjustment amount, thereby triggering the angle of the display device 101 to be adjusted. It can be understood that when the second eye position acquired in a stable state is less than the first threshold and the ideal eye position is less than the first threshold, the display device 101 does not adjust. At this time, the processing device can abandon the calculated second eye position, and trigger the angle adjustment of the display device 101 until the difference between the second eye position and the ideal eye position in the next stable state is calculated to be greater than or equal to the first threshold. By setting the first threshold, the angle adjustment of the display device 101 is no longer too frequent, thereby ensuring the user experience.

[0091] It should be noted that in the present application, the first preset time and the first preset range may be fixed values ​​or variable values. Specifically, when the first preset time is a fixed value, it may be preset by the display system when it leaves the factory, or it may be generated by the processing device 520 based on the user's usage habits for a period of time, using machine learning or big data algorithms, etc., and this application does not limit it. For example, it may be 0.8s to 3s. When the first preset time is a variable value, the first preset time can be flexibly adjusted according to the environment in which the cockpit of the display device 101 is set, wherein the environment in which the cockpit is located may include but is not limited to the brightness of the cockpit, the posture of the cockpit (such as the road conditions of the car, vehicle navigation information, etc.). For example, when the ambient light described in the cockpit is relatively dim, the accuracy of the second eye position generated by the processing device 520 based on multiple first images is poor. At this time, the first preset time can be set longer to avoid errors in the calculation. For another example, when a car is traveling on a flat highway, the possibility of the car bumping is small, or the frequency of the user's sitting posture adjustment is low, or the processing device 520 learns from the navigation information that the car will continue to travel on the highway for a long time in the future, etc. At this time, the processing device 520 can appropriately set a longer first preset time. When the first preset range is a fixed value, it can be preset in the processing device 520 by the display system when it leaves the factory, or it can be generated by the processing device 520 according to the user's usage habits, using machine learning or big data algorithms, etc., and this application does not limit it. For example, it can be 5cm to 7cm. When the first preset range is a variable value, the first preset time can be flexibly adjusted according to the environment of the cabin, etc. For example, when the car is traveling on a flat highway, the first preset range can be adjusted to be larger, so that it is easier to distinguish the user's posture adjustment.

[0092] It should also be noted that in some scenarios, the processing device 520 may stop calculating the first adjustment amount Δθ for a period of time, and it may be considered that even if the processing device 520 calculates the first adjustment amount Δθ, it will not be sent to the adjustment device; or, it may be considered that the processing device 520 discards the data of multiple first images received during this period. For example, for an aircraft cockpit, the processing device 520 may know the flight environment in advance, such as the presence of strong airflow in a certain flight distance. At this time, the processing device 520 may calculate the time taken to pass through the airflow based on the flight speed of the aircraft and the length of the airflow, and stop adjusting the angle of the display device 101 during this time.

[0093] Based on the above scheme, the accuracy of the eye position can be improved by generating the second eye position through multiple first images, thereby ensuring the accuracy of the angle adjustment of the display device. When the second eye position is generated through multiple first images in a stable state, and the first threshold is used to determine whether to adjust the angle, the jitter existing in the cockpit display system can be filtered, and the angle adjustment of the display device 101 can be performed under the trigger condition (that is, the above first threshold is used as the trigger condition), thereby further ensuring the reliability of the angle adjustment and further improving the user experience.

[0094] In order to further improve the reliability of the display system 500, the display system 500 may further include a second acquisition device 530, which is used to acquire the environmental information of the display device 101, such as the cockpit posture (including but not limited to the road conditions of the vehicle, the navigation information of the vehicle, etc.), the brightness of the cockpit, the temperature of the display device 101, etc., so that the processing device 520 can further determine the credibility of the acquired second eye position according to the environmental information. Specifically, when the processing device 520 determines that the credibility of the second eye position generated according to the environmental information is low, the processing device 520 discards the current second eye position and recalculates the second eye position with higher credibility according to the received multiple first images. Exemplarily, when the processing device 520 determines the credibility of the second eye position according to the cockpit posture, the second acquisition device 530 may be a laser radar device for detecting road conditions or a navigation device for navigating routes, etc. At this time, the processing device 530 can generate road condition information corresponding to the multiple first images, compare the actual road condition information with the ideal road condition information, and obtain the road condition credibility coefficient. When the road condition credibility coefficient is greater than or equal to 0.5, the processing device 520 considers that the second eye position corresponding to the multiple first images is credible. Exemplarily, when the processing device 520 determines the credibility of the second eye position according to the brightness of the cabin, the second acquisition device 530 can be a brightness detector. At this time, the processing device 530 can generate brightness information corresponding to the multiple first images, compare the brightness information with the ideal brightness information, and obtain the brightness credibility coefficient. When the brightness credibility coefficient is greater than or equal to 0.5, the processing device 520 considers that the second eye position corresponding to the multiple first images is credible. Exemplarily, when the processing device 520 determines the credibility of the second eye position according to the temperature of the display device 101, the second acquisition device 530 can be a temperature detector. At this time, the processing device 530 can determine whether the second eye position corresponding to the multiple first images is credible according to the temperature of the display device 101 when the multiple first images are acquired. It can be understood that the above environmental information is only an example and not a limitation, and the present application is not limited thereto. Other information of the display device 101 that affects the credibility of the second eye position, or other information of the cockpit, are within the protection scope of the present application.

[0095] In addition, the processing device 520 can also make a credibility judgment based on the information of the first image acquired by the first acquisition device 510. In this case, the display system 500 may not include the above-mentioned second acquisition device 530. Exemplarily, the processing device 530 can generate color information corresponding to multiple first images, compare the color information with the ideal color information, and obtain a color credibility coefficient. When the color credibility coefficient is greater than or equal to 0.5, the processing device 520 believes that the second eye position corresponding to the multiple first images is credible. Alternatively, the processing device 530 can also determine through image processing that the eye positions in the multiple first images (including the above-mentioned first eye positions and second eye positions) are not credible. For example, the processing device 530 determines that the generated eye positions are inaccurate due to the obstructions such as sunglasses worn by the users in the multiple first images.

[0096] Based on the above solution, by using the processing device to determine the credibility of the second eye position, the reliability of the display system can be further improved, thereby improving the user experience.

[0097] It is understandable that in some scenarios, even if the display device 101 has adjusted the angle relatively perfectly, the user may still not be able to see the complete virtual image. For example, when the user is close to the display device 101, or the user is too high or too far away, the angle adjustment can only enable the user to see a partial image in the eye box of the display device 101. At this time, the display system 500 provided in the present application can also adjust the frame. Specifically, the first acquisition device 510 is also used to acquire one or more second images containing the user's eyes when the display device 101 is at a second angle, and send one or more second images to the processing device 520. The processing device 520 also generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit 201. The image generation unit 201 generates an image of a corresponding size according to the second adjustment amount, and emits a second imaging light to the window unit 202. The window unit 202 reflects the second imaging light from the image generating unit 201 to the image magnifying unit 203, and transmits the second imaging light from the image magnifying unit 203, so that the user can view the complete virtual image formed by the second imaging light at the second angle through the window unit 202. The image magnifying unit 203 is used to reflect the second imaging light from the window unit 202 to the window unit 202.

[0098] In some embodiments, when the first acquisition device 510 acquires a second image, the processing device 520 determines the first human eye depth based on the received second image, and generates a second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit 202 when acquiring the second image, the second human eye depth is the human eye depth corresponding to the third image, the second human eye depth is the distance between the human eye and the window unit 202 when acquiring the third image, the acquisition time of the third image is before the acquisition time of a second image, or the second human eye depth is a preset human eye depth.

[0099] It is understandable that different eye depths correspond to different frame sizes, or different eye depth ranges correspond to different frame sizes. Therefore, after the processing device 520 determines the first eye depth, it can determine the first frame size corresponding to the first eye depth according to the value of the first eye depth or the range of the first eye depth, and simultaneously determine the second frame size corresponding to the second eye depth, and generate a second adjustment amount by comparing the first frame size and the second frame size, and send the second adjustment amount to the image generation unit 201, so that the image generation unit 201 emits the second imaging light corresponding to the second frame size.

[0100] It should be noted that different human eye depths correspond to different frame sizes, which may be the frame size of the virtual image or the frame size in the image generation unit 201, and this application does not limit this.

[0101] In addition, the preset human eye depth may be the one set before the cockpit display system leaves the factory, or the human eye depth corresponding to the frame adjusted by the user based on usage habits, or the human eye depth learned by the processing device 502 based on user usage habits, etc., and this application does not limit this.

[0102] In other embodiments, when the first acquisition device 510 acquires multiple second images, the processing device 520 determines a third human eye depth based on the received multiple second images, and generates a second adjustment amount based on the third human eye depth and the fourth human eye depth, wherein the third human eye depth is the distance between the human eye and the window unit 202 when the multiple second images are acquired, the fourth human eye depth is the human eye depth corresponding to the multiple third images, the fourth human eye depth is the distance between the human eye and the window unit 202 when the multiple third images are acquired, the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth.

[0103] It should be noted that the third eye depth can be the average value, variance, mean square error, median, etc. of the distance between the eye and the window unit 202 when each of the multiple second images is acquired, which is not limited in this application. Exemplarily, when the first acquisition device 510 sends 10 second images to the processing device 520, and the third eye depth is expressed by the average value, the processing device 520 calculates the eye depth when each second image is acquired, and then calculates the average value of the 10 eye depths of the 10 second images to obtain the third eye depth.

[0104] It should be noted that, in the embodiment of the present application, the depth of the human eye (including the first to fourth depths of the human eye in the text) is the distance between the plane where the human eye is located and the plane where the window unit 202 is located. When the human eye in one or more images obtained is a front view, since the one or more images have depth information, the depth of the human eye can be determined from the depth information. When the human eye in one or more images obtained is a side view, the depth of the human eye in the one or more images can be converted by the distance d between the human eye in the image and the window unit 202. For example, Fig.10 As shown, the image is a side view of a human eye, wherein the depth of the human eye can be determined by the distance between the plane where the human eye is located and the plane where the window unit 202 is located in the image.

[0105] Similarly, in order to avoid unnecessary frame adjustment caused by cockpit shaking, in some other embodiments, when the processing device 520 determines that the distance between the third eye depth and the fourth eye depth is greater than the second threshold, that is, the difference between the third eye depth and the fourth eye depth is greater than the second threshold, the processing device 520 generates a second adjustment amount based on the third eye depth and the fourth eye depth. Among them, the multiple second images and the multiple third images are acquired in a stable state. In other words, the multiple second images and the multiple third images are acquired within the first preset time, and at the same time, the multiple eye depths corresponding to the multiple second images are within the second preset range, and the multiple eye depths corresponding to the multiple third images are within the second preset range. Exemplarily, the multiple eye depths corresponding to the multiple second images are within the second preset range, which can be understood as the change of the eye depth in the second image acquired later in the two adjacent second images relative to the eye depth in the previous second image is within the second preset range, or it can be understood that the difference between the maximum and minimum values ​​of the eye depth in the multiple second images is within the second preset range, etc., which is not limited in this application. Similarly, the multiple human eye depths corresponding to the multiple third images are within the second preset range, which can be understood as the change in the human eye depth in the later acquired third image between two adjacent third images relative to the human eye depth in the previous third image is within the second preset range, or it can be understood as the difference between the maximum and minimum values ​​of the human eye depth in the multiple third images is within the second preset range, etc., and this application is not limited to this.

[0106] Specifically, after the first image acquisition unit 510 sends the second image acquired in real time to the processing device 520, the processing device 520 first determines that the changes in the depths of multiple human eyes of the multiple second images acquired within the first preset time period are within the second preset range. The processing device 520 believes that the depth of the human eyes in the first preset time period is actively adjusted by the user, for example, the depth of the human eyes changes after the user changes his sitting posture, rather than passive shaking caused by the cabin. At this time, the processing device 520 generates a third human eye depth based on the multiple human eye depths. If the processing device 520 continues to determine that the difference between the generated third human eye depth and the fourth human eye depth is greater than the second threshold, the processing device 520 generates a second adjustment amount, triggering the frame of the display device 101 to change. At the same time, the fourth human eye depth is saved for the next adjustment. It can be understood that when the difference between the third eye depth and the fourth eye depth obtained in a stable state is less than the second threshold, the display device 101 does not make any adjustments. At this time, the processing device may discard the calculated third eye depth and trigger the frame adjustment of the display device 101 only when the difference between the third eye depth and the fourth eye depth in the next stable state is calculated to meet the second threshold.

[0107] Similarly, the second preset range may be a fixed value or a variable value. The setting of the second preset range may refer to the setting of the first preset range, which will not be described in detail here.

[0108] In addition, the processing device 520 also stops calculating the second adjustment amount for a period of time according to the environment of the cabin, etc., and reference may be made to the description of the relevant parts in the above text, which will not be repeated here.

[0109] In order to further improve the reliability of the display system 500, the display system 500 can determine the credibility of the acquired third-person eye depth through the environmental information of the display device 101 obtained by the second acquisition device 530, or the information of multiple second images obtained by the first acquisition device 510. This process is the same as the process of determining the credibility of the second person's eye position, and will not be repeated here.

[0110] It can be understood that the angle adjustment of the display device 101 is performed based on one or more first images acquired by the first acquisition device 510, and the frame adjustment is performed based on one or more second images acquired by the first acquisition device 510. Since the second image is acquired when the display device is located at the second angle, in other words, the frame adjustment can further improve the user experience on the basis of the angle adjustment. Of course, in other embodiments, the display system 500 can also perform frame adjustment first and then angle adjustment, and the display device can use one or more identical images.

[0111] It is understandable that the above embodiment is an adjustment of the display device 101, including angle and frame. In some embodiments, the performance of the display system can be further improved and the usage scenarios of the display system can be enriched by adjusting the seat of the user. Fig.11 Schematic diagram of a third display system 1100 provided in an embodiment of the present application. Fig.11 As shown, the display system 1100 includes a seat 1120, a display device 101, a first acquisition device 510, a processing device 520, a third acquisition device 1110 and a second drive device 1130. The user sits on the seat 1120, the second drive device 1130 is connected to the seat 1120, and the second drive device 1130 is connected to the processing device 520. The third acquisition device 1110 is used to acquire user information and send the user information to the processing device 520. The processing device 520 is used to generate a third adjustment amount according to the user information and the relative height between the height of the display device 101 and the height of the human eye, and send the third adjustment amount to the second drive device 1130. The height of the display device 101 is the height of the center of the window unit 202 relative to the cabin ground, and the height of the human eye is the height of the human eye relative to the cabin ground. The relative height between the height of the display device 101 and the height of the human eye satisfies that the user is within the viewing angle range when viewing the virtual image. The second drive device 1130 is used to adjust the height of the seat 1120 according to the third adjustment amount.

[0112] Generally speaking, when the display device 101 is in the display state, the height of the display device 101 will no longer change. Therefore, in order to ensure that the user is within the viewing angle range when viewing the virtual image, the height of the human eye needs to be adjusted to a position that is approximately equal to the relative height of the height of the display device 101. In other words, in order to ensure the user's comfortable viewing, the relative height between the height of the display device 101 and the height of the human eye is fixed. For example, Fig.11As shown, if the height of the human eye is position 1, since the height of the human eye at a relative height to the height of the display device 101 is position 2, it is necessary to adjust the seat from height 1 to height 2. Specifically, in some embodiments, after the user sits in the seat 1120, the third acquisition device 1110 acquires user information and sends the user information to the processing device 520, and the processing device 520 determines the third adjustment amount ΔH1 of the height of the seat according to the user information and the relative height. Alternatively, in other embodiments, after the user sits in the seat 1120, the third acquisition device 1110 acquires user information and sends the user information to the processing device 520, and the processing device 520 determines the target height of the human eye according to the height of the display device 101, and determines the third adjustment amount ΔH1 of the height of the seat according to the user information and the target height. Subsequently, the processing device 520 sends an adjustment message to the second drive device 1130, so that the second drive device 1130 adjusts the height of the seat by ΔH1 based on the adjustment message. For example, the adjustment message includes a specific adjustment amount, such as the adjustment amount ΔH1. Then, the second driving device 1130 adjusts the height of the seat according to the adjustment amount ΔH1.

[0113] It should be noted that in the present application, the user information includes but is not limited to at least one of the following: the user's eye height, the user's height, the position of the eye in the image, and the user's weight. Among them, the user's eye height is the height of the eye (or the eye's line of sight or the center of the pupil, etc.) relative to the ground of the cabin when the eye is looking straight ahead. It can be understood that when the user information is the user's eye height, the user's height, and the position of the eye in the image, the user information can be obtained by the above-mentioned first acquisition device 510, for example, by an image detector, to obtain the eye height, the user's height, and the position of the eye in the image. At this time, the system 1100 may not include the third acquisition device 1110. When the user information is the user's weight, the third acquisition device 1110 can be a pressure detector for detecting the user's weight and sending the weight information to the processing device 520.

[0114] Fig.12 This is a circuit diagram of a display device provided in an embodiment of the present application. Fig.12As shown, the circuit in the display device mainly includes a host CPU 1201, an external memory interface 1202, an internal memory 1203, an audio module 1204, a video module 1205, a power module 1206, a wireless communication module 1207, an I / O interface 1208, a video interface 1209, a display circuit 1210 and a modulator 1212. Among them, the host processor 1201 and its peripheral components, such as the external memory interface 1202, the internal memory 1203, the audio module 1204, the video module 1205, the power module 1206, the wireless communication module 1207, the I / O interface 1208, the video interface 1209, and the display circuit 1210 can be connected through a bus. The host processor 1201 can be called a front-end processor.

[0115] In addition, the circuit diagrams shown in the embodiments of the present application do not constitute a specific limitation on the display device. In other embodiments of the present application, the display device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0116] The main processor 1201 includes one or more processing units, for example, the main processor 1201 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU), etc. Different processing units may be independent devices or integrated in one or more processors.

[0117] The main processor 1201 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the main processor 1201 is a cache memory. The memory may store instructions or data that the main processor 1201 has just used or cyclically used. If the main processor 1201 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the main processor 1201, and thus improves the efficiency of the system.

[0118] In some embodiments, the display device may further include a plurality of input / output (I / O) interfaces 1208 connected to the main processor 1201. The interface 1208 may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. The above-mentioned I / O interface 1208 may be connected to devices such as a mouse, a touchpad, a keyboard, a camera, a speaker / speaker, a microphone, etc., and may also be connected to physical buttons on the display device (such as a volume button, a brightness adjustment button, a power button, etc.).

[0119] The external memory interface 1202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with the main processor 1201 through the external memory interface 1202 to implement a data storage function.

[0120] The internal memory 1203 can be used to store computer executable program codes, which include instructions. The internal memory 1203 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a call function, a time setting function, etc.), etc. The data storage area may store data created during the use of the display device (such as a phone book, world time, etc.), etc. In addition, the internal memory 1203 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (Universal Flash Storage, UFS), etc. The main processor 1201 executes various functional applications and data processing of the display device by running instructions stored in the internal memory 1203 and / or instructions stored in a memory provided in the main processor 1201.

[0121] The display device can implement audio functions such as music playing and calls through the audio module 1204 and the application processor.

[0122] The audio module 1204 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 1204 can also be used to encode and decode audio signals, such as playing or recording. In some embodiments, the audio module 1204 can be arranged in the main processor 1201, or some functional modules of the audio module 1204 can be arranged in the main processor 1201.

[0123] The video interface 1209 can receive external audio and video signals, which can be specifically a high-definition multimedia interface (HDMI), a digital video interface (DVI), a video graphics array (VGA), a display port (DP), etc. The video interface 1209 can also output video to the outside. When the display device is used as a vehicle display, the video interface 1209 can receive speed signals and power signals input from peripheral devices, and can also receive external VR video signals. When the display device is in use, the video interface 1209 can receive video signals input from an external computer or terminal device.

[0124] The video module 1205 can decode the video input by the video interface 1209, for example, by performing H.264 decoding. The video module can also encode the video collected by the display device, for example, by performing H.264 encoding on the video collected by the external camera. In addition, the main processor 1201 can also decode the video input by the video interface 1209, and then output the decoded image signal to the display circuit 1210.

[0125] The display circuit 1210 and the modulator 1212 are used to display the corresponding image. In this embodiment, the video interface 1209 receives an external video source signal, and the video module 1205 decodes and / or digitally processes and outputs one or more image signals to the display circuit 1210. The display circuit 1210 drives the modulator 1212 to image the incident polarized light according to the input image signal, and then outputs the image light. In addition, the main processor 1201 can also output one or more image signals to the display circuit 1210.

[0126] In this embodiment, the display circuit 1210 and the modulator 1212 are electronic components in the above-mentioned image generating unit, and the display circuit 1210 can be called a driving circuit.

[0127] The power module 1206 is used to provide power to the main processor 1201 and the light source 1200 according to the input power (e.g., direct current), and the power module 1206 may include a rechargeable battery, which can provide power to the main processor 1201 and the light source 1200. The light emitted by the light source 1200 can be transmitted to the modulator 1212 for imaging, thereby forming an image light signal.

[0128] The wireless communication module 1207 enables the display device to communicate wirelessly with the outside world, and can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR) and other wireless communication solutions. The wireless communication module 1207 can be one or more devices integrating at least one communication processing module. The wireless communication module 1207 receives electromagnetic waves via an antenna, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the main processor 1201. The wireless communication module 1207 can also receive the signal to be sent from the main processor 1201, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0129] In addition, in addition to being input through the video interface 1209, the video data decoded by the video module 1205 can also be wirelessly received through the wireless communication module 1207 or read from an external memory. For example, the display device can receive video data from a terminal device or an in-vehicle entertainment system through the wireless LAN in the vehicle, and the display device can also read audio and video data stored in an external memory.

[0130] The above display device can be installed on a vehicle, see Fig.13 , Fig.13 A schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application.

[0131] like Fig.13As shown, the functional framework of the vehicle may include various subsystems, such as the sensor system 12, the control system 14, one or more peripheral devices 16 (one is shown as an example), the power supply 18, the computer system 20 and the vehicle display system 22. Optionally, the vehicle may also include other functional systems, such as an engine system that provides power for the vehicle, etc., which is not limited in this application.

[0132] The sensor system 12 may include a number of detection devices, which can sense the measured information and convert the sensed information into electrical signals or other required forms of information output according to a certain rule. As shown in the figure, these detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser rangefinder, a camera device, a wheel speed sensor, a steering sensor, a gear position sensor, or other components for automatic detection, etc., and the present application does not limit them.

[0133] The control system 14 may include several components, such as the steering unit, brake unit, lighting system, automatic driving system, map navigation system, network timing system and obstacle avoidance system shown in the figure. Optionally, the control system 14 may also include components such as a throttle controller and an engine controller for controlling the vehicle's speed, which are not limited in this application.

[0134] The peripheral device 16 may include several components, such as the communication system, touch screen, user interface, microphone, and speaker shown in the figure. The communication system is used to realize network communication between the vehicle and other devices other than the vehicle. In practical applications, the communication system may use wireless communication technology or wired communication technology to realize network communication between the vehicle and other devices. The wired communication technology may refer to communication between the vehicle and other devices through network cables or optical fibers.

[0135] The power source 18 represents a system that provides power or energy for the vehicle, which may include but is not limited to a rechargeable lithium battery or a lead-acid battery, etc. In practical applications, one or more battery components in the power source are used to provide power or energy for starting the vehicle, and the type and material of the power source are not limited in this application.

[0136] Several functions of the vehicle are controlled and implemented by the computer system 20. The computer system 20 may include one or more processors 2001 (one processor is shown as an example in the figure) and a memory 2002 (also referred to as a storage device). In actual applications, the memory 2002 is also inside the computer system 20, or it may be outside the computer system 20, for example, as a cache in the vehicle, etc., which is not limited in this application.

[0137] in,

[0138] The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 may be used to run related programs or instructions corresponding to the programs stored in the memory 2002 to implement corresponding functions of the vehicle.

[0139] The memory 2002 may include a volatile memory, such as a RAM; the memory may also include a non-volatile memory, such as a ROM, a flash memory, a HDD or a solid-state drive SSD; the memory 2002 may also include a combination of the above-mentioned types of memories. The memory 2002 may be used to store a set of program codes or instructions corresponding to the program codes, so that the processor 2001 calls the program codes or instructions stored in the memory 2002 to implement the corresponding functions of the vehicle. In the present application, a set of program codes for vehicle control may be stored in the memory 2002, and the processor 2001 calls the program codes to control the safe driving of the vehicle. How to achieve safe driving of the vehicle is described in detail below in the present application.

[0140] Optionally, in addition to storing program codes or instructions, the memory 2002 may also store information such as road maps, driving routes, sensor data, etc. The computer system 20 may be combined with other elements in the vehicle functional framework diagram, such as sensors in the sensor system, GPS, etc., to implement relevant functions of the vehicle. For example, the computer system 20 may control the driving direction or driving speed of the vehicle based on the data input from the sensor system 12, which is not limited in this application.

[0141] The vehicle display system 22 may include several components, such as a controller and a vehicle display. The controller 222 is used to generate an image (such as an image of VR content) according to user instructions, and send the image to the vehicle display for display; the vehicle display may include an image generation unit, a window unit and an image magnification unit, and passengers can view the target image presented by the vehicle display through the window unit. Among them, the functions of some components in the vehicle display system can also be implemented by other subsystems of the vehicle. For example, the controller can also be a component in the control system.

[0142] Among them, this application Fig.13The four subsystems shown are sensor system 12, control system 14, computer system 20 and vehicle display system 22, which are only examples and not limiting. In practical applications, vehicles can combine several components in the vehicle according to different functions to obtain subsystems with corresponding different functions. In practical applications, vehicles can include more or fewer systems or components, which is not limited in this application.

[0143] The above-mentioned means of transportation may be a car, a truck, a bus, a ship, an airplane, a helicopter, an amusement vehicle, a train, etc., and the embodiments of the present application do not make any particular limitation.

[0144] Unless otherwise defined, technical or scientific terms used herein shall have the common meanings understood by one of ordinary skill in the art to which the present disclosure belongs.

[0145] The above description is only an embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the present application shall be included in the protection scope of the present application.

Claims

1. A display system, characterized in that: include: A display device and a first driving device, wherein the display device is installed in a dashboard of a cockpit, the display device comprises an image generating unit, an image magnifying unit, a window unit and a housing, the window unit comprises a first surface and a second surface, the housing comprises a third surface and a fourth surface, an end of the third surface close to the fourth surface is tightly connected to an end of the fourth surface close to the third surface, wherein: The image generating unit is configured to emit a first imaging light toward the window unit, wherein the first imaging light is configured to generate a first virtual image; The window unit is used to reflect the first imaging light from the image generating unit to the image magnifying unit on the first surface, and transmit the first imaging light from the image magnifying unit from the first surface to the second surface, so that human eyes can see the first virtual image through the first imaging light emitted from the second surface; The image amplifying unit is used to reflect the first imaging light from the window unit to the window unit; The housing is used to enclose the image generating unit and the image magnifying unit, wherein an end of the third surface away from the fourth surface is connected to the upper edge of the window unit, and an end of the fourth surface away from the third surface is connected to the lower edge of the window unit, so that the display device constitutes a closed whole with an internal space, and the first surface of the window unit is enclosed in the internal space; The first driving device is used to adjust the state of the display device to a storage state or a display state, wherein the storage state is that the second surface is embedded in the dashboard so that the third surface constitutes a part of the knee guard of the dashboard, and the fourth surface constitutes a part of the table top of the dashboard, and the display state is that the third surface is separated from the knee guard of the dashboard, and the fourth surface is separated from the table top of the dashboard, so that the second surface is opposite to the human eye.

2. The display system according to claim 1, characterized in that: When the display device is in the storage state, the curvature of the connection between the third surface and the fourth surface is the same as the curvature of the connection between the knee guard and the table top.

3. The display system according to claim 1, characterized in that: When the display device is in a display state, the table top and a position for storing the display device present a stepped surface.

4. The display system according to any one of claims 1 to 3, characterized in that: The first driving device is installed inside the display device or in the instrument panel.

5. The display system according to any one of claims 1 to 4, characterized in that: The display device further includes a connecting unit, wherein the connecting unit is connected to the first driving device. The first driving device is specifically used to drive the connecting unit to work; The connecting unit is used to adjust the state of the display device to a storage state or a display state during operation.

6. The display system according to any one of claims 1 to 5, characterized in that: The first driving device is further used to adjust the first angle of the display device to a second angle, so that the user can view the first virtual image at the second angle through the window unit.

7. The display system according to claim 6, characterized in that: The display system further includes a first acquisition device and a processing device, wherein the first acquisition device is connected to the processing device. The first acquisition device is used to acquire one or more first images containing the human eye when the display device is at the first angle, and send the one or more first images to the processing device; The processing device generates a first adjustment amount based on the one or more first images, and sends the first adjustment amount to the first driving device; The first driving device is specifically configured to adjust the first angle to the second angle according to the first adjustment amount.

8. The display system according to claim 7, characterized in that: The first acquisition device is further configured to acquire one or more second images including the human eye when the display device is at a second angle, and send the one or more second images to the processing device; The processing device further generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit; The image generating unit is configured to generate an image of a corresponding size according to the second adjustment amount, and emit a second imaging light; The window unit is used to reflect the second imaging light from the image generating unit to the image magnifying unit, and transmit the second imaging light from the image magnifying unit, so that the user can view a second virtual image formed by the second imaging light at the second angle through the window unit; The image amplifying unit is used to reflect the second imaging light from the window unit to the window unit.

9. The display system according to claim 7, characterized in that: The display system further includes: a second acquisition device, a seat, and a second drive device, a user sits on the seat to view the first virtual image, the second drive device is connected to the seat, and the second drive device is connected to the processing device. The second acquisition device is used to acquire user information and send the user information to the processing device; The processing device is used to generate a third adjustment amount according to the user information and a relative height between the height of the display device and the height of the human eye, and send the third adjustment amount to the second driving device, wherein the height of the display device is the height of the center of the window unit of the display device relative to the ground of the cabin, the height of the human eye is the height of the human eye relative to the ground of the cabin, and the relative height between the height of the display device and the height of the human eye satisfies that the user is within a viewing angle range when viewing the first virtual image; The second driving device is used to adjust the height of the seat according to the third adjustment amount.

10. The display system according to claim 9, characterized in that: The user information includes at least one of the following: the height of the human eye, the height of the user, the position of the human eye in the image, and the weight of the user.

11. A means of transport, characterized in that: The invention comprises a display system as claimed in any one of claims 1 to 10.

12. A cockpit system, characterized in that: The invention comprises a display system as claimed in any one of claims 1 to 10.

Images