Display system, vehicle, and cabin system

Abstract

A display system (100) capable of being applied to a vehicle, comprising: a display device (101) and a first driving device (103). The display device (101) is of a closed integral structure having an internal space, and the display device (101) is mounted in a dashboard (102) of a cabin and comprises an image generation unit (201), an image enlargement unit (203), a window unit (202), and a housing (204). The image generation unit (201), the image enlargement unit (203), and the window unit (202) are used for generating a virtual image for human eyes to view. The housing (204) is used for enclosing the image generation unit (201) and the image enlargement unit (203). The first driving device (103) is used for adjusting the state of the display device (101) to a stored state or a display state. The display system (100) can provide intelligent visual experience for passengers in the cabin, while ensuring the aesthetics of the cabin. Further provided are a vehicle and cabin system comprising the display system (100).

Description

Display system, vehicle and cockpit system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on October 31, 2023, with application number 202311439626.8 and application name “A Display System and Vehicle”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the fields of display technology and intelligent automobile driving technology, and more specifically, to a display system and a vehicle. Background Art

[0003] Cars have become an indispensable means of transportation in our daily lives. With the advancement of intelligent vehicles, people's demands for cars have evolved from simple transportation to living spaces that provide access to information and entertainment. In-car display technology has become a hot research area. By installing in-car displays, passengers can access information or engage in activities such as viewing entertainment, thereby creating intelligent applications for the cabin space.

[0004] In some cockpits, the display device is installed on the car dashboard. How to balance the aesthetics of the dashboard with the functionality of the display device to enhance the user's viewing experience is a problem that needs to be solved.

[0005] Summary of the Invention

[0006] The present application provides a display system and a vehicle. The display system provided in the present application can not only provide an intelligent visual experience for passengers in the cabin, but also take into account the aesthetics of the cabin.

[0007] In a first aspect, an embodiment of the present application provides a display system. It includes: a display device and a first driving device, wherein the display device is installed in the instrument panel of the cockpit, the display device includes an image generating unit, an image magnifying unit, a window unit and a housing, the window unit includes a first surface and a second surface, the housing includes a third surface and a fourth surface, the end of the third surface close to the fourth surface is tightly connected to the end of the fourth surface close to the third surface, wherein: the image generating unit is used to emit a first imaging light to the window unit, the first imaging light is used to generate a first virtual image; the window unit is used to reflect the first imaging light from the image generating unit to the image magnifying unit on the first surface, and transmit the first imaging light from the image magnifying unit from the first surface to the second surface, so that the human eye can view the first virtual image through the first imaging light emitted from the second surface; the image magnifying unit is used to reflect the first imaging light from the window unit The first imaging light is directed to the window unit; the outer shell is used to wrap the image generating unit and the image magnifying unit, wherein the end of the third surface away from the fourth surface is connected to the upper edge of the window unit, and the end of the fourth surface away from the third surface is connected to the lower edge of the window unit, so that the display device constitutes a closed whole with an internal space, and the first surface of the window unit is wrapped in the internal space; the first driving device is used to adjust the state of the display device to a storage state or a display state, wherein the storage state is that the second surface is embedded in the instrument panel, so that the third surface constitutes a part of the knee guard of the instrument panel, and the fourth surface constitutes a part of the table top of the instrument panel, and the display state is that the third surface is separated from the knee guard of the instrument panel, and the fourth surface is separated from the table top of the instrument panel, so that the second surface is opposite to the human eye.

[0008] It should be noted that in the present application, the display device can be installed in the main driver's instrument panel, or in the co-pilot's instrument panel, or in both the main driver's instrument panel and the co-pilot's instrument panel, and this application does not limit this.

[0009] It should also be noted that the display system provided by the present application can automatically switch the state of the display device, or it can switch the state of the display device based on manual operation of the user. For example, when the display system automatically switches the state of the display device, the first drive device can be implemented by electric, magnetic, etc. In this case, the first drive device can be a motor or a magnet. For example, when some detectors detect that a user is sitting on the seat, the first drive device starts automatic switching, so that the display device stored in the driving console is moved out of the driving console, and the state is changed to the display state. When the display system manually switches the state of the display device, the first drive device can be a manual rocker, a manual rotary valve, etc.

[0010] It should be noted that in the present application, when the display device is in the display state, it does not necessarily provide a display image to the user. This depends on whether the display device has loaded an image source or video source, or whether the user needs to watch the image or video. For example, in some scenarios, upon detecting that a user is sitting in a chair, the display system automatically changes the display device state to the display state. When the user wants to watch an image or video, the user provides a video source to the display device, or the user turns on the video source connected to the display device, etc., at which point the display device provides the display image to the user.

[0011] Based on the above solution, the display system provided by this application allows the user to view videos and images when the display device is in the stowed state and is not in use. The display device is stored in the instrument panel, thereby saving instrument panel space. This storage also provides further protection for the display device's window unit, preventing scratches and other damage. Furthermore, the stowed display device prevents secondary harm to the user in the event of a safety incident. When the display device is in the display state, the user views video images via imaging light emitted from the second surface of the window unit, providing a satisfying user experience in the intelligent cockpit.

[0012] In combination with the first aspect, in certain implementations of the first aspect, when the display device is in the retracted state, the curvature of the connection between the third surface and the fourth surface is the same as the curvature of the connection between the knee guard and the table top.

[0013] Based on the above solution, the third surface and the fourth surface of the display device can be made to form a seamless effect with the knee guard and the instrument panel surface respectively, thereby improving the aesthetics of the cockpit system.

[0014] In combination with the first aspect, in certain implementations of the first aspect, when the display device is in a display state, the table top and the position for storing the display device present a stepped surface.

[0015] In combination with the first aspect, in some implementations of the first aspect, the first driving device is installed inside the display device or in the instrument panel.

[0016] In combination with the first aspect, in certain implementations of the first aspect, the display device further includes a connecting unit, which is connected to the first driving device, and the first driving device is specifically used to drive the connecting unit to work; the connecting unit is used to adjust the state of the display device to a storage state or a display state when working.

[0017] In combination with the first aspect, in some implementations of the first aspect, the first driving device is further used to adjust the first angle of the display device to a second angle, so that the user can view the first virtual image at the second angle through the window unit.

[0018] It should be noted that, in the present application, the angle of the display device (including the first angle and the second angle) can be the pitch angle of the display device. When the display device is adjusted from the first angle to the second angle, the display device can be shaken up and down in the vertical direction, similar to the "nodding" effect; or, the angle of the display device can be the swing angle of the display device (or called the horizontal deflection angle). When the display device is adjusted from the first angle to the second angle, the display device can be shaken left and right in the horizontal direction, similar to the "shaking head" effect; or, the angle of the display device can be the pitch angle and swing angle of the display device that change simultaneously. When the display device is adjusted from the first angle to the second angle, the display device can be adjusted in the entire spatial angle.

[0019] In the present application, the angle of the display device can be automatically or manually adjusted according to the function of the first driving device. When the angle of the display device is automatically adjusted, the intelligent performance of the vehicle display system can be improved, thereby providing users with a smarter experience.

[0020] In combination with the first aspect, in certain implementations of the first aspect, the display system further includes a first acquisition device and a processing device, the first acquisition device and the processing device being connected, the first acquisition device being used to acquire one or more first images containing the human eye when the display device is at the first angle, and to send the one or more first images to the processing device; the processing device generating a first adjustment amount based on the one or more first images, and sending the first adjustment amount to the first driving device; the first driving device being specifically used to adjust the first angle to the second angle according to the first adjustment amount.

[0021] The display system provided in the present application can generate an angle adjustment amount based on one or more images containing the human eye, so that the display system provided in the present application can achieve an automatic adjustment effect based on the human eye.

[0022] In combination with the first aspect, in certain implementations of the first aspect, the first acquisition device is further used to acquire one or more second images containing the human eye when the display device is at a second angle, and send the one or more second images to the processing device; the processing device also generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit; the image generation unit is used to generate an image of corresponding size according to the second adjustment amount, and emit second imaging light; the window unit is used to reflect the second imaging light from the image generation unit to the image magnification unit, and transmit the second imaging light from the image magnification unit, so that the user can view the second virtual image formed by the second imaging light at the second angle through the window unit; the image magnification unit is used to reflect the second imaging light from the window unit to the window unit.

[0023] Based on the above scheme, the display system provided in the embodiment of the present application can not only adjust the angle of the display device, but also further calculate the size of the virtual image based on one or more second images, thereby ensuring that the user can view the complete virtual image when the angle cannot be adjusted (for example, when the limit of the display device angle adjustment is reached), further improving the reliability of the display system performance.

[0024] In conjunction with the first aspect, in certain implementations of the first aspect, the display system further includes: a second acquisition device, a seat, and a second drive device, wherein a user sits in the seat and views the first virtual image; the second drive device is connected to the seat, and the second drive device is connected to the processing device. The second acquisition device is configured to acquire user information and send the user information to the processing device; the processing device is configured to generate a third adjustment amount based on the user information and the relative height between the display device and the height of the user's eyes, and send the third adjustment amount to the second drive device, wherein the height of the display device is the height of the center of the display device's window unit relative to the floor of the cabin; the height of the user's eyes is the height of the user's eyes relative to the floor of the cabin; and the relative height between the height of the display device and the height of the user's eyes satisfies the user's viewing angle range when viewing the first virtual image; and the second drive device is configured to adjust the seat height according to the third adjustment amount. In conjunction with the first aspect, in certain implementations of the first aspect, the viewing angle θ ranges from -1.5° ≤ θ1 ≤ 0°.

[0025] Based on the above solution, the present application provides a display system that can adjust the relative height between the display device and the human eye height by adjusting the height of the seat, thereby satisfying the user's need to be within the viewing angle range when viewing the virtual image of the display device, thereby improving the user experience.

[0026] In combination with the first aspect, in certain implementations of the first aspect, the user information includes at least one of the following: the height of the human eye, the height of the user, the position of the human eye in the image, and the weight of the user.

[0027] In a second aspect, embodiments of the present application provide a processing device. This device is applicable to the display system provided by the first aspect and any one of the implementations of the first aspect. The processing device may include one or more units and / or modules. The processing device may include an input / output interface. Optionally, the input / output interface may be an input / output circuit.

[0028] Alternatively, the processing device may be a chip, a chip system or a processor, a processing circuit or a logic circuit, etc.

[0029] For the acquisition and other operations involved in the processing device, unless otherwise specified, or unless they conflict with their actual function or internal logic in the relevant description, they can be understood as processor reception, input and other operations, and this application does not impose any limitations on this.

[0030] In a third aspect, an embodiment of the present application provides a chip, which includes the processing device and the communication interface described in the second aspect, and the processor obtains user information through the communication interface.

[0031] In a fourth aspect, an embodiment of the present application provides a cockpit system, which includes the display system provided by the above-mentioned first aspect and any one of the implementation methods of the first aspect.

[0032] In a fifth aspect, an embodiment of the present application provides a vehicle, including the system provided by the above-mentioned first aspect and any one of the implementation methods of the first aspect.

[0033] The beneficial effects brought about by the second to fifth aspects mentioned above can be specifically referred to the description of the beneficial effects in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] FIG1 is a schematic diagram of an application scenario of a first display system 100 provided in this application.

[0035] FIG. 2 is a schematic diagram of a display device 101 applicable to an embodiment of the present application.

[0036] FIG3 is a schematic diagram of the display device 101 provided in an embodiment of the present application in a stored state.

[0037] FIG4 is a schematic diagram of the display device 101 provided in an embodiment of the present application when in a display state.

[0038] FIG5 is a schematic structural diagram of a second display system 500 provided in an embodiment of the present application.

[0039] FIG6 is a schematic diagram of adjusting the first eye position and the ideal eye position in the vertical direction provided by an embodiment of the present application.

[0040] FIG7 is a diagram showing the effects of adjusting the first eye position and rotating the display device 101 according to an embodiment of the present application.

[0041] FIG8 is a schematic diagram of adjusting the first eye position and the ideal eye position in the horizontal direction provided by an embodiment of the present application.

[0042] FIG9 is a schematic diagram of simultaneously adjusting the first eye position and the ideal eye position in the vertical and horizontal directions according to an embodiment of the present application.

[0043] FIG10 is a schematic diagram of the depth of the human eye provided in an embodiment of the present application.

[0044] FIG11 is a schematic diagram of a third display system 1100 provided in an embodiment of the present application.

[0045] FIG12 is a circuit diagram of a display device provided in an embodiment of the present application.

[0046] FIG13 is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0048] In order to facilitate understanding of the embodiments of the present application, the following explanations are provided.

[0049] First, the terms "first," "second," and various numbers used in the following descriptions or drawings of the embodiments of this application are merely for ease of description and are not intended to limit the scope of the embodiments of this application. For example, the first virtual image and the second virtual image are virtual images generated by different imaging lights, and the first adjustment amount, the second adjustment amount, and the third adjustment amount are used to distinguish the adjustment amount for angle adjustment, the adjustment amount for frame adjustment, and the adjustment amount for seat height, respectively.

[0050] Second, the terms "including" and "having" and any variations thereof in the embodiments of the present application shown below are intended to cover non-exclusive inclusions. For example, a system, product or device that includes a series of units is not necessarily limited to those units explicitly listed, but may include other units that are not explicitly listed or are inherent to these products or devices.

[0051] Third, in the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or descriptions. An embodiment or design described as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. The use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete manner to facilitate understanding.

[0052] Fourth, in the embodiments of the present application, imaging light refers to light carrying an image (or image information) and is used to generate an image, and may also be referred to as image light, etc.

[0053] Fifth, in the drawings of this application, the thickness, size, and shape of each optical element have been slightly exaggerated for ease of illustration. Specifically, the shapes of the optical elements shown in the drawings are by way of example, and the drawings are for illustrative purposes only and are not drawn strictly to scale.

[0054] Sixth, unless otherwise defined, all terms (including technical and scientific terms) used in this application have the same meaning as commonly understood by those skilled in the art to which this application belongs. It should also be understood that terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology and will not be interpreted in an idealized or overly formal sense unless expressly defined as such herein.

[0055] With the rapid development of smart cars, cars are playing an increasingly important role in people's lives, and the demand for in-car displays is gradually increasing. For example, they can provide entertainment services such as games and movies for passengers who spend long hours in the car, or provide office workers with a private office display environment.

[0056] To provide in-vehicle display functions, directly installing a display screen is a common solution. For example, a liquid crystal display (LCD) can be installed on the cockpit instrument panel for use by passengers in the vehicle. However, the image viewed on such a display device is related to the screen size of the display device. To achieve a large-size viewing experience, the display device needs to have a larger screen size, which is not only costly but also causes congestion in the vehicle interior.

[0057] In view of this, an embodiment of the present application provides a display system that not only provides users with a large-format, long-distance visual experience, but also, due to its small size, can be hidden in the internal space of the dashboard when not in use, saving space inside the car.

[0058] FIG1 is a schematic diagram of an application scenario of the first display system 100 provided in this application. As shown in FIG1 , the display system 100 includes a display device 101 and a drive device 103 arranged on a dashboard 102. The display device 101 can generate a long-distance magnified virtual image through the input of an external video signal (also referred to as a signal source), providing the viewer with a large-format, long-distance visual experience, and meeting the needs of various application scenarios such as user leisure and entertainment, business office, etc. The display device 101 can be installed on the dashboard before leaving the factory. Alternatively, it can also be installed on the dashboard after the dashboard is modified after leaving the factory, and this application does not limit it.

[0059] It is understood that the display system 100 can be applied to vehicles including but not limited to the following: cars, trucks, buses, ships, airplanes, helicopters, recreational vehicles, trains, etc.

[0060] In the present application, the display device 101 can be set on the instrument panel of the main driver's seat, or on the instrument panel of the co-pilot's seat, or on both the instrument panel of the main driver's seat and the co-pilot's seat, and this application does not limit it. It can be understood that for the instrument panel extending from the main driver's seat to the co-pilot's seat, the display device 101 is set on the instrument panel of the main driver's seat or on the instrument panel of the co-pilot's seat, which means that the display device 101 is installed in the instrument panel near the main driver's seat or near the co-pilot's seat.

[0061] In some embodiments, FIG2 is a schematic diagram of a display device 101 applicable to embodiments of the present application. FIG2(a) is a side structural perspective view of the display device 101, FIG2(b) is a front view of the display device 101, and FIG2(c) is a schematic diagram of the display device 101 from other viewing angles. As shown in FIG2 , the display device 101 includes an image generating unit 201, a window unit 202, an image magnifying unit 203, and a housing 204 (also referred to as a protective shell, external housing, etc.). The window unit 202 includes a first surface 212 and a second surface 222, and the housing 204 includes a third surface 214 and a fourth surface 224. One end of the third surface 214 is connected to the upper edge of the window unit 202, the other end of the third surface 214 is tightly connected to one end of the fourth surface 224 (i.e., connected at the connection point in FIG2 ), and the other end of the fourth surface 224 is connected to the lower edge of the window unit 202, so that the second surface 222 of the window unit 202, the third surface 214, and the fourth surface 224 enclose a closed internal space, and the image generation unit 201 and the image magnification unit 203 are arranged in the internal space. Specifically, when the display device 101 is in operation, the image generation unit 201 is configured to emit imaging light toward the first surface 212 of the window unit 202. After being reflected by the first surface 212 of the window unit 202, the imaging light is transmitted to the surface of the image magnification unit 203. After being reflected by the image magnification unit 203, the imaging light reaches the first surface 212 again, and then passes through the first surface 212 and the second surface 222 before entering the human eye, so that the human eye can see a virtual image located at the image plane.

[0062] It should be noted that in the present application, the third surface 214 and the fourth surface 224 can be two surfaces of the shell 204. In this case, the shell 204 is a complete shell, such as a structural member integrally formed by an injection mold process. Alternatively, the third surface 214 and the fourth surface 224 are respectively the surfaces of a partial shell of the shell 204. In this case, the shell 204 can be split into a portion corresponding to the third surface 214 and another portion corresponding to the fourth surface 224, that is, the shell 204 is no longer a complete shell. When the third surface 214 and the fourth surface 224 are respectively the surfaces corresponding to the partial shells, the third surface 214 and the fourth surface 224 are closely connected, which can mean that the portion of the shell corresponding to the third surface 214 and the other portion of the shell corresponding to the fourth surface 224 are closely connected, such as by being glued together with a specific glue. In this case, there is no other connection structure between the portion of the shell corresponding to the third surface 214 and the other portion of the shell corresponding to the fourth surface 224. In other words, the connection in Figure 2 is only used to indicate the position where the portion of the shell corresponding to the third surface 214 and the other portion of the shell corresponding to the fourth surface 224 are closely connected, and can also be understood as the boundary between the third surface and the fourth surface. Alternatively, the third surface 214 and the fourth surface 224 are closely connected, which may mean that a portion of the shell corresponding to the third surface 214 and another portion of the shell corresponding to the fourth surface 224 are closely connected via other connecting structures, such as a decorative strip or another small portion of the shell serving as the outer shell 204, to secure the portion of the shell corresponding to the third surface 214 and the other portion of the shell corresponding to the fourth surface 224 together. In this case, the connection in FIG. 2 represents the connecting structure connecting the portion of the shell corresponding to the third surface 214 and the other portion of the shell corresponding to the fourth surface 224.

[0063] In the embodiment of the present application, the states of the display device 101 include a storage state and a display state. The first driving device 103 is used to adjust the display device 101 from the storage state to the display state, or from the display state to the storage state.

[0064] Specifically, when the display device 101 is in the stowed state, the second surface 222 of the window unit 202 is embedded in the instrument panel 102, such that the third surface 214 forms part of the knee guard of the instrument panel 102, and the fourth surface 224 forms part of the tabletop of the instrument panel 102. For example, when a user is not viewing images using the display device 101, the display device 101 can be controlled to switch from the display state to the stowed state via an operating system, such as a mobile phone application, or by operating a control button on the instrument panel 102. Alternatively, if no human eyes or user are detected for an extended period of time, the display system 100 can control the first drive device 103 (e.g., via instructions sent by a processing device) to automatically switch from the display state to the stowed state.

[0065] It will be appreciated that, when the display device 101 is in the stowed state, in some embodiments, at least a portion of the third surface 214 or the fourth surface 224 may not fully align with the corresponding surface of the instrument panel 102. In other words, the third surface 214 may not fully align with the knee pad of the instrument panel 102, or the fourth surface 224 may not fully align with the surface of the instrument panel 102. Alternatively, the third surface 214 may not fully align with the knee pad of the instrument panel 102, and the fourth surface 224 may not fully align with the surface of the instrument panel 102. In other embodiments, when the display device 101 is in the stowed state, the third surface 214 may fully align with the knee pad of the instrument panel 102, and the fourth surface 224 may fully align with the surface of the instrument panel 102. In this case, the curvature of the junction between the third surface 214 and the fourth surface 224 is the same as the curvature of the junction between the knee pad of the instrument panel 102 and the surface of the instrument panel 102, as shown in FIG. Compared with the case of incomplete fitting, when the display device 101 is fully embedded, the shape of the display device 101 can be coupled with the design of the instrument panel 102, thereby achieving perfect unification of the interior shape of the vehicle.

[0066] When the display device 101 is in the display state, the third surface 214 is separated from the knee pads of the instrument panel 102, and the fourth surface 224 is separated from the instrument panel surface, so that the second surface 222 is opposite the user's eyes. For example, when a user needs to use the display device 101 to view images, the display device 101 can be controlled to adjust from the storage state to the display state through the operating system or control buttons. Alternatively, when a human eye or user is detected (at this time, the user is not using the display device), the display system 100 controls the first drive device 103 to automatically adjust from the storage state to the display state.

[0067] It can be understood that since the display device 101 occupies the internal space of the instrument panel 102 when in the storage state, when the display device 101 is in the display state, the display device 101 is moved out of the instrument panel 102, so that the table top of the instrument panel 102 and the position for storing the display device 101 present a stepped surface, as shown in Figure 4.

[0068] It should be noted that in this application, the terms "stowed state" and "display state" are used solely to define the spatial state of the display device 101 and should not be construed as necessarily providing a viewable image to the user. In other words, even when the display device 101 is in the stowed state, it can still continue to operate; or even when the display device 101 is in the display state, it can be inoperative, appearing only as if it were deployed from the instrument panel and visible within the cabin.

[0069] In some embodiments, the state adjustment of the display device 101 by the first drive device 103 can be implemented based on the connection unit 205. In this case, the display device 101 also includes a connection unit 205. Optionally, the connection unit 205 can be at least one of a rotating component (including but not limited to one or more rotating shafts, one or more rotating brackets, one or more rotating gears, etc.) and a moving component (including but not limited to a slide rail, a lifting platform, etc.), which can adjust the state of the display device 200 as a whole under the adjustment of the first drive device 103. Exemplarily, when the first drive device 103 adjusts the display device 101 from the storage state to the display state, if the connection unit 205 is a rotating component, at this time, the display device 101 rotates out of the instrument panel 102 until it rotates to a suitable angle and then stops. If the connection unit 205 is a rotating component and a moving component, the first drive device 103 can first drive the moving component to move the display device 101 out of the instrument panel (for example, slide out or lift), and then drive the rotating component to rotate the display device 101 to a suitable angle and then stop.

[0070] Optionally, the first drive device 103 is connected to the connection unit 205 via a damping structure, wherein the damping structure may include but is not limited to a hinge, a damper, a gear, etc. Alternatively, the first drive device 103 is connected to the connection unit 205 via a magnetic connection. Alternatively, the first drive device 103 may be an automatic device (e.g., electric, magnetic, etc.) or a manual device. For example, when the first drive device 103 is connected to the connection unit 205 via a damping structure, and the first drive device 103 is an automatic device, the first drive device 103 may be a motor that drives the connection unit 205 to operate, thereby adjusting the state of the display device 101. Alternatively, the first drive device 103 may be a permanent magnet that drives the connection unit 205 (e.g., a magnetic coil) to operate, thereby adjusting the state of the display device 101. Alternatively, when the first drive device 103 is a manual device, the first drive device 103 can adjust the state of the display device 101 by user operation of the connection unit 205.

[0071] When the first driving device 103 is an automatic device, the automatic device can be arranged in the internal space of the display device 101, or arranged outside the display device 101, such as in the instrument panel, or on the surface outside the shell of the display device 101, which is not limited in this application.

[0072] It should be noted that in some embodiments, the display system 100 provided herein may not include the first drive device 103. For example, the user can manually press the housing of the display device 101 to achieve rotation of the display device 101. For example, when a user needs to adjust the display device 103 from the storage state to the display state, the user presses downward on the fourth surface 224. At this time, the downward pressure drives the connection unit 205 to rotate, causing the third surface 214 and the window unit 202 to tilt. Subsequently, the user can use both hands or one hand to help the display device 101 be fixed to a fixing device such as a card slot for use.

[0073] Alternatively, in other embodiments, there is no obvious connection relationship between the first driving device 103 and the connecting unit 205. For example, when the connecting unit 205 is a rotating component, the first driving device 103 can be a rotating handle or rotating gear of the connecting unit 205. In this case, it can be regarded as the first driving device 103 directly driving the display device 101 to rotate, or it can be regarded as the connecting unit 205 directly driving the display device 101 to rotate.

[0074] Optionally, the image generation unit 201 can adopt a liquid crystal display (LCD) display, a liquid crystal on silicon (LCOS) display, an organic light-emitting diode (OLED) display, a micro light-emitting diode (Micro-LED) display, a display using miniLED display technology, a digital light processing (DLP) display or a micro-electro-mechanical systems (MEMS) display, etc., which is not limited in this application.

[0075] Optionally, the image magnifying unit 203 is a free-form surface mirror, or a non-free-form surface mirror, such as a spherical mirror.

[0076] It should be noted that FIG2 is merely an example of a display device applicable to an embodiment of the display system of the present application, that is, the structure of the display device applicable to the embodiment of the present application is not limited to the structure shown in FIG2. In other embodiments, the image generation unit 201 in the display device 200 may be arranged at other locations, for example, behind the image magnification unit 203. In this case, the imaging light emitted by the image generation unit 201 transmits through the image magnification unit 203 and is incident on the surface of the window unit 202. After being reflected by the window unit 202, it is incident on the image magnification unit 203, and then is reflected again by the image magnification unit 203 to the window unit 202, and then transmits through the window unit 202 before entering the human eye.

[0077] FIG5 is a schematic structural diagram of a second display system 500 provided in an embodiment of the present application. It should be noted that the display system 500 shown in FIG5 is illustratively described using the display device 101 shown in FIG2 above as an example. As shown in FIG5 , the display system 500 includes a display device 101, a first drive device 103, a first acquisition device 510, and a processing device 520. The first acquisition device 510 is connected to the processing device 520, which is in turn connected to the first drive device 103. Specifically, the first acquisition device 510 is configured to acquire one or more first images containing a user's eyes when the display device 101 is at a first angle, and to send the one or more first images to the processing device 520. The processing device 520 generates a first adjustment value based on the received one or more first images, and sends the first adjustment value to the first drive device 103. For the description of the display device 101 and the first drive device 103, reference can be made to the relevant portions of FIG2 above, and will not be repeated here.

[0078] Alternatively, the first acquisition device 510 may be a sensor within the cabin, for example, an image sensor disposed on the cabin roof or on the housing of the display device 101. When the first acquisition device 510 is an image sensor disposed on the cabin roof, it may be disposed directly in front of the user's eyes to capture one or more first images containing the front view of the eyes; or it may be disposed to the side of the user's face to capture one or more first images containing a side view of the eyes. When the first acquisition device 510 is an image sensor disposed on the housing of the display device 101, it may be disposed on the housing above the window unit 202 (as shown in FIG. 5 ) to capture one or more first images containing the front view of the eyes.

[0079] Alternatively, the processing device 520 may be a processor disposed in the cockpit or on the housing of the display device 101. When the processing device 520 is a processor disposed in the cockpit, the processor may be a central processing unit (CPU) that controls the cockpit system. When the processing device 520 is located on the housing of the display device 101, it may be disposed next to the first acquisition device 510 located on the housing, as shown in FIG5 .

[0080] It should be noted that this application does not limit the connection method between the processing device 520 and the first acquisition device 510, and the connection method between the processing device 520 and the first drive device 103. Both can be connected through a wired link or a wireless link. They can be directly connected or indirectly connected through other network devices, controllers, etc., so that the processing device 520 can exchange information with the first acquisition device 510 or the first drive device 103 through the connected link.

[0081] In some embodiments, when the first acquisition device 510 acquires a first image, the processing device 520 determines the first human eye position and the ideal human eye position based on the received first image, and generates a first adjustment amount based on the first human eye position and the ideal human eye position, wherein the first human eye position is the distance of the human eye in the first image relative to the image edge in the vertical direction and / or horizontal direction.

[0082] Specifically, when the first human eye position is the distance in the vertical direction relative to the edge of the first image, (a) in Figure 6 shows a schematic diagram of the first human eye position in the first image being located above and below the ideal human eye position, wherein the vertical direction is the y direction shown in Figure 6. At this time, the processing device 520 can determine the distance d or distance d' between the first human eye position and the ideal human eye position in the vertical direction (that is, the difference between the y coordinate of the first human eye position and the y coordinate of the ideal human eye position) through an image processing algorithm, and generate a first adjustment amount Δθ of the angle of the display device 101 based on the distance d or the distance d', and send the first adjustment amount Δθ to the first driving device 103. The first driving device 103 drives the connecting unit 205 to rotate Δθ according to the first adjustment amount Δθ to complete the angle adjustment of the display device 101, so that the human eye position in the image after the angle adjustment basically coincides with the ideal human eye position, as shown in (b) in Figure 6. When the first eye position is the distance in the vertical direction relative to the edge of the first image, if the ideal eye position is used as the coordinate axis with a distance of 0, when the first eye position is above the ideal eye position, the distance d can be set to a positive value, and the display device 101 achieves a "head-up" effect when adjusting the angle. When the first eye position is below the ideal eye position, the distance d' is set to a negative value, and the display device 101 achieves a "head-down" effect when adjusting the angle. For example, as shown in Figure 7, when the first eye position is adjusted from position 1 to position 2, since the first eye position is upward relative to the ideal eye position, the display device 101 achieves a head-up effect.

[0083] When the first eye position is a horizontal distance relative to the edge of the first image, FIG8(a) shows a schematic diagram of the first eye position being located to the left and right of the ideal eye position, where the horizontal direction is the x-direction shown in FIG8 . In this case, the processing device 520 can determine the horizontal distance d or distance d' between the first eye position and the ideal eye position (i.e., the difference between the x-coordinate of the first eye position and the x-coordinate of the ideal eye position) through an image processing algorithm, and calculate a first adjustment amount Δθ for the angle of the display device 101 based on the distance d. The first adjustment amount Δθ is sent to the first driving device 103, which drives the connecting unit 205 to rotate Δθ based on the first adjustment amount Δθ, completing the angle adjustment of the display device 101 so that the eye position in the adjusted image substantially coincides with the ideal eye position, as shown in FIG8(b). When the first eye position is a horizontal distance relative to the edge of the first image, the left side of the ideal eye position can be set as negative, and the right side of the ideal eye position can be set as positive. That is, when the first eye is to the left of the ideal eye, the distance d is a negative value, and the display device 101 achieves a leftward "shaking head" effect when adjusting the angle. When the first eye is to the right of the ideal eye, the distance d' is a positive value, and the display device 101 achieves a rightward "shaking head" effect when adjusting the angle.

[0084] When the position of the first human eye in a first image acquired by the first acquisition device 510 changes in both the vertical and horizontal directions relative to the ideal human eye position, for example, as shown in (a) of Figure 9 , when the first human eye position is located to the upper left of the ideal human eye position, the processing device 520 can determine the vertical distance d1 and the horizontal distance d2 between the first human eye position and the ideal human eye position through an image processing algorithm, and calculate and generate a first adjustment amount Δθ of the angle of the display device 101 based on the distances d1 and d2, and send the first adjustment amount Δθ to the first driving device 103. The first driving device 103 drives the connecting unit 205 to rotate Δθ according to the first adjustment amount Δθ to complete the angle adjustment of the display device 101, so that the human eye position in the image after the angle adjustment basically coincides with the ideal human eye position, as shown in (b) of Figure 9 .

[0085] Generally speaking, during the actual angle adjustment process, there are errors in the rotation process of the connecting unit 205, or the calculation process of the processing device 520, or the process of the first acquisition device 510 acquiring the first image. Therefore, the human eye position in the image after the angle adjustment described in this application basically coincides with the ideal human eye position, which means that the distance between the human eye position after the angle adjustment and the ideal human eye position (including at least one of the vertical distance and horizontal distance mentioned above) is within the allowable error range.

[0086] It will be appreciated that in FIG6 , since the first eye position varies only in the vertical direction relative to the ideal eye position, the first eye position obtained by the processing device 520 is the vertical coordinate value of the eye in the first image relative to the edge of the first image. When the first image is rectangular, the vertical direction can be understood as the direction of the short side of the rectangle. In FIG8 , the first eye position varies only in the horizontal direction relative to the ideal eye position. Therefore, the first eye position obtained by the processing device 520 is the horizontal coordinate value of the eye in the first image relative to the edge of the first image. When the first image is rectangular, the horizontal direction can be understood as the direction along the long side of the rectangle. In FIG9 , the first eye position varies in both the vertical and horizontal directions relative to the ideal eye position. Therefore, the first eye position obtained by the processing device 520 is determined by combining the horizontal and vertical coordinate values ​​of the eye in the first image relative to the edge of the first image. Furthermore, in the present application, the ideal eye position is the center of the first image. That is, the ideal human eye position is at the same distance from the upper and lower edges of the first image. At the same time, the ideal human eye position is at the same distance from the left and right edges of the first image.

[0087] It can also be understood that in Figures 6, 8, and 9, the bottom edge of the first image is used as the axis of y=0, and the left edge of the first image is used as the axis of x=0, but the present application is not limited to this. In other words, in the description of the present application, the long side of the rectangle is used as the horizontal direction, and the short side of the rectangular image is used as the vertical direction for explanation. The horizontal direction and the vertical direction are only for the convenience of explanation, and can also be referred to as the first direction and the second direction, and the first direction and the second direction are perpendicular to each other. Therefore, the present application does not limit the positioning of the coordinate axis to be strictly the same as the above-mentioned example figure, as long as the first eye position in the first image and the ideal eye position are calculated using the same image coordinates.

[0088] It should be noted that in the embodiment of the present application, when the image acquired by the first acquisition device 510 (including the one or more first images described above, and the one or more second images described below, and the one or more third images described below) is a front view of the user, for example, when the image contains both eyes of the user, the eye position (including the first eye position described above, and the second eye position described below) can be understood as the midpoint of the line connecting the two eyes, or the position between the user's eyebrows, etc., which is not limited in this application. When the image acquired by the first acquisition device 510 (including the one or more first images described above, and the one or more second images described below, and the one or more third images described below) is a side view of the user, the eye position can be understood as the vertical and / or horizontal distance of the eye relative to the edge of the image in the side view. It should be understood that Figures 6, 8, and 9 above are all described using the front view of the user acquired by the first acquisition device 510 as an example.

[0089] In other embodiments, when the first acquisition device 510 acquires multiple first images, the processing device 520 determines the second eye position and the ideal eye position based on the received multiple first images, and generates a first adjustment amount based on the second eye position and the ideal eye position, wherein the second eye position is determined based on the vertical and / or horizontal distance of the eye relative to the edge of the corresponding image in each of the multiple first images. Optionally, the second eye position can be the average, variance, mean square error, median, etc. of the vertical and / or horizontal distance of the eye relative to the edge of the corresponding image in the multiple first images, which is not limited in this application. For example, when the first acquisition device 510 sends 10 first images to the processing device 520, and the second eye position is represented by an average value, the processing device 520 calculates the eye position in each first image and then calculates the average of the 10 eye positions in the 10 first images to obtain the second eye position.

[0090] It is understood that the eye position in each of the multiple first images can be a vertical variation relative to the ideal eye position as shown in FIG6 , or a horizontal variation relative to the ideal eye position as shown in FIG8 , or a vertical and horizontal variation relative to the ideal eye position as shown in FIG9 , which will not be described in detail here. Furthermore, when calculating the difference between the eye position in the multiple first images and the ideal eye position, the difference is always calculated by subtracting the ideal eye position from the actual eye position in the first image, or by subtracting the actual eye position from the ideal eye position.

[0091] In addition, since the display system provided by the present application is installed in the dashboard of a vehicle, there are usually bumps when the vehicle is driving, such as when a car is driving on a road with poor road conditions or when an airplane is passing through an air layer. In order to prevent the display device 101 from frequently adjusting its angle, which may cause dizziness and fatigue in the user, in some embodiments, only when the processing device 520 determines that the distance between the second eye position and the ideal eye position is greater than a first threshold, and at the same time determines that the second eye position is an eye position actively adjusted by the user, does the display system trigger the angle adjustment process, and the processing device 520 generates the first adjustment amount Δθ, or sends the first adjustment amount Δθ to the first driving device 103. The processing device 520 determines that the distance between the second eye position and the ideal eye position is greater than the first threshold, that is, the difference between the second eye position and the ideal eye position is greater than the first threshold; and the processing device 520 determines that the second eye position is an eye position actively adjusted by the user, which means that the multiple first images are acquired in a stable state. Among them, the stable state is defined as a plurality of first images being acquired within a first preset time, and at the same time, the distance of the human eye in each first image relative to the edge of the corresponding image in the vertical direction and / or horizontal direction is within a first preset range. In other words, the position of the human eye in the plurality of first images acquired by the first acquisition device within the first preset time is within a first preset range. It should be noted that the first preset range refers to a preset range of changes in the position of the human eye within the first preset time (such as the change value of the coordinates). Exemplarily, it can be understood that, among the plurality of first images acquired in chronological order, the change in the position of the human eye in the later acquired first image of the two adjacent first images relative to the position of the human eye in the previous first image is within the first preset range, or it can be understood that the difference between the maximum and minimum values ​​of the position of the human eye in the plurality of first images is within the first preset range, etc., and this application does not make any limitation.

[0092] Specifically, after the first acquisition device 510 transmits the first image captured in real time to the processing device 520, the processing device 520 first determines that the eye positions corresponding to the multiple first images captured within a first preset time period are within a first preset range. The processing device 520 then determines that the eye position during the first preset time period was actively adjusted by the user, such as when the user changes their sitting posture, rather than due to passive vibration caused by the cabin. If the processing device 520 further determines that the difference between the generated second eye position and the ideal eye position is greater than a first threshold, the processing device 520 generates a first adjustment amount, thereby triggering the angle adjustment of the display device 101. It is understood that when the second eye position obtained in a stable state is less than the first threshold from the ideal eye position, the display device 101 does not adjust. In this case, the processing device may discard the calculated second eye position and trigger the angle adjustment of the display device 101 only when the difference between the second eye position and the ideal eye position in the next stable state is greater than or equal to the first threshold. Setting the first threshold reduces the frequency of angle adjustment of the display device 101, thereby ensuring a good user experience.

[0093] It should be noted that in the present application, the first preset time and the first preset range can be fixed values ​​or variable values. Specifically, when the first preset time is a fixed value, it can be preset by the display system when it leaves the factory, or it can be generated by the processing device 520 based on the user's usage habits over a period of time using machine learning or big data algorithms, etc., and this application does not limit it. For example, it can be 0.8s to 3s. When the first preset time is a variable value, the first preset time can be flexibly adjusted according to the environment in which the cockpit of the display device 101 is set, wherein the environment in which the cockpit is located can include but is not limited to the brightness of the cockpit, the posture of the cockpit (such as the road conditions of the car, vehicle navigation information, etc.). For example, when the ambient light in the cockpit is relatively dim, the accuracy of the second eye position generated by the processing device 520 based on multiple first images is poor. At this time, the first preset time can be set longer to avoid errors in the calculation. For another example, when a car is traveling on a flat highway, the possibility of the car shaking is small, or the frequency of the user adjusting their sitting posture is low, or the processing device 520 knows from the navigation information that the car will be traveling on the highway for a long time in the future, etc., in this case, the processing device 520 can appropriately set a longer first preset time. When the first preset range is a fixed value, it can be preset in the processing device 520 by the display system at the factory, or it can be generated by the processing device 520 based on the user's usage habits using machine learning or big data algorithms, etc., and this application does not limit it. For example, it can be 5cm to 7cm. When the first preset range is a variable value, the first preset time can be flexibly adjusted according to the environment of the cabin, etc. For example, when the car is traveling on a flat highway, the first preset range can be adjusted to be larger, so that it is easier to distinguish the user's posture adjustment.

[0094] It should also be noted that in some scenarios, the processing device 520 may stop calculating the first adjustment amount Δθ for a period of time. It may also be considered that even if the processing device 520 calculates the first adjustment amount Δθ, it will not be sent to the adjustment device. Alternatively, it may be considered that the processing device 520 discards the data of multiple first images received during this period. For example, in an aircraft cockpit, the processing device 520 may be aware of the flight environment in advance, such as the presence of strong airflow at a certain flight distance. In this case, the processing device 520 may calculate the time required to pass through the airflow based on the aircraft's flight speed and the length of the airflow, and stop adjusting the angle of the display device 101 during this period of time.

[0095] Based on the above solution, generating the second eye position using multiple first images can improve the accuracy of the eye position, thereby ensuring the accuracy of the display device angle adjustment. When the second eye position is generated using multiple first images in a stable state and the first threshold is used to determine whether to adjust the angle, jitter in the cockpit display system can be filtered out while ensuring that the angle adjustment of the display device 101 is triggered (i.e., using the first threshold as the trigger condition), thereby further ensuring the reliability of the angle adjustment and further improving the user experience.

[0096] In order to further improve the reliability of the display system 500, the display system 500 optionally further includes a second acquisition device 530, which is used to obtain environmental information of the display device 101, such as the cabin posture (including but not limited to the road conditions of the vehicle, the navigation information of the vehicle, etc.), the brightness of the cabin, the temperature of the display device 101, etc., so that the processing device 520 can further determine the credibility of the acquired second eye position based on the environmental information. Specifically, when the processing device 520 determines that the credibility of the second eye position generated based on the environmental information is low, the processing device 520 discards the current second eye position and recalculates the second eye position with higher credibility based on the received multiple first images. For example, when the processing device 520 determines the credibility of the second eye position based on the cabin posture, the second acquisition device 530 can be a laser radar device for detecting road conditions or a navigation device for navigating routes, etc. At this point, the processing device 530 can generate road condition information corresponding to the multiple first images, compare the actual road condition information with the ideal road condition information, and obtain a road condition credibility coefficient. When the road condition credibility coefficient is greater than or equal to 0.5, the processing device 520 deems the second eye position corresponding to the multiple first images to be credible. For example, when the processing device 520 determines the credibility of the second eye position based on cabin brightness, the second acquisition device 530 can be a brightness detector. At this point, the processing device 530 can generate brightness information corresponding to the multiple first images, compare the brightness information with the ideal brightness information, and obtain a brightness credibility coefficient. When the brightness credibility coefficient is greater than or equal to 0.5, the processing device 520 deems the second eye position corresponding to the multiple first images to be credible. For example, when the processing device 520 determines the credibility of the second eye position based on the temperature of the display device 101, the second acquisition device 530 can be a temperature detector. At this time, the processing device 530 can determine whether the second eye position corresponding to the multiple first images is credible based on the temperature of the display device 101 when the multiple first images are acquired. It should be understood that the above-mentioned environmental information is merely illustrative and not limiting, and the present application is not limited thereto. Other information of the display device 101 or other information of the cockpit that may affect the credibility of the second eye position is also within the scope of protection of this application.

[0097] In addition, the processing device 520 can also make a credibility judgment based on the information of the first image acquired by the first acquisition device 510. In this case, the display system 500 may not include the above-mentioned second acquisition device 530. For example, the processing device 530 can generate color information corresponding to multiple first images, compare the color information with the ideal color information, and obtain a color credibility coefficient. When the color credibility coefficient is greater than or equal to 0.5, the processing device 520 believes that the second eye position corresponding to the multiple first images is credible. Alternatively, the processing device 530 can also determine through image processing that the eye positions in the multiple first images (including the above-mentioned first eye position and second eye position) are unreliable. For example, the processing device 530 determines that the generated eye positions are inaccurate due to obstructions such as sunglasses worn by the user in the multiple first images.

[0098] Based on the above solution, by using the processing device to determine the credibility of the second eye position, the reliability of the display system can be further improved, thereby improving the user experience.

[0099] It is understandable that in some scenarios, even if the display device 101 has been adjusted to a relatively perfect angle, the user may still not be able to see the complete virtual image. For example, when the user is close to the display device 101, or when the user is too high or too far to the side, the angle adjustment can only enable the user to see a partial image within the eye box of the display device 101. In this case, the display system 500 provided in the present application can also adjust the frame. Specifically, the first acquisition device 510 is also used to acquire one or more second images containing the user's human eyes when the display device 101 is at a second angle, and send the one or more second images to the processing device 520. The processing device 520 also generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit 201. The image generation unit 201 generates an image of corresponding size according to the second adjustment amount, and emits a second imaging light to the window unit 202. The window unit 202 reflects the second imaging light from the image generating unit 201 to the image magnifying unit 203, and transmits the second imaging light from the image magnifying unit 203, so that the user can view the complete virtual image formed by the second imaging light at the second angle through the window unit 202. The image magnifying unit 203 is configured to reflect the second imaging light from the window unit 201 to the window unit 202.

[0100] In some embodiments, when the first acquisition device 510 acquires a second image, the processing device 520 determines the first human eye depth based on the received second image, and generates a second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit 202 when the second image is acquired, the second human eye depth is the human eye depth corresponding to the third image, the second human eye depth is the distance between the human eye and the window unit 202 when the third image is acquired, the acquisition time of the third image is before the acquisition time of the second image, or the second human eye depth is a preset human eye depth.

[0101] It is understandable that different eye depths correspond to different frame sizes, or different eye depth ranges correspond to different frame sizes. Therefore, after the processing device 520 determines the first eye depth, it can determine a first frame size corresponding to the first eye depth based on the value of the first eye depth or the range of the first eye depth, and simultaneously determine a second frame size corresponding to the second eye depth. By comparing the first frame size and the second frame size, a second adjustment amount is generated, and the second adjustment amount is sent to the image generation unit 201, so that the image generation unit 201 emits second imaging light corresponding to the second frame size.

[0102] It should be noted that different human eye depths correspond to different frame sizes, which may be the frame size of the virtual image or the frame size in the image generation unit 201 , and this application does not limit this.

[0103] In addition, the preset human eye depth can be the one set before the cockpit display system leaves the factory, or the human eye depth corresponding to the frame adjusted by the user based on usage habits, or the human eye depth learned by the processing device 520 based on user usage habits, etc. This application does not limit this.

[0104] In other embodiments, when the first acquisition device 510 acquires multiple second images, the processing device 520 determines a third human eye depth based on the received multiple second images, and generates a second adjustment amount based on the third human eye depth and the fourth human eye depth, wherein the third human eye depth is the distance between the human eye and the window unit 202 when the multiple second images are acquired, the fourth human eye depth is the human eye depth corresponding to the multiple third images, the fourth human eye depth is the distance between the human eye and the window unit 202 when the multiple third images are acquired, the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth.

[0105] It should be noted that the third eye depth can be the average, variance, mean square error, median, etc. of the distance between the human eye and the window unit 202 when each of the multiple second images is acquired, and this application does not limit this. For example, when the first acquisition device 510 sends 10 second images to the processing device 520, and the third eye depth is expressed as an average, the processing device 520 calculates the eye depth when each second image is acquired, and then calculates the average of the 10 eye depths of the 10 second images to obtain the third eye depth.

[0106] It should be noted that, in the embodiment of the present application, the depth of the human eye (including the first to fourth depths of the human eye in the text) is the distance between the plane where the human eye is located and the plane where the window unit 202 is located. When the human eye in the acquired one or more images is a front view, since the one or more images have depth information, the depth of the human eye can be determined from the depth information. When the human eye in the acquired one or more images is a side view, the depth of the human eye in the one or more images can be converted by the distance d between the human eye and the window unit 202 in the image. Exemplarily, as shown in Figure 10, the image is a side view of the human eye, wherein the depth of the human eye can be determined by the distance between the plane where the human eye is located and the plane where the window unit 202 is located in the image.

[0107] Similarly, to avoid unnecessary image adjustments caused by cabin vibration, in some further embodiments, when the processing device 520 determines that the distance between the third eye depth and the fourth eye depth is greater than a second threshold, that is, the difference between the third eye depth and the fourth eye depth is greater than the second threshold, the processing device 520 calculates and generates a second adjustment amount based on the third eye depth and the fourth eye depth. The plurality of second images and the plurality of third images are acquired in a stable state. In other words, the plurality of second images and the plurality of third images are acquired within a first preset time. Simultaneously, the plurality of eye depths corresponding to the plurality of second images are within a second preset range, and the plurality of eye depths corresponding to the plurality of third images are within a second preset range. Exemplarily, the plurality of eye depths corresponding to the plurality of second images being within the second preset range can be understood as meaning that the change in the eye depth in the later-acquired second image relative to the eye depth in the previous second image is within the second preset range, or that the difference between the maximum and minimum eye depths in the plurality of second images is within the second preset range, etc., which is not limited in this application. Similarly, the multiple human eye depths corresponding to the multiple third images are within the second preset range, which can be understood as the change in the human eye depth in the later acquired third image among the two adjacent third images relative to the human eye depth in the previous third image is within the second preset range, or it can be understood as the difference between the maximum and minimum values ​​of the human eye depth in the multiple third images is within the second preset range, etc., which is not limited in this application.

[0108] Specifically, after the first acquisition device 510 transmits the real-time second image to the processing device 520, the processing device 520 first determines whether the changes in the eye depths of multiple second images acquired within a first preset time period are within a second preset range. The processing device 520 then determines that the eye depths during the first preset time period were actively adjusted by the user, such as by a change in sitting posture, rather than due to passive cabin vibration. At this point, the processing device 520 generates a third eye depth based on the multiple eye depths. If the processing device 520 further determines that the difference between the generated third eye depth and the fourth eye depth is greater than a second threshold, the processing device 520 generates a second adjustment amount, triggering a change in the image frame of the display device 101. The fourth eye depth is also saved for future adjustments. It is understandable that when the difference between the third eye depth and the fourth eye depth obtained in a stable state is less than the second threshold, the display device 101 does not perform adjustment. At this time, the processing device can discard the calculated third eye depth and trigger the frame adjustment of the display device 101 only when the difference between the third eye depth and the fourth eye depth in the next stable state is calculated to meet the second threshold.

[0109] Likewise, the second preset range may be a fixed value or a variable value. The setting of the second preset range may refer to the setting of the first preset range, which will not be described in detail here.

[0110] In addition, the processing device 520 also stops calculating the second adjustment amount for a period of time according to the environment of the cabin, etc., and reference may be made to the relevant descriptions above, which will not be repeated here.

[0111] In order to further improve the reliability of the display system 500, the display system 500 can determine the credibility of the depth of the third human eye obtained by the environmental information of the display device 101 obtained by the second acquisition device 530, or the information of multiple second images obtained by the first acquisition device 510. This process is the same as the process of determining the credibility of the second human eye position and will not be repeated here.

[0112] It can be understood that the angle adjustment of the display device 101 is performed based on one or more first images acquired by the first acquisition device 510, and the frame adjustment is performed based on one or more second images acquired by the first acquisition device 510. Since the second images are acquired when the display device is at a second angle, in other words, the frame adjustment can further enhance the user experience based on the angle adjustment. Of course, in other embodiments, the display system 500 may also perform frame adjustment first and then angle adjustment, in which case the display device may use one or more identical images.

[0113] It is understandable that the above embodiment is an adjustment of the display device 101, including the angle and frame. In some embodiments, the performance of the display system can be further improved by adjusting the seat in which the user sits, thereby enriching the usage scenarios of the display system. Figure 11 is a schematic diagram of the third display system 1100 provided in an embodiment of the present application. As shown in Figure 11, the display system 1100 includes a seat 1120, a display device 101, a first acquisition device 510, a processing device 520, a third acquisition device 1110 and a second drive device 1130. The user sits on the seat 1120, the second drive device 1130 is connected to the seat 1120, and the second drive device 1130 is connected to the processing device 520. Among them, the third acquisition device 1110 is used to obtain user information and send the user information to the processing device 520. The processing device 520 is used to generate a third adjustment amount based on the user information and the relative height between the height of the display device 101 and the height of the human eye, and send the third adjustment amount to the second drive device 1130. The height of the display device 101 is the height of the center of the window unit 202 relative to the cabin floor, and the height of the human eye is the height of the human eye relative to the cabin floor. The relative height between the display device 101 and the human eye ensures that the user's viewing angle is within the viewing angle range when viewing the virtual image. The second drive device 1130 is configured to adjust the height of the seat 1120 according to the third adjustment amount.

[0114] Generally speaking, when the display device 101 is in the display state, the height of the display device 101 will no longer change. Therefore, in order to ensure that the user is within the viewing angle range when viewing the virtual image, the height of the human eye needs to be adjusted to a position that is approximately equal to the relative height of the height of the display device 101. In other words, to ensure comfortable viewing for the user, the relative height between the height of the display device 101 and the height of the human eye is fixed. For example, as shown in Figure 11, if the height of the human eye is at position 1, since the height of the human eye that is at a relative height to the height of the display device 101 is at position 2, the seat needs to be adjusted from height 1 to height 2. Specifically, in some embodiments, after the user sits in the seat 1120, the third acquisition device 1110 acquires user information and sends the user information to the processing device 520. The processing device 520 determines the third adjustment amount ΔH1 of the seat height based on the user information and the relative height. Alternatively, in other embodiments, after a user sits in seat 1120, third acquisition device 1110 acquires user information and sends the user information to processing device 520. Processing device 520 determines a target eye height based on the height of display device 101 and determines a third adjustment amount ΔH1 for the seat height based on the user information and the target height. Processing device 520 then sends an adjustment message to second drive device 1130, instructing second drive device 1130 to adjust the seat height by ΔH1 based on the adjustment message. For example, the adjustment message may include a specific adjustment amount, such as ΔH1. Second drive device 1130 then adjusts the seat height based on ΔH1.

[0115] It should be noted that, in the present application, user information includes but is not limited to at least one of the following: the user's eye height, the user's height, the position of the eye in the image, and the user's weight. The user's eye height is the height of the eye (or the line of sight or the center of the pupil, etc.) relative to the cabin floor when the eye is looking straight ahead. It is understandable that when the user information is the user's eye height, the user's height, and the position of the eye in the image, the user information can be obtained through the above-mentioned first acquisition device 510, for example, by acquiring the eye height, the user's height, and the position of the eye in the image through an image detector. In this case, the system 1100 may not include the third acquisition device 1110. When the user information is the user's weight, the third acquisition device 1110 may be a pressure detector for detecting the user's weight and sending the weight information to the processing device 520.

[0116] Figure 12 is a circuit diagram of a display device provided in an embodiment of the present application. As shown in Figure 12, the circuit in the display device mainly includes a host CPU 1201, an external memory interface 1202, an internal memory 1203, an audio module 1204, a video module 1205, a power module 1206, a wireless communication module 1207, an I / O interface 1208, a video interface 1209, a display circuit 1210 and a modulator 1212. Among them, the main processor 1201 and its peripheral components, such as the external memory interface 1202, the internal memory 1203, the audio module 1204, the video module 1205, the power module 1206, the wireless communication module 1207, the I / O interface 1208, the video interface 1209, and the display circuit 1210 can be connected via a bus. The main processor 1201 can be called a front-end processor.

[0117] In addition, the circuit diagrams shown in the embodiments of the present application do not constitute specific limitations on the display device. In other embodiments of the present application, the display device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The components shown in the diagrams may be implemented in hardware, software, or a combination of software and hardware.

[0118] The main processor 1201 includes one or more processing units. For example, the main processor 1201 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0119] The main processor 1201 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the main processor 1201 is a cache memory. This memory can store instructions or data that the main processor 1201 has just used or is reusing. If the main processor 1201 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the main processor 1201, and thus improves system efficiency.

[0120] In some embodiments, the display device may further include multiple input / output (I / O) interfaces 1208 connected to the main processor 1201. The interfaces 1208 may include an I2C (Inter-Integrated Circuit) interface, an I2S (Inter-Integrated Circuit Sound) interface, a PCM (Pulse Code Modulation) interface, a UART (Universal Asynchronous Receiver / Transmitter) interface, a MIPI (Mobile Industry Processor Interface) interface, a GPIO (General-Purpose Input / Output) interface, a SIM (Subscriber Identity Module) interface, and / or a USB (Universal Serial Bus) interface. The I / O interfaces 1208 may be connected to devices such as a mouse, touchpad, keyboard, camera, speaker, microphone, etc., as well as physical buttons on the display device (e.g., volume button, brightness adjustment button, power button, etc.).

[0121] The external memory interface 1202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with the main processor 1201 through the external memory interface 1202 to implement data storage function.

[0122] The internal memory 1203 can be used to store computer executable program codes, which include instructions. The internal memory 1203 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as a call function, a time setting function, etc.), etc. The data storage area may store data created during the use of the display device (such as a phone book, world time, etc.), etc. In addition, the internal memory 1203 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (UFS), etc. The main processor 1201 executes various functional applications and data processing of the display device by running instructions stored in the internal memory 1203 and / or instructions stored in a memory provided in the main processor 1201.

[0123] The display device can implement audio functions such as music playback and calls through the audio module 1204 and the application processor.

[0124] The audio module 1204 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 1204 can also be used to encode and decode audio signals, such as for playing or recording. In some embodiments, the audio module 1204 can be provided in the main processor 1201, or some functional modules of the audio module 1204 can be provided in the main processor 1201.

[0125] The video interface 1209 can receive external audio and video signals, which can specifically be a High Definition Multimedia Interface (HDMI), a Digital Visual Interface (DVI), a Video Graphics Array (VGA), a Display Port (DP), etc. The video interface 1209 can also output video. When the display device is used as an in-vehicle display, the video interface 1209 can receive speed signals and power signals input from peripheral devices, and can also receive external VR video signals. When the display device is in use, the video interface 1209 can receive video signals input from an external computer or terminal device.

[0126] The video module 1205 can decode the video input from the video interface 1209, for example, by performing H.264 decoding. The video module can also encode the video captured by the display device, for example, by performing H.264 encoding on the video captured by an external camera. Furthermore, the main processor 1201 can also decode the video input from the video interface 1209 and output the decoded image signal to the display circuit 1210.

[0127] The display circuit 1210 and modulator 1212 are used to display corresponding images. In this embodiment, the video interface 1209 receives an external video source signal, which the video module 1205 decodes and / or digitizes before outputting one or more image signals to the display circuit 1210. The display circuit 1210 drives the modulator 1212 based on the input image signal to image the incident polarized light and output image light. Furthermore, the main processor 1201 may also output one or more image signals to the display circuit 1210.

[0128] In this embodiment, the display circuit 1210 and the modulator 1212 are electronic components in the image generating unit, and the display circuit 1210 can be referred to as a driving circuit.

[0129] The power module 1206 is used to provide power to the main processor 1201 and the light source 1200 based on input power (e.g., direct current). The power module 1206 may include a rechargeable battery, which can provide power to the main processor 1201 and the light source 1200. Light emitted by the light source 1200 can be transmitted to the modulator 1212 for imaging, thereby forming an image light signal.

[0130] The wireless communication module 1207 enables the display device to communicate wirelessly with the outside world. It can provide wireless local area networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), infrared technology (IR) and other wireless communication solutions. The wireless communication module 1207 can be one or more devices that integrate at least one communication processing module. The wireless communication module 1207 receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the main processor 1201. The wireless communication module 1207 can also receive signals to be sent from the main processor 1201, frequency modulate them, amplify them, and convert them into electromagnetic waves for radiation through the antenna.

[0131] In addition, in addition to being input through the video interface 1209, the video data decoded by the video module 1205 can also be received wirelessly through the wireless communication module 1207 or read from an external memory. For example, the display device can receive video data from a terminal device or an in-vehicle entertainment system through the wireless local area network in the vehicle, and the display device can also read audio and video data stored in an external memory.

[0132] The above-mentioned display device can be installed on a vehicle. Please refer to Figure 13, which is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application.

[0133] As shown in FIG13 , the functional framework of a vehicle may include various subsystems, such as a sensor system 12, a control system 14, one or more peripheral devices 16 (one of which is shown as an example), a power supply 18, a computer system 20, and an onboard display system 22. Optionally, the vehicle may also include other functional systems, such as an engine system that provides power to the vehicle, etc., which are not limited in this application.

[0134] The sensor system 12 may include a plurality of detection devices that sense the information being measured and convert the sensed information into electrical signals or other required information outputs according to certain rules. As shown in the figure, these detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser rangefinder, a camera, a wheel speed sensor, a steering sensor, a gear position sensor, or other components for automatic detection, etc., and this application does not limit them.

[0135] The control system 14 may include several components, such as a steering unit, a braking unit, a lighting system, an autonomous driving system, a map navigation system, a network timing system, and an obstacle avoidance system, as shown. Optionally, the control system 14 may also include components such as a throttle controller and an engine controller for controlling vehicle speed, although this application does not limit this.

[0136] The peripheral devices 16 may include several components, such as the communication system shown in the figure, a touch screen, a user interface, a microphone, and a speaker. The communication system is used to enable network communication between the vehicle and other devices. In practical applications, the communication system may utilize wireless communication technology or wired communication technology to enable network communication between the vehicle and other devices. Wired communication technology may involve communication between the vehicle and other devices via network cables or optical fibers.

[0137] Power supply 18 represents a system that provides electrical power or energy to the vehicle, and may include, but is not limited to, rechargeable lithium batteries or lead-acid batteries. In practical applications, one or more battery components in the power supply are used to provide electrical energy or energy for starting the vehicle. The type and material of the power supply are not limited in this application.

[0138] Several functions of the vehicle are controlled and implemented by the computer system 20. The computer system 20 may include one or more processors 2001 (one processor is shown as an example) and a memory 2002 (also referred to as a storage device). In actual applications, the memory 2002 is also inside the computer system 20, or it can be outside the computer system 20, for example, as a cache in the vehicle, etc., which is not limited in this application.

[0139] The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 may be used to run relevant programs or instructions corresponding to the programs stored in the memory 2002 to implement corresponding functions of the vehicle.

[0140] The memory 2002 may include a volatile memory, such as RAM; the memory may also include a non-volatile memory, such as ROM, flash memory, HDD or solid-state drive SSD; the memory 2002 may also include a combination of the above types of memory. The memory 2002 can be used to store a set of program codes or instructions corresponding to the program codes, so that the processor 2001 can call the program codes or instructions stored in the memory 2002 to implement the corresponding functions of the vehicle. In the present application, the memory 2002 can store a set of program codes for vehicle control, and the processor 2001 can call the program codes to control the safe driving of the vehicle. How to achieve safe driving of the vehicle is described in detail below in this application.

[0141] Optionally, in addition to storing program code or instructions, memory 2002 may also store information such as road maps, driving routes, and sensor data. Computer system 20 may integrate with other components in the vehicle functional framework diagram, such as sensors and GPS in the sensor system, to implement relevant vehicle functions. For example, computer system 20 may control the vehicle's direction or speed based on data input from sensor system 12, although this application does not limit this.

[0142] The in-vehicle display system 22 may include several components, such as a controller and an in-vehicle display. The controller is used to generate an image (e.g., an image of VR content) based on user instructions and send the image to the in-vehicle display for display. The in-vehicle display may include an image generation unit, a window unit, and an image magnification unit. Passengers can view the target image displayed on the in-vehicle display through the window unit. The functions of some components in the in-vehicle display system may also be implemented by other subsystems of the vehicle. For example, the controller may also be a component of the control system.

[0143] FIG13 of this application shows four subsystems: sensor system 12, control system 14, computer system 20, and onboard display system 22. These subsystems are merely illustrative and not limiting. In practice, a vehicle may combine several components according to different functions to create subsystems with corresponding functions. In practice, a vehicle may include more or fewer systems or components, and this application does not limit this.

[0144] The above-mentioned means of transportation can be a car, a truck, a bus, a ship, an airplane, a helicopter, an RV, a train, etc., and the embodiments of the present application do not make any special limitations.

[0145] Unless otherwise defined, technical or scientific terms used herein shall have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.

[0146] The above description is only one embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made on the basis of the present application shall be included in the scope of protection of the present application.

Claims

1. A display system, characterized in that: include: A display device and a first driving device, wherein the display device is installed in a dashboard of a cockpit, the display device comprises an image generating unit, an image magnifying unit, a window unit and a housing, the window unit comprises a first surface and a second surface, the housing comprises a third surface and a fourth surface, an end of the third surface close to the fourth surface is tightly connected to an end of the fourth surface close to the third surface, wherein: The image generating unit is configured to emit a first imaging light toward the window unit, wherein the first imaging light is configured to generate a first virtual image; The window unit is used to reflect the first imaging light from the image generating unit to the image magnifying unit on the first surface, and transmit the first imaging light from the image magnifying unit from the first surface to the second surface, so that human eyes can see the first virtual image through the first imaging light emitted from the second surface; The image amplifying unit is used to reflect the first imaging light from the window unit to the window unit; The housing is used to enclose the image generating unit and the image magnifying unit, wherein an end of the third surface away from the fourth surface is connected to the upper edge of the window unit, and an end of the fourth surface away from the third surface is connected to the lower edge of the window unit, so that the display device constitutes a closed whole with an internal space, and the first surface of the window unit is enclosed in the internal space; The first driving device is used to adjust the state of the display device to a storage state or a display state, wherein the storage state is that the second surface is embedded in the dashboard so that the third surface constitutes a part of the knee guard of the dashboard, and the fourth surface constitutes a part of the table top of the dashboard, and the display state is that the third surface is separated from the knee guard of the dashboard, and the fourth surface is separated from the table top of the dashboard, so that the second surface is opposite to the human eye.

2. The display system according to claim 1, characterized in that: When the display device is in the storage state, the curvature of the connection between the third surface and the fourth surface is the same as the curvature of the connection between the knee guard and the table top.

3. The display system according to claim 1, characterized in that: When the display device is in a display state, the table top and a position for storing the display device present a stepped surface.

4. The display system according to any one of claims 1 to 3, characterized in that: The first driving device is installed inside the display device or in the instrument panel.

5. The display system according to any one of claims 1 to 4, characterized in that: The display device further includes a connecting unit, wherein the connecting unit is connected to the first driving device. The first driving device is specifically used to drive the connecting unit to work; The connecting unit is used to adjust the state of the display device to a storage state or a display state during operation.

6. The display system according to any one of claims 1 to 5, characterized in that: The first driving device is further used to adjust the first angle of the display device to a second angle, so that the user can view the first virtual image at the second angle through the window unit.

7. The display system according to claim 6, characterized in that: The display system further includes a first acquisition device and a processing device, wherein the first acquisition device is connected to the processing device. The first acquisition device is used to acquire one or more first images containing the human eye when the display device is at the first angle, and send the one or more first images to the processing device; The processing device generates a first adjustment amount based on the one or more first images, and sends the first adjustment amount to the first driving device; The first driving device is specifically configured to adjust the first angle to the second angle according to the first adjustment amount.

8. The display system according to claim 7, characterized in that: The first acquisition device is further configured to acquire one or more second images including the human eye when the display device is at a second angle, and send the one or more second images to the processing device; The processing device further generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit; The image generating unit is configured to generate an image of a corresponding size according to the second adjustment amount, and emit a second imaging light; The window unit is used to reflect the second imaging light from the image generating unit to the image magnifying unit, and transmit the second imaging light from the image magnifying unit, so that the user can view a second virtual image formed by the second imaging light at the second angle through the window unit; The image amplifying unit is used to reflect the second imaging light from the window unit to the window unit.

9. The display system according to claim 7, characterized in that: The display system further includes: a second acquisition device, a seat, and a second drive device, a user sits on the seat to view the first virtual image, the second drive device is connected to the seat, and the second drive device is connected to the processing device. The second acquisition device is used to acquire user information and send the user information to the processing device; The processing device is used to generate a third adjustment amount according to the user information and a relative height between the height of the display device and the height of the human eye, and send the third adjustment amount to the second driving device, wherein the height of the display device is the height of the center of the window unit of the display device relative to the ground of the cabin, the height of the human eye is the height of the human eye relative to the ground of the cabin, and the relative height between the height of the display device and the height of the human eye satisfies that the user is within a viewing angle range when viewing the first virtual image; The second driving device is used to adjust the height of the seat according to the third adjustment amount.

10. The display system according to claim 9, characterized in that: The user information includes at least one of the following: the height of the human eye, the height of the user, the position of the human eye in the image, and the weight of the user.

11. A means of transport, characterized in that: The invention comprises a display system as claimed in any one of claims 1 to 10.

12. A cockpit system, characterized in that: The invention comprises a display system as claimed in any one of claims 1 to 10.

Images