Display system, vehicle and cabin system

Abstract

A display system, which can be applied to a vehicle, for example, being mounted in the back of a seat, a seat headrest or a front-passenger console, etc. The display system (100, 600, 700) comprises: a display device (101, 200) and an adjustment device (610), wherein the display device (101, 200) comprises an image generation unit (201), a viewing window unit (202) and an image magnification unit (203), and the adjustment device (610) is connected to the display device (101, 200). The image generation unit (201) is used for emitting first imaging light to the viewing window unit (202); the viewing window unit (202) is used for reflecting to the image magnification unit (203) the first imaging light from the image generation unit (201), and for transmitting the first imaging light from the image magnification unit (203); and the image magnification unit (203) is used for reflecting to the viewing window unit (202) the first imaging light from the viewing window unit (202). The adjustment device (610) is used for adjusting the display device (101, 200) from a first angle to a second angle, so that a user views, at the second angle and by means of the viewing window unit (202), a virtual image which is formed by the first imaging light. The display system can achieve angle adjustment of the display device, thereby improving the viewing experience of a user.

Description

Display system, vehicle and cockpit system

[0001] This application claims priority to the Chinese patent application with application number 202311242896.X filed with the State Intellectual Property Office of China on September 22, 2023, and priority to the Chinese patent application with invention name “A method for adjusting height, a display system and a vehicle”; and claims priority to the Chinese patent application with application number 202322865003.9 filed with the State Intellectual Property Office of China on October 25, 2023, and priority to the Chinese patent application with utility model name “A display system and a vehicle”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the fields of display technology and intelligent automobile driving technology, and more specifically, to a display system, a vehicle, and a cockpit system. Background Art

[0003] Cars have become an indispensable means of transportation in our daily lives. With the advancement of intelligent vehicles, people's demands for cars have evolved from simple transportation to living spaces that provide access to information and entertainment. In-car display technology has become a hot research area. By installing in-car displays, passengers can access information or engage in entertainment activities, thereby creating intelligent application scenarios for the cabin space.

[0004] How to achieve automatic adjustment of the angle of the display device to improve the user's viewing experience is a problem that needs to be solved.

[0005] Summary of the Invention

[0006] The present application provides a display system, a vehicle, and a cockpit system. The display system provided in the present application can adjust the angle of the display device to enhance the user's viewing experience.

[0007] In a first aspect, embodiments of the present application provide a display system that can be used for in-vehicle display. The display system includes a display device and an adjustment device, wherein the display device includes an image generation unit, an image magnification unit, and a window unit. The adjustment device is connected to the display device, wherein: the image generation unit is configured to emit first imaging light toward the window unit; the window unit is configured to reflect the first imaging light from the image generation unit to the image magnification unit and transmit the first imaging light from the image magnification unit; the image magnification unit is configured to reflect the first imaging light from the window unit to the window unit; and the adjustment device is configured to adjust the first angle of the display device to a second angle, so that a user can view a virtual image formed by the first imaging light through the window unit at the second angle.

[0008] It should be noted that, in the present application, the angle of the display device (including the first angle and the second angle) can be the pitch angle of the display device. When the display device is adjusted from the first angle to the second angle, the display device can be shaken up and down in the vertical direction, similar to the "nodding" effect; or, the angle of the display device can be the swing angle of the display device (or called the horizontal deflection angle). When the display device is adjusted from the first angle to the second angle, the display device can be shaken left and right in the horizontal direction, similar to the "shaking head" effect; or, the angle of the display device can be the pitch angle and swing angle of the display device that change simultaneously. When the display device is adjusted from the first angle to the second angle, the display device can be adjusted in the entire spatial angle.

[0009] In the present application, the adjustment device can adjust the angle of the display device automatically or manually. When the automatic adjustment of the angle of the display device is achieved, the intelligent performance of the vehicle display system can be improved, thereby providing users with a smarter experience.

[0010] In combination with the first aspect, in certain implementations of the first aspect, the display system further includes a first acquisition device and a processing device, wherein the first acquisition device is used to acquire one or more first images containing the user's eyes when the display device is at the first angle, and send the one or more first images to the processing device; the processing device generates a first adjustment amount based on the one or more first images, and sends the first adjustment amount to the adjustment device; the adjustment device is specifically used to adjust the first angle to the second angle according to the first adjustment amount.

[0011] The display system provided in the present application can generate an angle adjustment amount based on an image containing the human eye, so that the display system provided in the present application can achieve an automatic adjustment effect based on the human eye.

[0012] In combination with the first aspect, in certain implementations of the first aspect, when the first acquisition device acquires the first image, the processing device is specifically used to: determine the first human eye position and the ideal human eye position based on the first image, and generate the first adjustment amount based on the first human eye position and the ideal human eye position, where the first human eye position is the distance in the vertical direction and / or horizontal direction of the human eye relative to the image edge in the first image.

[0013] It should be noted that in the present application, the ideal eye position is located at the center of the first image. When the adjustment device adjusts the display device according to the first adjustment amount, the adjustment is to ensure that the actual eye position coincides with the ideal eye position as much as possible. In other words, when the adjustment device adjusts the display device from the first angle to the second angle, the eye position at the second angle will be within a preset range of the ideal eye position, making the user more comfortable viewing at the second angle compared to the first angle.

[0014] The angle adjustment amount calculated based on the first eye position determined by the first image and the ideal eye position can make the adjusted eye position meet a better viewing angle. At the same time, angle adjustment based on a first image can enable the display device to adjust the angle in a timely and rapid manner according to the eye position, thereby making the angle adjustment more efficient.

[0015] In combination with the first aspect, in certain implementations of the first aspect, when the first acquisition device acquires the multiple first images, the processing device is specifically used to: determine the second human eye position and the ideal human eye position based on the multiple first images, and generate the first adjustment amount based on the second human eye position and the ideal human eye position, wherein the second human eye position is determined based on the distance in the vertical direction and / or horizontal direction of the human eye in each first image of the multiple first images relative to the edge of the corresponding image.

[0016] By generating the second eye position using multiple first images, the systematic error of the second eye position generated by the processing device can be eliminated, thereby further improving the accuracy of the calculation of the second eye position.

[0017] In combination with the first aspect, in certain implementations of the first aspect, the difference between the second human eye position and the ideal human eye position is greater than a first threshold, the multiple first images are acquired within a first preset time, and the distance of the human eye in each of the multiple first images relative to the corresponding image edge in the vertical direction and / or horizontal direction is within a first preset range.

[0018] By acquiring multiple first images that meet a preset range within a preset time, and only when the difference between the second eye position and the ideal eye position meets the first threshold, the angle adjustment is initiated. This can avoid abnormal jitter when the display system is in an unstable state, and while improving the reliability of the system, it can also further enhance the user experience.

[0019] In combination with the first aspect, in certain implementations of the first aspect, the display system further includes a second acquisition device, which is used to obtain environmental information of the display device and send the environmental information to the processing device; the processing device is also used to determine the credibility of the second human eye position based on the environmental information.

[0020] It should be noted that, in the present application, environmental information may include information such as the cabin's posture, cabin brightness, cabin temperature, and display device temperature. For example, if the cabin is that of a smart car, the cabin's posture may include road conditions or navigation information on the road on which the smart car is traveling. It is understood that cabin brightness may affect the brightness of one or more images captured by the first acquisition device. Therefore, in some embodiments, the brightness of one or more images may be used to indirectly represent cabin brightness. For example, when cabin brightness is too low, the multiple images captured within the first preset time period cannot accurately calculate the second eye position, resulting in a low confidence level for the second eye position. The cabin temperature and display device temperature may also affect the clarity of one or more images captured by the first acquisition device. For example, when the temperature is too high, the first acquisition device may not function, rendering the multiple images captured within the first preset time period unusable, resulting in a low confidence level for the second eye position.

[0021] It should also be noted that factors that affect the credibility of the second eye position also include user factors. For example, the user's face is blocked by a hat, sunglasses, etc., which causes the processing device to be unable to accurately calculate the second eye position based on multiple first images. That is, at this time, the credibility of the second eye position is too low.

[0022] By determining the credibility of the second eye position, the processing device can generate the first adjustment amount according to the second eye position with higher credibility, thereby further improving the accuracy of angle adjustment and ensuring the stability of system performance.

[0023] In combination with the first aspect, in certain implementations of the first aspect, the processing device further generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit; the image generation unit is used to generate an image of corresponding size according to the second adjustment amount, and emit second imaging light; the window unit is used to reflect the second imaging light from the image generation unit to the image magnification unit, and transmit the second imaging light from the image magnification unit, so that the user can view the virtual image formed by the second imaging light at the second angle through the window unit; the image magnification unit is used to reflect the second imaging light from the window unit to the window unit.

[0024] Based on the above scheme, the display system provided in the embodiment of the present application is not only capable of adjusting the angle of the display device, but can also further calculate the size of the virtual image based on one or more second images, thereby ensuring that the user can view the complete virtual image when the angle cannot be adjusted (for example, when the limit of the display device angle adjustment is reached), further improving the reliability of the display system performance.

[0025] In combination with the first aspect, in certain implementations of the first aspect, when the first acquisition device acquires the second image, the processing device is specifically used to: determine a first human eye depth based on the second image, and generate the second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit when acquiring the second image, the second human eye depth is the distance between the human eye and the window unit when acquiring the third image, and the acquisition time of the third image is before the acquisition time of the second image, or the second human eye depth is a preset human eye depth.

[0026] It is understandable that when the adjustment device adjusts the frame according to the second adjustment amount, it is to match the adjusted frame with the actual human eye depth, so that the user can see the complete virtual image. In other words, when the human eye depth changes from the second human eye depth to the first human eye depth, the display system provided by this application can adjust the frame corresponding to the second human eye to the frame corresponding to the first human eye depth, thereby ensuring a reliable user experience. In addition, by adjusting the frame using a second image, the frame can be adjusted in a timely and rapid manner, making the frame adjustment more efficient.

[0027] In combination with the first aspect, in certain implementations of the first aspect, when the first acquisition device acquires the multiple second images, the processing device is specifically used to: determine a third human eye depth based on the multiple second images, and generate the second adjustment amount based on the third human eye depth and the fourth human eye depth, the third human eye depth is determined based on the distance between the human eye and the window unit when the multiple second images are acquired, the fourth human eye depth is determined based on the distance between the human eye and the window unit when the multiple third images are acquired, the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth.

[0028] By generating the third human eye depth through multiple second images, the systematic error of the third human eye depth generated by the processing device can be eliminated, thereby further improving the accuracy of the third human eye depth calculation.

[0029] In combination with the first aspect, in certain implementations of the first aspect, the difference between the third human eye depth and the fourth human eye depth is greater than a second threshold, the multiple second images and the multiple third images are acquired within a second preset time, and when acquiring the multiple second images, the distance between the human eye and the window unit is within a second preset range, and when acquiring the multiple third images, the distance between the human eye and the window unit is within the second preset range.

[0030] By acquiring multiple second images that meet a preset range within a preset time, and only when the difference between the depth of the third eye and the depth of the fourth eye meets the second threshold, the adjustment of the frame is initiated. This can avoid abnormal jitter when the display system is in an unstable state, thereby further improving the reliability of the system and further improving the user experience.

[0031] In combination with the first aspect, in certain implementations of the first aspect, the display system further includes a second acquisition device, which is used to obtain environmental information of the display device and send the environmental information to the processing device; the processing device is also used to determine the credibility of the third human eye depth and the fourth human eye depth based on the environmental information.

[0032] By determining the credibility of the third eye depth and the fourth eye depth, the processing device can generate a second adjustment amount based on the third eye depth and the fourth eye depth with higher credibility, thereby further improving the accuracy of the frame adjustment and ensuring the stability of the system performance.

[0033] In a second aspect, an embodiment of the present application provides a vehicle, which includes a display system as described in the first aspect and various implementations thereof.

[0034] In combination with the second aspect, in certain implementations of the second aspect, the display system is arranged at at least one of a headrest of a seat of the vehicle, a backrest of a seat of the vehicle, and a co-pilot console of the vehicle.

[0035] In a third aspect, an embodiment of the present application provides a cockpit system, which includes the display system as described in the first aspect and various implementations thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] FIG1 is a schematic diagram of an application scenario of a smart cockpit display system 100 applicable to an embodiment of the present application.

[0037] FIG. 2 is a schematic structural diagram of a display device 200 applicable to an embodiment of the present application.

[0038] FIG. 3 is a side perspective view of the display device 200 .

[0039] FIG. 4 is a schematic diagram of the display device 200 from various angles.

[0040] FIG5 is a schematic diagram 5 showing a rotation angle θ of the window unit 202 around the vertical direction.

[0041] FIG6 is a schematic structural diagram of a first display system 600 provided in an embodiment of the present application.

[0042] FIG7 is a schematic structural diagram of a second display system 700 provided in an embodiment of the present application.

[0043] FIG8 is a schematic diagram of adjusting the first eye position and the ideal eye position in the vertical direction provided by an embodiment of the present application.

[0044] FIG9 is a schematic diagram of adjusting the first eye position and the ideal eye position in the horizontal direction according to an embodiment of the present application.

[0045] FIG10 is a schematic diagram of simultaneously adjusting the first eye position and the ideal eye position in the vertical and horizontal directions according to an embodiment of the present application.

[0046] FIG11 is a schematic diagram of the depth of the human eye provided in an embodiment of the present application.

[0047] FIG12 is a circuit diagram of a display device provided in an embodiment of the present application.

[0048] FIG13 is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application.

[0049] FIG14 is a schematic flowchart of a method 1400 for adjusting the angle of a display device provided in an embodiment of the present application.

[0050] FIG15 is a schematic flowchart of a method 1500 for adjusting the frame of a display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0052] In order to facilitate understanding of the embodiments of the present application, the following explanations are provided.

[0053] First, the terms "first," "second," and various numbers in the following descriptions or drawings of the embodiments of the present application are merely for convenience of description and are not necessarily used to describe a specific order or sequence, and are not intended to limit the scope of the embodiments of the present application. For example, they may be used to distinguish between different imaging lights, different angles, different images, etc.

[0054] Second, the terms "including" and "having" and any variations thereof in the embodiments of the present application shown below are intended to cover non-exclusive inclusions. For example, a system, product or device that includes a series of units is not necessarily limited to those units explicitly listed, but may include other units that are not explicitly listed or are inherent to these products or devices.

[0055] Third, in the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or descriptions. An embodiment or design described as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. The use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete manner to facilitate understanding.

[0056] Fourth, in the embodiment of the present application, imaging light refers to light carrying an image (or image information) and is used to generate an image.

[0057] Fifth, in the drawings of this application, the thickness, size, and shape of each optical element have been slightly exaggerated for ease of illustration. Specifically, the shapes of the optical elements shown in the drawings are by way of example, and the drawings are for illustrative purposes only and are not drawn strictly to scale.

[0058] Sixth, unless otherwise defined, all terms (including technical and scientific terms) used in this application have the same meaning as commonly understood by those skilled in the art to which this application belongs. It should also be understood that terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology and will not be interpreted in an idealized or overly formal sense unless expressly defined as such herein.

[0059] With the rapid development of smart cars, cars are playing an increasingly important role in people's lives, and the demand for in-car displays is gradually increasing. For example, they can provide entertainment services such as games and movies for passengers who spend long hours in the car, or provide office workers with a private office display environment.

[0060] To provide in-vehicle display functionality, a common solution is to install a display directly inside the vehicle. For example, a liquid crystal display (LCD) can be hung on the vehicle's roof or placed on the seatback for viewing by passengers. However, the pitch angle of these LCDs cannot be automatically adjusted, requiring users to manually adjust it based on their viewing habits. Some LCDs even cannot be adjusted once installed, resulting in a poor user experience.

[0061] In view of this, the present application provides a display system that can be used in a smart cockpit, which can not only realize automatic adjustment of the pitch angle, but also avoid cockpit jitter. While meeting the needs of different individuals, it improves the intelligent performance of the cockpit display system and further enhances the user experience.

[0062] FIG1 is a schematic diagram of an application scenario of an intelligent cockpit display system 100 applicable to an embodiment of the present application. As shown in FIG1 , the intelligent cockpit display system 100 includes at least one display device 101 and at least one seat 102. FIG1 takes a display device and a seat as an example, and the display device 101 is arranged on the back of the seat 102. Among them, the display device 101 can generate a long-distance magnified virtual image through the input of an external video signal (also referred to as a signal source), providing the viewer with a large-format, long-distance visual experience, and meeting the needs of users in various application scenarios such as leisure and entertainment, business office, etc. Among them, the display device 101 can be installed on the back of the seat 102 before leaving the factory, or installed on the back of the seat 102 by modifying the seat 102 after leaving the factory.

[0063] It is understood that the intelligent cockpit display system 100 can be applied to vehicles including, but not limited to, cars, trucks, buses, ships, airplanes, helicopters, recreational vehicles, and trains. Furthermore, the display device 101 can be installed on a seat headrest or in the passenger console before shipment, or it can be installed on a seat headrest or in the passenger console after shipment by modifying the seat.

[0064] It should be noted that the display system provided in this application can be applied to the smart cockpit display system 100 shown in Figure 1, but the embodiments of this application are not limited to this and can also be other similar systems that include the smart cockpit display system 100 shown in Figure 1.

[0065] FIG2 is a schematic diagram of the structure of a display device 200 applicable to an embodiment of the present application. Display device 200 can be used in the cockpit virtual image display system shown in FIG1 . As shown in FIG2 , display device 200 is sequentially arranged along the transmission direction of imaging light into an image generation unit 201, a window unit 202, and an image magnification unit 203. The image generation unit 201 is configured to emit imaging light toward the window unit. The window unit 202 is configured to reflect the imaging light from the image generation unit 201 to the image magnification unit 203 and transmit the imaging light from the image magnification unit 203. The window unit 202 is also configured to allow the human eye to view the virtual image formed by the imaging light through the window unit 202. The image magnification unit 203 is configured to reflect the imaging light from the window unit 1002 to the window unit 202.

[0066] The display device 200 further includes a rotating unit 204 . Optionally, the rotating unit 204 is a rotating shaft or a rotating gear, etc., which can rotate the display device 200 as a whole under the adjustment of the adjustment device, thereby changing the angle of the display device 200 .

[0067] Optionally, the image generation unit 201 can adopt a liquid crystal display (LCD) display, a liquid crystal on silicon (LCOS) display, an organic light-emitting diode (OLED) display, a micro light-emitting diode (Micro-LED) display, a display using micro LED (miniLED) display technology, a digital light processing (DLP) display or a micro-electro-mechanical systems (MEMS) display, etc., which is not limited in this application.

[0068] Optionally, the image magnifying unit 203 is a free-form surface mirror.

[0069] Specifically, when a user uses the display device 200 to watch a video image, the image generation unit 201 emits imaging light to the window unit 202. The imaging light is reflected by the window unit 202 and then incident on the image magnification unit 203. It is reflected again by the image magnification unit 203 and then incident on the window unit 202, passing through the window unit 202. At this time, the user can see a large-format image located far away through the window unit 202.

[0070] When the display device 200 shown in FIG2 is installed in a cockpit system, a housing is generally required to secure the relative positions of the various components of the display device 200 to ensure both its optical performance and protection. FIG3 shows a side perspective view of the display device 200. In FIG3 , the housing houses the image generation unit 201 and the image magnification unit 203 within an internal cavity formed by the housing. The window unit 202 serves as a light outlet within the enclosed housing, allowing the user to view the virtual image generated by the display device 200 through the window unit 202. This not only ensures the optical performance of the display device 200 but also protects the image generation unit 201 and the image magnification unit 203. If the display device 200 includes a rotation unit 204, the rotation unit 204 is disposed on the housing.

[0071] It should be noted that, in the present application, adjusting or changing the angle of the display device 200 can be understood as including but not limited to at least one of the following angle changes: the angle α between the plane where the window unit 202 is located and the vertical plane (the angles α1 and α2 before the change as shown in Figure 4), the angle β between the plane where the window unit 202 is located and the horizontal plane (the angles β1 and β2 before the change as shown in Figure 4), the angle γ between the imaging light and the vertical plane (the angles γ1 and γ2 before the change as shown in Figure 4), the angle δ between the imaging light and the horizontal plane (the angles δ1 and δ2 before the change as shown in Figure 4), the rotation angle θ of the window unit 202 around the vertical direction (the changed angle θ as shown in Figure 5), etc. Therefore, in the present application, adjusting the angle of the display device 200 may be adjusting the angle between the display device 200 and the horizontal plane (also referred to as the pitch angle). When the angle between the display device 200 and the horizontal plane changes, the display device 200 exhibits an effect similar to "nodding". Alternatively, adjusting the angle of the display device 200 may be adjusting the angle between the display device 200 and the vertical plane (also referred to as the horizontal deflection angle or the swing angle). When the angle between the display device 200 and the vertical plane changes, the display device 200 exhibits an effect similar to "shaking its head". Alternatively, adjusting the angle of the display device 200 may be simultaneously adjusting the angle between the display device 200 and the vertical plane and adjusting the angle between the display device 200 and the vertical plane.

[0072] It is understood that FIG2 is merely an example of a display device applicable to an embodiment of the display system of the present application, that is, the structure of the display device applicable to the embodiment of the present application is not limited to the structure shown in FIG2. In other embodiments, the image generation unit 201 in the display device 200 can also be arranged at other locations, for example, behind the curved mirror 203. In this case, the imaging light emitted by the image generation unit 201 transmits through the image magnification unit 203 and is incident on the surface of the window unit 202. After being reflected by the window unit 202, it is incident on the image magnification unit 203, and then is reflected again by the image magnification unit 203 to the window unit 202, and then transmits through the window unit 202 before entering the human eye.

[0073] FIG6 is a schematic structural diagram of a first display system 600 provided in an embodiment of the present application. It should be noted that the display system 600 shown in FIG6 is illustrated using the display device 200 shown in FIG2 as an example. As shown in FIG6 , the display system 600 includes the display device 200 and an adjustment device 610. The adjustment device 610 is configured to adjust the first angle of the display device 200 to a second angle, so that a user can view a virtual image formed by the first imaging light at the second angle through the window unit 202.

[0074] Specifically, the adjustment device 610 is connected to the display device 200 via the rotation unit 204. Optionally, the adjustment device 610 is an automatic device (e.g., electric, magnetic, etc.) or a manual device. Exemplarily, when the adjustment device 610 is an automatic device, the adjustment device 610 can be a motor that drives the rotation unit 204 to rotate, thereby rotating the display device 200 from a first angle to a second angle. Alternatively, when the adjustment device 610 is a manual device, the adjustment device 610 can be a rotation handle of the rotation unit 204, such as a rotating gear or a rotation handle, and the user operates the rotation unit 204 to rotate the display device 200 from the first angle to the second angle.

[0075] Optionally, when the adjustment device 610 is an automatic device, the automatic device can be arranged inside the display device 200, or arranged outside the display device 200 as shown in FIG6 . The present application does not limit the position of the adjustment device 610.

[0076] Based on the above scheme, the display system provided in this application can use an adjustment device to realize automatic or manual adjustment of the angle of the display device. When the adjustment device automatically adjusts the angle of the display device, the intelligent performance of the display system is improved. The angle of the adjusted display device matches the user's viewing angle, thereby achieving the purpose of improving the user experience.

[0077] FIG7 is a schematic structural diagram of a second display system 700 provided in an embodiment of the present application. It should be noted that the display system 700 shown in FIG7 is illustratively described using the display device 200 shown in FIG2 as an example. As shown in FIG7 , the display system 700 includes the display device 200, an adjustment device 610, a first acquisition device 710, and a processing device 720. The first acquisition device 710 is connected to the processing device 720, which is in turn connected to the adjustment device 610. Specifically, the first acquisition device 710 is configured to acquire one or more first images containing the user's eyes when the display device 200 is at a first angle, and to send the one or more first images to the processing device 720. The processing device 720 generates a first adjustment amount based on the received one or more first images, and sends the first adjustment amount to the adjustment device 610. For the description of the display device 200 and the adjustment device 610, reference can be made to the relevant portions of FIG2 or FIG6 above, and will not be repeated here.

[0078] Alternatively, the first acquisition device 710 may be a sensor within the cabin, for example, an image sensor disposed on the cabin roof or on the housing of the display device 200. When the first acquisition device 710 is an image sensor disposed on the cabin roof, it may be disposed directly in front of the user's eyes to capture one or more first images containing the front view of the eyes; or it may be disposed to the side of the user's face to capture one or more first images containing a side view of the eyes. When the first acquisition device 710 is an image sensor disposed on the housing of the display device 200, it may be disposed on the housing above the window unit 202 (as shown in FIG. 7 ) to capture one or more first images containing the front view of the eyes.

[0079] Alternatively, the processing device 720 may be a processor disposed in the cockpit or on the housing of the display device 200. When the processing device 720 is a processor disposed in the cockpit, the processor may be a central processing unit (CPU) that controls the cockpit system. When the processing device 720 is located on the housing of the display device 200, it may be disposed adjacent to the first acquisition device 710 located on the housing, as shown in FIG7 .

[0080] It should be noted that this application does not limit the connection method between the processing device 720 and the first acquisition device 710, or the connection method between the processing device 720 and the adjustment device 610. Both can be connected through a wired link or a wireless link. They can be directly connected or indirectly connected through other network devices, controllers, etc., so that the processing device 720 can exchange information with the first acquisition device 710 or the adjustment device 610 through the connected link.

[0081] In some embodiments, when the first acquisition device 710 acquires a first image, the processing device 720 determines the first human eye position and the ideal human eye position based on the received first image, and generates a first adjustment amount based on the first human eye position and the ideal human eye position, wherein the first human eye position is the distance of the human eye in the first image relative to the image edge in the vertical direction and / or horizontal direction.

[0082] Specifically, when the first human eye position is the distance in the vertical direction relative to the edge of the first image, (a) in Figure 8 shows a schematic diagram of the first human eye position in the first image being located above and below the ideal human eye position, wherein the vertical direction is the y direction shown in Figure 8. At this time, the processing device 720 can determine the vertical distance d or distance d' between the first human eye position and the ideal human eye position (that is, the difference between the y coordinate of the first human eye position and the y coordinate of the ideal human eye position) through an image processing algorithm, and generate a first adjustment amount Δθ of the angle of the display device 200 based on the distance d or the distance d', and send the first adjustment amount Δθ to the adjustment device 510. The adjustment device 510 drives the rotation unit 204 to rotate Δθ according to the first adjustment amount Δθ to complete the angle adjustment of the display device 200, so that the human eye position in the image after the angle adjustment basically coincides with the ideal human eye position, as shown in (b) in Figure 8. It is understood that if the ideal eye position is used as the coordinate axis with a distance of 0, when the first eye position is above the ideal eye position, the distance d can be set to a positive value, and the display device 200 achieves a "head-up" effect when adjusting the angle. When the first eye position is below the ideal eye position, the distance d' is set to a negative value, and the display device 200 achieves a "head-down" effect when adjusting the angle.

[0083] When the first eye position is the horizontal distance relative to the edge of the first image, FIG9(a) shows a schematic diagram of the first eye position being located to the left and right of the ideal eye position, where the horizontal direction is the x-direction shown in FIG9 . In this case, the processing device 720 can determine the horizontal distance d or distance d' between the first eye position and the ideal eye position (i.e., the difference between the x-coordinate of the first eye position and the x-coordinate of the ideal eye position) through an image processing algorithm, and calculate a first adjustment amount Δθ for the angle of the display device 200 based on the distance d. The first adjustment amount Δθ is sent to the adjustment device 510, which drives the rotation unit 204 to rotate Δθ based on the first adjustment amount Δθ, completing the angle adjustment of the display device 200 so that the eye position in the adjusted image substantially coincides with the ideal eye position, as shown in FIG9(b). It will be understood that when the first eye position is to the left of the ideal eye position, the distance d is a negative value, and the display device 200 achieves a "shaking head" effect to the left when adjusting the angle. When the first human eye position is located to the right of the ideal human eye position, the distance d' is a positive value, and the display device 200 achieves a rightward "shaking head" effect when adjusting the angle.

[0084] When the position of the first human eye in a first image acquired by the first acquisition device 710 changes in both the vertical and horizontal directions relative to the ideal human eye position, for example, as shown in (a) of Figure 10, the first human eye position is located to the upper left of the ideal human eye position, the processing device 720 can determine the vertical distance d1 and the horizontal distance d2 between the first human eye position and the ideal human eye position through an image processing algorithm, and calculate and generate a first adjustment amount Δθ of the angle of the display device 200 based on the distances d1 and d2, and send the first adjustment amount Δθ to the adjustment device 510. The adjustment device 510 drives the rotation unit 204 to rotate Δθ according to the first adjustment amount Δθ to complete the angle adjustment of the display device 200, so that the human eye position in the image after the angle adjustment basically coincides with the ideal human eye position, as shown in (b) of Figure 10.

[0085] Generally speaking, during the actual angle adjustment process, there are errors in the rotation process of the rotation unit 204, the calculation process of the processing device 720, or the process of the first acquisition device 710 acquiring the first image. Therefore, the human eye position in the image after the angle adjustment described in this application basically coincides with the ideal human eye position, which means that the distance between the human eye position after the angle adjustment and the ideal human eye position (including at least one of the vertical distance and horizontal distance mentioned above) is within the allowable error range.

[0086] It will be appreciated that in FIG8 , since the first eye position varies only in the vertical direction relative to the ideal eye position, the first eye position obtained by the processing device 720 is the vertical coordinate value of the eye in the first image relative to the edge of the first image. When the first image is a rectangle, the vertical direction can be understood as the direction of the short side of the rectangle. In FIG9 , the first eye position varies only in the horizontal direction relative to the ideal eye position. Therefore, the first eye position obtained by the processing device 720 is the horizontal coordinate value of the eye in the first image relative to the edge of the first image. When the first image is a rectangle, the horizontal direction can be understood as the direction along the long side of the rectangle. In FIG10 , the first eye position varies in both the vertical and horizontal directions relative to the ideal eye position. Therefore, the first eye position obtained by the processing device 720 is determined by combining the horizontal and vertical coordinate values ​​of the eye in the first image relative to the edge of the first image. Furthermore, in the present application, the ideal eye position is the center of the first image. That is, the ideal human eye position is at the same distance from the upper and lower edges of the first image. At the same time, the ideal human eye position is at the same distance from the left and right edges of the first image.

[0087] It can also be understood that in Figures 8 to 10, the lower edge of the first image is used as the axis of y=0, and the left edge of the first image is used as the axis of x=0, but the present application is not limited to this. In other words, in the description of the present application, the long side of the rectangle is used as the horizontal direction, and the short side of the rectangular image is used as the vertical direction for explanation. The horizontal direction and the vertical direction are only for the convenience of explanation, and can also be referred to as the first direction and the second direction, and the first direction and the second direction are perpendicular to each other. Therefore, the present application does not limit the positioning of the coordinate axis to be strictly the same as the above-mentioned example diagram, as long as the first eye position in the first image and the ideal eye position are calculated using the same image coordinates.

[0088] It should be noted that in the embodiment of the present application, when the image captured by the first acquisition device 710 (including the one or more first images described above, and the one or more second images and one or more third images described below) is a front view of the user, for example, when the image contains both eyes of the user, the eye position (including the first eye position described above, and the second eye position described below) can be understood as the midpoint of the line connecting the two eyes, or the position between the user's eyebrows, etc., which is not limited in this application. When the image captured by the first acquisition device 710 (including the one or more first images described above, and the one or more second images and one or more third images described below) is a side view of the user, the eye position can be understood as the vertical and / or horizontal distance of the eye relative to the edge of the image in the side view. It should be understood that Figures 8, 9, and 10 above are all described using the front view of the user captured by the first acquisition device 710 as an example.

[0089] In other embodiments, when the first acquisition device 710 acquires multiple first images, the processing device 720 determines the second eye position and the ideal eye position based on the received multiple first images, and generates a first adjustment amount based on the second eye position and the ideal eye position, wherein the second eye position is determined based on the vertical and / or horizontal distance of the eye relative to the edge of the corresponding image in each of the multiple first images. Optionally, the second eye position can be the average, variance, mean square error, median, etc. of the vertical and / or horizontal distance of the eye relative to the edge of the corresponding image in the multiple first images, which is not limited in this application. For example, when the first acquisition device 710 sends 10 first images to the processing device 720, and the second eye position is represented by an average value, the processing device 720 calculates the eye position in each first image and then calculates the average of the 10 eye positions in the 10 first images to obtain the second eye position.

[0090] It is understood that the eye position in each of the multiple first images can be a vertical variation relative to the ideal eye position as shown in FIG8 , or a horizontal variation relative to the ideal eye position as shown in FIG9 , or a vertical and horizontal variation relative to the ideal eye position as shown in FIG10 , which will not be described in detail here. Furthermore, when calculating the difference between the eye position in the multiple first images and the ideal eye position, the difference is always calculated by subtracting the ideal eye position from the actual eye position in the first image, or by subtracting the actual eye position from the ideal eye position.

[0091] In some scenarios, such as when a car is traveling on a bumpy road, the cabin may experience vibration. To prevent the display device 200 from frequently adjusting its angle, which could cause dizziness and fatigue in the user, in some further embodiments, when the processing device 720 determines that the distance between the second eye position and the ideal eye position is greater than a first threshold, that is, when the difference between the second eye position and the ideal eye position is greater than the first threshold, the processing device 720 generates a first adjustment amount Δθ. The multiple first images are acquired in a stable state. A stable state is defined as the multiple first images being acquired within a first preset time, and the vertical and / or horizontal distances of the eye in each first image relative to the corresponding image edge are within a first preset range. In other words, the eye positions in the multiple first images acquired by the first acquisition device within the first preset time are within the first preset range. It should be noted that the first preset range refers to a preset range of variation (e.g., change in coordinates) of the eye position within the first preset time. Exemplarily, it can be understood that among the multiple first images acquired in chronological order, the change in the position of the human eye in the later acquired first image of two adjacent first images relative to the position of the human eye in the previous first image is within the first preset range, or it can be understood that the difference between the maximum and minimum values ​​of the human eye position in the multiple first images is within the first preset range, etc., and this application does not limit this.

[0092] Specifically, after the first acquisition device 710 transmits the first image captured in real time to the processing device 720, the processing device 720 first determines whether the eye position in each of the multiple first images captured within a first preset time period is within a first preset range. The processing device 720 may then determine that the eye position during the first preset time period was actively adjusted by the user, such as by a change in sitting posture, rather than due to passive cabin vibration. If the processing device 720 further determines that the difference between the generated second eye position and the ideal eye position is greater than a first threshold, the processing device 720 generates a first adjustment amount, triggering a change in the angle of the display device 200. It is understood that if the difference between the second eye position obtained in a stable state and the ideal eye position is less than the first threshold, the display device 200 does not adjust the angle. In this case, the processing device may discard the calculated second eye position and trigger the angle adjustment of the display device 200 only when the difference between the second eye position and the ideal eye position in the next stable state is greater than or equal to the first threshold. By setting the first threshold, the angle adjustment of the display device 200 can be made less frequent, thereby ensuring the user experience.

[0093] It should be noted that, in the present application, the first preset time and the first preset range can be fixed values ​​or can be variable values. Specifically, when the first preset time is a fixed value, it can be preset by the display system when it leaves the factory, or it can be generated by the processing device 720 based on the user's usage habits over a period of time, using machine learning or big data algorithms, etc., and this application does not limit it. For example, it can be 0.8s to 3s. When the first preset time is a variable value, the first preset time can be flexibly adjusted according to the environment in which the cabin is located, wherein the environment in which the cabin is located can include but is not limited to the brightness of the cabin, the posture of the cabin (such as the road conditions of the car, vehicle navigation information, etc.). For example, when the ambient light in the cabin is relatively dim, the accuracy of the second eye position generated by the processing device 720 based on multiple first images is poor. At this time, the first preset time can be set to be longer to avoid errors in the calculation. For another example, when a car is traveling on a flat highway, the possibility of the car shaking is small, or the frequency of the user adjusting their sitting posture is low, or the processing device 720 knows from the navigation information that the car will continue to travel on the highway for a long time in the future, etc. At this time, the processing device 720 can appropriately set a longer first preset time. When the first preset range is a fixed value, it can be preset in the processing device 720 by the display system at the factory, or it can be generated by the processing device 720 based on the user's usage habits using machine learning or big data algorithms, etc., and this application does not limit it. For example, it can be 5cm to 7cm. When the first preset range is a variable value, the first preset time can be flexibly adjusted according to the environment of the cabin, etc. For example, when the car is traveling on a flat highway, the first preset range can be adjusted to be larger.

[0094] It should also be noted that in some scenarios, the processing device 720 may stop calculating the first adjustment amount Δθ for a period of time. In this case, even though the processing device 720 has calculated the first adjustment amount Δθ, it may not be sent to the adjustment device. Alternatively, the processing device 720 may discard the data of multiple first images received during this period. For example, in an aircraft cockpit, the processing device 720 may be aware of the flight environment in advance, such as the presence of strong airflow at a certain distance. In this case, the processing device 720 may calculate the time required to pass through the airflow based on the aircraft's flight speed and the length of the airflow, and stop adjusting the display device during this period of time.

[0095] Based on the above solution, generating the second eye position from multiple first images can improve the accuracy of the eye position, thereby ensuring the accuracy of the display device's angle adjustment. When the second eye position is generated from multiple stable first images and a first threshold is used to determine whether to perform angle adjustment, jitter present in the cockpit display system can be filtered out while ensuring that the angle adjustment of the display device 200 is performed under a trigger condition (i.e., using the first threshold as a trigger condition), further ensuring the reliability of the angle adjustment and further improving the user experience.

[0096] In order to further improve the reliability of the display system 700, the display system 700 optionally further includes a second acquisition device 730, which is used to obtain environmental information of the display device 200, such as the cabin posture (including but not limited to the road conditions of the vehicle, the navigation information of the vehicle, etc.), the brightness of the cabin, the temperature of the display device 200, etc., so that the processing device 720 can further determine the credibility of the second eye position obtained based on the environmental information. Specifically, when the processing device 720 determines that the credibility of the second eye position generated based on the environmental information is low, the processing device 720 discards the current second eye position and recalculates the second eye position with higher credibility based on the multiple first images received. When the processing device 720 determines the credibility of the second eye position based on the cabin posture, illustratively, the second acquisition device 730 can be a laser radar device for detecting road conditions or a navigation device for navigating routes, etc. At this time, the processing device 730 can generate road condition information corresponding to the multiple first images, compare the actual road condition information with the ideal road condition information, and obtain a road condition credibility coefficient. When the road condition credibility coefficient is greater than or equal to 0.5, the processing device 720 deems the second eye position corresponding to the multiple first images to be credible. When the processing device 720 determines the credibility of the second eye position based on the cabin brightness, the second acquisition device 730 can be a brightness detector. Exemplarily, when the second acquisition device 730 is a brightness detector, the processing device 730 can generate brightness information corresponding to the multiple first images, compare the brightness information with the ideal brightness information, and obtain a brightness credibility coefficient. When the brightness credibility coefficient is greater than or equal to 0.5, the processing device 720 deems the second eye position corresponding to the multiple first images to be credible. When the processing device 720 determines the credibility of the second eye position based on the temperature of the display device 200, the second acquisition device 730 can be a temperature detector. At this time, the processing device 730 can determine whether the second eye position corresponding to the multiple first images is credible based on the temperature of the display device 200 when the multiple first images are acquired. It should be understood that the above-mentioned environmental information is merely illustrative and not limiting, and this application is not limited thereto. Other information of the display device 200 or other information of the cockpit that may affect the credibility of the second eye position is also within the scope of protection of this application.

[0097] It should be noted that the processing device 720 can also make a credibility judgment based on the information of the first image obtained by the first acquisition device 710. In this case, the display system 700 may not include the above-mentioned second acquisition device 730. For example, the processing device 730 can generate color information corresponding to multiple first images, compare the color information with the ideal color information, and obtain a color credibility coefficient. When the color credibility coefficient is greater than or equal to 0.5, the processing device 720 believes that the second eye position corresponding to the multiple first images is credible. Alternatively, the processing device 730 can also determine through image processing that the eye position in the multiple first images (including the above-mentioned first eye position and second eye position) is unreliable. For example, the processing device 730 determines that the generated eye position is inaccurate due to an obstruction such as sunglasses worn by the user in the multiple first images.

[0098] Based on the above solution, by using the processing device to determine the credibility of the second eye position, the reliability of the display system can be further improved, thereby improving the user experience.

[0099] It will be appreciated that the embodiments described above are only for angular adjustment of the display device 200. In other scenarios, the display system provided in this application also has the function of adjusting the virtual image frame. For example, after the angle of the display device 200 is adjusted, the user may still not be able to view the entire virtual image, in which case the virtual image needs to be reduced; or, the virtual image generated by the first imaging light emitted by the display device 200 is small, in which case the user needs to enlarge the virtual image. Specifically, the first acquisition device 710 is configured to acquire one or more second images containing the user's eyes when the display device 200 is at a second angle, and send the one or more second images to the processing device 720. The processing device 720 also generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit 201. The image generation unit 201 generates an image of a corresponding size based on the second adjustment amount and emits the second imaging light to the window unit 202. The window unit 202 reflects the second imaging light from the image generating unit 201 to the image magnifying unit 203, and transmits the second imaging light from the image magnifying unit 203, so that the user can view the virtual image formed by the second imaging light at the second angle through the window unit 202. The image magnifying unit 203 is configured to reflect the second imaging light from the window unit 201 to the window unit 202.

[0100] In some embodiments, when the first acquisition device 710 acquires a second image, the processing device 720 determines the first human eye depth based on the received second image, and generates a second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit 202 when the second image is acquired, the second human eye depth is the human eye depth corresponding to the third image, the second human eye depth is the distance between the human eye and the window unit 202 when the third image is acquired, the acquisition time of the third image is before the acquisition time of the second image, or the second human eye depth is a preset human eye depth.

[0101] It is understandable that different eye depths correspond to different frame sizes, or different eye depth ranges correspond to different frame sizes. Therefore, after the processing device 720 determines the first eye depth, it can determine a first frame size corresponding to the first eye depth based on the value of the first eye depth or the range of the first eye depth, and simultaneously determine a second frame size corresponding to the second eye depth. By comparing the first frame size and the second frame size, a second adjustment amount is generated, and the second adjustment amount is sent to the image generation unit 201, so that the image generation unit 201 emits second imaging light corresponding to the second frame size.

[0102] It should be noted that different human eye depths correspond to different frame sizes, which may be the frame size of the virtual image or the frame size in the image generation unit 201 , and this application does not limit this.

[0103] In addition, the preset human eye depth can be the one set before the cockpit display system leaves the factory, or the human eye depth corresponding to the frame adjusted by the user based on usage habits, or the human eye depth learned by the processing device 702 based on user usage habits, etc. This application does not limit this.

[0104] In other embodiments, when the first acquisition device 710 acquires multiple second images, the processing device 720 determines a third human eye depth based on the received multiple second images, and generates a second adjustment amount based on the third human eye depth and the fourth human eye depth, wherein the third human eye depth is the distance between the human eye and the window unit 202 when the multiple second images are acquired, the fourth human eye depth is the human eye depth corresponding to the multiple third images, the fourth human eye depth is the distance between the human eye and the window unit 202 when the multiple third images are acquired, the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth.

[0105] It should be noted that the third eye depth can be the average, variance, mean square error, median, etc. of the distance between the human eye and the window unit 202 when each of the multiple second images is acquired, and this application does not limit this. For example, when the first acquisition device 710 sends 10 second images to the processing device 720, and the third eye depth is expressed as an average, the processing device 720 calculates the eye depth when each second image is acquired, and then calculates the average of the 10 eye depths of the 10 second images to obtain the third eye depth.

[0106] It should be noted that, in the embodiment of the present application, the depth of the human eye (including the first to fourth depths of the human eye in the text) is the distance between the plane where the human eye is located and the plane where the window unit 202 is located. When the human eye in the acquired one or more images is a front view, since the one or more images have depth information, the depth of the human eye can be determined from the depth information. When the human eye in the acquired one or more images is a side view, the depth of the human eye in the one or more images can be converted by the distance d between the human eye and the window unit 202 in the image. Exemplarily, as shown in Figure 11, the image is a side view of the human eye, wherein the depth of the human eye can be determined by the distance between the plane where the human eye is located and the plane where the window unit 202 is located in the image.

[0107] Similarly, to avoid unnecessary image adjustments caused by cabin vibration, in some further embodiments, when the processing device 720 determines that the distance between the third eye depth and the fourth eye depth is greater than a second threshold, that is, the difference between the third eye depth and the fourth eye depth is greater than the second threshold, the processing device 720 calculates and generates a second adjustment amount based on the third eye depth and the fourth eye depth. The plurality of second images and the plurality of third images are acquired in a stable state. In other words, the plurality of second images and the plurality of third images are acquired within a second preset time. Simultaneously, the plurality of eye depths corresponding to the plurality of second images are within a second preset range, and the plurality of eye depths corresponding to the plurality of third images are within a second preset range. Exemplarily, the plurality of eye depths corresponding to the plurality of second images being within the second preset range can be understood as meaning that the change in the eye depth in the later-acquired second image relative to the eye depth in the previous second image is within the second preset range, or that the difference between the maximum and minimum eye depths in the plurality of second images is within the second preset range, etc., which is not limited in this application. Similarly, the multiple human eye depths corresponding to the multiple third images are within the second preset range, which can be understood as the change in the human eye depth in the later acquired third image among the two adjacent third images relative to the human eye depth in the previous third image is within the second preset range, or it can be understood as the difference between the maximum and minimum values ​​of the human eye depth in the multiple third images is within the second preset range, etc., which is not limited in this application.

[0108] Specifically, after the first acquisition device 710 transmits the real-time acquired second image to the processing device 720, the processing device 720 first determines whether the eye depth in each of the multiple second images acquired within the second preset time period is within a second preset range. The processing device 720 then determines that the eye depth during the second preset time period was actively adjusted by the user, such as by a change in sitting posture, rather than due to passive cabin vibration. At this point, the processing device 720 generates a third eye depth based on the multiple eye depths. If the processing device 720 further determines that the difference between the generated third eye depth and the fourth eye depth is greater than a second threshold, the processing device 720 generates a second adjustment amount, triggering a change in the image frame of the display device 200. The fourth eye depth is also saved for future adjustment. It is understandable that when the difference between the third eye depth and the fourth eye depth obtained in a stable state is less than the second threshold, the display device 200 does not perform adjustment. At this time, the processing device can discard the calculated third eye depth and trigger the frame adjustment of the display device 200 until the difference between the third eye depth and the fourth eye depth in the next stable state is calculated to meet the second threshold.

[0109] Likewise, the second preset range may be a fixed value or a variable value. The setting of the second preset range may refer to the setting of the first preset range, which will not be described in detail here.

[0110] In addition, the processing device 720 also stops calculating the second adjustment amount for a period of time according to the environment of the cabin, etc., and reference may be made to the relevant descriptions above, which will not be repeated here.

[0111] In order to further improve the reliability of the display system 700, the display system 700 can determine the credibility of the depth of the third human eye obtained by the second acquisition device 730, or the information of multiple second images obtained by the first acquisition device 710. This process is the same as the process of determining the credibility of the second human eye position and will not be repeated here.

[0112] It can be understood that the angle adjustment of the display device 200 is performed based on one or more first images captured by the first acquisition device 710, and the frame adjustment is performed based on one or more second images captured by the first acquisition device 710. Since the second images are captured when the display device is at a second angle, in other words, the frame adjustment can further enhance the user experience based on the angle adjustment. Of course, in other embodiments, the display system 700 can also perform frame adjustment first and then angle adjustment, in which case the display device can use one or more identical images.

[0113] Figure 12 is a circuit diagram of a display device provided in an embodiment of the present application. As shown in Figure 12, the circuit in the display device mainly includes a host CPU 1201, an external memory interface 1202, an internal memory 1203, an audio module 1204, a video module 1205, a power module 1206, a wireless communication module 1207, an I / O interface 1208, a video interface 1209, a display circuit 1210 and a modulator 1212. Among them, the main processor 1201 and its peripheral components, such as the external memory interface 1202, the internal memory 1203, the audio module 1204, the video module 1205, the power module 1206, the wireless communication module 1207, the I / O interface 1208, the video interface 1209, and the display circuit 1210 can be connected via a bus. The main processor 1201 can be called a front-end processor.

[0114] In addition, the circuit diagrams shown in the embodiments of the present application do not constitute specific limitations on the display device. In other embodiments of the present application, the display device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The components shown in the diagrams may be implemented in hardware, software, or a combination of software and hardware.

[0115] The main processor 1201 includes one or more processing units. For example, the main processor 1201 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0116] The main processor 1201 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the main processor 1201 is a cache memory. This memory can store instructions or data that the main processor 1201 has just used or is reusing. If the main processor 1201 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the main processor 1201, and thus improves system efficiency.

[0117] In some embodiments, the display device may further include multiple input / output (I / O) interfaces 1208 connected to the main processor 1201. The interfaces 1208 may include an I2C (Inter-Integrated Circuit) interface, an I2S (Inter-Integrated Circuit Sound) interface, a PCM (Pulse Code Modulation) interface, a UART (Universal Asynchronous Receiver / Transmitter) interface, a MIPI (Mobile Industry Processor Interface) interface, a GPIO (General-Purpose Input / Output) interface, a SIM (Subscriber Identity Module) interface, and / or a USB (Universal Serial Bus) interface. The I / O interfaces 1208 may be connected to devices such as a mouse, touchpad, keyboard, camera, speaker, microphone, etc., as well as physical buttons on the display device (e.g., volume button, brightness adjustment button, power button, etc.).

[0118] The external memory interface 1202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with the main processor 1201 through the external memory interface 1202 to implement data storage function.

[0119] The internal memory 1203 can be used to store computer executable program codes, which include instructions. The internal memory 1203 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as a call function, a time setting function, etc.), etc. The data storage area may store data created during the use of the display device (such as a phone book, world time, etc.), etc. In addition, the internal memory 1203 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (UFS), etc. The main processor 1201 executes various functional applications and data processing of the display device by running instructions stored in the internal memory 1203 and / or instructions stored in a memory provided in the main processor 1201.

[0120] The display device can implement audio functions such as music playback and calls through the audio module 1204 and the application processor.

[0121] The audio module 1204 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 1204 can also be used to encode and decode audio signals, such as for playing or recording. In some embodiments, the audio module 1204 can be provided in the main processor 1201, or some functional modules of the audio module 1204 can be provided in the main processor 1201.

[0122] The video interface 1209 can receive external audio and video signals, which can specifically be a High Definition Multimedia Interface (HDMI), a Digital Visual Interface (DVI), a Video Graphics Array (VGA), a Display Port (DP), etc. The video interface 1209 can also output video. When the display device is used as an in-vehicle display, the video interface 1209 can receive speed signals and power signals input from peripheral devices, and can also receive external VR video signals. When the display device is in use, the video interface 1209 can receive video signals input from an external computer or terminal device.

[0123] The video module 1205 can decode the video input from the video interface 1209, for example, by performing H.264 decoding. The video module can also encode the video captured by the display device, for example, by performing H.264 encoding on the video captured by an external camera. Furthermore, the main processor 1201 can also decode the video input from the video interface 1209 and output the decoded image signal to the display circuit 1210.

[0124] The display circuit 1210 and modulator 1212 are used to display corresponding images. In this embodiment, the video interface 1209 receives an external video source signal, which the video module 1205 decodes and / or digitizes before outputting one or more image signals to the display circuit 1210. The display circuit 1210 drives the modulator 1212 based on the input image signal to image the incident polarized light and output image light. Furthermore, the main processor 1201 may also output one or more image signals to the display circuit 1210.

[0125] In this embodiment, the display circuit 1210 and the modulator 1212 are electronic components in the image generating unit, and the display circuit 1210 can be referred to as a driving circuit.

[0126] The power module 1206 is used to provide power to the main processor 1201 and the light source 1200 based on input power (e.g., direct current). The power module 1206 may include a rechargeable battery, which can provide power to the main processor 1201 and the light source 1200. Light emitted by the light source 1200 can be transmitted to the modulator 1212 for imaging, thereby forming an image light signal.

[0127] The wireless communication module 1207 enables the display device to communicate wirelessly with the outside world. It can provide wireless local area networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), infrared technology (IR) and other wireless communication solutions. The wireless communication module 1207 can be one or more devices that integrate at least one communication processing module. The wireless communication module 1207 receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the main processor 1201. The wireless communication module 1207 can also receive signals to be sent from the main processor 1201, frequency modulate them, amplify them, and convert them into electromagnetic waves for radiation through the antenna.

[0128] In addition, in addition to being input through the video interface 1209, the video data decoded by the video module 1205 can also be received wirelessly through the wireless communication module 1207 or read from an external memory. For example, the display device can receive video data from a terminal device or an in-vehicle entertainment system through the wireless local area network in the vehicle, and the display device can also read audio and video data stored in an external memory.

[0129] The above-mentioned display device can be installed on a vehicle. Please refer to Figure 13, which is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application.

[0130] As shown in FIG13 , the functional framework of a vehicle may include various subsystems, such as a sensor system 12, a control system 14, one or more peripheral devices 16 (one of which is shown as an example), a power supply 18, a computer system 20, and an onboard display system 22. Optionally, the vehicle may also include other functional systems, such as an engine system that provides power to the vehicle, etc., which are not limited in this application.

[0131] The sensor system 12 may include a plurality of detection devices that sense the information being measured and convert the sensed information into electrical signals or other required information outputs according to certain rules. As shown in the figure, these detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser rangefinder, a camera, a wheel speed sensor, a steering sensor, a gear position sensor, or other components for automatic detection, etc., and this application does not limit them.

[0132] The control system 14 may include several components, such as a steering unit, a braking unit, a lighting system, an autonomous driving system, a map navigation system, a network timing system, and an obstacle avoidance system, as shown. Optionally, the control system 14 may also include components such as a throttle controller and an engine controller for controlling vehicle speed, although this application does not limit this.

[0133] The peripheral devices 16 may include several components, such as the communication system shown in the figure, a touch screen, a user interface, a microphone, and a speaker. The communication system is used to enable network communication between the vehicle and other devices. In practical applications, the communication system may utilize wireless communication technology or wired communication technology to enable network communication between the vehicle and other devices. Wired communication technology may involve communication between the vehicle and other devices via network cables or optical fibers.

[0134] Power supply 18 represents a system that provides electrical power or energy to the vehicle, and may include, but is not limited to, rechargeable lithium batteries or lead-acid batteries. In practical applications, one or more battery components in the power supply are used to provide electrical energy or energy for starting the vehicle. The type and material of the power supply are not limited in this application.

[0135] Several functions of the vehicle are controlled and implemented by a computer system 20. The computer system 20 may include one or more processors 2001 (a single processor is shown as an example) and a memory 2002 (also referred to as a storage device). In practical applications, the memory 2002 may be internal to the computer system 20 or external to the computer system 20, for example, as a cache in the vehicle, although this application does not limit this.

[0136] in,

[0137] The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 may be used to run relevant programs or instructions corresponding to the programs stored in the memory 2002 to implement corresponding functions of the vehicle.

[0138] The memory 2002 may include a volatile memory, such as RAM; the memory may also include a non-volatile memory, such as ROM, flash memory, HDD or solid-state drive SSD; the memory 2002 may also include a combination of the above types of memory. The memory 2002 can be used to store a set of program codes or instructions corresponding to the program codes, so that the processor 2001 can call the program codes or instructions stored in the memory 2002 to implement the corresponding functions of the vehicle. In the present application, the memory 2002 can store a set of program codes for vehicle control, and the processor 2001 can call the program codes to control the safe driving of the vehicle. How to achieve safe driving of the vehicle is described in detail below in this application.

[0139] Optionally, in addition to storing program code or instructions, memory 2002 may also store information such as road maps, driving routes, and sensor data. Computer system 20 may integrate with other components in the vehicle functional framework diagram, such as sensors and GPS in the sensor system, to implement relevant vehicle functions. For example, computer system 20 may control the vehicle's direction or speed based on data input from sensor system 12, although this application does not limit this.

[0140] The in-vehicle display system 22 may include several components, such as a controller and an in-vehicle display. The controller 222 is used to generate images (e.g., images of VR content) based on user instructions and transmit these images to the in-vehicle display for display. The in-vehicle display may include an image generation unit, a window unit, and an image magnification unit, through which passengers can view the target image presented on the in-vehicle display. The functions of some components in the in-vehicle display system may also be implemented by other subsystems of the vehicle. For example, the controller may also be a component of the control system.

[0141] FIG13 of this application shows four subsystems: sensor system 12, control system 14, computer system 20, and onboard display system 22. These subsystems are merely illustrative and not limiting. In practice, a vehicle may combine several components according to different functions to create subsystems with corresponding functions. In practice, a vehicle may include more or fewer systems or components, and this application does not limit this.

[0142] The above-mentioned means of transportation can be a car, a truck, a bus, a ship, an airplane, a helicopter, an RV, a train, etc., and the embodiments of the present application do not make any special limitations.

[0143] Figure 14 is a schematic flowchart of a method 1400 for adjusting the angle of a display device, provided in an embodiment of the present application. This method can be applied to the cockpit virtual image display system shown in Figure 1 . Method 1400 can be executed by the processing device 610 in the display system 700 described above, and this application does not limit this. As shown in Figure 14 , method 1400 includes the following steps.

[0144] S1401, obtaining the human eye position and the ideal human eye position in the image.

[0145] In some embodiments, the processing device 610 acquires a first image through the first acquisition device 710, and determines the first human eye position and the ideal human eye position based on the first image; in other embodiments, the processing device 610 acquires a first image through the first acquisition device 710, and determines the second human eye position and the ideal human eye position based on the multiple first images.

[0146] S1402 : Determine a first adjustment amount of the display device based on the human eye position in the image and the ideal human eye position, where the first adjustment amount is an angle adjustment amount of the display device.

[0147] In some embodiments, when the processing device 610 determines a first human eye position and an ideal human eye position based on a first image, the processing device 610 generates a first adjustment amount based on the first human eye position and the ideal human eye position; in other embodiments, when the processing device 610 determines a second human eye position and an ideal human eye position based on multiple first images, the processing device 610 generates a first adjustment amount based on the second human eye position and the ideal human eye position.

[0148] The acquisition process of the one or more first images, the first eye position, the second eye position, the ideal eye position, the first adjustment amount, etc. can all be referred to the relevant descriptions above and will not be repeated here.

[0149] Figure 15 is a schematic flowchart of a method 1500 for adjusting the image width of a display device, provided in an embodiment of the present application. This method can be applied to the cockpit virtual image display system shown in Figure 1 . Method 1500 can be executed by processing device 610 in display system 700 described above, and this application does not limit this. As shown in Figure 15 , method 1500 includes the following steps.

[0150] S1501: Acquire a first human eye depth and a second human eye depth in an image, or acquire a third human eye depth and a fourth human eye depth in an image.

[0151] In some embodiments, the processing device 610 acquires a second image through the second acquisition device 730 and determines a first eye depth based on the second image. The first eye depth is the distance between the human eye and the window unit 202 when the second image is acquired. The second eye depth is the distance between the human eye and the window unit 202 when a third image is acquired, the third image being acquired before the second image. Alternatively, the processing device 610 acquires multiple second images through the second acquisition device 730 and determines a third eye depth based on the multiple second images. The third eye depth is determined based on the distance between the human eye and the window unit 202 when the multiple second images are acquired. The fourth eye depth is determined based on the distance between the human eye and the window unit 202 when the multiple third images are acquired, the multiple third images being acquired before the multiple fourth images.

[0152] S1502 : Generate a second adjustment amount based on the first eye depth and the second eye depth, or generate a second adjustment amount based on the third eye depth and the fourth eye depth, where the second adjustment amount is an adjustment amount of the frame.

[0153] In some embodiments, the processing device 610 generates the second adjustment amount based on the first human eye depth and the second human eye depth; in other embodiments, the processing device 610 generates the second adjustment amount based on the third human eye depth and the fourth human eye depth.

[0154] The above-mentioned process of acquiring one or more second images, the process of acquiring one or more third images, the process of acquiring one or more fourth images, the first human eye depth, the second human eye depth, the second adjustment amount, etc. can all be referred to the relevant descriptions above and will not be repeated here.

[0155] It can be understood that the specific working process of the system described in the above method can refer to the corresponding process in the aforementioned display system embodiment, and will not be repeated here.

[0156] Unless otherwise defined, technical or scientific terms used herein shall have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.

[0157] The above description is only one embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made on the basis of the present application shall be included in the scope of protection of the present application.

Claims

1. A display system, characterized in that: For vehicle-mounted display, the display system comprises: a display device and an adjustment device, the display device comprises an image generating unit, an image magnifying unit and a window unit, the adjustment device is connected to the display device, wherein: The image generating unit is configured to emit a first imaging light toward the window unit; The window unit is used to reflect the first imaging light from the image generating unit to the image amplifying unit, and transmit the first imaging light from the image amplifying unit; The image amplification unit is used to reflect the first imaging light from the window unit to the window unit, The adjusting device is used to adjust the first angle of the display device to a second angle, so that the user can view the virtual image formed by the first imaging light at the second angle through the window unit.

2. The display system according to claim 1, characterized in that: The display system further includes a first acquisition device and a processing device. The first acquisition device is used to acquire one or more first images including the user's eyes when the display device is at the first angle, and send the one or more first images to the processing device; The processing device generates a first adjustment amount based on the one or more first images, and sends the first adjustment amount to the adjustment device; The adjusting device is specifically used to adjust the first angle to the second angle according to the first adjustment amount.

3. The display system according to claim 2, characterized in that: When the first acquisition device acquires the first image, The processing device is specifically used to: determine a first human eye position and an ideal human eye position based on the first image, and generate the first adjustment amount based on the first human eye position and the ideal human eye position, wherein the first human eye position is the distance of the human eye in the first image relative to the image edge in the vertical direction and / or horizontal direction.

4. The display system according to claim 2, characterized in that: When the first acquisition device acquires the plurality of first images, The processing device is specifically used to: determine the second human eye position and the ideal human eye position based on the multiple first images, and generate the first adjustment amount based on the second human eye position and the ideal human eye position, wherein the second human eye position is determined based on the distance of the human eye in each first image of the multiple first images relative to the edge of the corresponding image in the vertical direction and / or horizontal direction.

5. The display system according to claim 4, characterized in that: The difference between the second human eye position and the ideal human eye position is greater than a first threshold, the multiple first images are acquired within a first preset time, and the distance of the human eye in each of the multiple first images relative to the corresponding image edge in the vertical direction and / or horizontal direction is within a first preset range.

6. The display system according to claim 5, characterized in that: The display system further includes a second acquisition device, The second acquisition device is used to acquire the environment information of the display device and send the environment information to the processing device; The processing device is further used to determine the credibility of the second human eye position according to the environmental information.

7. The display system according to claim 2, characterized in that: The processing device further generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit; The image generating unit is configured to generate an image of a corresponding size according to the second adjustment amount, and emit a second imaging light; The window unit is used to reflect the second imaging light from the image generating unit to the image amplifying unit, and transmit the second imaging light from the image amplifying unit, so that the user can view the virtual image formed by the second imaging light at the second angle through the window unit; The image amplifying unit is used to reflect the second imaging light from the window unit to the window unit.

8. The display system according to claim 7, characterized in that: When the first acquisition device acquires the second image, The processing device is specifically used to: determine a first human eye depth based on the one second image, and generate the second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit when the one second image is acquired, and the second human eye depth is the distance between the human eye and the window unit when the third image is acquired, and the acquisition time of the third image is before the acquisition time of the one second image, or the second human eye depth is a preset human eye depth.

9. The display system according to claim 7, characterized in that: When the first acquisition device acquires the plurality of second images, The processing device is specifically used to: determine a third eye depth based on the multiple second images, and generate the second adjustment amount based on the third eye depth and the fourth eye depth, wherein the third eye depth is based on the distance between the human eye and the visual window when the multiple second images are acquired. The fourth human eye depth is determined by the distance between the human eye and the window unit when the multiple third images are acquired, and the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth.

10. The display system according to claim 9, characterized in that: A difference between the third human eye depth and the fourth human eye depth is greater than a second threshold, the multiple second images and the multiple third images are acquired within a second preset time, the distance between the human eye and the window unit is within a second preset range when the multiple second images are acquired, and the distance between the human eye and the window unit is within the second preset range when the multiple third images are acquired.

11. The display system according to claim 10, characterized in that: The display system further includes a second acquisition device, The second acquisition device is used to acquire the environment information of the display device and send the environment information to the processing device; The processing device is further used to determine the credibility of the third human eye depth and the fourth human eye depth according to the environmental information.

12. A means of transport, characterized in that: The invention comprises a display system as claimed in any one of claims 1 to 11.

13. The vehicle according to claim 12, characterized in that: The display system is arranged at at least one of a headrest of a seat of the vehicle, a backrest of a seat of the vehicle, and a co-pilot platform of the vehicle.

14. A cockpit system, characterized in that: Comprising the display system as claimed in any one of claims 1 to 11.

Images