Display device, virtual image control method, cockpit system, and transportation vehicle

Abstract

A display device (400) and a virtual image control method, which can be applied to in-vehicle systems and transportation vehicles. The display device (400) can simultaneously display a real image and a virtual image, and implement control of the virtual image by a user touching the real image, thereby realizing a low-delay and high-efficiency interaction solution between the user and a virtual image display device, and achieving the purpose of improving user experience. The display device (400) comprises a window unit (420), a first image generation unit (410), and an image magnification unit (430). The first image generation unit (410) is used for emitting first imaging light to the window unit (420). The window unit (420) is used for reflecting the first imaging light from the image generation unit (410) to the image magnification unit (430), and transmitting to a user the first imaging light reflected from the image magnification unit (430), the first imaging light being used for generating a virtual image. Additionally, the window unit (420) is also used for displaying a real image, so that the user controls the virtual image by touching the real image. The image magnification unit (430) is used for reflecting the first imaging light from the window unit (420) to the window unit (420).

Description

Display device, method of controlling virtual image, cockpit system and vehicle

[0001] This application claims priority to the Chinese patent application No. 202410696198.5, filed on May 30, 2024, and entitled "Display device, method of controlling virtual image, cockpit system and vehicle", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of display, and more particularly, to a display device, a method of controlling a virtual image, a cockpit system and a vehicle. BACKGROUND

[0003] Today, with the design of automobiles focusing on user experience, vehicle display devices are developing rapidly. In order to better realize human-vehicle interaction or improve the driving experience, larger, more and smarter vehicle display devices are applied to many smart cars. At present, virtual image display devices that use optical engine technology to break through the physical space limitations in the car gradually enter people's field of vision. Virtual image display devices are based on unique spatial optical engine design, use light field folding technology principles, and increase the viewing distance through multiple reflections of light, which can achieve the effect of presenting a 40-inch frame at a distance of 3 meters from the human eye. However, compared with traditional display devices, the virtual image generated by the virtual image display device cannot be touched and there are some problems in interaction. Therefore, how to realize human-computer interaction for the virtual image display device is a problem to be solved. SUMMARY

[0004] The present application provides a display device, a method of controlling a virtual image, a cockpit system and a vehicle. The display device provided by the present application can display real images and virtual images at the same time, and can realize interaction between the display device and the user through user touch control, thereby achieving the purpose of improving user experience.

[0005] In a first aspect, an embodiment of the present application provides a display device. The display device comprises a view window unit, a first image generation unit and an image magnification unit, wherein the first image generation unit is configured to emit first imaging light to the view window unit; the view window unit is configured to reflect the first imaging light from the image generation unit to the image magnification unit, and transmit the first imaging light reflected from the image magnification unit to the user, the first imaging light being used to generate a virtual image, the view window unit is also configured to display a real image on the view window unit, so that the user controls the virtual image by touching the real image; and the image magnification unit is configured to reflect the first imaging light from the view window unit to the view window unit.

[0006] Based on the above scheme, the display device provided in the application can enable a user to view a virtual image through a view window unit while displaying a real image, that is, to achieve the effect of simultaneously displaying a real image and a virtual image, so that the user can control the virtual image through the real image displayed by the view window unit, thereby realizing interaction with the display device and improving the user's experience.

[0007] With reference to the first aspect, in some implementations of the first aspect, the view window unit is configured to display the real image by using the second imaging light.

[0008] With reference to the first aspect, in some implementations of the first aspect, the view window unit comprises a display touch module, and the display touch module is configured to display the real image and realize touch control on a real image area.

[0009] With reference to the first aspect, in some implementations of the first aspect, the display touch module comprises one of a transparent display touch module, a projection display touch module, or an illumination display touch module.

[0010] With reference to the first aspect, in some implementations of the first aspect, the display touch module comprises the transparent display touch module, and the transparent display touch module is configured to generate the second imaging light by using image information of the real image, and the second imaging light is configured to display the real image on the view window unit.

[0011] With reference to the first aspect, in some implementations of the first aspect, the display device further comprises an image processing unit, and the image processing unit is configured to input the image information of the real image to the transparent display touch module.

[0012] With reference to the first aspect, in some implementations of the first aspect, the transparent display touch module covers all or part of a surface of the view window unit.

[0013] The transparent display touch module generates a real image and realizes touch control, which not only increases the touch area of the outer surface of the view window unit, but also enables the transparent display touch module to generate different real images according to the application scenario of the display device, thereby increasing the application scenario of the display device.

[0014] With reference to the first aspect, in some implementations of the first aspect, the display touch module comprises the projection display touch module, and the display device further comprises a second image generation unit, the second image generation unit is configured to emit the second imaging light to the view window unit, and the projection display touch module is configured to generate the real image on the view window unit by using the second imaging light emitted by the second image generation unit.

[0015] With reference to the first aspect, in some implementations of the first aspect, the projection display touch module covers part of the surface of the view window unit.

[0016] By means of the projection display touch module, a real image is displayed on the view window unit, and the display device has a touch function. The position of the real image displayed on the view window unit can be changed flexibly, so that the interactivity between the display device and the user is enhanced, and the user experience is improved.

[0017] With reference to the first aspect, in some implementations of the first aspect, the display touch module comprises the illumination display touch module, and the display device further comprises: a light source, configured to emit a light beam to the view window unit; and the illumination display touch module, configured to illuminate the real image on the illumination display touch module by using the light beam emitted by the light source.

[0018] With reference to the first aspect, in some implementations of the first aspect, the illumination display touch module covers part of the surface of the view window unit.

[0019] By means of the illumination display touch module, the display of the real image and the touch function are realized, and the cost of the touch module can be reduced. The scheme is simple and easy to implement.

[0020] With reference to the first aspect, in some implementations of the first aspect, the user touches the real image by using a finger. With reference to the first aspect, in some implementations of the first aspect, when the user touches the real image, the real image changes in at least one of the following manners: the brightness of the real image changes from a first brightness to a second brightness, the brightness value of the second brightness is greater than that of the first brightness; the frame size of the real image changes from a first frame size to a second frame size, the area of the second frame size is greater than that of the first frame size; and the real image displays a bright edge.

[0021] The second aspect provides a method for controlling a virtual image. The method is applied to a display device, and comprises: in response to a touch operation of a user on a real image displayed on the display device, a virtual image displayed by the display device changes from a first virtual image to a second virtual image, the first virtual image is generated by transmitting first imaging light of the display device, and the second virtual image is generated by transmitting second imaging light of the display device.

[0022] With reference to the second aspect, in some implementations of the second aspect, the user touches the real image by using a finger.

[0023] With reference to the second aspect, in some implementations of the second aspect, when the user touches the real image, the real image changes in at least one of the following manners: a brightness of the real image changes from a first brightness to a second brightness, the second brightness having a brightness value greater than that of the first brightness; a frame size of the real image changes from a first frame size to a second frame size, the second frame size having an area greater than that of the first frame size; the real image displays a bright border.

[0024] In a third aspect, an embodiment of the present application provides a cockpit system, which comprises the display device provided by the first aspect and any implementation manner of the first aspect, and a seat, wherein the seat is used for the user to sit on the seat.

[0025] In a fourth aspect, an embodiment of the present application provides a vehicle, which comprises the display device provided by the first aspect and any implementation manner of the first aspect, or the cockpit system provided by the third aspect.

[0026] With reference to the fourth aspect, in some implementations of the fourth aspect, the display device is arranged at at least one of a headrest of a seat of the vehicle, a backrest of the seat of the vehicle, and an instrument panel of the vehicle.

[0027] The beneficial effects brought by the second aspect to the fourth aspect can refer to the description of the beneficial effects of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0028] FIG. 1 is a functional schematic diagram of a vehicle 100 according to an embodiment of the present application.

[0029] FIG. 2 is a schematic diagram of an application scenario of an intelligent cockpit display system 200 according to an embodiment of the present application.

[0030] FIG. 3 is a schematic diagram of an application scenario of another intelligent cockpit display system 200 according to an embodiment of the present application.

[0031] FIG. 4 is a structural schematic diagram of a first display device 400 according to an embodiment of the present application.

[0032] FIG. 5 shows two forms of a transparent display touch module covering a window unit according to an embodiment of the present application.

[0033] FIG. 6 is a structural schematic diagram of a first window unit 420 according to an embodiment of the present application.

[0034] FIG. 7 is a structural schematic diagram of a second window unit 420 according to an embodiment of the present application.

[0035] FIG. 8 is a schematic diagram of user touch interaction of the display device 400 in two scenarios of being covered by different transparent display touch modules according to an embodiment of the present application.

[0036] FIG. 9 is a structural schematic diagram of a second display device 900 according to an embodiment of the present application.

[0037] FIG. 10 is a structural schematic diagram of two window units 920 according to an embodiment of the present application.

[0038] FIG. 11 is a structural schematic diagram of a third display device 1100 according to an embodiment of the present application.

[0039] FIG. 12 is a structural schematic diagram of two window units 1120 according to an embodiment of the present application.

[0040] FIG. 13 is a possible side structural perspective view of a display apparatus 30 according to an embodiment of the present application.

[0041] FIG. 14 is a schematic diagram of a cockpit of a vehicle according to an embodiment of the present application.

[0042] FIG. 15 is a circuit schematic diagram of a display device according to an embodiment of the present application.

[0043] FIG. 16 is a possible functional framework schematic diagram of a vehicle according to an embodiment of the present application.

[0044] FIG. 17 is a schematic functional block diagram of a mobile carrier 25 according to an embodiment of the present application. DETAILED DESCRIPTION

[0045] The technical solutions in the present application will be described below with reference to the accompanying drawings.

[0046] In order to facilitate understanding of the embodiments of the present application, the following explanations are made.

[0047] First, in the textual explanations in the embodiments of the present application shown below or the terms in the accompanying drawings, “first”, “second”, and the like as well as various numerical numbers are only for differentiation for convenience of description, and are not intended to limit the scope of the embodiments of the present application. For example, the first imaging light and the second imaging light are used to differentiate different imaging lights.

[0048] Second, the term “comprise” and any variations thereof in the embodiments of the present application shown below are intended to cover the non-exclusive inclusion, for example, a system, a product or a device comprising a series of units does not have to be limited to only those clearly listed units, but can include other units that are not clearly listed or inherent to these products or devices.

[0049] Third, in the embodiments of the present application, the words such as "exemplarily" or "for example" are used to represent examples, illustrations or descriptions, and the embodiments or design schemes described as "exemplarily" or "for example" should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. The words such as "exemplarily" or "for example" are intended to present relevant concepts in a specific manner and facilitate understanding.

[0050] Fourth, in the embodiments of the present application, the imaging light refers to light carrying an image (or image information) and used for generating an image, which can also be referred to as image light and the like. The light beam refers to light not carrying image information and only used for illumination.

[0051] Fifth, in the drawings of the present application, the thickness, size and shape of each optical element have been slightly exaggerated for the purpose of illustration. Specifically, the shapes of the optical elements shown in the drawings are shown by way of example, and the drawings are drawn only as examples and not strictly according to scale.

[0052] Sixth, unless otherwise defined, all the terms (including technical terms and scientific terms) used in the present application have the same meaning as commonly understood by those skilled in the art to which the present application belongs.

[0053] It can be understood that the embodiments described in the present application are only a part of the embodiments of the present application, not all the embodiments. Those skilled in the art can know that, with the development of technology and the appearance of new scenes, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

[0054] Automobiles are developing and innovating in the tide of electrification, networking, intelligence, sharing and the like. FIG. 1 is a functional schematic diagram of a vehicle 100 provided in an embodiment of the present application. The vehicle 100 can include various subsystems, such as an infotainment system 110, a perception system 120, a decision control system 130, a drive system 140 and a computing platform 150. Alternatively, the vehicle 100 can include more or fewer subsystems, and each subsystem can include multiple components. In addition, each subsystem and component of the vehicle 100 can be interconnected by wired or wireless means.

[0055] In some embodiments, the infotainment system 110 can include a communication system 111, an entertainment system 112 and a navigation system 113.

[0056] Communication system 111 may include a wireless communication system that can communicate wirelessly with one or more devices directly or via a communication network. For example, the wireless communication system may use third-generation (3G) cellular communication technologies, such as code division multiple access (CDMA), or fourth-generation (4G) cellular communication technologies, such as long-term evolution (LTE) technologies. Alternatively, it may use fifth-generation (5G) cellular communication technologies, such as new radio (NR) technologies. The wireless communication system may utilize WiFi or a wireless local area network (WLAN) to communicate. In some embodiments, the wireless communication system may utilize an infrared link, Bluetooth, or ZigBee to communicate directly with devices. Other wireless protocols, such as various vehicle communication systems, may also be used. For example, the wireless communication system may include one or more dedicated short-range communications (DSRC) devices that may enable public and / or private data communication between vehicles and / or roadside stations.

[0057] The entertainment system 112 may include a central control screen, microphone, and speakers. Users can listen to the radio and play music within the vehicle using the entertainment system; or connect their mobile phones to the vehicle and project their screens onto the central control screen, which may be touch-sensitive, allowing users to operate it via touch. In some cases, the microphone can capture the user's voice signal, and analysis of this signal can enable the user to control certain aspects of the vehicle 100, such as adjusting the interior temperature. In other cases, music can be played to the user through the speakers.

[0058] The navigation system 113 may include map services provided by a map provider to provide navigation for the vehicle 100. The navigation system 113 may be used in conjunction with the vehicle's global positioning system 121 and inertial measurement unit 122. The map services provided by the map provider may be two-dimensional maps or high-precision maps.

[0059] The perception system 120 may include several sensors for sensing information about the environment surrounding the vehicle 100. For example, the perception system 120 may include a Global Positioning System 121 (which may be a Global Position Satellite (GPS) system, a BeiDou system, or another positioning system), an inertial measurement unit (IMU) 122, a lidar 123, a millimeter-wave radar 124, an ultrasonic radar 125, and a camera device 126. The perception system 120 may also include sensors for the internal systems of the monitored vehicle 100 (e.g., an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, speed, etc.). This detection and identification is a critical function for the safe operation of the vehicle 100.

[0060] The positioning system 121 can be used to estimate the geographical location of the vehicle 100. The inertial measurement unit 122 is used to sense changes in the position and orientation of the vehicle 100 based on inertial acceleration. In some embodiments, the inertial measurement unit 122 may be a combination of an accelerometer and a gyroscope. The lidar 123 can use lasers to sense objects in the environment in which the vehicle 100 is located. In some embodiments, the lidar 123 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components. The millimeter-wave radar 124 can use radio signals to sense objects in the surrounding environment of the vehicle 100. In some embodiments, in addition to sensing objects, the radar 126 can also be used to sense the speed and / or direction of travel of objects. The ultrasonic radar 125 can use ultrasonic signals to sense objects around the vehicle 100. The camera device 126 can be used to capture image information of the surrounding environment of the vehicle 100. The camera device 126 may include a monocular camera, a binocular camera, a structured light camera, and a panoramic camera, etc., and the image information acquired by the camera device 126 may include still images or video stream information.

[0061] The decision control system 130 includes a computing system 131 that analyzes and makes decisions based on information acquired by the perception system 120. The decision control system 130 also includes a vehicle controller 132 that controls the power system of the vehicle 100, as well as a steering system 133, an accelerator pedal 134 (including the accelerator pedal of an electric vehicle or the accelerator of a fuel vehicle, which is an exemplary term) and a braking system 135 for controlling the vehicle 100.

[0062] The computing system 131 is operable to process and analyze various information acquired by the perception system 120 to identify targets, objects, and / or features in the environment surrounding the vehicle 100. The targets may include pedestrians or animals, and the objects and / or features may include traffic signals, road boundaries, and obstacles. The computing system 131 may use object recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other techniques. In some embodiments, the computing system 131 may be used to map the environment, track objects, estimate object speeds, etc. The computing system 131 can analyze the acquired information and derive a control strategy for the vehicle.

[0063] The vehicle controller 132 can be used to coordinate the control of the vehicle's power battery and drive 141 to improve the power performance of the vehicle 100.

[0064] The steering system 133 is operable to adjust the forward direction of the vehicle 100. For example, in one embodiment, it may be a steering wheel system. The accelerator pedal 134 is used to control the operating speed of the drive 141 and thus the speed of the vehicle 100.

[0065] Braking system 135 is used to control the deceleration of vehicle 100. Braking system 135 may use friction to slow down wheel 144. In some embodiments, braking system 135 may convert the kinetic energy of wheel 144 into electric current. Braking system 135 may also take other forms to slow down the rotational speed of wheel 144 to control the speed of vehicle 100.

[0066] The drive system 140 may include components that provide powered motion to the vehicle 100. In one embodiment, the drive system 140 may include a drive unit 141, an energy source 142, a transmission system 143, and wheels 144. The drive unit 141 may be an internal combustion engine, an electric motor, an air compressor engine, or other types of engine combinations, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air compressor engine. The drive unit 141 converts the energy source 142 into mechanical energy.

[0067] Examples of energy sources 142 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. Energy source 142 may also provide energy to other systems of vehicle 100.

[0068] The transmission 143 can transmit mechanical power from the drive 141 to the wheels 144. The transmission 143 may include a gearbox, a differential, and a drive shaft. In one embodiment, the transmission 143 may also include other components, such as a clutch. The drive shaft may include one or more axles that can be coupled to one or more wheels 121.

[0069] Some or all of the functions of vehicle 100 are controlled by computing platform 150. Computing platform 150 may include at least one processor 151, which can execute instructions 153 stored in a non-transitory computer-readable medium such as memory 152. In some embodiments, computing platform 150 may also be multiple computing devices that control individual components or subsystems of vehicle 100 in a distributed manner.

[0070] Processor 151 can be any conventional processor, such as a central processing unit (CPU). Alternatively, processor 151 may also include graphics processing units (GPUs), field-programmable gate arrays (FPGAs), systems-on-chips (SoCs), application-specific integrated circuits (ASICs), or combinations thereof. Although Figure 1 functionally illustrates a processor, memory, and other elements of computer 110 in the same block, those skilled in the art will understand that the processor, computer, or memory may actually include multiple processors, computers, or memories that may or may not be stored in the same physical housing. For example, memory may be a hard disk drive or other storage media located in a housing different from that of computer 110. Therefore, references to processors or computers will be understood to include references to a collection of processors or computers or memories that may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as steering components and deceleration components, may each have their own processor that performs only calculations related to the component's specific function.

[0071] In the various aspects described herein, the processor may be located remotely from the vehicle and communicate wirelessly with the vehicle. In other aspects, some of the processes described herein are executed on a processor located within the vehicle, while others are executed by a remote processor, including taking the necessary steps to perform a single operation.

[0072] In some embodiments, memory 152 may contain instructions 153 (e.g., program logic) that can be executed by processor 151 to perform various functions of vehicle 100. Memory 152 may also contain additional instructions, including instructions for sending data to, receiving data from, interacting with, and / or controlling one or more of the infotainment system 110, perception system 120, decision control system 130, and drive system 140.

[0073] In addition to instruction 153, memory 152 may also store data such as road maps, route information, vehicle position, direction, speed, and other such vehicle data, as well as other information. This information can be used by vehicle 100 and computing platform 150 during operation of vehicle 100 in autonomous, semi-autonomous, and / or manual modes.

[0074] The computing platform 150 can control the functions of the vehicle 100 based on inputs received from various subsystems, such as the drive system 140, the perception system 120, and the decision control system 130. For example, the computing platform 150 can utilize inputs from the decision control system 130 to control the steering system 133 to avoid obstacles detected by the perception system 120. In some embodiments, the computing platform 150 is operable to provide control over many aspects of the vehicle 100 and its subsystems.

[0075] Alternatively, one or more of these components may be installed separately from or associated with vehicle 100. For example, memory 152 may exist partially or completely separately from vehicle 100. The components may be communicatively coupled together in a wired and / or wireless manner.

[0076] Optionally, the above components are just an example. In actual applications, the components in the above modules may be added or deleted according to actual needs. Figure 1 should not be construed as a limitation on the embodiments of this application.

[0077] Optionally, vehicle 100 can be configured to fully or partially autonomous driving mode. For example, vehicle 100 can acquire environmental information about its surroundings through perception system 120, and obtain an autonomous driving strategy based on the analysis of the surrounding environmental information to achieve fully autonomous driving, or present the analysis results to the user to achieve partial autonomous driving.

[0078] Autonomous vehicles traveling on roads, such as vehicle 100 above, can identify objects in their surrounding environment to determine adjustments to their current speed. These objects can be other vehicles, traffic control equipment, or other types of objects. In some examples, each identified object can be considered independently, and based on the object's individual characteristics, such as its current speed, acceleration, and distance from the vehicle, the speed adjustment to be made by the autonomous vehicle can be determined.

[0079] Optionally, vehicle 100 or its associated perception and computing devices (e.g., computing system 131, computing platform 150) can predict the behavior of the identified object based on the characteristics of the identified object and the state of the surrounding environment (e.g., traffic, rain, ice on the road, etc.). Optionally, each identified object depends on the behavior of each other, so all identified objects can be considered together to predict the behavior of a single identified object. Vehicle 100 can adjust its speed based on the predicted behavior of the identified objects. In other words, the autonomous vehicle can determine which state the vehicle needs to adjust to (e.g., accelerate, decelerate, or stop) based on the predicted behavior of the objects. In this process, other factors can also be considered in determining the speed of vehicle 100, such as the lateral position of vehicle 100 in the road, the curvature of the road, the proximity of static and dynamic objects, etc.

[0080] In addition to providing instructions to adjust the speed of the autonomous vehicle, the computing device can also provide instructions to modify the steering angle of the vehicle 100 so that the autonomous vehicle follows a given trajectory and / or maintains a safe lateral and longitudinal distance from objects near the autonomous vehicle (e.g., cars in adjacent lanes on the road).

[0081] The aforementioned vehicle 100 can be a car, truck, bus, ship, airplane, helicopter, recreational vehicle, amusement park vehicle, construction equipment, tram, train, etc., and this application embodiment does not impose any special limitations.

[0082] It is understood that the display device, method for controlling virtual images, and cockpit system provided in this application embodiment can be applied to the vehicle shown in FIG1, and the vehicle 100 can be a vehicle including a cockpit as shown in FIG2 and / or FIG3 below. It should be noted that the display device provided in this application can be applied to both left-hand drive and right-hand drive vehicles. This application embodiment does not limit the type of vehicle.

[0083] Figure 2 is a schematic diagram illustrating an application scenario of an intelligent cockpit display system 200 applicable to an embodiment of this application. As shown in Figure 2, the intelligent cockpit display system 200 includes at least one display device 101 and at least one seat 102. Figure 2 illustrates an example with one display device and one seat, where the display device 101 is mounted on the back of the seat 102. The display device 101 can generate a magnified virtual image at a relatively distant image plane through the input of an external video signal (also referred to as a signal source), providing viewers with a large-screen, long-distance visual experience and meeting the needs of users in various application scenarios such as leisure and entertainment, and business office work.

[0084] It should be noted that the display device 101 can also be installed on the headrest of the seat 102. Alternatively, when the intelligent cockpit display system also includes an instrument panel, the display device 101 can also be installed on the instrument panel, as shown in the cockpit system 300 of Figure 3. When the display device 101 is installed on the instrument panel 202, the display device 101 can also be designed to be stored in the instrument panel 202. In this case, the shell of the display device 101 can be designed and styled with reference to the shape and color of the instrument panel to achieve perfect unity with the appearance of the instrument panel 202, thus achieving the goal of aesthetics for the cockpit system 300. To further enhance the intelligence of the cockpit system, the system 300 can also use detectors to detect information such as the user's posture and position, and realize the automatic display of the display device 101 based on the user's posture and position. For example, when it is detected that the user is in front of the instrument panel 202 or the user's eyes are looking at the display device 101, the display device 101 can automatically rise or slide out from the instrument panel 202, and autonomously adjust to a suitable position and angle before displaying the image.

[0085] It should also be noted that, in this embodiment, the display device 101 may be installed on the back of the seat 102, the headrest, or the dashboard 202 before leaving the factory. Alternatively, it may be installed on the back of the seat 102, the headrest, or the dashboard 202 after leaving the factory by modifying the seat 102, headrest, or dashboard 202 respectively. This application does not impose any limitations on this.

[0086] It is understood that the intelligent cockpit display systems 200 and 300 shown in Figures 2 and 3 are merely examples. The intelligent cockpit systems applicable to the embodiments of this application may also include intelligent steering wheels, head-up displays (HUDs), etc. That is, the intelligent cockpit display systems applicable to the embodiments of this application are not limited to those shown in Figures 2 or 3, but may also be other systems including the intelligent cockpit display systems 200 or 300 shown in Figures 2 or 3, or other systems similar to those in Figures 2 or 3. This application does not impose any limitations. It should also be noted that Figures 2 and 3 are only applicable to vehicle-mounted application scenarios in the embodiments of this application. That is, the display device provided in this application can be applied to display devices in other display systems. In other words, the application of the display device provided in the embodiments of this application includes, but is not limited to, applications in vehicle-mounted display systems.

[0087] Currently, several interactive solutions exist for virtual image displays. For example, users can achieve voice-controlled interaction using technologies such as speech recognition, speech synthesis, and natural language processing; gesture interaction can be achieved by capturing user gestures using image detectors (e.g., cameras) and converting them into machine commands; eye-tracking interaction can be achieved by locating and analyzing pupils using eye-tracking technology and converting them into machine commands; and air-based interaction can be achieved using remote control devices. Voice-controlled and gesture-based interaction solutions require powerful central processing units (CPUs), leading to higher power consumption and cost for the display device. Eye-tracking interaction solutions rely on highly accurate eye-tracking algorithms; otherwise, misjudgments may occur, affecting the user experience. Furthermore, to capture and analyze the user's eye position, the display device is also equipped with an eye-following module, further increasing cost and power consumption. Although air-based touch control can be achieved in pointing and remote control interaction solutions, the remote control devices accompanying the display device are usually small and easily lost or damaged during use, rendering the display device unusable and thus reducing the user experience. To improve the interactive experience of virtual image display devices, increasing research is focusing on touch-based solutions. However, in existing touchscreen solutions, virtual image display devices can only display either real or virtual images independently. That is, in these touch solutions, when a touch operation is performed, the virtual image display device functions as a touch tablet and cannot achieve true human-computer interaction. In view of this, this application proposes a display device that reduces interaction costs and power consumption through touch interaction, allowing users to control the virtual image by touching the real image while the virtual image is displayed, thereby improving the user experience.

[0088] The display device provided in the embodiments of this application will be described in detail below.

[0089] Figure 4 is a schematic diagram of the structure of a first type of display device 400 provided in an embodiment of this application. The display device 400 can be applied to the vehicle 100 shown in Figure 1, wherein the vehicle 100 may include a cockpit virtual image display system as shown in Figure 2 and / or Figure 3. As shown in Figure 4, the display device 400 has an image generation unit 410, a window unit 420, and an image magnification unit 430 arranged sequentially along the transmission direction of the imaging light. The display device 400 can display virtual and real images simultaneously. Specifically, when the display device 400 displays virtual and real images, the image generation unit 410 emits a first imaging light to the window unit 420. The first imaging light is reflected by the window unit 420 to the image magnification unit 430, and then reflected again by the image magnification unit 430 to the window unit 420. The window unit 420 transmits the first imaging light to the user, so that the user can view the virtual image formed by the first imaging light through the first imaging light transmitted by the window unit 420. At the same time, a real image is displayed on the window unit 420, and the user can control the virtual image viewed by touching the real image, so that the user can interact with the display device 400 by touch.

[0090] In the display device 400 shown in Figure 4, the window unit 420 includes a transparent display touch module disposed on the side of the window unit 420 that is viewed by the user's eye, i.e., on the outer surface of the window unit 420 near the user. This module displays a real image and enables touch control of the image area. It is understood that the transparent display touch module generates a second image light based on the input image information. This second image light is used to generate the corresponding real image, which is then displayed on the window unit 420. In other words, in the display device 400 shown in Figure 4, the transparent display touch module in the window unit 420 is connected to an image processing unit, which inputs the image information of the real image to the transparent display touch module. In one possible implementation, the image processing unit may be part of the display device 400, in which case the display device 400 includes the image processing unit; or, in another possible implementation, the image processing unit may be an external image processor. For example, when the display device of this application is applied to an in-vehicle display, it may be another image processor in the vehicle. That is, the image processor is not only used to provide image information of the real image to the display device 400, but also has other functions. In this case, the display device 400 does not include the image processing unit.

[0091] It should be noted that this application does not limit the transparent display touch module included in the window unit 420. For example, it can be a touch screen based on a transparent organic light-emitting diode (OLED), a touch screen based on a transparent liquid crystal display (LCD), or a touch screen based on a novel transparent display technology developed in the future. All of these are within the protection scope of this application. For example, when the transparent display touch module included in the window unit 420 is a touch screen based on a transparent OLED, the transparent OLED touch screen displays a real image based on a second imaging light. In this case, the image processing unit inputs the image information of the real image to the transparent OLED touch screen, and the transparent OLED touch screen drives the self-emissive pixels to light up according to the image information, that is, generates the second imaging light, thereby displaying the corresponding real image on the transparent OLED touch screen.

[0092] In some embodiments, the entire outer surface of the window unit 420, i.e., the surface that the user can touch, is a transparent display touch module. In this case, the size of the transparent display touch module is the same as the size of the window unit 420. For example, in the schematic diagram of the interactive area covered by the transparent display touch module shown in FIG5, FIG5(a) is a schematic diagram showing the entire outer surface of the window unit used for interaction. It can be understood that when the window unit 420 is completely covered by the transparent display touch module, the display device 400 shown in FIG4 can achieve a display effect of a real image superimposed on a virtual image.

[0093] In other embodiments, only specific areas on the outer surface of the window unit 420 are used for user touch operations. For example, Figure 5(b) is a schematic diagram showing a portion of the outer surface of the window unit used for interaction. Specifically, if this portion of the transparent display touch module used for interaction does not affect viewing the virtual image at a distance, it can remain constantly on, meaning this portion of the touch module remains always lit, while the other parts of the transparent display touch module remain transparent. In this case, a real image is always displayed on the area used for interaction.

[0094] It should be noted that this application does not limit the real image displayed by the display device 400. That is, the content displayed on the transparent display touch module can include, but is not limited to, various application (APP) playback icons, real images synchronized with the virtual image, icons and buttons for controlling the virtual image, etc. It is understood that when the display device 400 displays both virtual and real images, the user can view the virtual image through the first imaging light transmitted through the transparent display touch module. Simultaneously, the user can perform touch operations on the transparent display touch module as needed. For example, switching APPs to switch the content displayed in the virtual image; or when the virtual image is displayed as a video animation or game interface, the user can adjust the video's sound, brightness, color, etc., through icons and buttons, or interact with the game through icons and buttons; or when the virtual image is displayed as a real image synchronized with the virtual image, such as an office document or picture, the user can modify the document or picture on the real image, which is then presented through the magnified virtual image.

[0095] It is understood that in this application, whether the entire outer surface of the window unit or a portion thereof is used for user touch operations, the touch-enabled portion is a transparent display touch module. This transparent display touch module can sense whether the user is touching the module's surface and determine the contact position based on a conductor (e.g., a human finger). This allows the transparent display touch module, which displays a real image, to recognize user actions such as clicking, long-pressing, or swiping based on the user's contact position, thereby realizing the corresponding function. For example, when the displayed real image is various app play icons, the user can select the desired application by clicking; or when the displayed real image is a real image synchronized with a virtual image, such as an image, the user can browse images by swiping; or when the displayed real image is a real image video or music synchronized with a virtual image, the user can adjust the volume, brightness, etc., by long-pressing. It should be noted that the solution in this application is not limited to the user's operation and the content displayed on the transparent display touch module of the real image. It can be the real image type and touch operation listed above, or other real images and other touch operations. It can be customized according to the user's needs and usage habits, or designed and configured according to the vehicle type, the usage scenario of the display device, etc.

[0096] It is also understood that the area covered by the transparent display touch module shown in Figure 5 above is only for illustrative purposes. That is, when the transparent display touch module only covers a part of the surface of the window unit 420, this application does not limit the position of the part of the transparent display touch module. It can be distributed on one side of the outer surface of the window unit 420 as shown in Figure 5. In some other embodiments, the transparent display touch module can also be distributed at the bottom or top of the outer surface of the window unit 420, etc.

[0097] It should be noted that the conductor used for touch control is not limited to the user's finger, a pen with touch functionality, or gloves with touch functionality. In some embodiments, the method by which the transparent display touch module senses the conductor contacting the module can be direct sensing, i.e., the conductor directly contacts the transparent display touch module, thus sensing is performed using the transparent display touch module. For example, the transparent display touch module can be designed with a sensing unit (also called a touch unit), such as a pressure sensor or a capacitive sensor, to sense whether the conductor is in contact with the transparent display touch module. It is understood that when the transparent display touch module includes a sensor, the type of sensor is related to the touch scheme adopted by the transparent display touch module, and this application does not limit this. In other embodiments, the transparent display touch module can sense indirectly, i.e., the conductor may not need to contact the transparent display touch module. For example, a camera module can be used to capture images of the conductor's position to sense the conductor. For example, the camera module can be a fixed-focus shooting module. Once the touch conductor is clearly captured, it can sense the touch conductor. Alternatively, the camera module can calculate the distance between the touch conductor and the transparent display touch module based on the captured image. When the distance between the touch conductor and the transparent display touch module is less than or equal to a threshold, it can sense the touch conductor.

[0098] To achieve energy saving, in this application, the transparent display touch module can be set as a non-constantly lit module, requiring the touch module to be woken up. It is understood that the transparent display touch module can be woken up after sensing (directly or indirectly) the touch conductor. For example, when using finger touch, when the user's finger touches or approaches the touch module, the non-constantly lit portion of the touch module will be woken up, entering interactive mode and allowing the user to perform corresponding touch operations. Correspondingly, if the user does not perform any touch operation within a preset time (which could be a factory-preset time for the display device or a time set by the user after factory installation, etc., without limitation), that portion of the touch module automatically exits interactive mode, and at this time, the physical image is no longer displayed on that portion of the touch module.

[0099] It is understandable that the display device 400 can also display real and virtual images separately. When the display device 400 displays a virtual image, the image generation unit 410 emits a first imaging light to the viewing window unit 420. The viewing window unit 420 reflects the first imaging light from the image generation unit 420 to the image magnification unit 430 and transmits the reflected first imaging light from the image magnification unit 430 to the human eye. The viewing window unit 420 is also used by the human eye to view the virtual image formed by the first imaging light through the viewing window unit 420. The image magnification unit 430 reflects the imaging light from the viewing window unit 420 back to the viewing window unit 420. When the display device 400 displays a real image, the image generation unit 410 is turned off, and the viewing window unit 420 is used to generate the real image and for the user to interact with the display device 400 via touch. It should be noted that when the display device 400 displays a real image, in order not to interfere with the displayed real image and to improve the user interaction experience, the virtual image can be turned off.

[0100] To enhance user experience and improve interaction, optionally, when a user touches the real image displayed on the window unit 420, the real image on the window unit can change accordingly after being touched, allowing the user to determine whether the touched real image is correct based on the change in the real image. The change in the touched real image may include, but is not limited to, at least one of the following: the brightness of the real image increases, that is, the first brightness before being touched changes to a second brightness with a larger brightness value after being touched; the size of the real image increases, that is, the first size before being touched changes to a second size (representing size, image area, etc.) with a larger size; or, the real image displays a bright edge, that is, the real image without a bright edge before being touched changes to a real image with a bright edge after being touched, etc.

[0101] It should be noted that this application does not limit the structure of the window unit 420. It can be understood that when the window unit 420 included in the display device 400 can split the imaging light, generate and display a real image, and be used for user touch operation, it is within the protection scope of this application.

[0102] In one possible implementation, Figure 6 is a schematic diagram of the structure of a first window unit 420 provided in an embodiment of this application. As shown in Figure 6, the window unit 420 includes a substrate 610, a beam-splitting film system 620, and a transparent display touch module 630. The substrate 610 includes a first surface 611 and a second surface 612 that are relatively distributed. The first surface 611 can be understood as the inner surface of the substrate 610, i.e., located inside the display device 400, that is, the surface of the substrate 610 furthest from the user; the second surface 612 can be understood as the outer surface of the substrate 610, i.e., located outside the display device 400, that is, the surface of the substrate 610 closest to the user. The beam-splitting film system 620 is disposed outside the first surface 611 of the substrate 610, and the transparent display touch module 630 is disposed outside the second surface 612 of the substrate 610. Specifically, the beam splitter 620 is used to reflect the first imaging light emitted from the image generation unit 410 to the image magnification unit 430 and to transmit the first imaging light reflected from the image magnification unit 430 to the substrate 610. This first imaging light passes sequentially through the first surface 611 and the second surface 612 of the substrate 610 before entering the human eye, allowing the human eye to view the virtual image (which can be a picture, document, video, etc.) displayed by the display device 400. Simultaneously, the transparent display touch module 630 displays an image that can be touched by the user, including but not limited to the real image identical to the virtual image and touch icons, allowing the user to control the virtual image by touching the real image or touch icons on the transparent display touch module 630, thereby interacting with the display device 400.

[0103] In another possible implementation, Figure 7 is a schematic diagram of the structure of a second type of window unit 420 provided in an embodiment of this application. As shown in Figure 7, the window unit 420 includes a substrate 710, a beam-splitting film system 720, a transparent display touch module 730, a polarizing film layer 740, and an anti-reflection film 750. The substrate 710 includes a first surface 711 and a second surface 712 that are relatively distributed. The first surface 711 and the second surface 712 are respectively the inner and outer surfaces of the substrate 710. That is, the first surface 711 is located inside the display device 400, i.e., the surface of the substrate 710 away from the user; the second surface 712 is located outside the display device 400, i.e., the surface of the substrate 710 close to the user. The beam-splitting film system 720 is disposed outside the first surface 711 of the substrate 710, the polarizing film layer 740 is disposed outside the second surface 712 of the substrate 710, the transparent display touch module 730 is disposed outside the polarizing film layer 740, and the anti-reflection film 750 is disposed outside the transparent display touch module 730. Specifically, the beam splitter 720 reflects the first imaging light emitted from the image generation unit 410 to the image magnification unit 430 and transmits the first imaging light reflected from the image magnification unit 430 to the substrate 710. This first imaging light sequentially passes through the first surface 711, the second surface 712, the polarizing film layer 740, the transparent display touch module 730, and the anti-reflection film 750 of the substrate 710 before entering the human eye, allowing the human eye to view the virtual image (which can be a picture, document, video, etc.) displayed by the display device 400. Simultaneously, the transparent display touch module 730 displays an image that can be touched by the user, including but not limited to a real image identical to the virtual image, touch icons, etc., allowing the user to control the virtual image by touching the real image or touch icons, thereby achieving interaction with the display device 400. It is understood that in Figure 7, when the user performs a touch operation, the surface the user operates on is actually the surface of the anti-reflection film 750, while in the window unit 420 shown in Figure 6, the surface the user operates on is the surface of the transparent display touch module 630. It is also understandable that the anti-reflection film 750 on the window unit 420 can reduce stray light entering the display device 400, while the polarizing film layer 740 has an absorption effect on stray light entering from outside the display device 400. That is, when the window unit 420 is provided with an anti-reflection film and a polarizing film layer, it can reduce stray light entering the display device 400, thereby achieving the effect of improving display quality.

[0104] It should be noted that when the window unit 420 provided in this application includes a beam-splitting film system, the beam-splitting film system is composed of at least one dielectric film. That is, the beam-splitting film system 620 in FIG. 6 and the beam-splitting film system 720 in FIG. 7, as well as the beam-splitting film systems included in other window units 420 not listed in the embodiments of this application, include at least one dielectric film for realizing the reflection and transmission of imaging light. The material of the at least one dielectric film can be silicon oxide, such as SiO2; magnesium fluoride, such as MgF2; niobium oxide, such as Nb2O5; titanium oxide, such as TiO2; indium tin oxide (ITO); zinc sulfide (ZnS); oxides of chromium; oxides of nickel; oxides of aluminum, etc., which are not limited in this application. At the same time, when the beam-splitting film system 520 includes multiple dielectric films, whether the materials of the multiple dielectric films are completely the same is not limited in this application. That is, the materials of the multiple dielectric films of the beam-splitting film system included in the window unit 420 provided in this application can be completely the same, completely different, or partially the same. For example, for the spectrophotometer system 620 shown in FIG6, if the spectrophotometer system 620 includes three dielectric films, the first dielectric film, the second dielectric film, and the third dielectric film can be completely identical; or, the materials of the first dielectric film, the second dielectric film, and the third dielectric film are completely different; or, two of the first dielectric film, the second dielectric film, and the third dielectric film have the same material, for example, the material of the first dielectric film is the same as the material of the third dielectric film, but different from the material of the second dielectric film, etc., which will not be elaborated here.

[0105] It is understood that in the structures of the window units shown in Figures 6 and 7, the transparent display touch module can either completely cover the surface of the window unit 420, meaning the entire surface of the window unit 420 can be used for user touch operations; or the transparent display touch module can partially cover the surface of the window unit, meaning only a specific area on the surface of the window unit 420 is used for user touch interaction. For example, Figure 8 is a schematic diagram of user touch interaction using the display device 400 provided in this application embodiment under two different scenarios of transparent display touch module coverage.

[0106] Figure 9 is a schematic diagram of the structure of a second type of display device 900 provided in an embodiment of this application. The display device 900 can be applied to the vehicle 100 shown in Figure 1, wherein the vehicle 100 may include a cockpit virtual image display system as shown in Figures 2 and / or 3. As shown in Figure 9, the display device 900 has a first image generation unit 910, a window unit 920, and an image magnification unit 930 arranged sequentially along the transmission direction of the first imaging light. The display device 900 has a second image generation unit 940 and a window unit 920 arranged sequentially along the transmission direction of the second imaging light. The display device 900 can simultaneously display virtual and real images. Specifically, when the display device 400 displays a virtual image and a real image, the first image generation unit 910 emits a first imaging light into the viewing window unit 920. This first imaging light is reflected by the viewing window unit 920 to the image magnification unit 930, and then reflected again by the image magnification unit 930 to the viewing window unit 920. The viewing window unit 920 transmits this first imaging light to the user, allowing the user to view the virtual image formed by the first imaging light transmitted through the viewing window unit 920. Simultaneously, the second image generation unit 940 projects a second imaging light into the viewing window unit 920. This second imaging light generates a real image on the viewing window unit 920, allowing the user to control the virtual image viewed by touching the real image, thus enabling the user to interact with the display device 900 via touch.

[0107] In the display device 900 shown in Figure 9, the window unit 920 includes a projection display touch module (specifically, see the structure of the window unit 920 in Figure 10 below). This projection display touch module is disposed on the side of the window unit that is viewed by the user's eye, i.e., on the outer surface of the window unit close to the user. It should be noted that this application does not limit the projection display touch module included in the window unit 920; for example, it can be an LCD-based projection display touch module, etc., all of which are within the scope of protection of this application. It is understood that in the description of the embodiments of this application, the name of the projection display touch module is merely exemplary, and other names may also be used, such as projection display touch module, etc., which this application does not limit.

[0108] In the display device 900 shown in Figure 9, the projection display touch module covers part of the outer surface of the window unit 920, that is, the area of ​​the projection display touch module is smaller than the area of ​​the window unit 920. However, this application does not limit the position of the projection display touch module. For the sake of simplicity, the description of this part can be referred to the relevant description in Figure 5(b) above, and will not be repeated here.

[0109] Similar to the display device 400 in Figure 4, in the solution shown in Figure 9, the projection display touch module for touch control can sense whether the user is touching the surface of the module screen and determine the contact position based on a conductor (e.g., a human finger). This allows the projection display touch module to recognize user actions such as clicking, long-pressing, or swiping based on the user's contact position, and realize the corresponding functions. For example, when the displayed image is various APP playback icons, the user can select the desired application by clicking; or when the displayed image is a real-image screen synchronized with the virtual image, such as an image, the user can browse the image by swiping; or when the displayed image is a real-image video or music synchronized with the virtual image, the user can adjust the volume, brightness, etc. by long-pressing. It is understood that this solution does not limit the user's operation or the displayed image, and can be customized according to the user's needs and usage habits, or designed and configured according to the vehicle type, the usage scenario of the display device, etc.

[0110] Furthermore, in the scheme shown in Figure 9, the touch conductor is not limited. At the same time, the projection display touch module can directly or indirectly sense the conductor. The wake-up and exit of the projection display touch module can also refer to the description of the display device 400 in Figure 4 above, which will not be repeated here.

[0111] It should be noted that this application does not limit the structure of the window unit 920. It can be understood that when the window unit included in the display device can split the imaging light, can be used to display a real image, and can be touched by the user, it is within the protection scope of this application.

[0112] For example, Figure 10 illustrates two possible structures of the window unit 920. As shown in Figure 10, in Figure 10(a), the window unit 920 includes a substrate 1010, a beam-splitting film system 1020, and a projection display touch module 1030. Compared to the window unit 420 shown in Figure 6, in Figure 10(a), the window unit 920 includes a projection display touch module 1030, rather than a transparent display touch module. Specifically, the beam-splitting film 1020 is used to reflect the first imaging light emitted from the first image generation unit 910 to the image magnification unit 930, and to transmit the first imaging light reflected from the image magnification unit 930 to the substrate 1010. The first imaging light passes through the beam-splitting film 1020 and the substrate 1010 in sequence and then enters the human eye, allowing the human eye to view the virtual image (which may be a picture, document, video, etc.) displayed by the display device 900. Simultaneously, the second imaging light emitted from the second image generation unit 940 passes through the beam splitter 1020 and the substrate 1010 in sequence, generating an image that can be touched by the user on the projection display touch module 1030. This includes, but is not limited to, the real image that is the same as the virtual image, touch icons, etc., so that the user can control the virtual image by touching the real image or touch icons on the projection display touch module 1030, thereby interacting with the display device 900.

[0113] In Figure 10(b), the window unit 920 includes a substrate 1010, a beam-splitting film system 1020, a projection display touch module 1030, a polarizing film layer 1040, and an anti-reflection film 1050. Compared with the window unit 420 shown in Figure 7, in Figure 10(b), the window unit 920 replaces the transparent display touch module with the projection display touch module 1030. Specifically, the beam-splitting film 1020 is used to reflect the first imaging light emitted from the first image generation unit 910 to the image magnification unit 930, and to transmit the first imaging light reflected from the image magnification unit 930 to the substrate 1010. The first imaging light passes through the substrate 1010, the polarizing film layer 1040, the projection display touch module 1030, and the anti-reflection film 1050 in sequence before entering the human eye, allowing the human eye to view the virtual image displayed by the display device 900. Simultaneously, the second imaging light emitted from the second image generation unit 940 passes through the beam splitter 1020, the substrate 1010, and the polarization film layer 1040 in sequence, generating an image that can be touched by the user on the projection display touch module 1030. This includes, but is not limited to, the real image that is the same as the virtual image, touch icons, etc., so that the user can control the virtual image by touching the real image or touch icons on the projection display touch module 1030, thereby interacting with the display device 900.

[0114] It should be noted that the touch module shown in Figure 6 or Figure 7 above is a transparent display touch module, while the projection display touch module included in the window unit in the display device 900 is not necessarily transparent when displaying a real image. Furthermore, for scenarios where the display device 900 interacts with the user via touch, please refer to the relevant explanation in Figure 8 above.

[0115] It should be noted that in some other embodiments, when the real image displayed on the display device is generated by projection from an image generation unit, the image generation unit used for projection to generate the real image may not be located inside the display device. In other words, for a display device that uses projection for touch interaction, the image generation unit used for projection to generate the real image can be located inside or outside the display device. When located outside the display device, the size of the display device can be reduced. For example, for display device 900, the second image generation unit 940 may also be located outside the display device.

[0116] It is understandable that the projection display touch module in Figure 9 can also be a non-always-on module. In this case, the user can perform touch operations on the touch module by waking it up. For details, please refer to the explanation in Figure 4, which will not be repeated here.

[0117] Understandably, the display device 900 can also display real and virtual images separately. When the display device 900 displays a virtual image, the first image generation unit 910 emits a first imaging light into the viewing window unit 920. The viewing window unit 920 reflects the first imaging light from the first image generation unit 920 to the image magnification unit 930 and transmits the reflected first imaging light from the image magnification unit 930 to the human eye. The viewing window unit 920 is also used by the human eye to view the virtual image formed by the first imaging light through the viewing window unit 920. The image magnification unit 930 reflects the first imaging light from the viewing window unit 920 back to the viewing window unit 920. When the display device 900 displays a real image, the first image generation unit 910 is turned off, and the second image generation unit 940 projects a second imaging light into the viewing window unit 920. This second imaging light is used to generate a real image on the viewing window unit 920. The viewing window unit 920 is used to display the real image generated by the second imaging light and for the user to interact with the display device 900 via touch.

[0118] Figure 11 is a schematic diagram of the structure of a third type of display device 1100 provided in an embodiment of this application. The display device 1100 can be applied to the vehicle 100 shown in Figure 1, wherein the vehicle 100 may include a cockpit virtual image display system as shown in Figure 2 and / or Figure 3. As shown in Figure 11, the display device 1100 has an image generation unit 1110, a window unit 1120, an image magnification unit 1130, and a light source 1140 arranged sequentially along the transmission direction of the imaging light. The display device 1100 can display virtual images and real images simultaneously. Specifically, when the display device displays virtual images and real images, the image generation unit 1110 emits a first imaging light to the window unit 1120. The first imaging light is reflected by the window unit 1120 to the image magnification unit 1130, and then reflected again by the image magnification unit 1130 to the window unit 1120. The window unit 1120 transmits the first imaging light to the user, so that the user can view the virtual image formed by the first imaging light through the first imaging light transmitted by the window unit 1120. At the same time, the light source 1140 projects an illumination beam onto the window unit 1120, which illuminates the real image on the window unit 1120, allowing the user to interact with the display device 1100 via touch.

[0119] It is understood that the display device 1100 can also display real and virtual images separately. Specifically, when the display device 1100 displays a virtual image, the image generation unit 1110 emits a first imaging light to the viewing window unit 1120. The viewing window unit 1120 reflects the first imaging light from the image generation unit 1120 to the image magnification unit 1130 and transmits the reflected first imaging light from the image magnification unit 1130 to the human eye. The viewing window unit 1120 is also used by the human eye to view the virtual image formed by the first imaging light through the viewing window unit 1120. The image magnification unit 1130 reflects the first imaging light from the viewing window unit 1120 back to the viewing window unit 1120. When the display device 1100 displays a virtual image, the light source 1140 projects a light beam to the viewing window unit 1120, which illuminates the image on the viewing window unit 1120. The viewing window unit 1120 displays a real image based on the light beam emitted from the light source 1140 and is used by the user to interact with the display device 1100 via touch.

[0120] In the display device 1100 shown in Figure 11, the window unit 1120 includes an illumination display touch module (specifically, see Figure 12). This illumination display touch module is disposed on the side of the window unit that is viewed by the human eye, i.e., on the outer surface of the window unit close to the user. It should be noted that this application does not limit the illumination display touch module included in the window unit 1120. For example, it can be an illumination display touch module based on film, etc., all of which are within the protection scope of this application.

[0121] In the display device 1100 shown in Figure 11, the illumination display touch module covers part of the outer surface of the window unit 1120, that is, the area of ​​the illumination display touch module is smaller than the area of ​​the window unit 1120. It is understood that the position of the illumination display touch module is not limited in this application and will not be described in detail.

[0122] It is understood that in the display devices shown in Figures 9 and 11, the display touch module covers part of the outer surface of the window unit. Compared with the illumination display touch module in the display device 1100, the projection display touch module included in the display device 900 in Figure 9 generates a real image whose position changes according to the incident position of the second image light. That is, in the display device 900 shown in Figure 9, the position and size of the real image can be changed.

[0123] Similar to the display device 400 in Figure 4, in the scheme shown in Figure 11, the part used for touch control is an illuminated display touch module. This module can sense whether the user is touching the surface of the module screen and determine the contact position based on a conductor (e.g., a human finger). This allows the illuminated display touch module to recognize user actions such as clicking, long-pressing, or swiping based on the user's contact position, thus realizing the corresponding function. It should be noted that in the display device 1100 shown in Figure 11, since the real image is pre-generated on the window unit 1120 (e.g., a film pattern is formed by etching), the real image displayed in the display device 1100 is a fixed image. It is understood that this scheme does not limit the user's operation or the displayed real image; it can be customized according to the user's needs and usage habits, or designed and configured according to vehicle type, usage scenario, etc.

[0124] Furthermore, in the scheme shown in Figure 11, the touch conductor is not limited. At the same time, the illumination display touch module can sense the conductor directly or indirectly. The wake-up and exit of the illumination display touch module can also refer to the description of the display device 400 in Figure 4 above, which will not be repeated here.

[0125] It should be noted that this application does not limit the structure of the window unit 1120. It can be understood that any window unit included in the display device that can split the imaging light, can be used to display a real image, and can be touched by the user is within the protection scope of this application.

[0126] For example, Figure 12 illustrates two possible structures of the window unit 1120. As shown in Figure 12(a), the window unit 1120 includes a substrate 1210, a beam-splitting film system 1220, and an illumination display touch module 1230. Compared to the window unit 420 shown in Figure 6, the window unit 1120 in Figure 12(a) includes an illumination display touch module 1230, rather than a transparent display touch module. Specifically, the beam-splitting film 1220 is used to reflect the first imaging light emitted from the image generation unit 1110 to the image magnification unit 1130, and to transmit the first imaging light reflected from the image magnification unit 1130 to the substrate 1210. The first imaging light passes through the beam-splitting film 1220 and the substrate 1210 in sequence and then enters the human eye, allowing the human eye to view the virtual image (which may be a picture, document, video, etc.) displayed by the display device 1100. Simultaneously, the illumination beam emitted from the light source 1140 passes through the beam splitter 1220 and the substrate 1210 in sequence, and then illuminates the illumination display touch module 1230, causing the illumination display touch module 1230 to display an image that can be touched by the user, including but not limited to the real image that is the same as the virtual image, touch icons, etc., so that the user can control the virtual image by touching the real image or touch icons on the illumination display touch module 1230, thereby interacting with the display device 1100.

[0127] In Figure 12(b), the window unit 1120 includes a substrate 1210, a beam-splitting film system 1220, an illumination display touch module 1230, a polarizing film layer 1240, and an anti-reflection film 1250. Compared with the window unit 420 shown in Figure 7, in Figure 12(b), the window unit 1120 replaces the transparent display touch module with the illumination display touch module 1230. Specifically, the beam-splitting film 1220 is used to reflect the first imaging light emitted from the image generation unit 1110 to the image magnification unit 1130, and to transmit the first imaging light reflected from the image magnification unit 1130 to the substrate 1210. The first imaging light passes through the substrate 1210, the polarizing film layer 1240, the illumination display touch module 1230, and the anti-reflection film 1250 in sequence before entering the human eye, allowing the human eye to view the virtual image displayed by the display device 1100. Simultaneously, the illumination beam emitted from the light source 1140 passes through the beam splitter 1220, the substrate 1210, and the polarizing film layer 1240 in sequence, and then illuminates the illumination display touch module 1230, causing the illumination display touch module 1230 to display an image that can be touched by the user, including but not limited to the real image that is the same as the virtual image, touch icons, etc., so that the user can control the virtual image by touching the real image or touch icons on the illumination display touch module 1230, thereby interacting with the display device 1100.

[0128] It should be noted that the touch module shown in Figure 6 or Figure 7 above is a transparent display touch module, while the illumination display touch module included in the window unit in the display device 1100 is not transparent when displaying a real image. Furthermore, for the user touch interaction scenario used by the display device 1100, please refer to Figure 8(b) above.

[0129] It should be noted that in some other embodiments, when the real image displayed on the display device is generated by illumination from a light beam, the light source used to emit the light beam to illuminate the real image may not be located inside the display device. In other words, for a display device that uses light beam illumination for touch interaction, it needs to be equipped with an additional light source. This light source can be located inside or outside the display device. When located outside the display device, the size of the display device can be reduced. For example, for display device 1100, the light source 1140 may also be located outside the display device.

[0130] It is understood that the display device 1100 can also display real and virtual images separately. When the display device 1100 displays a virtual image, the image generation unit 1110 emits a first imaging light into the viewing window unit 1120. The viewing window unit 1120 reflects the first imaging light from the image generation unit 1120 to the image magnification unit 1130 and transmits the reflected first imaging light from the image magnification unit 1130 to the human eye. The viewing window unit 1120 is also used by the human eye to view the virtual image formed by the first imaging light through the viewing window unit 1120. The image magnification unit 1130 reflects the first imaging light from the viewing window unit 1120 back to the viewing window unit 1120. When the display device 1100 displays a real image, the image generation unit 1110 is turned off, and the light source 1140 projects a light beam into the viewing window unit 1120, which illuminates the image on the viewing window unit 1120. The window unit 1120 displays a real image based on the light beam emitted from the light source 1140 and is used for human-computer interaction between the user and the display device 1100 via touch.

[0131] It should be noted that Figures 4, 9, and 11 above are merely examples of three display devices provided in the embodiments of this application, but the structure of the display device provided in the embodiments of this application is not limited to the structures shown in Figures 4, 9, and 11. In some other embodiments, the image generation unit or the image magnification unit in the display device provided in this application may be arranged in other positions, that is, the relative positional relationship between the image generation unit, the window unit, and the image magnification unit is not limited in this application. In addition, the display device provided in the embodiments of this application may also include other units, such as a rotation unit, such as a rotation shaft or a rotation gear, which can rotate the display device to change the angle of the display device to accommodate users of different heights.

[0132] It should also be noted that, in the various display devices provided in this application, the image generation unit (including the image unit 410 in FIG4, the first image generation unit 910 and the second image generation unit 940 in FIG9, and the image generation unit 1110 in FIG11) can be an LCD display, a liquid crystal on silicon (LCOS) display, an OLED display, a micro-LED display, a display using miniLED display technology, a digital light processing (DLP) display, or a micro-electro-mechanical system (MEMS) display, etc., and this application does not limit it.

[0133] Optionally, in the various display devices provided in this application, the image magnification unit is a freeform mirror, that is, the image magnification unit 420 in FIG4, the image magnification unit 920 in FIG9, and the image magnification unit 1120 in FIG11 are freeform mirrors.

[0134] Figure 13 is a possible side view of a display device 30 applicable to an embodiment of this application. As shown in Figure 13, the display device 30 includes an image generation unit 310, a window unit 320, an image magnification unit 330, and a first housing 340. The window unit 320 can be any of the above embodiments, such as the window unit 420 in Figure 6. The window unit 320 includes an outer surface 321 and an inner surface 322. One end of the first housing 340 is connected to the upper edge of the window unit 320, and the other end of the first housing 340 is connected to the lower edge of the window unit 320, such that the first housing 340 and the window unit 320 form a closed cavity. The image generation unit 310 and the image magnification unit 330 are disposed within this cavity, and the inner surface 322 of the window unit 320 is located within this cavity. Specifically, when the display device 30 is operating, the image generation unit 310 emits a first imaging light onto the inner surface 322 of the viewing window unit 320. This first imaging light is reflected by the inner surface 322 of the viewing window unit 320 and transmitted to the surface of the image magnification unit 330. After being reflected by the image magnification unit 330, it reaches the inner surface 322 of the viewing window unit 320 again, is transmitted through the inner surface 322, and exits from the outer surface 321 of the viewing window unit 320. When a user views an image through the outer surface 321 of the viewing window unit 320, the image light emitted from the outer surface 321 of the viewing window unit 320 enters the user's eye, allowing the user to see a virtual image located at the image plane. Simultaneously, the user can see a real image displayed on the viewing window unit 320.

[0135] Optionally, the display device 30 also includes a second housing, which is fixed to the periphery of the outer surface 321 of the window unit 320 by means of adhesive or screws. Electronic components, such as buttons, indicator lights, microphones, etc., may also be provided on the second housing to realize different functions of the display device 30.

[0136] It should be noted that the first outer shell 340 can be a single, complete shell. Alternatively, the first outer shell 340 can also be formed by connecting multiple partial shells, for example, by connecting them together through decorative strips.

[0137] It should be noted that Figure 13 is only an example of the display device 400 corresponding to Figure 4 above. That is, for the display devices shown in Figures 9 and 11, as well as other display devices not listed in the embodiments of this application, there can be display devices similar to Figure 13, including the structure and housing of the corresponding display devices, which will not be described in detail here.

[0138] Figure 14 is a schematic diagram of the cockpit of a vehicle according to an embodiment of this application. As shown in Figure 14, the vehicle includes a display device 2000, which is disposed inside the instrument panel. The display device 2000 may be the display device 30 in Figure 13, or it may be a display device that includes the display device 900 and the display device 1100.

[0139] Optionally, in addition to being installed on the dashboard, the display device 2000 provided in this application embodiment can also be installed on other structural equipment of the vehicle, such as the seat back, the inner wall of the vehicle, the control panel, the processing table, etc., and this application does not limit it in this regard.

[0140] Optionally, the operating table can be a resuscitation operating table on an ambulance, a kitchen operating table on a motorhome, etc.; the processing table can be a bar on a motorhome, a dining table in a passenger cabin, an office desk, etc., and this application does not limit it in this regard.

[0141] Figure 15 is a circuit diagram of the display device provided in an embodiment of this application. As shown in Figure 15, the circuit in the display device mainly includes a main processor (host CPU) 1201, an external memory interface 1202, an internal memory 1203, an audio module 1204, a video module 1205, a power supply module 1206, a wireless communication module 1207, an I / O interface 1208, a video interface 1209, a display circuit 12100, and a modulator 1212. The main processor 1201 and its peripheral components, such as the external memory interface 1202, the internal memory 1203, the audio module 1204, the video module 1205, the power supply module 1206, the wireless communication module 1207, the I / O interface 1208, the video interface 1209, and the display circuit 12100, can be connected via a bus. The main processor 1201 can be referred to as a front-end processor.

[0142] Furthermore, the circuit diagrams illustrated in the embodiments of this application do not constitute a specific limitation on the display device. In other embodiments of this application, the display device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0143] The main processor 1201 includes one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units can be independent devices or integrated into one or more processors.

[0144] The main processor 1201 may also include a memory for storing instructions and data. In some embodiments, the memory in the main processor 1201 is a cache memory. This memory can store instructions or data that the main processor 1201 has just used or is recurring. If the main processor 1201 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the main processor 1201, and thus improves the efficiency of the system.

[0145] In some embodiments, the display device may further include multiple input / output (I / O) interfaces 1208 connected to the main processor 1201. Interfaces 1208 may include Inter-Integrated Circuit (I2C) interfaces, Inter-Integrated Circuit Sound (I2S) interfaces, Pulse Code Modulation (PCM) interfaces, Universal Asynchronous Receiver / Transmitter (UART) interfaces, Mobile Industry Processor Interface (MIPI) interfaces, General-Purpose Input / Output (GPIO) interfaces, Subscriber Identity Module (SIM) interfaces, and / or Universal Serial Bus (USB) interfaces, etc. The aforementioned I / O interfaces 1208 can connect to devices such as mice, touchpads, keyboards, cameras, speakers, microphones, etc., and can also connect to physical buttons on the display device (e.g., volume buttons, brightness adjustment buttons, power buttons, etc.).

[0146] The external memory interface 1202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with the main processor 1201 through the external memory interface 1202 to perform data storage functions.

[0147] Internal memory 1203 can be used to store executable program code, including instructions. Internal memory 1203 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as a call function, time setting function, etc.), etc. The data storage area may store data created during the use of the display device (such as a phone book, world time, etc.). Furthermore, internal memory 1203 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, Universal Flash Storage (UFS), etc. The main processor 1201 executes various functional applications and data processing of the display device by running instructions stored in internal memory 1203 and / or instructions stored in memory located in the main processor 1201.

[0148] The display device can implement audio functions, such as music playback and phone calls, through the audio module 1204 and application processor.

[0149] The audio module 1204 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 1204 can also be used for encoding and decoding audio signals, such as for playback or recording. In some embodiments, the audio module 1204 may be located in the main processor 1201, or some functional modules of the audio module 1204 may be located in the main processor 1201.

[0150] The video interface 1209 can receive externally input audio and video signals, specifically including High Definition Multimedia Interface (HDMI), Digital Visual Interface (DVI), Video Graphics Array (VGA), and DisplayPort (DP). The video interface 1209 can also output video. When the display device is used as an in-vehicle display, the video interface 1209 can receive speed and power signals from peripheral devices, as well as externally input VR video signals. When the display device is in use, the video interface 1209 can receive video signals from an external computer or terminal device.

[0151] The video module 1205 can decode the video input from the video interface 1209, such as performing H.264 decoding. The video module can also encode video captured by the display device, such as performing H.264 encoding on video captured by an external camera. Furthermore, the main processor 1201 can also decode the video input from the video interface 1209 and then output the decoded image signal to the display circuit 12100.

[0152] The display circuit 12100 and modulator 1212 are used to display the corresponding image. In this embodiment, the video interface 1209 receives an externally input video source signal. The video module 1205 performs decoding and / or digitization processing and outputs one or more image signals to the display circuit 12100. The display circuit 12100 drives the modulator 1212 to image the incident polarized light according to the input image signal, and then outputs image light. In addition, the main processor 1201 can also output one or more image signals to the display circuit 12100.

[0153] In this embodiment, the display circuit 12100 and the modulator 1212 are electronic components in the image generation unit described above, and the display circuit 12100 can be referred to as the driving circuit.

[0154] The power module 1206 provides power to the main processor 1201 and the light source 1200 based on the input power (e.g., DC power). The power module 1206 may include a rechargeable battery, which can provide power to the main processor 1201 and the light source 1200. The light emitted by the light source 1200 can be transmitted to the modulator 1212 for imaging, thereby forming an image light signal.

[0155] The wireless communication module 1207 enables the display device to communicate wirelessly with the outside world. It can provide solutions for wireless communication such as Wireless Local Area Networks (WLAN) (e.g., Wireless Fidelity (Wi-Fi)), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR). The wireless communication module 1207 can be one or more devices integrating at least one communication processing module. The wireless communication module 1207 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signal, and sends the processed signal to the main processor 1201. The wireless communication module 1207 can also receive signals to be transmitted from the main processor 1201, modulate and amplify them, and then convert them into electromagnetic waves for radiation via the antenna.

[0156] In addition, the video data decoded by the video module 1205 can be input not only through the video interface 1209, but also wirelessly received through the wireless communication module 1207 or read from external memory. For example, the display device can receive video data from the terminal device or the in-vehicle entertainment system through the vehicle's wireless local area network, and the display device can also read audio and video data stored in external memory.

[0157] The aforementioned display device can be installed on a vehicle. Please refer to Figure 16, which is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of this application.

[0158] As shown in Figure 16, the functional framework of a vehicle may include various subsystems, such as the sensor system 12, control system 14, one or more peripheral devices 16 (one is shown as an example), power supply 18, computer system 20, and in-vehicle display system 22. Optionally, the vehicle may also include other functional systems, such as an engine system that provides power to the vehicle, etc., which are not limited herein.

[0159] The sensor system 12 may include several detection devices that can sense the measured information and convert the sensed information into electrical signals or other required forms of information output according to a certain rule. As shown in the figure, these detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser rangefinder, a camera device, a wheel speed sensor, a steering sensor, a gear sensor, or other components used for automatic detection, etc., and this application does not limit them.

[0160] The control system 14 may include several components, such as the steering unit, braking unit, lighting system, automatic driving system, map navigation system, network time synchronization system, and obstacle avoidance system shown in the figure. Optionally, the control system 14 may also include components such as a throttle controller and an engine controller for controlling the vehicle's speed; this application is not limiting.

[0161] Peripheral device 16 may include several components, such as the communication system, touch module, user interface, microphone, and speaker shown in the figure. The communication system is used to enable network communication between the vehicle and other devices. In practical applications, the communication system can employ wireless or wired communication technologies to achieve network communication between the vehicle and other devices. The wired communication technology can refer to communication between the vehicle and other devices via network cables or fiber optic cables.

[0162] Power source 18 represents a system that provides electricity or energy to the vehicle, which may include, but is not limited to, rechargeable lithium batteries or lead-acid batteries. In practical applications, one or more battery components in the power source are used to provide electrical energy or power for vehicle startup, and the type and materials of the power source are not limited in this application.

[0163] Several functions of the vehicle are controlled and implemented by the computer system 20. The computer system 20 may include one or more processors 2001 (the illustration shows one processor as an example) and a memory 2002 (also referred to as a storage device). In practical applications, the memory 2002 may be located inside the computer system 20 or outside the computer system 20, for example, as a cache in the vehicle; this application does not limit this. The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 can be used to run relevant programs or instructions corresponding to programs stored in the memory 2002 to implement the corresponding functions of the vehicle.

[0164] The memory 2002 may include volatile memory, such as RAM; it may also include non-volatile memory, such as ROM, flash memory, HDD, or SSD; or it may include a combination of the above types of memory. The memory 2002 can be used to store a set of program code or instructions corresponding to the program code, so that the processor 2001 can call the program code or instructions stored in the memory 2002 to implement the corresponding functions of the vehicle. In this application, the memory 2002 may store a set of program code for vehicle control. The processor 2001 can call this program code to control the safe driving of the vehicle. The specific details of how to achieve safe vehicle driving are described below in this application.

[0165] Optionally, in addition to storing program code or instructions, the memory 2002 may also store information such as road maps, driving routes, and sensor data. The computer system 20 can be integrated with other components in the vehicle functional framework diagram, such as sensors in the sensor system and GPS, to realize the vehicle's related functions. For example, the computer system 20 can control the vehicle's direction of travel or speed based on data input from the sensor system 12; this application does not impose limitations on this.

[0166] The in-vehicle display system 22 may include several components, such as a controller and an in-vehicle display. The controller 222 generates images (e.g., images of VR content) according to user instructions and sends the images to the in-vehicle display for display. The in-vehicle display may include an image generation unit, a viewing unit, and an image magnification unit, allowing passengers to view the target image displayed on the in-vehicle display through the viewing unit. Some of the functions of the components in the in-vehicle display system can also be implemented by other subsystems of the vehicle; for example, the controller may also be a component within the control system.

[0167] Figure 16 of this application illustrates four subsystems: sensor system 12, control system 14, computer system 20, and in-vehicle display system 22. These are merely examples and do not constitute a limitation. In practical applications, vehicles can combine various components according to different functions to obtain subsystems with corresponding functions. In practical applications, vehicles may include more or fewer systems or components; this application does not impose any limitations.

[0168] The aforementioned means of transportation can be cars, trucks, buses, ships, airplanes, helicopters, recreational vehicles, trains, etc., and this application does not impose any special limitations on them.

[0169] Figure 17 is a schematic functional block diagram of a mobile carrier 25 provided in an embodiment of this application. The mobile carrier 25 may include a sensing system 120, a display device 130, and a computing platform 150. The sensing system 120 may include one or more sensors for sensing information about the environment surrounding the mobile carrier 25. For example, the sensing system 120 may include a positioning system, which may be a global positioning system (GPS), a BeiDou system or other positioning systems, an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and one or more of a camera device.

[0170] Some or all of the functions of the mobile carrier 25 can be controlled by the computing platform 150. The computing platform 150 may include one or more processors, such as processors 151 to 15n (n is a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor may be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a type of microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of hardware circuits. The logical relationship of the hardware circuits is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration document and implementing the hardware circuit configuration can be understood as the process of the processor loading instructions to implement some or all of the functions of the above units. Furthermore, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In addition, the computing platform 150 may also include a memory for storing instructions. Some or all of the processors 151 to 15n can call and execute the instructions in the memory to achieve the corresponding functions. The display device 130 in the cockpit is a display device suitable for the embodiments of this application, such as the display device 300 in the above embodiments.

[0171] The mobile carrier in this application can include road vehicles, water vehicles, air vehicles, or entertainment equipment. For example, the mobile carrier can be a vehicle, which is a vehicle in a broad sense, and can be a means of transportation (such as commercial vehicles, passenger cars, trains, etc.), amusement equipment, toy vehicles, etc. The embodiments of this application do not specifically limit the type of vehicle. As another example, the mobile carrier can be a means of transportation such as an airplane or a ship.

[0172] Unless otherwise defined, the technical or scientific terms used herein should have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure pertains. The above description is merely one embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, or improvements made based on this application should be included within the scope of protection of this application.

Claims

1. A display device, characterized in that, The display device comprises: a window unit, a first image generating unit and an image amplifying unit, wherein the first image generating unit is configured to emit first imaging light to the window unit; the window unit is configured to reflect the first imaging light from the image generating unit to the image amplifying unit, and transmit the first imaging light reflected from the image amplifying unit to a user, the first imaging light being used to generate a virtual image, and the window unit is further configured to display a real image on the window unit, so that the user controls the virtual image by touching the real image; the image amplifying unit is configured to reflect the first imaging light from the window unit to the window unit.

2. The display device according to claim 1, wherein The window unit is particularly configured to display the real image by using second imaging light.

3. The display device according to claim 2, wherein The window unit comprises a display touch module, the display touch module is configured to display the real image and realize touch on a real image area.

4. The display device according to claim 3, wherein The display touch module comprises one of a transparent display touch module, a projection display touch module or an illumination display touch module.

5. The display device according to claim 4, wherein The display touch module comprises the transparent display touch module, the transparent display touch module is configured to generate the second imaging light by using image information of the real image, and the second imaging light is used to display the real image on the window unit.

6. The display device according to claim 5, wherein The display device further comprises an image processing unit, wherein the image processing unit is configured to input the image information of the real image to the transparent display touch module.

7. The display device according to any one of claims 4 to 6, wherein The transparent display touch module covers all or part of the surface of the window unit.

8. The display device according to claim 4, wherein The display touch module comprises the projection display touch module, and the display device further comprises a second image generating unit, the second image generating unit is configured to emit the second imaging light to the window unit; the projection display touch module is configured to generate the real image on the window unit by using the second imaging light emitted by the second image generating unit.

9. The display device according to claim 4 or 8, wherein The projection display touch module covers part of the surface of the window unit.

10. The display device according to claim 4, wherein The display touch module comprises the illumination display touch module, and the display device further comprises a light source, the light source is configured to emit a light beam to the window unit; the illumination display touch module is configured to illuminate the real image on the illumination display touch module by using the light beam emitted by the light source.

11. The display device according to claim 4 or 10, wherein The illumination display touch module covers part of the surface of the window unit.

12. The display device according to any one of claims 1 to 11, wherein The user touches the real image by a finger.

13. The display device according to any one of claims 1 to 12, wherein When the user touches the real image, the real image changes in at least one of the following aspects: the brightness of the real image changes from a first brightness to a second brightness, the brightness value of the second brightness being greater than that of the first brightness; the frame size of the real image changes from a first frame size to a second frame size, the area of the second frame size being greater than that of the first frame size; the real image displays a bright edge.

14. A method of controlling a virtual image, the method comprising: The display device comprises: in response to a touch operation of a user on a real image displayed on the display device, a virtual image displayed by the display device changes from a first virtual image to a second virtual image, the first virtual image being generated by transmitting first imaging light of the display device, and the second virtual image being generated by transmitting second imaging light of the display device.

15. The method of claim 14, wherein, The user touches the real image by a finger.

16. The method according to claim 14 or 15, characterized in that When the user touches the real image, the real image changes at least one of: a brightness of the real image changes from a first brightness to a second brightness, the second brightness having a brightness value greater than a brightness value of the first brightness; a frame size of the real image changes from a first frame size to a second frame size, the second frame size having an area greater than an area of the first frame size; the real image displays a bright border.

17. A cockpit system characterized by, A seat for a user to sit on, comprising the display device of any one of claims 1 to 13.

18. A vehicle, characterized by A cockpit system comprising the display device of any one of claims 1 to 13 or the seat of claim 17.

19. The vehicle of claim 18, wherein, The display device is arranged at least one of a headrest of a seat of the vehicle, a backrest of a seat of the vehicle, and a dashboard of the vehicle.

Images