Dual-screen air projection method, system and automobile display device

Abstract

The present invention relates to the field of automotive projection display technology, specifically a dual-screen air projection method, system, and automotive display device. The method comprises generating a first image beam using a first image generation source, the first image generation source comprising a liquid crystal on silicon chip, a digital light processing chip, or a thin-film transistor liquid crystal display, the first image beam containing image information. The dual-screen air projection method of the present invention generates a first light beam and a second light beam having different polarization states using the first image generation source and a second image generation source, respectively. These light beams are shaped using a plane reflector located along the beam propagation path, ultimately forming a stable dual-screen virtual image in the air.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile projection display, and in particular to a dual-screen air projection method, system and automobile display device. Background Art

[0002] Traditional automotive display methods, such as touchscreen operation on central control screens or HUDs (head-up displays), have significant limitations in human-computer interaction. For example, touchscreen operation on central control screens requires the driver to reach out and operate while driving, posing a safety hazard. Traditional buttons and knobs, on the other hand, are less intuitive and convenient, and are particularly cumbersome for controlling complex functions. Although air projection technology is gaining attention as an emerging display method, existing air projection systems typically rely on complex water curtain or fog screen imaging, which not only increases the system size and cost, but also makes image quality susceptible to external environmental factors (such as temperature and humidity), resulting in unstable imaging and poor visual effects.

[0003] Furthermore, most existing air projection systems only support single-screen imaging, making it difficult to achieve rich 3D effects and multi-dimensional information display. This makes them unable to meet the higher demands of drivers and passengers for information display and interactive experiences in modern automotive environments. This is especially true at high speeds or in complex road conditions, where drivers need to quickly and accurately access critical information, placing even higher demands on automotive display devices. Summary of the Invention

[0004] The present invention provides a dual-screen air projection method, system and automobile display device capable of directly imaging in the air, which has a small size, a strong 3D effect and is not easily affected by the external environment.

[0005] The technical solution of the present invention to solve the above technical problems is as follows:

[0006] In one aspect, a dual-screen air projection method is provided, the method comprising the steps of:

[0007] generating a first image beam by a first image generation source, wherein the first image generation source includes a liquid crystal on silicon chip, a digital light processing chip, or a thin film transistor liquid crystal display, and the first image beam includes image information;

[0008] The first image beam is shaped by a plane reflector located in the propagation path of the first image generation source beam, wherein the light incident surface of the plane reflector is coated with a semi-transparent and semi-reflective film or a CMF film, and the light exit surface is coated with an anti-reflection film, so that the first image beam forms a virtual image in the air at a preset position after reflection;

[0009] A second image generating source is placed at a suitable position for forming the virtual image. The second image generating source emits a second image beam. The second image beam passes through the plane reflector and emerges into the air, where it is superimposed with the first image beam to form a dual-screen virtual image.

[0010] On the other hand, a dual-screen air projection system is provided for implementing the dual-screen air projection method described above, the projection system comprising:

[0011] a first image generating source for emitting a first image light beam;

[0012] a plane reflective mirror, located on a beam propagation path of the first image generating source, and configured to perform shaping processing on the first image beam and form a virtual image in the air;

[0013] a second image generating source, configured to emit a second image beam, wherein the second image beam passes through the plane reflecting mirror and is superimposed with the first image beam to form a dual-screen virtual image;

[0014] A rotating structure, including a base and a motor, for achieving 360° rotating imaging;

[0015] The intelligent interactive control system includes a voice recognition module, an eye tracking module and a motion recognition module, and is used for real-time interactive control of the dual-screen virtual images.

[0016] In another aspect, an automobile display device is provided, comprising the dual-screen air projection system as described above, the display device further comprising:

[0017] A display controller, configured to switch and adjust the display content of the dual-screen virtual image according to driving status and user needs;

[0018] A safety detection module, used to monitor the driving environment in real time to prevent the dual-screen virtual image from interfering with driving safety;

[0019] The display controller includes:

[0020] A user preference learning module that analyzes the user's historical operation data through a machine learning algorithm to adjust the display content and interaction mode of the dual-screen virtual image;

[0021] The dynamic environment adaptation module adjusts the display parameters of the dual-screen virtual image in real time according to the vehicle's speed, road conditions and weather conditions to ensure the best visual effect.

[0022] The beneficial effects of the present invention are:

[0023] The dual-screen air projection method of the present invention generates first and second light beams with different polarization states using a first image generation source and a second image generation source. These light beams are then shaped using plane mirrors located along the beam propagation paths, ultimately forming a stable dual-screen virtual image in the air. This technical solution addresses the issues of existing air projection systems that rely on complex water curtains or fog screens for imaging, resulting in bulk, high costs, and unstable image quality.

[0024] Furthermore, by using a plane mirror with a semi-transparent and semi-reflective film or CMF film coated on the light-entering surface and an anti-reflection film coated on the light-emitting surface, the present invention achieves the effect of direct imaging in the air, which not only reduces the dependence on the physical screen, but also reduces the size and cost of the system. Secondly, the design of the dual-screen virtual image makes the imaging content richer, the 3D effect more significant, and enhances the visual experience. Especially when driving at high speeds or in complex road conditions, the driver can quickly and accurately obtain key driving information through the dual-screen virtual image, and passengers can also enjoy independent entertainment and information interaction screens, improving overall driving safety and comfort.

[0025] In addition, the dual-screen air projection method of the present invention uses intelligent rotation imaging and interactive control systems, allowing users to flexibly adjust display content and viewing angles according to their needs, ensuring optimal visual effects in various driving environments.

[0026] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention and implement it according to the contents of the specification, the following is a detailed description of the preferred embodiments of the present invention with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 Flowchart of a dual-screen air projection method according to an embodiment of the present invention;

[0028] Figure 2 The principle of the dual-screen air projection method in one embodiment of the present invention Figure 1 ;

[0029] Figure 3 The principle of the dual-screen air projection method in one embodiment of the present invention Figure 2 ;

[0030] In the attached figure:

[0031] 1. Eye box; 2. Plane mirror; 3. First image generation source; 4. Virtual image; 5. Second image generation source; 6. Base; 7. Motor. DETAILED DESCRIPTION

[0032] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0033] The term "comprise" and any variations thereof in the specification and claims of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units that are not explicitly listed or are inherent to these processes, methods, products, or apparatuses. In addition, the use of "and / or" in the specification and claims to indicate at least one of the connected objects, such as A and / or B, means that A alone, B alone, and both A and B are included.

[0034] In the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0035] The present invention provides the following preferred embodiments:

[0036] Example 1

[0037] In order to solve the problems of unstable imaging quality and difficulty in realizing multi-dimensional information display in existing air projection systems, this embodiment provides an imaging process of a dual-screen air projection method. Specifically, this embodiment describes in detail how to generate a first image beam through a first image generation source, and shape it through a plane reflector to finally form a virtual image in the air. On this basis, this embodiment also explores how to place a second image generation source at a suitable position for virtual image imaging to realize superimposed imaging of dual-screen virtual images. Figures 1 to 3 As shown, the steps of the dual-screen air projection method include:

[0038] S100 , generating a first image beam through a first image generation source 3 , the first image generation source including a liquid crystal on silicon chip, a digital light processing chip, or a thin film transistor liquid crystal display, and the first image beam containing image information.

[0039] S200. The first image light beam is shaped by a plane mirror 2 located on the light beam propagation path of the first image generation source 3. The light incident surface of the plane mirror 2 is coated with a semi-transparent and semi-reflective film or a CMF film, and the light emitting surface is coated with an anti-reflection film, so that the first image light beam forms a virtual image 4 in the air at a preset position after reflection.

[0040] S300. Place a second image generation source 5 at a suitable position for forming the virtual image 4. The second image generation source 5 emits a second image beam. The second image beam passes through the plane reflector 2 and is emitted into the air, where it is superimposed with the first image beam to form a dual-screen virtual image.

[0041] The first image generation source 3 employed in this embodiment may be a liquid crystal on silicon (LCoS) chip, capable of generating high-resolution and high-contrast image beams. The operating principle of LCoS chips is to convert image information into optical signals through the electrically controlled deflection characteristics of liquid crystal material. LCoS chips are chosen for their high resolution and low power consumption, making them suitable for long-term, stable operation in a vehicle environment. The first image beam generated by the first image generation source contains image information, such as vehicle speed, navigation instructions, and driver assistance system prompts.

[0042] Furthermore, the first image light beam generated by the first image generation source 3 passes through a plane reflector 2 located on its light beam propagation path for shaping during its propagation process. The light incident surface of the plane reflector is coated with a semi-transparent and semi-reflective film, and the light emitting surface is coated with an anti-reflection film. It should be understood that the role of the semi-transparent and semi-reflective film is to allow part of the light beam to be reflected without affecting the propagation of the first image light beam, thereby achieving the shaping of the light beam. The anti-reflection film is used to reduce the reflection loss of the light beam on the light emitting surface, ensuring that more light beams can pass through the reflector and enter the air. In this way, after the first image light beam is processed by the reflector, a virtual image 4 is formed in the air at a preset position. The position where the virtual image is formed can be adjusted according to the actual application scenario to ensure that the driver can observe clear image information at the most appropriate position.

[0043] Furthermore, a second image generation source 5 is placed at a suitable location for virtual image 4. This second image generation source also utilizes a liquid crystal on silicon chip. The generated second image beam passes through the plane reflector 2 and emerges into the air, where it is superimposed with the first image beam to form a dual-screen virtual image. The image information from the second image generation source can include passenger entertainment content, trip details, and other information, complementing the driving information from the first image generation source. It should be understood that the second image generation source's beam is not affected by the first image beam when passing through the plane reflector, ensuring the independence of the two beams and the clarity of their superposition.

[0044] As you can see, the superimposed dual-screen virtual imagery not only enriches the displayed content but also creates a more realistic 3D effect. Drivers and passengers can choose to view different virtual images based on their needs, improving information acquisition efficiency and visual experience. Furthermore, the dual-screen virtual image design allows for greater flexibility in the display area, allowing it to be adjusted to the vehicle's interior layout, eliminating the need for fixed physical screens.

[0045] The benefit of this embodiment is that, by using a silicon-based liquid crystal chip as the image generation source, combined with the shaping processing of a plane reflector, the effect of direct imaging in the air is achieved. This method not only reduces the dependence on the physical screen, but also greatly reduces the size and cost of the system. At the same time, the design of the dual-screen virtual image makes the imaging content richer, the 3D effect more significant, and enhances the user's visual experience. Especially when driving at high speeds or in complex road conditions, the driver can quickly and accurately obtain key driving information through the dual-screen virtual image, while passengers can also enjoy independent entertainment and information interaction screens, improving driving safety and comfort. Through this embodiment, not only the problem of unstable imaging quality in the existing air projection system is solved, but also the function of multi-dimensional information display is realized, providing a new solution for the development of automotive display technology.

[0046] Example 2

[0047] To address the glare issue that can occur when images enter the eyebox in existing air projection systems, this embodiment further optimizes the design of the micro-projection module in the dual-screen air projection method. Specifically, this embodiment describes in detail how the micro-projection module generates a first image beam, and uses a diffuser and Fresnel lens to ensure that the image enters the eyebox softly, avoiding glare caused by LED imaging in the eyebox. Furthermore, this embodiment introduces an adaptive light intensity adjustment module to adjust the intensity of the image beam in real time based on ambient light intensity, ensuring optimal imaging under varying lighting conditions.

[0048] Furthermore, the micro-projection module selected in this embodiment includes a light homogenizer, which can be a reflective or transmissive type. The function of the light homogenizer is to homogenize the image light beam from the first image generation source 3, so that the image light beam is softer when entering the eye box, avoiding the glare caused by the direct imaging of the LED on the eye box. The reflective light homogenizer is suitable for application scenarios where the light beam needs to be reflected back to the eye, while the transmissive light homogenizer is more suitable for situations where the light beam directly passes through and enters the eye. Selecting the appropriate type of light homogenizer can ensure that the image light beam does not produce a dazzling bright spot when entering the eye box, thereby improving the user's visual comfort.

[0049] Furthermore, the micro-projection module is also equipped with a Fresnel lens, which is located between the illumination light path and the light homogenizer. The main function of the Fresnel lens is to enhance the brightness and uniformity of the image, ensuring that the image light beam has been fully enhanced and homogenized before entering the eye box. The use of the Fresnel lens not only improves the brightness of the image, but also makes the brightness distribution of the image more uniform at different viewing angles, eliminating the common phenomenon of uneven brightness. In addition, the Fresnel lens can be replaced by a DOE lens, which has higher diffraction efficiency and can precisely control the light intensity distribution while maintaining a high light intensity, further improving the image quality.

[0050] Furthermore, in order to cope with changes in ambient light intensity, this embodiment introduces an adaptive light intensity adjustment module. This module has a built-in first adjustment algorithm for adjusting the intensity of the first image beam in real time according to the ambient light intensity. Specifically, the expression of the first adjustment algorithm is:

[0051] , where I out Indicates the adjusted light intensity, I in Indicates the initial light intensity, L env Indicates the ambient light intensity, L ref Represents the reference light intensity threshold. Using the first adjustment algorithm, the system dynamically adjusts the image beam's intensity based on ambient light intensity, ensuring the image isn't too dim in bright environments or too bright in dim ones. It's important to understand that this adaptive adjustment mechanism not only improves image visibility but also reduces user visual fatigue.

[0052] The benefit of this embodiment is that by introducing a micro-projection module, a light-homogenizing sheet, a Fresnel lens, and an adaptive light intensity adjustment module, this embodiment effectively solves the glare problem that may occur when the image enters the eye box, and ensures that the best imaging effect can be obtained under different lighting conditions. The design of the micro-projection module makes the image beam softer, avoiding the discomfort caused by direct imaging of the LED on the eye box. At the same time, the adaptive light intensity adjustment module adjusts the light intensity in real time according to the ambient light intensity, further enhancing the user's visual experience. Through this embodiment, the dual-screen air projection system not only improves the imaging quality, but also provides users with a more comfortable visual environment.

[0053] Example 3

[0054] To address the issues of light loss and insufficient image clarity in existing air projection systems, this embodiment further optimizes the plane mirror design used in the dual-screen air projection method. Specifically, this embodiment describes in detail how to reduce light loss and improve image brightness and clarity by coating the plane mirror with a CMF coating on the light incident surface, an anti-reflection coating on the light exit surface, and the provision of a polarization control layer. Furthermore, this embodiment introduces an adaptive polarization adjustment module to adjust the polarization state of the image beam in real time based on the polarization characteristics of the ambient light, ensuring consistently high contrast and clarity.

[0055] Furthermore, the light incident surface of the plane reflector 2 selected in this embodiment is coated with a CMF film. The main function of the CMF film is to reduce the light loss of the first image light beam during the reflection process, ensuring that more light can be reflected and used for imaging. The CMF film has specific optical properties, which can effectively reduce light loss during the reflection process and improve imaging quality. The light emitting surface is coated with an anti-reflection film, which has the function of reducing the reflectivity of light and ensuring that more light can pass through the plane reflector 2, thereby improving the brightness and clarity of the image. It should be understood that through the combination of these two coating technologies, this embodiment not only reduces light loss, but also improves the transmittance of light, making the image brighter and clearer when formed in the air.

[0056] Furthermore, this embodiment also provides a polarization control layer on the light entrance surface and the light exit surface of the plane reflector 2. The main function of the polarization control layer is to control the polarization state of the first image light beam to improve the contrast and clarity of the virtual image 4. The polarization control layer adjusts the polarization state of the light beam so that the image light beam has a higher contrast when formed in the air, reduces the interference of background light, and thus improves the clarity of the image. In addition, the polarization control layer also includes an adaptive polarization adjustment module, which has a built-in second adjustment algorithm for adjusting the polarization state of the first image light beam in real time according to the polarization characteristics of the ambient light. Specifically, the expression of the second adjustment algorithm is:

[0057] , where P out represents the initial polarization state, P in represents the initial polarization state, P env Represents the polarization characteristics of ambient light, P ref represents the reference polarization threshold, and ΔP represents the polarization adjustment amplitude. Through this second adjustment algorithm, the system dynamically adjusts the polarization state of the image beam based on the polarization characteristics of the ambient light, ensuring consistently high contrast and clarity. This adaptive adjustment mechanism not only improves image visibility but also reduces background light interference, further enhancing the user's visual experience.

[0058] The benefit of this embodiment lies in that, by introducing a CMF film, an anti-reflection film, and a polarization control layer, it effectively reduces light loss and improves image brightness and clarity. The plane mirror design allows more light to be reflected and transmitted, thereby improving image brightness and clarity. Furthermore, the adaptive polarization adjustment module adjusts the polarization state of the light beam in real time based on the polarization characteristics of the ambient light, further enhancing image contrast and clarity.

[0059] Example 4

[0060] To address the issues of weak 3D effects and limited display content in existing air projection systems, this embodiment further optimizes the design of the second image generation source in the dual-screen air projection method. Specifically, this embodiment describes in detail how to use a DLP projection, LCOS projection module, or laser projection module as the second image generation source to provide complementary image information to the first image generation source, thereby creating a complete 3D effect. Furthermore, this embodiment introduces a dynamic adjustment mechanism for beam intensity and angle, as well as a color adjustment module, to adapt to different driving environments and user preferences, ensuring that the image always has the best visual effect.

[0061] Furthermore, the second image generation source 5 selected in this embodiment adopts a DLP projection, an LCOS projection module or a laser projection module. These projection modules have the characteristics of high resolution and high brightness, and can generate high-quality image beams. The DLP projection module realizes image generation through a micromirror array, the LCOS projection module utilizes the deflection characteristics of the silicon-based liquid crystal chip, and the laser projection module generates images through laser beam scanning. The selection of the three projection modules allows the second image generation source to be flexibly adjusted according to different application scenarios to meet diverse display needs. It should be understood that the image information of the second image generation source complements the image information of the first image generation source 3, and together constitute a complete 3D effect. For example, the first image generation source can display key driving information, while the second image generation source can display passenger entertainment content or itinerary details. The combination of the two makes the display content richer.

[0062] Furthermore, this embodiment also introduces a dynamic adjustment mechanism for beam intensity and angle. The beam intensity and angle of the second image generation source 5 can be dynamically adjusted as needed to adapt to different driving environments and user preferences. Specifically, the adjustment of the beam intensity can be adjusted in real time according to the ambient light intensity and user needs to ensure that the image always has the best brightness. The angle adjustment can be intelligently adjusted according to the user's line of sight to ensure that the user is always in the best viewing position. In addition, the beam generated by the second image generation source also needs to undergo secondary shaping processing by the plane reflector 2 to ensure that the second image beam is perfectly superimposed on the first image beam to form a seamless dual-screen virtual image. The secondary shaping process includes detailed adjustment of the angle, intensity and color of the second image beam. The specific expression is:

[0063] , where I1 and I2 represent the intensities of the first and second image beams, respectively, and α is an adjustment coefficient between 0 and 1. This expression allows the system to dynamically adjust the intensity of the second image beam based on actual needs to ensure optimal superposition with the first image beam.

[0064] Furthermore, this embodiment also introduces a color adjustment module, which has a built-in color temperature adaptive algorithm for adjusting the color of the second image beam in real time according to the color temperature of the ambient light. Specifically, the expression of the color temperature adaptive algorithm is:

[0065] , where C in Indicates the initial color, T env Indicates the color temperature of the ambient light, T ref represents the reference color temperature threshold, and ΔC represents the color adjustment amplitude. Using a color temperature adaptive algorithm, the system dynamically adjusts the color of the second image beam based on the color temperature of the ambient light, ensuring optimal image color performance. This adaptive adjustment mechanism not only improves image color consistency but also reduces the impact of ambient light on image color.

[0066] The benefit of this embodiment lies in the fact that by introducing a DLP, LCOS, or laser projection module as a secondary image generation source, this embodiment achieves image information that complements the primary image generation source, together forming a complete 3D effect. The dynamic adjustment mechanism for beam intensity and angle, as well as the introduction of a color adjustment module, ensures that the image always has the best visual effect, adapting to different driving environments and user preferences.

[0067] Example 5

[0068] In order to solve the problems of limited visual range and single interactive mode in the existing air projection system, this embodiment further optimizes the rotating structure design in the dual-screen air projection method. Figure 3 As shown, this embodiment details how to achieve 360° rotation by adding a base and motor beneath the imaging structure, thereby achieving a full range of viewing. Furthermore, this embodiment incorporates intelligent voice, eye tracking, and motion recognition systems for real-time interactive control of the dual-screen virtual image, ensuring that users can flexibly adjust the display content and viewing angle as needed. Finally, this embodiment also incorporates an intelligent angle compensation module to dynamically adjust the angle of the dual-screen virtual image based on the vehicle's driving posture, ensuring that the image is always perpendicular to the user's line of sight.

[0069] Furthermore, this embodiment adds a base 6 and a motor 7 under the imaging structure to achieve 360° rotation of the imaging structure. The design of the base and the motor allows the entire imaging structure to rotate freely within a 360° range, thereby achieving a full range of visual range. This design not only expands the user's visual range, but also enhances the user's visual experience. It should be understood that the 360° rotation design allows the user to observe the dual-screen virtual image from any angle without being restricted by a fixed viewing angle, thereby enhancing the flexibility of use. In addition, the design of the base and the motor also takes into account the stability of the vehicle during driving, ensuring that the dual-screen virtual image will not be distorted due to vibration during driving.

[0070] Furthermore, this embodiment also introduces intelligent voice, eye tracking and motion recognition systems for real-time interactive control of the dual-screen virtual image. The intelligent voice system uses voice recognition technology, and the user can control the display content and viewing angle of the dual-screen virtual image through voice commands. The eye tracking system captures the user's eye movements through a camera, and the system automatically adjusts the display content and viewing angle of the dual-screen virtual image according to the user's line of sight. The motion recognition system captures the user's body movements through a camera, and the user can control the display content and viewing angle of the dual-screen virtual image through gestures and other actions. These interaction methods not only improve the user's interactive experience, but also allow the user to interact with the dual-screen virtual image more naturally and conveniently. It can be understood that the introduction of multiple interaction methods not only improves the user's interactive experience, but also allows the user to choose the most suitable interaction method according to different needs, thereby improving the convenience of use.

[0071] Furthermore, this embodiment also introduces an intelligent angle compensation module, which has a built-in angle compensation algorithm for dynamically adjusting the angle of the dual-screen virtual image according to the vehicle's driving posture, ensuring that the image is always perpendicular to the user's line of sight. Specifically, the angle compensation algorithm is expressed as:

[0072] , where θ comp Represents the attitude angle after compensation, θ vehicle represents the vehicle's attitude angle, v represents the vehicle's speed, and v refrepresents the reference speed threshold, and Δθ represents the compensation angle. Using an angle compensation algorithm, the system dynamically adjusts the angle of the dual-screen virtual image based on the vehicle's driving posture, ensuring the images are always perpendicular to the user's line of sight. This intelligent angle compensation mechanism not only improves image visibility but also reduces visual fatigue when viewing the images in different driving postures.

[0073] The benefits of this embodiment lie in its ability to achieve 360° rotation through the introduction of a base and motors, which not only expands the user's field of view but also enhances the visual experience. The introduction of intelligent voice, eye tracking, and motion recognition systems allows users to interact with the dual-screen virtual images more naturally and conveniently, improving ease of use. The introduction of an intelligent angle compensation module ensures that the image is always perpendicular to the user's line of sight.

[0074] Example 6

[0075] To address the limitations of existing air projection systems, which suffer from a single interactive mode and an inability to predict user intent, this embodiment further optimizes the intelligent interactive control mechanism within the dual-screen air projection approach. Specifically, this embodiment describes how to utilize real-time data analysis and interaction through voice recognition, eye tracking, and motion recognition modules. Furthermore, it introduces a behavior prediction module to predict user intent based on historical user behavior, thereby achieving a more intelligent and efficient interactive experience.

[0076] Furthermore, this embodiment achieves early prediction of user operation intentions through the built-in behavior prediction algorithm of the behavior prediction module. The algorithm first collects the user's historical operation data and builds a user behavior database. These historical data include various behavioral records of users when operating the dual-screen virtual image in the past, such as voice commands, gestures, and eye movement trajectories. By building a user behavior database, the system can accumulate a large amount of user operation data, providing a basis for subsequent predictions. It should be understood that the user behavior database not only records the user's operation content, but also records the timestamp of each operation, which provides important time dimension information for subsequent time series analysis.

[0077] Furthermore, this embodiment uses a deep neural network model to train the user behavior database to obtain a user behavior prediction model. The input of the model is the user's current operating state, and the output is the probability distribution of the user's expected operation. Specifically, the deep neural network can identify the patterns in the user's operating patterns by learning a large amount of user behavior data, and predict the user's next operating intention based on this. For example, when a user frequently uses a certain gesture to operate, the system can recognize this pattern and predict the user's operating intention in advance when the user makes a similar gesture again, thereby speeding up the response speed. It can be understood that the training process of the deep neural network model not only improves the accuracy of the prediction, but also enables the system to continuously optimize its own prediction capabilities and adapt to the operating habits of different users.

[0078] Furthermore, the behavior prediction algorithm also includes a multimodal fusion module for analyzing the user's voice, gestures, and eye movements to improve prediction accuracy. By combining multiple user interaction methods, the multimodal fusion module can more comprehensively understand the user's operational intentions. Specifically, the expression for multimodal fusion is:

[0079] , where P multi represents the user operation probability after multimodal fusion, P voice 、P gesture and P eye denote the probabilities of speech, gesture and eye movement respectively, m denotes the number of time windows, t denotes the current time, ω j represents the weight of the jth time window, t j represents the timestamp of the jth time window, σ j represents the time deviation, α j ,β j ,γ j Represent the weight coefficients of speech, gesture, and eye movement respectively. Through the expression of multimodal fusion, the system can comprehensively consider the user's various interaction methods and improve the accuracy of prediction.

[0080] Furthermore, the behavior prediction algorithm also calculates the user's next action based on the probability distribution of the user's expected action. The specific expression is:

[0081] , where P next Indicates the next step, P i represents the probability of the i-th operation, w i Represents the weight coefficient of the i-th operation, t i represents the timestamp of the i-th operation, σ irepresents the time deviation, n represents the number of operation types, and t represents the current time. Through the behavior prediction algorithm, the system can predict the user's next operation based on their historical operation patterns, thereby achieving a more intelligent interactive experience.

[0082] The benefit of this embodiment lies in that, by introducing the behavior prediction module and the multimodal fusion module, it not only enables early prediction of user operation intentions but also improves the intelligent level of interaction. Users can interact through various methods such as voice, gestures, and eye movements. The system can predict their operation intentions in advance based on their historical operation habits and current operation status, thereby accelerating response speed.

[0083] Example 7

[0084] To address the issue of unstable imaging under varying lighting conditions in existing air projection systems, this embodiment further optimizes the design of the plane reflector in the dual-screen air projection method. Specifically, this embodiment describes how to monitor ambient light intensity in real time using an ambient light sensor and adjust the transmittance and reflectivity of the transflective film using a feedback control system to enhance imaging under varying lighting conditions.

[0085] Furthermore, the light incident surface of the plane reflector 2 selected in this embodiment is coated with a semi-transparent and semi-reflective film, and the transmittance and reflectance of the semi-transparent and semi-reflective film can be adaptively adjusted according to the ambient light intensity. The ambient light sensor monitors the ambient light intensity in real time and adjusts the transmittance and reflectance of the semi-transparent and semi-reflective film through a feedback control system. It should be understood that the ambient light sensor can not only monitor the light intensity, but also analyze the spectral characteristics of the ambient light to optimize the adjustment strategy of the semi-transparent and semi-reflective film. Specifically, the spectral analysis module of the ambient light sensor can identify light components of different wavelengths by analyzing the spectral characteristics of the ambient light, thereby optimizing the adjustment strategy of the semi-transparent and semi-reflective film.

[0086] Furthermore, the spectrum analysis expression of the ambient light sensor is:

[0087] , where S(λ) represents the spectrum analysis result, I(λ) represents the intensity of ambient light at wavelength λ, and min and λ max Represent the minimum and maximum wavelengths of the spectrum, λ avg represents the average wavelength, σ λ represents wavelength deviation. Using spectral analysis, the ambient light sensor comprehensively analyzes the spectral characteristics of ambient light, providing an accurate basis for adjusting the transflective film. As can be seen, the results of spectral analysis not only improve the accuracy of transmittance and reflectance adjustments but also optimize imaging, ensuring clear and stable images under varying lighting conditions.

[0088] Furthermore, the feedback control system adjusts the transmittance and reflectance of the translucent and semi-reflective film in real time based on data provided by the ambient light sensor. Specifically, when the ambient light is strong, the system appropriately increases the reflectivity to enhance image brightness and contrast; when the ambient light is weak, the system appropriately increases the transmittance to ensure image clarity. It is important to understand that the design of the feedback control system not only improves the stability of the imaging effect but also reduces the impact of ambient light on image quality. Furthermore, the feedback control system takes into account the characteristics of light of different wavelengths to ensure optimal imaging under different lighting conditions.

[0089] The benefit of this embodiment lies in the fact that, by introducing an ambient light sensor and feedback control system, it not only achieves real-time adjustment of the transflective film's transmittance and reflectivity, but also optimizes imaging. The ambient light sensor's spectral analysis module further improves adjustment accuracy by analyzing the spectral characteristics of ambient light, ensuring clear and stable images under varying lighting conditions.

[0090] Example 8

[0091] To address the unstable imaging effects caused by beam deflection angles and ambient light interference in existing air projection systems, this embodiment further optimizes the adaptive optics algorithm used in the dual-screen air projection method. Specifically, this embodiment describes in detail how to use the adaptive optics algorithm to adjust the beam deflection angle and optimize the imaging effect based on the ambient light interference vector.

[0092] Furthermore, the adaptive optics algorithm in this embodiment satisfies the following constraints:

[0093] , where I adjusted represents the adjusted light intensity, I0 is the initial light intensity, L is the optical path function, θn is the deflection angle of the nth beam, E env is the ambient light interference vector, α is the attenuation coefficient, Δθ n represents the change in the beam deflection angle, and k represents the number of beam deflection angles. This formula allows the system to dynamically adjust light intensity and optimize imaging based on changes in the ambient light interference vector and the beam deflection angle. It's important to understand that the optical path function L describes the path changes of the beam during propagation, while changes in the beam deflection angle directly affect the beam's propagation direction and imaging position.

[0094] Furthermore, the ambient light interference vector E envThis describes the degree to which ambient light interferes with the imaging effect. Specifically, the ambient light interference vector includes information on multiple dimensions, including the direction, intensity, and color of the ambient light. The system monitors the ambient light interference in real time and dynamically adjusts the beam's propagation path and intensity to ensure that the imaging effect is not affected by ambient light. As can be seen, the introduction of the ambient light interference vector not only improves the stability of the imaging effect but also reduces the impact of ambient light on image quality.

[0095] Furthermore, the attenuation coefficient α controls the degree of influence of the ambient light interference vector on light intensity adjustment. When the ambient light interference is strong, the system will appropriately increase the attenuation coefficient α to reduce the impact of ambient light on the imaging effect; when the ambient light interference is weak, the system will appropriately reduce the attenuation coefficient α to ensure image clarity. It is important to understand that the design of the attenuation coefficient not only improves the stability of the imaging effect, but also optimizes the brightness and contrast of the image. In addition, the system also takes into account the imaging effect under different ambient light interference conditions to ensure the best imaging effect in different environments.

[0096] The benefit of this embodiment is that, by introducing an adaptive optics algorithm, it not only achieves dynamic adjustment of the beam deflection angle but also optimizes the imaging effect based on the ambient light interference vector. The introduction of the ambient light interference vector enables the system to monitor ambient light interference in real time and dynamically adjust the light intensity based on the actual situation, ensuring that the imaging effect is not affected by ambient light.

[0097] Embodiment 9

[0098] To address the issues of fixed imaging structures and limited interaction methods in existing air projection systems, this embodiment provides a dual-screen air projection system. Specifically, this embodiment describes how to achieve 360° rotational imaging using a base and motors, and how to enable real-time interactive control of the dual-screen virtual images through voice recognition, eye tracking, and motion recognition modules, thereby achieving a more flexible and convenient interactive experience.

[0099] Further, if Figure 3 As shown, the rotating structure in this embodiment includes a base 6 and a motor 7, which is used to achieve 360° rotation of the imaging structure. The design of the base and the motor allows the entire imaging structure to rotate freely within a 360° range, thereby achieving a full range of visual range. This design not only expands the user's visual range, but also enhances the user's visual experience. It should be understood that the 360° rotation design allows the user to observe the dual-screen virtual image from any angle without being restricted by a fixed viewing angle, thereby enhancing the flexibility of use. In addition, the design of the base and the motor also takes into account the stability of the vehicle during driving, ensuring that the dual-screen virtual image will not be distorted due to vibration during driving.

[0100] Furthermore, the intelligent interactive control system in this embodiment includes a voice recognition module, an eye tracking module, and a motion recognition module, which are used to perform real-time interactive control of the dual-screen virtual image. The voice recognition module uses voice recognition technology, and the user can control the display content and viewing angle of the dual-screen virtual image through voice commands. The eye tracking module captures the user's eye movements through a camera, and the system automatically adjusts the display content and viewing angle of the dual-screen virtual image according to the user's line of sight. The motion recognition module captures the user's body movements through a camera, and the user can control the display content and viewing angle of the dual-screen virtual image through gestures and other actions. These interaction methods not only improve the user's interactive experience, but also allow the user to interact with the dual-screen virtual image more naturally and conveniently. It can be understood that the introduction of multiple interaction methods not only improves the user's interactive experience, but also allows the user to choose the most suitable interaction method according to different needs, thereby improving the convenience of use.

[0101] Furthermore, the intelligent interactive control system in this embodiment also includes an intelligent angle compensation module. This module incorporates an angle compensation algorithm that dynamically adjusts the angle of the dual-screen virtual images based on the vehicle's driving posture, ensuring that the images are always perpendicular to the user's line of sight. This intelligent angle compensation mechanism not only improves image visibility but also reduces visual fatigue when viewing images in different driving postures.

[0102] The benefits of this embodiment lie in its ability to achieve 360° rotation through the introduction of a base and motor, expanding the user's visual range. The introduction of an intelligent interactive control system allows users to interact with the dual-screen virtual images more naturally and conveniently, enhancing ease of use. The introduction of an intelligent angle compensation module ensures that the image is always perpendicular to the user's line of sight, further enhancing the user's visual experience.

[0103] Example 10

[0104] To address the issue of existing automotive display devices displaying a single display content and failing to dynamically adjust content based on driving conditions and user needs, this embodiment provides a display controller and safety detection module for a dual-screen air projection system. Specifically, this embodiment describes how the display controller switches and adjusts the display content of the dual-screen virtual image based on driving conditions and user needs, while the safety detection module monitors the driving environment in real time to prevent interference with driving safety caused by the dual-screen virtual image.

[0105] Furthermore, the display controller in this embodiment includes a user preference learning module and a dynamic environment adaptation module. The user preference learning module analyzes the user's historical operation data through a machine learning algorithm to adjust the display content and interaction method of the dual-screen virtual image. Specifically, the user preference learning module can identify the user's preferences and habits by learning the user's operation data, so that the user's needs can be predicted in advance when the user operates next time, and the display content and interaction method can be automatically adjusted. For example, when the user often checks the navigation information while driving, the system will automatically display the navigation interface when the user starts the vehicle, reducing the number of manual operations of the user. It can be understood that the user preference learning module not only improves the user's operating efficiency, but also enables the system to better adapt to the usage habits of different users.

[0106] Furthermore, the dynamic environment adaptation module adjusts the display parameters of the dual-screen virtual image in real time according to the vehicle's speed, road conditions and weather conditions to ensure the best visual effect. Specifically, the dynamic environment adaptation module can dynamically adjust the brightness, contrast, color and other parameters of the display content according to actual conditions by monitoring the vehicle's speed, road conditions and weather conditions in real time, ensuring that users can obtain the best visual effect in different driving environments. For example, when driving at night, the system will reduce the brightness of the display content to avoid glare from affecting the driver's vision; when driving during the day, the system will appropriately increase the brightness of the display content to ensure that users can clearly see the display content. It should be understood that the design of the dynamic environment adaptation module not only improves the visibility of the display content, but also reduces the impact of environmental factors on the display effect.

[0107] Furthermore, the safety detection module in this embodiment is used to monitor the driving environment in real time to prevent the dual-screen virtual image from interfering with driving safety. Specifically, the safety detection module uses sensors and cameras to monitor various information in the driving environment in real time, such as traffic conditions, road signs and weather conditions around the vehicle. When a potential safety hazard is detected, the system will automatically adjust the display content of the dual-screen virtual image to avoid distracting the driver. For example, when the vehicle approaches an intersection, the system will automatically hide unnecessary display content to ensure that the driver can focus on driving operations. It can be understood that the design of the safety detection module not only improves driving safety, but also reduces the interference of the dual-screen virtual image on driving operations.

[0108] The benefits of this embodiment lie in the fact that, by introducing a user preference learning module and a dynamic environment adaptation module, it not only dynamically adjusts the display content of the dual-screen virtual image based on driving status and user needs, but also ensures driving safety through the safety detection module. The user preference learning module, by learning user operation data, can predict user needs in advance and automatically adjust the display content and interaction mode, thereby improving user operation efficiency. The dynamic environment adaptation module adjusts display parameters in real time based on vehicle speed, road conditions, and weather conditions, ensuring that users receive optimal visual effects in different driving environments. The safety detection module, by monitoring the driving environment in real time, prevents interference from the dual-screen virtual image, thereby improving driving safety.

[0109] The above embodiments further illustrate the objectives, technical solutions and beneficial effects of the present invention. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made on the basis of the technical solutions of the present invention should be included in the scope of protection of the present invention.

Claims

1. A dual-screen air projection method, characterized in that: The steps of the method include: A first image light beam is generated by a first image generation source (3), wherein the first image generation source comprises a silicon-based liquid crystal chip, a digital light processing chip or a thin film transistor liquid crystal display screen, and the first image light beam contains image information; The first image light beam is shaped by a plane reflector (2) located on the light beam propagation path of the first image generation source (3), wherein the light incident surface of the plane reflector (2) is coated with a semi-transparent semi-reflective film or a CMF film, and the light exit surface is coated with an anti-reflection film, so that the first image light beam forms a virtual image (4) in the air at a preset position after reflection; A second image generating source (5) is placed at a suitable position for forming the virtual image (4), wherein the second image generating source (5) emits a second image light beam, which passes through the plane reflector (2) and is emitted into the air, and is superimposed with the first image light beam to form a double-screen virtual image; A base (6) and a motor (7) are added below the imaging structure to form a rotating structure for 360-degree rotation of the imaging structure to obtain a full range of visual range; Real-time interactive control of the dual-screen virtual image is performed through intelligent voice, eye tracking or motion recognition systems to flexibly adjust display content and viewing angles as needed; The rotating structure also includes an intelligent angle compensation module with a built-in angle compensation algorithm for dynamically adjusting the angle of the dual-screen virtual image according to the vehicle's driving posture to ensure that the image is always perpendicular to the user's line of sight. The expression of the angle compensation algorithm is: Among them, θ comp Represents the attitude angle after compensation, θ vehicle represents the vehicle's attitude angle, v represents the vehicle's speed, and v ref represents the reference speed threshold, Δθ represents the compensation angle; The step of performing real-time interactive control of the dual-screen virtual image by intelligent voice, eye tracking or motion recognition system includes: Real-time data analysis and interaction through voice recognition module, eye tracking module and action recognition module; The behavior prediction module is used to predict the user's operation intention in advance based on the user's historical operation habits. The behavior prediction module has a built-in behavior prediction algorithm; The steps of the behavior prediction algorithm include: Collect users' historical operation data and build a user behavior database; Using a deep neural network model to train the user behavior database to obtain a user behavior prediction model, wherein the input of the user behavior prediction model is the user's current operation state, and the output is the user's expected operation probability distribution; According to the probability distribution of the user's expected operation, the user's next operation is calculated. The expression is: Among them, P next Indicates the next step, P i represents the probability of the i-th operation, w i represents the weight coefficient of the i-th operation, t represents the current time, t i represents the timestamp of the i-th operation, σ i Indicates time deviation; The behavior prediction algorithm also includes a multimodal fusion module for analyzing the user's voice, gestures, and eye movements to improve the accuracy of the prediction. The expression of multimodal fusion is: Among them, ω j represents the weight of the jth time window, t j represents the timestamp of the jth time window, σ j Indicates the time deviation, P voice 、P gesture and P eye denote the probabilities of speech, gesture and eye movement respectively, α j ,β j ,γ j Represent the weight coefficients of speech, gesture and eye movement respectively.

2. The dual-screen air projection method according to claim 1, wherein: The first image generation source (3) generates the first image beam through a micro-projection module, and the micro-projection module includes a light homogenizer, which is a reflective or transmissive type to ensure that the image enters the eyeball softly and avoids glare caused by the LED imaging in the eyeball; The micro-projection module further includes a Fresnel lens or a DOE lens, which is located between the illumination light path and the light homogenizer to improve the brightness and uniformity of the image; The micro-projection module further includes an adaptive light intensity adjustment module having a built-in first adjustment algorithm for adjusting the light intensity of the first image beam in real time according to the ambient light intensity. The expression of the first adjustment algorithm is: Among them, I out Indicates the adjusted light intensity, I in Indicates the initial light intensity, L env Indicates the ambient light intensity, L ref Indicates the reference light intensity threshold.

3. The dual-screen air projection method according to claim 1, wherein: The light incident surface of the plane reflector (2) is coated with a CMF film, which is used to reduce the light loss of the first image light beam during the reflection process; The light-emitting surface of the plane reflector (2) is coated with an anti-reflection film for reducing the reflectivity of light, thereby ensuring that more light can pass through the plane reflector (2) to improve the brightness and clarity of the image; The light entrance surface and the light exit surface of the plane reflector (2) are further provided with polarization control layers for controlling the polarization state of the first image light beam to improve the contrast and clarity of the virtual image (4); The polarization control layer further includes an adaptive polarization adjustment module having a built-in second adjustment algorithm for adjusting the polarization state of the first image light beam in real time according to the polarization characteristics of the ambient light. The expression of the second adjustment algorithm is: Among them, P out represents the initial polarization state, P in represents the initial polarization state, P env Represents the polarization characteristics of ambient light, P ref represents the reference polarization threshold, and ΔP represents the polarization adjustment amplitude.

4. The dual-screen air projection method according to claim 1, wherein: The second image generation source (5) adopts a DLP projection, an LCOS projection module or a laser projection module, and the image information of the second image generation source (5) complements the image information of the first image generation source (3), and together constitutes a complete 3D effect; The intensity and angle of the beam of the second image generating source (5) are dynamically adjusted according to demand to adapt to different driving environments and user preferences; The light beam generated by the second image generation source (5) undergoes secondary shaping processing by the plane reflector (2), and the second image light beam is superimposed on the first image light beam to form a seamless dual-screen virtual image. The secondary shaping processing includes finely adjusting the angle, intensity and color of the second image light beam. The expression for the fine adjustment is: I final =α·I1+(1-α)·I2, where I1 and I2 represent the intensities of the first image light beam and the second image light beam, respectively, and α is an adjustment coefficient between 0 and 1; The color adjustment module has a built-in color temperature adaptive algorithm for adjusting the color of the second image light beam in real time according to the color temperature of the ambient light. The expression of the color temperature adaptive algorithm is: Among them, C in Indicates the initial color, T env Indicates the color temperature of the ambient light, T ref represents the reference color temperature threshold, and ΔC represents the color adjustment amplitude.

5. The dual-screen air projection method according to claim 1, wherein: The light incident surface of the plane reflector (2) is coated with a semi-transparent and semi-reflective film, and the transmittance and reflectance of the semi-transparent and semi-reflective film are adaptively adjusted according to the intensity of ambient light to enhance the imaging effect under different lighting conditions; The adjustment mechanism of the translucent and semi-reflective film is based on data from an ambient light sensor, which monitors the ambient light intensity in real time and adjusts the transmittance and reflectance of the translucent and semi-reflective film through a feedback control system; The ambient light sensor also includes a spectrum analysis module, which analyzes the spectral characteristics of the ambient light to optimize the adjustment strategy of the semi-transparent and semi-reflective film. The expression of the spectrum analysis is: Where I(λ) represents the intensity of ambient light at wavelength λ, avg represents the average wavelength, σ λ Indicates wavelength deviation.

6. The dual-screen air projection method according to claim 5, wherein: The method further includes an adaptive optics algorithm that satisfies the following constraints: Where I0 is the initial light intensity, L is the optical path function, θn is the deflection angle of the nth beam, and E env is the ambient light interference vector, and α is the attenuation coefficient.

7. A dual-screen air projection system, used to implement the dual-screen air projection method according to any one of claims 1 to 6, characterized in that: The projection system comprises: a first image generating source (3) for emitting a first image light beam; a plane reflective mirror (2), located on a beam propagation path of the first image generating source (3), for shaping the first image beam and forming a virtual image (4) in the air; a second image generating source (5) for emitting a second image light beam, the second image light beam passing through the plane reflector (2) and superimposed with the first image light beam to form a dual-screen virtual image; The rotating structure comprises a base (6) and a motor (7) for achieving 360° rotating imaging; The intelligent interactive control system includes a voice recognition module, an eye tracking module and a motion recognition module, and is used for real-time interactive control of the dual-screen virtual images.

8. An automobile display device comprising the dual-screen air projection system according to claim 7, characterized in that: The display device further includes: A display controller, configured to switch and adjust the display content of the dual-screen virtual image according to driving status and user needs; A safety detection module, used to monitor the driving environment in real time to prevent the dual-screen virtual image from interfering with driving safety; The display controller includes: A user preference learning module that analyzes the user's historical operation data through a machine learning algorithm to adjust the display content and interaction mode of the dual-screen virtual image; The dynamic environment adaptation module adjusts the display parameters of the dual-screen virtual image in real time according to the vehicle's speed, road conditions and weather conditions to ensure the best visual effect.

Images