Display system with virtual image touch interaction function

Abstract

This invention provides a display system with virtual image touch interaction function, comprising an image source module, an optical imaging module, a touch sensing module, a mapping control module, and a housing. The image source module displays image content from an external smart terminal. The optical imaging module is disposed on the light-emitting side of the image source module and is used to reflect or refract light from the image source module through an optical path to form a distant image. The touch sensing module is disposed on the outgoing light path of the optical imaging module and is used to detect the user's touch position. The mapping control module is electrically connected to both the touch sensing module and the image source module and is used to establish the correspondence between the touch position and the coordinates of the distant virtual image. The housing is used to fix each module and limit the relative position of the optical system. This invention, through the combination of a touch-sensing interface, a light reverse mapping algorithm, and a distant image optical imaging system, achieves complete visual consistency between the user's operation on the touchpad and the position of the virtual image.

Description

Technical Field

[0001] This invention relates to the field of optical display and human-computer interaction technology, specifically to a display system with virtual image touch interaction function. Background Technology

[0002] With the widespread use of mobile devices (such as children's smartwatches, smartphones, and tablets), users, especially teenagers, spend long periods of time staring at small screens at close range. This causes the visual accommodation and convergence systems to be under constant stress, easily leading to visual health problems such as eye fatigue, dry eye, and myopia. According to the "Guidelines for Myopia Prevention and Control of the Ophthalmology Branch of the Chinese Medical Association" (2022), continuous close-range eye use has become one of the main reasons for the rising incidence of myopia in children and adolescents.

[0003] To alleviate the visual burden of near-field displays, academia and industry have proposed a series of far-image imaging display technologies. Typical solutions include:

[0004] (1) Head-Up Display (HUD) structure based on optical reflection: By combining optical mirrors with semi-transparent and semi-reflective mirrors, the virtual image is projected to a distance, realizing the imaging method of "parallel line of sight observation". For example, the paper "Applied Optics, 2019, 58(25): 6784–6793" reported a vehicle-mounted birdbath optical path HUD structure that can image at a distance of 1.5–2 m.

[0005] (2) Near-eye waveguide display technology (Diffractive or Reflective Waveguide Display): The display image is expanded by diffraction or reflection couplers and output to the far image plane, such as the Microsoft HoloLens series devices (US 2017 / 0174552 A1) and the Magic Leap One system (US 2019 / 0300283 A1).

[0006] However, the above technologies still have the following obvious shortcomings:

[0007] (1) Complex structure and large size: Existing HUD or optical waveguide systems are mostly multi-layer optical combination structures, which are difficult to integrate into portable or wearable devices and are not suitable for children's use scenarios.

[0008] (2) Lack of human-computer interaction capability: Traditional far-view display only provides one-way visual output, and users cannot directly interact with the virtual image content through touch or spatial gestures; if an additional camera or infrared sensing module is used, the power consumption and cost will increase significantly.

[0009] (3) Inconsistent mapping relationship leads to poor interactive experience: If a touchpad is simply superimposed in front of the display screen, the user's touch coordinates and the coordinates of the distant image display are not consistent, and it is impossible to achieve spatial matching of "point on virtual image" visually, resulting in touch positioning deviation and making it difficult to form an immersive operating experience.

[0010] (4) Limited eye protection effect: Although some devices have the function of displaying distant images, the display brightness, light field uniformity and image source resolution are limited. It is still necessary to maintain a relatively close viewing distance to distinguish the content, which weakens the actual effect of eye protection of distant images.

[0011] Therefore, existing technologies lack an optical system that can achieve high-quality far-view display in a compact optical structure while also possessing real touch mapping interaction capabilities. Summary of the Invention

[0012] To address the technical problems of existing far-image display devices and near-eye display systems, such as complex structures, lack of interactive capabilities, inconsistent touch mapping, and limited eye protection effects, this invention proposes a display system with virtual image touch interaction functionality. By setting a touch-sensing interface in front of the far-image optical system and combining it with a reverse mapping calculation method based on light propagation, it achieves a precise correspondence between the touch position and the virtual image display coordinates. This allows users to directly touch the virtual image visually. While maintaining a compact optical structure and far-image imaging effect, it effectively improves the consistency of display interaction and visual comfort, achieving a low-power, lightweight, wearable, eye-protection display and spatial interaction integrated design.

[0013] To solve the above-mentioned technical problems, the present invention provides a display system with virtual image touch interaction function, which includes an image source module, an optical imaging module, a touch sensing module, a mapping control module and a shell;

[0014] The image source module and the specific optical path structure formed in the optical imaging module together constitute an optical imaging system; the image source module is used to display image content from an external smart terminal; the optical imaging module is located on the light-emitting side of the image source module and is used to reflect or refract the light from the image source module through an optical path to form a distant image;

[0015] The touch sensing module is positioned in front of the optical imaging module along the outgoing light path. It is used to detect the user's touch position and map it to the virtual image position. When the user touches the interface of the touch sensing module, the touch mapping control program running in the mapping control module receives the touch coordinate signal output by the touch sensing module. Based on the optical path parameters, geometric layout relationship, and pre-calibrated mapping model of the optical imaging module, it performs inverse mapping calculation on the touch coordinates to obtain the corresponding far-image virtual image plane coordinates. Then, it generates control commands and sends them to the image source module to realize interactive control of the virtual image content.

[0016] The mapping control module is electrically connected to the touch sensing module and the image source module respectively, and is used to establish the correspondence between the touch position and the coordinates of the far-field virtual image;

[0017] The image source module, optical imaging module, touch sensing module, and mapping control module are fixed inside the housing by a support structure; an optical system is also fixed inside the housing by a support structure.

[0018] The optical system includes an image generation unit, a viewing window unit, and an image magnification unit; the image generation unit emits image light into the viewing window unit, the viewing window unit reflects the image light from the image generation unit to the image magnification unit; the image magnification unit reflects the image light from the viewing window unit to the viewing window unit, and the viewing window unit transmits the image light from the image magnification unit to the location of the human eye.

[0019] As a preferred embodiment of the present invention: the image source module is a liquid crystal display screen, an organic light-emitting diode display screen, or a miniature light-emitting diode display screen; the image source module is connected to the terminal device via Bluetooth or other wireless communication methods to receive and update display data in real time.

[0020] The optical imaging module includes at least one mirror element and a partially transmissive and reflective optical element. Through optical path design, the image source image is imaged on a predetermined far image plane, thereby enabling the user to view virtual image content at a distance.

[0021] The touch sensing module uses a transparent capacitive touch panel or an optical infrared touch layer with a light transmittance of over 85%, ensuring that it will not significantly affect the display brightness and clarity.

[0022] The optical path design controls the propagation path of light by rationally arranging the relative positions and angles of the reflective mirror elements and some transmissive and reflective optical elements. The specific process is as follows: the reflective mirror elements reflect the light from the image source module, and by accurately calculating their reflection angle and shape, ensure that the light can be correctly transmitted to the partially transmissive and reflective optical elements; the partially transmissive and reflective optical elements, according to their transmittance and reflectance, partially transmit the light and reflect it to a predetermined distant image plane, thereby forming a clear virtual image at a distance.

[0023] As a preferred embodiment of the present invention: the mapping control module calculates the reflection and refraction angles of light in the optical path using an optical inverse mapping algorithm based on the light propagation model and preset geometric parameters, calculates the corresponding area of ​​the touch point in the virtual image plane, and outputs control commands to the image source module to realize interactive control of the virtual image content;

[0024] The mapping control module establishes a precise correspondence model between touch coordinates and virtual image coordinates through factory calibration. Specifically, the system is calibrated during production using precision equipment following a pre-defined standard procedure. First, the touch sensing module is mapped to a target point at a known location on the virtual image plane. Then, based on the geometric parameters of the optical system, the mapping relationship between the touch point and the virtual image position is calculated. Next, by precisely measuring the deviation between the touch surface and the virtual image, a precise mathematical model is established to ensure that each touch coordinate corresponds one-to-one with the virtual image coordinate.

[0025] Alternatively, the mapping control module establishes a precise correspondence model between touch coordinates and virtual image coordinates through user self-calibration. Specifically, during the use of the display system, adjustments are made manually by the user, including guiding the user to click specific calibration points on the touch sensing module. The touch mapping control program loaded and running in the mapping control module captures the positions of these click points and calculates the difference between the touch coordinates and virtual image coordinates in real time based on the known virtual image coordinates, thereby dynamically adjusting the mapping model.

[0026] As a preferred embodiment of the present invention: the touch mapping control program includes a human-computer interaction guidance program module for guiding the calibration process, a touch acquisition program module for collecting touch data, a reverse mapping calculation program module for performing mapping calculations, and a mapping model update program module for updating and storing mapping relationships.

[0027] The human-computer interaction guidance module is used to display preset virtual image correction marks on the image source module and prompt the user to perform corresponding click operations on the touch sensing module;

[0028] The touch acquisition module is used to receive the touch coordinate information output by the touch sensing module;

[0029] The reverse mapping calculation module performs difference calculation and fitting operations on the acquired touch coordinates and known virtual image coordinates based on the optical path geometric parameters of the optical imaging module and a predefined optical model.

[0030] The mapping model update program module is used to dynamically correct the mapping model parameters between touch coordinates and virtual image coordinates based on the difference calculation results and store them in the storage unit of the mapping control module, thereby realizing real-time adjustment and optimization of the mapping relationship during the user's manual correction process.

[0031] As a preferred embodiment of the present invention, the specific process of calculating and fitting the difference between the acquired touch coordinates and the known virtual image coordinates is as follows:

[0032] Light is emitted from the image source module, reflected by the mirror element, and reaches the partially transmissive and reflective optical element. Part of the light is transmitted and forms a distant virtual image, which is ultimately received by the observer's eye. The touch sensing module is located before the light path on the outgoing side of the image source module and is used to detect the user's touch position.

[0033] Let the outgoing direction vector of the ray on the virtual image plane be... After being reflected by the aforementioned partial transmission and reflection optical elements, the direction is... The reflection normal vector at the reflector element is Then the direction of reflection satisfies the law of reflection:

[0034] ;

[0035] The point of reflection of light on the mirror element From virtual image points Determined by the direction of reflection:

[0036] ;

[0037] Combining the mirror equation Find the location of the intersection point;

[0038] Light from After reflection, it continues to propagate, intersecting with the plane of the touch sensing module. Intersection, obtaining the coordinates of the touch point :

[0039] ;

[0040] After discretizing the above equation, the corresponding function between the touch coordinates and the virtual image coordinates can be obtained through system calibration or simulation fitting.

[0041] ;

[0042] After inverse solving, the inverse calculation model function for the virtual image plane coordinates is obtained:

[0043] ;

[0044] The aforementioned inverse calculation model function can be implemented using a polynomial or neural network fitting model, specifically as follows:

[0045] ;

[0046] In the above formula, These are the mapping coefficients obtained through calibration;

[0047] The touch sensing module first collects the user's touch coordinates on the touch interface in real time. The mapping control module uses a preset inverse mapping function. Calculate the corresponding coordinates of the touch point on the distant virtual image plane. Subsequently, the display system converts the virtual image coordinates into control signals and transmits them to the image source module to drive corresponding changes in the displayed content, enabling the user to directly control the virtual image.

[0048] As a preferred embodiment of the present invention, the display system further includes a brightness adjustment unit, an ambient light sensor, and a display module to automatically optimize the imaging brightness and contrast according to external light.

[0049] The ambient light sensor is mounted on the housing and faces the external environment to detect the light intensity of the surrounding environment in real time. It is responsible for sensing changes in ambient light, capturing the intensity, direction, and possible changes in the light source, and providing the necessary data input to the brightness adjustment unit.

[0050] The display module is mounted on the outside of one side of the housing; the brightness adjustment unit is connected between the ambient light sensor and the display module, and automatically adjusts the brightness and contrast of the display module according to the illumination data provided by the ambient light sensor.

[0051] As a preferred embodiment of the present invention: the mapping control module introduces an optical reverse mapping algorithm to achieve spatial consistency between the touch position and the virtual image position; the optical reverse mapping algorithm is based on the geometric model of light propagation, uses the law of reflection and the calibration parameters of the optical imaging system to establish a mapping relationship between the coordinates of the touch surface and the coordinates of the virtual image plane, and calculates the corresponding position of the touch point on the virtual image plane by calculating the light propagation path of the touch point in the optical system.

[0052] As a preferred embodiment of the present invention, the modeling principle of the optical inverse mapping algorithm is as follows:

[0053] Light is emitted from the image source module, reflected by the free reflector element, and reaches the partially transmissive and reflective optical element. Part of the light is transmitted and forms a distant virtual image, which is finally received by the observer's eye. The touch sensing module is located before the output light path of the display system, i.e., at the front end of the optical imaging module, and is used to detect the user's touch position.

[0054] Let the outgoing direction vector of the ray on the virtual image plane be... After being reflected by the aforementioned partial transmission and reflection optical elements, the direction is... The reflection normal vector at the reflector element is Then the direction of reflection satisfies the law of reflection:

[0055] ;

[0056] The point of reflection of light on the mirror element Can be derived from virtual image points Determined by the direction of reflection:

[0057] ;

[0058] Combining the equations of the aforementioned mirror element The position of the intersection point between the light ray and the reflector element is determined;

[0059] Light from After reflection, it continues to propagate, intersecting with the plane of the touch sensing module. Intersection, obtaining the coordinates of the touch point :

[0060] ;

[0061] After discretizing the above equation, the corresponding function between the touch coordinates and the virtual image coordinates is obtained through calibration or simulation fitting of the display system:

[0062] ;

[0063] After inverse solving, the inverse calculation model of the virtual image plane coordinates is obtained:

[0064] .

[0065] In a preferred embodiment of the present invention, the correspondence function between the touch coordinates and the virtual image coordinates is implemented by a polynomial or neural network fitting model, and the correspondence function between the touch coordinates and the virtual image coordinates is expressed by a polynomial of the following form:

[0066] ;

[0067] The above formula is used to control touch coordinates. Calculate the corresponding coordinates on the virtual image plane. This achieves a precise mapping between touch coordinates and virtual image coordinates; in the above formula These are the mapping coefficients obtained through system calibration or experimental measurement.

[0068] As a preferred embodiment of the present invention, the specific process of realizing interactive control of virtual image content is as follows: when the user touches the touch interface of the touch sensing module, the touch sensing module collects the user's touch coordinates in real time. and touch coordinates The data is passed to the mapping control module; the mapping control module then uses a preset inverse mapping function. Calculate the corresponding coordinates of the touch coordinates on the virtual image plane. The inverse mapping function, based on the geometric relationship of the optical system, accurately converts the coordinates on the touch sensing module into positions on the virtual image plane; the touch sensing module collects the user's touch coordinates on its touch interface in real time. Then, through the mapping control module, the coordinates on the virtual image plane corresponding to the touch coordinates are calculated according to the optical inverse mapping algorithm loaded and running in the mapping control module in the form of program code. The position of the virtual image is then converted into a control signal and transmitted to the image source module. The image source module adjusts the display content according to the received control signal, thereby enabling the user to directly control the virtual image. The user's operation on the touch interface of the touch sensing module can be instantly reflected in the virtual image, achieving an interactive effect.

[0069] As a preferred embodiment of the present invention: the outer shell is made of lightweight material; the far-image distance of the optical imaging module is set to 2.5m.

[0070] By adopting the above technical solution, the present invention has the following beneficial effects:

[0071] This invention enables information interconnection with children's smartwatches, smartphones, and other smart terminals via Bluetooth or other wireless communication methods. Through an optical imaging system, it reconstructs the terminal's displayed content onto a distant field of view, allowing the observer to perceive a high-resolution virtual image at a comfortable viewing distance. Spatial interactive operations aligned with the virtual image's position can be achieved through a front-facing touch interface. This invention can be widely applied in children's wearable devices, eye-protection display extension systems for mobile terminals, and healthy visual interactive display platforms. It can significantly reduce the focusing burden on the human eye, alleviate visual fatigue, and effectively reduce the risk of myopia in adolescents with long-term use.

[0072] This invention aims to achieve a precise correspondence between the touch position and the coordinates of the virtual image display by setting a touch-sensitive interface in front of the far-image optical system and combining it with a reverse mapping calculation method for light propagation. This allows users to directly interact with the virtual image visually. While maintaining a compact optical structure and far-image imaging effect, this invention effectively improves display interaction consistency and visual comfort, achieving a low-power, lightweight, wearable, eye-protecting display and spatial interaction integrated design.

[0073] By setting a touch sensing module in front of the far-image optical system and combining it with the reverse mapping algorithm of light propagation, a precise mapping relationship between the user's touch position and the coordinates of the virtual image is established, thereby achieving an eye-protecting display interaction experience that is consistent in visual and tactile space.

[0074] This invention achieves information interconnection with smart terminals such as children's smartwatches and smartphones via Bluetooth or other wireless communication methods. It utilizes an optical imaging system to reconstruct the terminal's displayed content into a distant virtual image, allowing the observer to perceive a high-resolution virtual image at a comfortable viewing distance. Users can not only view the virtual image at a comfortable viewing distance but also perform spatial interactive operations aligned with the virtual image's position through a front-facing touch interface. Compared to traditional near-eye display systems, this invention significantly reduces the focusing burden on the human eye while providing virtual image display, alleviating visual fatigue caused by prolonged close-range eye use. It is particularly suitable for daily use by children and adolescents, effectively reducing eye accommodation pressure and helping to prevent myopia in teenagers. Furthermore, this invention has broad application prospects and can be integrated into children's wearable devices, eye-protection display extension systems for mobile terminals, and healthy visual interaction display platforms. Due to its low power consumption, efficient display effect, and precise spatial touch interaction function, this invention not only enhances the user experience but also has good market potential. Long-term use can effectively improve the eye habits of children and adolescents, thereby reducing visual health problems caused by prolonged close-range eye use and providing a safe and comfortable eye-protection display solution.

[0075] Compared with the prior art, this application has the following significant technical effects, which are directly caused by the technical features or produced by the synergistic effect of the technical features, and are an inevitable result of the technical solution, as detailed below:

[0076] (1) Achieve a consistent interactive experience between visual and tactile spaces

[0077] By placing a high-transmittance touch sensing module in front of the far-image optical system and combining it with a reverse mapping algorithm for light propagation, this invention establishes a spatial correspondence between the user's touch position and the virtual image display area. When the user operates on the touch interface, their touch point visually aligns with the position of the far-image virtual image, thus achieving a realistic interactive experience of "clicking wherever you look."

[0078] (2) Compact structure and easy to integrate

[0079] The optical imaging module of this invention adopts a simplified distant image light field imaging structure. Clear distant image projection can be achieved by combining a single reflecting mirror and a semi-transparent reflecting element. It does not require a complex multi-layer optical system or diffraction coupler, making it suitable for integration into children's smartwatches, portable terminals, or eye-protection display accessories.

[0080] (3) Significantly reduces visual accommodation burden and has an eye-protecting effect.

[0081] By optically reconstructing the source image in a distant field of view of 0.5m–2.5m, this invention allows the observer's eye accommodation to be relaxed, effectively reducing eye strain and the risk of myopia caused by prolonged close-range screen viewing, and is especially suitable for scenarios involving the protection of visual health of teenagers.

[0082] (4) Low power consumption and high display efficiency

[0083] By employing a reflective optical structure, this invention avoids the energy loss of optical waveguides and transmission systems, achieving high brightness and contrast with low power consumption; the overall system power consumption does not exceed 1.5 W, making it suitable for battery-powered portable devices.

[0084] (5) High accuracy and fast response speed of interactive mapping

[0085] The mapping control module of this invention is based on a geometric optics inverse model, which can calculate the virtual image coordinates corresponding to the touch point in real time. Combined with wireless communication, it can achieve millisecond-level interactive response, meeting the interactive needs of educational and entertainment content.

[0086] (6) Highly scalable

[0087] The touch mapping model and optical structure of this invention have modular design features, which can be adaptively adjusted according to different terminal sizes and imaging distance parameters. They can also be combined with eye tracking or three-dimensional spatial positioning technology to further improve operation accuracy and immersion.

[0088] This invention is significantly superior to existing technologies in terms of distant image quality, touch mapping accuracy, user interaction experience, and visual health protection. It can achieve efficient eye-protecting spatial interactive display under compact structure and low energy consumption conditions, and has broad application and promotion value.

[0089] This invention achieves a spatial interaction function where the user's visual position is completely consistent with the virtual image when operating on the touchpad by combining a touch-sensitive interface, a light inverse mapping algorithm, and a far-image optical imaging system. Attached Figure Description

[0090] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0091] Figure 1 This is a schematic diagram illustrating the working principle of the display system with virtual image touch interaction function of the present invention. Detailed Implementation

[0092] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0093] The present invention will be further explained below with reference to specific embodiments.

[0094] like Figure 1 As shown, this embodiment provides a display system with virtual image touch interaction function, including image source module 1, optical imaging module 2, touch sensing module 3, mapping control module 4 and shell 5.

[0095] The image source module 1 is a specific display hardware device used to display image content from an external smart terminal (such as a children's smartwatch or a smartphone); the image source module can be a liquid crystal display (LCD), an organic light-emitting diode display (OLED), or a micro-LED display, etc.; the image source module is connected to the terminal device via Bluetooth or other wireless communication methods to receive and update display data in real time.

[0096] The optical imaging module 2 is located on the light-emitting side of the image source module and is used to reflect or refract light from the image source module through an optical path to form a distant image. The optical imaging module includes at least one reflective mirror element and a partially transmissive reflective optical element. Through optical path design, the image source image is imaged on a predetermined distant image plane, allowing the user to view the virtual image content at a distance. The optical path design controls the propagation path of light by rationally arranging the relative positions and angles of the reflective mirror element and the partially transmissive reflective optical element. Specifically, the reflective mirror element (e.g., a freeform mirror) reflects light from the image source module, and by accurately calculating its reflection angle and shape, ensures that the light is correctly transmitted to the partially transmissive reflective optical element (e.g., a semi-transparent mirror). This partially transmissive reflective optical element, based on its transmittance and reflectance, partially transmits the light and reflects it to the predetermined distant image plane, thereby forming a clear virtual image at a distance. The optimization of the optical path not only considers parameters such as the refractive index, reflectivity and focal length of the optical elements, but also takes into account the geometric characteristics of light propagation. By precisely designing the angle and relative position of the reflector elements and some transmission and reflection optical elements, the sharpness and brightness of the final virtual image are ensured, thereby achieving efficient far-image imaging effect.

[0097] The specific optical path structures formed in the image source module 1 and the optical imaging module 2 together constitute the optical imaging system; the calibration parameters of the optical imaging system include the spatial positional relationship of each optical element, the geometric parameters of the reflecting surface, and physical parameters such as the imaging distance of the distant image.

[0098] The touch sensing module 3 is positioned in front of the optical imaging module along the outgoing light path. It detects the user's touch position and maps it to the virtual image position. When the user touches the interface of the touch sensing module 3, the touch mapping control program running in the mapping control module 4 receives the touch coordinate signal output by the touch sensing module 3. Based on the optical path structure parameters, geometric layout, and pre-calibrated mapping model of the optical imaging module 2, it performs inverse mapping calculations on the touch coordinates to obtain the corresponding far-image virtual image plane coordinates. This generates control commands and sends them to the image source module 1 to achieve interactive control of the virtual image content. The touch sensing module 3 can use a transparent capacitive touch panel or an optical infrared touch layer with a transmittance higher than 85%, ensuring that it does not significantly affect display brightness and clarity. It also possesses high response speed and touch accuracy to ensure the precision and smoothness of virtual image interaction.

[0099] The mapping control module 4 is electrically connected to both the touch sensing module 3 and the image source module 2, and is used to establish the correspondence between the touch position and the coordinates of the virtual image. Based on the light propagation model and preset geometric parameters, the mapping control module 4 performs an optical inverse mapping algorithm to calculate the reflection and refraction angles of light in the optical path, calculates the corresponding area of ​​the touch point in the virtual image plane, and outputs control commands to the image source module 1 to realize interactive control of the virtual image content. The mapping control module 4 is control hardware including a processor, a storage unit, and interface circuits. The touch mapping control program is implemented in the form of embedded software or firmware, deployed on the microprocessor or control chip included in the mapping control module 4. By calling the optical parameters and calibration data stored in the storage unit, it calculates and processes the touch signal output by the touch sensing module 3, thereby generating control commands for the image source module 1.

[0100] The image source module 1, optical imaging module 2, touch sensing module 3, and mapping control module 4 are fixed inside the housing 5 by a support structure; the optical system is also fixed inside the housing 5 by a support structure; the housing 5 can be made of lightweight materials, suitable for the structural needs of children's wearable or portable terminals, ensuring comfortable use and good impact resistance.

[0101] The far-image distance of the optical imaging module 2 is set at 2.5m to meet the visual accommodation needs of children in a natural gazing state and reduce eye fatigue. This 2.5m is the optimal value determined during the design process based on human eye comfort and visual accommodation requirements. When designing the optical system, 2.5m was chosen as the ideal far-image distance by comprehensively considering ergonomics and visual health to ensure that the observer's eye accommodation is most relaxed in a natural gazing state, minimizing visual fatigue and the risk of myopia. The optical imaging module 2 consists of optical components such as mirrors and semi-transparent reflective elements.

[0102] The mapping control module 4 can establish a precise correspondence model between touch coordinates and virtual image coordinates through factory calibration or user self-calibration, ensuring the consistency and accuracy of touch mapping.

[0103] The mapping control module 4 establishes a precise correspondence model between touch coordinates and virtual image coordinates through factory calibration. The specific process is as follows: through a preset standard procedure, the system is calibrated during the production process using precision equipment. First, the touch sensing module 3 is mapped to a target point at a known position on the virtual image plane, and the mapping relationship between the touch point and the virtual image position is calculated based on the geometric parameters of the optical system. Then, by accurately measuring the deviation between the touch surface and the virtual image, a precise mathematical model is established to ensure that each touch coordinate corresponds one-to-one with the virtual image coordinate.

[0104] The mapping control module 4 establishes a precise correspondence model between touch coordinates and virtual image coordinates through user self-calibration (by a touch mapping control program running in the mapping control module 4). Specifically, during use of the display system with virtual image touch interaction functionality, adjustments are made manually by the user. This includes guiding the user to click specific calibration points on the touch sensing module 3. The touch mapping control program, loaded and running in the mapping control module 4, captures the positions of these click points and calculates the difference between the touch coordinates and virtual image coordinates in real time based on known virtual image coordinates, thereby dynamically adjusting the mapping model. User self-calibration can be performed not only during initial use but also periodically according to changes in the usage environment to ensure high precision and stability of the touch interaction. Through these two methods, the mapping control module 4 can continuously optimize the mapping relationship between touch coordinates and virtual image coordinates, ensuring an accurate and consistent interactive experience in various usage scenarios.

[0105] The touch mapping control software system, serving as the functional implementation carrier of the mapping control module 4, includes at least the following program functional modules: a human-computer interaction guidance program module for guiding the calibration process, which displays preset virtual image calibration marks on the image source module 1 and prompts the user to perform corresponding click operations on the touch sensing module 3; a touch acquisition program module for collecting touch data, which receives touch coordinate information output by the touch sensing module 3; a reverse mapping calculation program module for performing mapping calculations, which performs difference calculations and fitting operations on the acquired touch coordinates and known virtual image coordinates based on the optical path geometric parameters of the optical imaging module 2 and a predefined optical model; and a mapping model update program module for updating and storing the mapping relationship, which dynamically corrects the mapping model parameters between the touch coordinates and virtual image coordinates according to the difference calculation results and stores them in the storage unit of the mapping control module 4, thereby realizing real-time adjustment and optimization of the mapping relationship during the user's manual calibration process; through the coordinated operation of the above software program functional modules on the hardware carrier of the mapping control module 4, the establishment and dynamic updating of the accurate correspondence between the touch coordinates and virtual image coordinates under the user's self-calibration operation are realized.

[0106] The specific process of calculating the difference and fitting between the collected touch coordinates and the known virtual image coordinates is as follows:

[0107] Light is emitted from the image source module 1, reflected by the mirror element, and reaches the partially transmissive and reflective optical element. Part of the light is transmitted and forms a distant virtual image, which is eventually received by the observer's eye. The touch sensing module 3 is located in front of the light path on the emission side of the image source module 1 and is used to detect the user's touch position.

[0108] Let the outgoing direction vector of the ray on the virtual image plane be... After being reflected by some transmission and reflection optical elements, the direction is... The reflection normal vector at the reflector element is Then the direction of reflection satisfies the law of reflection:

[0109] ;

[0110] The point of reflection of light on the mirror element From virtual image points Determined by the direction of reflection:

[0111] ;

[0112] Combining the mirror equation Find the location of the intersection point;

[0113] Light from After reflection, the light continues to propagate and interacts with the touch sensing module 3 plane. Intersection, obtaining the coordinates of the touch point :

[0114] ;

[0115] After discretizing the above equation, the corresponding function between the touch coordinates and the virtual image coordinates can be obtained through system calibration or simulation fitting.

[0116] ;

[0117] After inverse solving, the inverse calculation model function for the virtual image plane coordinates is obtained:

[0118] ;

[0119] The aforementioned inverse calculation model function can be implemented using a polynomial or neural network fitting model, specifically as follows:

[0120] ;

[0121] In the above formula, These are the mapping coefficients obtained through calibration;

[0122] The touch sensing module 3 first collects the user's touch coordinates on the touch interface in real time. The mapping control module 4 uses a preset inverse mapping function. Calculate the corresponding coordinates of the touch point on the distant virtual image plane. Subsequently, the system converts the virtual image coordinates into control signals and transmits them to the image source module 1 to drive corresponding changes in the displayed content, enabling the user to directly control the virtual image.

[0123] The optical system includes an image generation unit, a viewing window unit, and an image magnification unit; the image generation unit emits image light to the viewing window unit, the viewing window unit reflects the image light from the image generation unit to the image magnification unit; the image magnification unit reflects the image light from the viewing window unit to the viewing window unit, and the viewing window unit transmits the image light from the image magnification unit to the location of the human eye.

[0124] The present invention provides a display system with virtual image touch interaction functionality, which further includes a brightness adjustment unit, an ambient light sensor, and a display module. This system automatically optimizes image brightness and contrast based on external lighting conditions to ensure optimal display performance under different lighting environments. The ambient light sensor is mounted on the housing 5, facing the external environment, to detect the ambient light intensity in real time. It is responsible for sensing changes in ambient light, capturing the intensity, direction, and possible changes in the light source, and providing necessary data input to the brightness adjustment unit. The display module is mounted on the outside of the housing. The brightness adjustment unit is connected between the ambient light sensor and the display module, and automatically adjusts the brightness and contrast of the display module based on the lighting data provided by the ambient light sensor. Specifically, when the ambient light sensor detects a change in light intensity, the brightness adjustment unit automatically adjusts the brightness output of the image source module 1 according to a preset algorithm or adjustment strategy. This allows the display module to maintain good display performance in both strong and low light environments, while avoiding the impact of excessively strong or weak external light on the clarity of the displayed content. The operation of the brightness adjustment unit not only improves the visual comfort of the system but also optimizes the display effect according to different lighting conditions, improves the visibility and contrast of the virtual image, and ensures that users can obtain an ideal viewing experience in various environments. In short, the ambient light sensor and the brightness adjustment unit work together to respond in real time to changes in external light, automatically optimizing the brightness and contrast of the display system of the present invention, thereby providing a more comfortable and clearer visual effect and improving the adaptability and energy efficiency of the display system of the present invention.

[0125] The overall power consumption of this invention is no more than 1.5W, ensuring safety and energy efficiency during long-term use.

[0126] Through the above technical solution, the present invention constructs an optical interactive system that integrates far-view display and spatial touch control. While maintaining a compact structure and high light efficiency output, it realizes real interactive control in virtual image space, providing children and teenagers with a safe, comfortable and healthy visual experience.

[0127] Light rays from the image source are reflected by a freeform mirror and projected onto a transreflective mirror. After partial transmission and reflection, the light forms a distant virtual image. The user's eye is positioned in the direction of the system's output, and the image seen is a magnified distant virtual image plane. The imaging distance is adjustable to approximately 2.5 meters for comfortable viewing at a distance. A high-transmittance touchpad is placed in front of the transreflective mirror to detect the user's touch position. Since the virtual image does not actually exist at the touchpad but is projected onto the distant image plane by the optical system, the coordinates of directly touching the touchpad are not the same as the coordinates of the virtual image.

[0128] To achieve spatial correspondence between vision and touch, the mapping control module 4 introduces an optical inverse mapping algorithm to achieve spatial consistency between the touch position and the virtual image position. This optical inverse mapping algorithm is based on a geometric model of light propagation and uses the law of reflection and the calibration parameters of the optical imaging system to establish a mapping relationship between the coordinates of the touch surface and the coordinates of the virtual image plane. Specifically, the optical inverse mapping algorithm calculates the light propagation path of the touch point in the optical system and reversely calculates the corresponding position of the touch point on the virtual image plane. In this way, it is ensured that when the user operates on the touch sensing module 3, the touch position is highly consistent with the visually perceived virtual image position, thereby achieving accurate virtual image touch interaction.

[0129] The modeling principle of the above optical inverse mapping algorithm is as follows:

[0130] Light is emitted from image source module 1, reflected by a self-reflecting mirror element, and reaches a partially transmissive optical element. Part of the light is transmitted and forms a virtual image, which is ultimately received by the observer's eye. The touch sensing module 3 is located before the outgoing light path of the display system of this invention, i.e., installed at the front end of the optical imaging module 2. (Light is emitted from image source module 1 and passes through the optical imaging module 2 (such as a reflector element and a partially transmissive optical element) to form a virtual image. To ensure that the virtual image can be accurately operated and interacted with by the user, the touch sensing module 3 is installed at the front end of the optical imaging module 2, i.e., before the light finally reaches the observer. This position ensures the stability of the touch sensing module 3.) It can directly sense the user's touch position on the display interface without interfering with the optical imaging process. The touch sensing module 3 is installed "before the outgoing optical path" of the system, meaning that the touch sensing module 3 is at the front of the light propagation path, but still in front of the user's line of sight. After the light is reflected by the optical system, a virtual image is formed, and the touch sensing module 3 is located in front of this optical path to detect the user's touch position; in this way, the spatial consistency between the touch coordinates and the virtual image coordinates can be ensured, and the user's operation when touching the screen will be directly mapped to the virtual image display, thereby achieving accurate virtual image touch interaction.

[0131] Let the outgoing direction vector of the ray on the virtual image plane be... After being reflected by some transmission and reflection optical elements, the direction is... The reflection normal vector at the reflector element is Then the direction of reflection satisfies the law of reflection:

[0132] ;

[0133] The point of reflection of light on the mirror element Can be derived from virtual image points Determined by the direction of reflection:

[0134] ;

[0135] Combined with the equations of the reflecting mirror element (responsible for reflecting light and guiding it to the virtual image plane) Determine the position of the intersection point between the light ray and the mirror element (the reflected light ray originates from the virtual image point). The emitted light, after being reflected by the reflector element, strikes a point on the mirror surface. Intersecting, this point of intersection It is the point of contact between the light and the mirror surface.

[0136] Light from After reflection, it continues to propagate, intersecting with the plane of touch sensing module 3. Intersection, obtaining the coordinates of the touch point :

[0137] ;

[0138] After discretizing the above equation, the corresponding function between the touch coordinates and the virtual image coordinates can be obtained through the display system of this invention (the display system calibration or simulation fitting determines the precise mapping relationship between the touch coordinates and the virtual image coordinates through actual measurement or simulation calculation; through calibration (e.g., using known coordinates of the touch point and the virtual image point) or through simulation calculation model, a function or mapping algorithm can be established to ensure that the position of the touch point on the touch sensing module 3 corresponds precisely to the position in the virtual image plane).

[0139] ;

[0140] After inverse solving, the inverse calculation model of the virtual image plane coordinates is obtained:

[0141] ;

[0142] The correspondence function between the touch coordinates and the virtual image coordinates can be achieved through a polynomial or neural network fitting model. Specifically, the correspondence function between the touch coordinates and the virtual image coordinates can be represented by a polynomial of the following form:

[0143] ;

[0144] The above formula is used to control touch coordinates. Calculate the corresponding coordinates on the virtual image plane. This achieves a precise mapping between touch coordinates and virtual image coordinates; in the above formula These are the mapping coefficients obtained through system calibration or experimental measurement.

[0145] The specific process for implementing interactive control of virtual image content is as follows: when the user touches the touch interface of the touch sensing module 3, the touch sensing module 3 collects the user's touch coordinates in real time. and touch coordinates The data is passed to the mapping control module 4; the mapping control module 4 then performs the mapping according to the preset inverse mapping function. Calculate the corresponding coordinates of the touch coordinates on the virtual image plane. The inverse mapping function, based on the geometric relationship of the optical system, accurately converts the coordinates on the touch sensing module 3 into positions on the virtual image plane.

[0146] The touch sensing module 3 will collect the user's touch coordinates on the touch interface in real time. Then, through the mapping control module 4, the coordinates on the virtual image plane corresponding to the touch coordinates are calculated according to the optical inverse mapping algorithm loaded and running in the mapping control module (4) in the form of program code. The virtual image's position is calculated, and its coordinates are then converted into control signals and transmitted to the image source module 1. The image source module 1 adjusts the displayed content based on the received control signals, enabling direct user control of the virtual image. User actions on the touch interface of the touch sensing module 3 are instantly reflected in the virtual image, achieving an interactive effect. The entire process possesses real-time response and self-correction capabilities, dynamically adjusting light path parameters based on eye position, ambient light, and viewing distance to ensure the accuracy of touch mapping and the stability of the interaction.

[0147] The optical inverse mapping algorithm of this invention boasts comprehensive advantages such as high precision, high real-time performance, high adaptability, and eye-friendly design. Based on the dual constraints of optical geometric models and system calibration, the algorithm can control the matching error between the touch position and the virtual image position to within 1mm. Its computational structure is simple, enabling millisecond-level real-time calculation and response on embedded microprocessors. Simultaneously, the algorithm exhibits good versatility, adapting to various reflective or catadioptric hybrid optical structures and terminal devices of different sizes. Furthermore, by combining it with the principle of far-image imaging, it allows users to complete interactive operations under natural gaze, effectively reducing visual adjustment burden and significantly improving the eye-friendly performance and interactive comfort of the display. Through this optical inverse mapping algorithm, the device of this invention can achieve virtual image touch operation with consistent visual and tactile space within a compact structure. While viewing the far-image screen, users can naturally touch and control icons, videos, or application interfaces within the virtual image, thereby achieving integrated functionality of eye-friendly display and interactive operation.

[0148] This invention achieves a spatial interaction function where the user's visual position is completely consistent with the virtual image position when operating on the touchpad by combining a touch-sensitive interface, a light inverse mapping algorithm, and a far-image optical imaging system.

[0149] This invention has the following features and advantages:

[0150] (1) Far-image light field imaging structure: The optical path is constructed by a mirror and a semi-transparent reflective element to reconstruct the near-display image to a far-image plane of 0.5–2.5m, so as to achieve eye protection display.

[0151] (2) Transparent touch sensing layer: It is set in front of the light path output end, does not affect the imaging quality, and is responsible for collecting the user's touch coordinates.

[0152] (3) Optical inverse mapping algorithm module: Based on the light propagation geometric model, the coordinates of the touch surface are converted into the coordinates of the virtual image plane in real time to complete the "virtual image touch" correspondence.

[0153] (4) Wireless communication and content synchronization mechanism: The image source module communicates with terminals such as smartwatches and mobile phones via Bluetooth to update the displayed content in real time and respond to touch commands.

[0154] (5) Lightweight and low power consumption design: The overall power consumption is less than 1.5W, which can be integrated into children's wearable devices or desktop eye protection terminals.

[0155] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A display system with virtual image touch interaction function, characterized in that: The display system includes an image source module (1), an optical imaging module (2), a touch sensing module (3), a mapping control module (4), and a housing (5); The image source module (1) and the specific optical path structure formed in the optical imaging module (2) together constitute an optical imaging system; the image source module (1) is used to display image content from an external smart terminal; the optical imaging module (2) is located on the light-emitting side of the image source module (1) and is used to reflect or refract the light from the image source module (1) through an optical path to form a distant image; The touch sensing module (3) is located on the outgoing light path in front of the optical imaging module (2) to detect the user's touch position and map it to the virtual image position. When the user touches the interface of the touch sensing module (3), the touch mapping control program running in the mapping control module (4) receives the touch coordinate signal output by the touch sensing module (3) and performs reverse mapping calculation on the touch coordinate based on the optical path parameters, geometric layout relationship and pre-calibrated mapping model of the optical imaging module (2) to obtain the corresponding far-image virtual image plane coordinates, and then generates control commands and sends them to the image source module (1) to realize interactive control of the virtual image content. The mapping control module (4) is electrically connected to the touch sensing module (3) and the image source module (2) respectively, and is used to establish the correspondence between the touch position and the coordinates of the far image virtual image; The image source module (1), optical imaging module (2), touch sensing module (3) and mapping control module (4) are fixed inside the housing (5) by a support structure; an optical system is also fixed inside the housing (5) by a support structure. The optical system includes an image generation unit, a viewing window unit, and an image magnification unit; the image generation unit emits image light into the viewing window unit, the viewing window unit reflects the image light from the image generation unit to the image magnification unit; the image magnification unit reflects the image light from the viewing window unit to the viewing window unit, and the viewing window unit transmits the image light from the image magnification unit to the location of the human eye.

2. The display system with virtual image touch interaction function according to claim 1, characterized in that: The image source module (1) is a liquid crystal display screen, an organic light-emitting diode display screen, or a miniature light-emitting diode display screen; the image source module (1) is connected to the terminal device via Bluetooth or other wireless communication methods to receive and update display data in real time; The optical imaging module (2) includes at least one mirror element and a partially transmissive and reflective optical element. Through optical path design, the image source image is imaged on a predetermined far image plane, thereby enabling the user to view virtual image content at a distance. The touch sensing module (3) adopts a transparent capacitive touch panel or an optical infrared touch layer with a light transmittance of more than 85%, ensuring that it will not significantly affect the display brightness and clarity. The optical path design controls the propagation path of light by rationally arranging the relative positions and angles of the mirror elements and the partial transmission and reflection optical elements. The specific process is as follows: the mirror elements reflect the light from the image source module (1), and by accurately calculating its reflection angle and shape, ensure that the light can be correctly transmitted to the partial transmission and reflection optical elements; the partial transmission and reflection optical elements, according to their transmittance and reflectance, partially transmit the light and reflect it to the predetermined far image plane, thereby forming a clear virtual image at a distance.

3. The display system with virtual image touch interaction function according to claim 2, characterized in that: The mapping control module (4) calculates the reflection and refraction angles of light in the optical path using an optical inverse mapping algorithm based on the light propagation model and preset geometric parameters, calculates the corresponding area of ​​the touch point in the virtual image plane, and outputs control commands to the image source module (1) to realize interactive control of the virtual image content. The mapping control module (4) establishes a precise correspondence model between the touch coordinates and the virtual image coordinates through factory calibration. The specific process is as follows: through a preset standard procedure, the system is calibrated using precision equipment during the production process. That is, the touch sensing module (3) is first matched with the target point at a known position on the virtual image plane, and the mapping relationship between the touch point and the virtual image position is calculated based on the geometric parameters of the optical system. Then, by accurately measuring the deviation between the touch surface and the virtual image, a precise mathematical model is established to ensure that each touch coordinate can correspond one-to-one with the virtual image coordinate. Alternatively, the mapping control module (4) establishes a precise correspondence model between touch coordinates and virtual image coordinates through user self-calibration. The specific process is as follows: during the use of the display system, the user manually adjusts the system, and the specific operation includes guiding the user to click on specific calibration points on the touch sensing module (3). The touch mapping control program loaded and running in the mapping control module (4) captures the position of these click points and calculates the difference between touch coordinates and virtual image coordinates in real time based on the known virtual image coordinates, thereby dynamically adjusting the mapping model.

4. The display system with virtual image touch interaction function according to claim 3, characterized in that: The touch mapping control program includes a human-computer interaction guidance program module for guiding the calibration process, a touch acquisition program module for collecting touch data, a reverse mapping calculation program module for performing mapping calculations, and a mapping model update program module for updating and storing mapping relationships. The human-computer interaction guidance module is used to display a preset virtual image correction mark on the image source module (1) and prompt the user to perform a corresponding click operation on the touch sensing module (3); The touch acquisition program module is used to receive the touch coordinate information output by the touch sensing module (3); The reverse mapping calculation program module performs difference calculation and fitting operation on the collected touch coordinates and known virtual image coordinates based on the optical path geometric parameters of the optical imaging module (2) and the predefined optical model. The mapping model update program module is used to dynamically correct the mapping model parameters between the touch coordinates and the virtual image coordinates according to the difference calculation results and store them in the storage unit of the mapping control module (4), so as to realize the real-time adjustment and optimization of the mapping relationship during the user's manual correction process.

5. The display system with virtual image touch interaction function according to claim 4, characterized in that, The specific process of calculating and fitting the difference between the acquired touch coordinates and the known virtual image coordinates is as follows: Light is emitted from the image source module (1), reflected by the mirror element, and reaches the partially transmissive and reflective optical element. Part of the light is transmitted and forms a distant virtual image, which is finally received by the observer's eye. The touch sensing module (3) is located before the light path on the emission side of the image source module (1) and is used to detect the user's touch position. Let the outgoing direction vector of the ray on the virtual image plane be... After being reflected by the aforementioned partial transmission and reflection optical elements, the direction is... The reflection normal vector at the reflector element is Then the direction of reflection satisfies the law of reflection: ； The point of reflection of light on the mirror element From virtual image points Determined by the direction of reflection: ； Combining the mirror equation Find the location of the intersection point; Light from After reflection, it continues to propagate and interacts with the plane of the touch sensing module (3). Intersection, obtaining the coordinates of the touch point : ； After discretizing the above equation, the corresponding function between the touch coordinates and the virtual image coordinates can be obtained through system calibration or simulation fitting. ； After inverse solving, the inverse calculation model function for the virtual image plane coordinates is obtained: ； The aforementioned inverse calculation model function can be implemented using a polynomial or neural network fitting model, specifically as follows: ； In the above formula, These are the mapping coefficients obtained through calibration; The touch sensing module (3) first collects the user's touch coordinates on the touch interface in real time. The mapping control module (4) determines the mapping function based on a preset inverse mapping function. Calculate the corresponding coordinates of the touch point on the distant virtual image plane. Subsequently, the display system converts the virtual image coordinates into control signals and transmits them to the image source module (1) to drive the corresponding changes in the display content, thereby enabling the user to directly control the virtual image.

6. The display system with virtual image touch interaction function according to claim 1, characterized in that: The display system also includes a brightness adjustment unit, an ambient light sensor, and a display module to automatically optimize the imaging brightness and contrast based on external lighting. The ambient light sensor is mounted on the housing and faces the external environment to detect the light intensity of the surrounding environment in real time. It is responsible for sensing changes in ambient light, capturing the intensity, direction, and possible changes in the light source, and providing the necessary data input to the brightness adjustment unit. The display module is mounted on the outside of one side of the housing; the brightness adjustment unit is connected between the ambient light sensor and the display module, and automatically adjusts the brightness and contrast of the display module according to the illumination data provided by the ambient light sensor.

7. The display system with virtual image touch interaction function according to claim 1, characterized in that: The mapping control module (4) introduces an optical reverse mapping algorithm to achieve spatial consistency between the touch position and the virtual image position. The optical reverse mapping algorithm is based on the geometric model of light propagation. It uses the law of reflection and the calibration parameters of the optical imaging system to establish a mapping relationship between the coordinates of the touch surface and the coordinates of the virtual image plane. It also calculates the corresponding position of the touch point on the virtual image plane by calculating the light propagation path of the touch point in the optical system.

8. The display system with virtual image touch interaction function according to claim 3 or 7, characterized in that, The modeling principle of the optical inverse mapping algorithm is as follows: Light is emitted from the image source module (1), reflected by the free reflector element, and reaches the partially transmissive and reflective optical element. Part of the light is transmitted and forms a distant virtual image, which is finally received by the observer's eye. The touch sensing module (3) is located in front of the optical imaging module (2) before the output light path of the display system, and is used to detect the user's touch position. Let the outgoing direction vector of the ray on the virtual image plane be... After being reflected by the aforementioned partial transmission and reflection optical elements, the direction is... The reflection normal vector at the reflector element is Then the direction of reflection satisfies the law of reflection: ； The point of reflection of light on the mirror element Can be derived from virtual image points Determined by the direction of reflection: ； Combining the equations of the aforementioned mirror element The position of the intersection point between the light ray and the reflector element is determined; Light from After reflection, it continues to propagate, interacting with the plane of the touch sensing module (3). Intersection, obtaining the coordinates of the touch point : ； After discretizing the above equation, the corresponding function between the touch coordinates and the virtual image coordinates is obtained through calibration or simulation fitting of the display system: ； After inverse solving, the inverse calculation model of the virtual image plane coordinates is obtained: 。 9. The display system with virtual image touch interaction function according to claim 8, characterized in that, The correspondence function between the touch coordinates and the virtual image coordinates is implemented through a polynomial or neural network fitting model. The correspondence function between the touch coordinates and the virtual image coordinates is expressed by a polynomial of the following form: ； The above formula is used to control touch coordinates. Calculate the corresponding coordinates on the virtual image plane. This achieves a precise mapping between touch coordinates and virtual image coordinates; in the above formula These are the mapping coefficients obtained through system calibration or experimental measurement.

10. The display system with virtual image touch interaction function according to claim 1 or 3, characterized in that, The specific process for implementing interactive control of the virtual image content is as follows: when the user touches the touch interface of the touch sensing module (3), the touch sensing module (3) collects the user's touch coordinates in real time. and touch coordinates The data is passed to the mapping control module (4); the mapping control module (4) processes the data according to a preset inverse mapping function. Calculate the corresponding coordinates of the touch coordinates on the virtual image plane. The inverse mapping function, based on the geometric relationship of the optical system, accurately converts the coordinates on the touch sensing module (3) into positions on the virtual image plane; the touch sensing module (3) will collect the user's touch coordinates on its touch interface in real time. Then, through the mapping control module (4), the coordinates on the virtual image plane corresponding to the touch coordinates are calculated according to the optical inverse mapping algorithm loaded and running in the mapping control module (4) in the form of program code. The position of the virtual image is then converted into a control signal and transmitted to the image source module (1). The image source module (1) adjusts the display content according to the received control signal, thereby enabling the user to directly control the virtual image. The user's operation on the touch interface of the touch sensing module (3) can be instantly fed back in the virtual image, achieving an interactive effect.

11. The display system with virtual image touch interaction function according to claim 1, characterized in that: The outer shell is made of lightweight materials; The distance to the far image of the optical imaging module (2) is set to 2.5m.

Images