Aerial imaging device

Abstract

The present invention discloses an aerial imaging device, an imaging subsystem, and a tactile feedback subsystem. The imaging subsystem is used to image and display human-computer interaction information in an aerial target area to form an aerial interaction interface, and to send a touch feedback control instruction and touch point coordinate information when an interaction signal between a user and the aerial interaction interface is detected; the tactile feedback subsystem is connected to the imaging subsystem and is used to spray gas to the touch point according to the touch feedback control instruction and the touch point coordinate information. The system can not only realize non-contact tactile feedback for users, but also satisfy the user's interactive experience in terms of vision and touch at the same time, which is more hygienic and safe.

Description

Technical Field

[0001] The invention relates to the field of aerial imaging, and in particular to an aerial imaging device. Background Art

[0002] At present, the common tactile feedback mechanism in the market is mainly contact tactile feedback. Contact tactile feedback technology is assisted by related equipment (such as screens, gloves, etc.) and uses principles and technologies such as vibration and electrostatic force to achieve tactile perception. Although the relevant equipment has been miniaturized and widely used in commercial applications, since users must contact auxiliary equipment, there are the following problems: on the one hand, the cross-use of equipment will cause public health and safety problems, and users cannot get rid of the constraints of bulky equipment; on the other hand, the fingerprints, palm prints and other personal information left on the device by the user after use will face the risk of leakage of personal information security. Summary of the invention

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, one object of the present invention is to provide an aerial imaging device.

[0004] According to an embodiment of the present invention, the aerial imaging device includes an imaging subsystem and a tactile feedback subsystem. The imaging subsystem is used to image and display human-computer interaction information in an aerial target area to form an aerial interaction interface, and to send touch feedback control instructions and touch point coordinate information when an interaction signal between a user and the aerial interaction interface is detected; the tactile feedback subsystem is connected to the imaging subsystem and is used to spray gas to the touch point according to the touch feedback control instructions and the touch point coordinate information.

[0005] The interactive imaging subsystem will form a floating real image at a certain position in the air, so that the jet area of ​​the jet unit in the air jet tactile feedback subsystem will be adjusted to cover the position of the floating real image. This area constitutes the user touch area. When the user touches the floating real image in the touch area with his or her finger or palm, the air jet tactile feedback subsystem will accurately control the airflow jet so that the finger or palm can feel the impact of the airflow, thereby realizing touch of the floating touch object.

[0006] According to the aerial imaging device of the embodiment of the present invention, the imaging subsystem displays the human-computer interaction information in the aerial target area to form an aerial interaction interface, and the aerial interaction interface is used as the reference plane of the user's tactile perception to guide the user's touch control, and when the imaging subsystem detects the interaction signal between the user and the aerial interaction interface, the touch feedback control instruction and the touch point coordinate information are sent to the tactile feedback subsystem. The tactile feedback subsystem sprays gas to the touch point according to the received touch feedback control instruction and the touch point coordinate information, and produces a tactile feedback effect between the human body and the touch point, so that the human body can truly feel the existence of the touch point, and the purpose of non-contact tactile feedback of the user is achieved. In the embodiment of the present invention, based on presenting the aerial interaction interface in the aerial target area, the touch feedback operation can be triggered by the user touching the aerial interaction interface, which satisfies the user's interactive experience in both vision and touch, and the operation mode is more natural and comfortable, without setting additional user operation restriction devices, avoiding the risk of the user touching the device during operation. At the same time, it avoids the information security problem caused by the leakage of personal information due to the residual user fingerprint information.

[0007] In some embodiments, the imaging subsystem includes: a housing, an imaging component, a detection module, and a main control module, the housing is formed with a display window and a accommodating cavity inside; the imaging component is arranged in the accommodating cavity, and is used to image and display human-computer interaction information in an aerial target area to form an aerial interaction interface; the detection module is used to detect the interaction signal between the user and the aerial interaction interface; the main control module is connected to the imaging component and the detection module, and is used to send touch feedback control instructions and touch point coordinate information in response to the interaction signal.

[0008] In some embodiments, the imaging component includes: a display and an optical component, wherein the display is disposed in the accommodating cavity and connected to the main control module for displaying the human-computer interaction information; the optical component is disposed in the accommodating cavity for converging the light carrying the human-computer interaction information into the aerial target area to form an aerial interaction interface; wherein the display is disposed on the light source side of the optical component, and the display window is on the imaging side of the optical component.

[0009] In some embodiments, the optical component includes two transparent substrates, and a first optical waveguide array and a second optical waveguide array placed between the two transparent substrates, the first optical waveguide array and the second optical waveguide array are composed of a plurality of reflective strips with rectangular cross-sections, and a reflective film is provided on one side or both sides along the arrangement direction of the reflective strips, and each reflective strip of the first optical waveguide array is orthogonal to each other with each reflective strip of the second optical waveguide array.

[0010] In some embodiments, the tactile feedback subsystem includes: a jet unit, a data processing module, and a driving module, wherein the jet unit is used to jet gas; the data processing module is electrically connected to the main control module, and sends the touch point coordinates of the operation interface to the data processing module, and the data processing module calculates the jet angle corresponding to the touch point according to the touch point coordinates and the position of the jet unit; the driving module is electrically connected to the data processing module to receive the control signal of the data processing module and obtain the driving signal, and the driving module is electrically connected to the jet unit to jet gas toward the touch area or the current touch point.

[0011] In some embodiments, the airflow formed by the gas sprayed by the jet unit is in the form of an air beam or an air curtain, and the jet unit is sprayed in a normally open type or a real-time open type. The real-time open type jet unit is used to spray when the user enters the touch area or the user clicks the touch point, and the normally open type jet unit is in a normally open state.

[0012] In some embodiments, the jet unit includes an air compressor and a gimbal. The air compressor is used to jet gas. The air compressor is arranged on the gimbal. The gimbal is configured to deflect in real time after receiving a signal indicating that the touch point is touched, so as to jet gas to the current touch point.

[0013] In some embodiments, the jet unit includes multiple jet components, each of which is an air compressor or an air knife. Multiple jet components are installed at preset positions, the jet direction of each jet component is fixed, and the jet range of each jet component covers the corresponding touch point.

[0014] In some embodiments, a gas source is further included, wherein the gas source is connected to the jet unit to provide gas to the jet unit.

[0015] In some embodiments, a temperature regulating module is further included, and the temperature regulating module is used to regulate the temperature of the gas stored in the gas source or injected by the injection unit according to the outdoor ambient temperature.

[0016] In some embodiments, a silencer unit is further included, and the silencer unit is disposed at at least one position outside the air source, at an air inlet of the jet unit, and at an air outlet of the jet unit.

[0017] In some embodiments, when the user clicks each touch point, the wind noise emitted by the jet unit is used as a touch prompt sound.

[0018] In some embodiments, the jet unit further comprises a carrier for containing disinfectant and an atomizer for atomizing the disinfectant, so that the jet unit can spray a mixture of gas and disinfectant.

[0019] In some embodiments, a constraint mechanism is further included, and the constraint mechanism is used to constrain the divergence angle of the air curtain or air beam sprayed by the jet unit.

[0020] In some embodiments, the data processing module includes: a data processing module, a data storage module, an interface module, and a power module; the data processing module is used to receive the coordinate data of the touch point and calculate the phase of each channel; the data storage module includes a storage unit and a program storage unit, the data storage unit is used for data storage during the data processing process, and the program storage unit is used for storing the system boot level and loading program; the interface module is used for data communication with external devices; the power module is used to convert the input power into the required power.

[0021] In some embodiments, the data processing module is configured to calculate the pitch angle and yaw angle corresponding to each touch point based on the spatial coordinates of each touch point and the position of the jet head of the jet unit, calculate the jet intensity based on the distance between the touch point and the jet head, and calculate the temperature of the airflow to be sprayed based on the ambient temperature.

[0022] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0024] Figure 1 FIG. 4 is a schematic diagram of an air imaging device according to an embodiment of the present invention.

[0025] Figure 2 FIG. 4 is a schematic diagram of an air imaging device according to another embodiment of the present invention.

[0026] Figure 3 FIG. 4 is a schematic diagram of human-computer interaction of an air imaging device according to another embodiment of the present invention.

[0027] Figure 4 Schematic diagram of the working principle of an aerial imaging device according to an embodiment of the present invention.

[0028] Figure 5 Schematic diagram of the structure of the optical components of the aerial imaging device according to an embodiment of the present invention.

[0029] Figure 6 Schematic diagram of a first optical waveguide array and a second optical waveguide array of an aerial imaging device according to an embodiment of the present invention.

[0030] Figure 7Schematic diagram of a top view of an optical component of an aerial imaging device according to an embodiment of the present invention.

[0031] Figure 8 FIG. 4 is a partial schematic diagram of a first optical waveguide array and a second optical waveguide array of an aerial imaging device according to an embodiment of the present invention.

[0032] Fig. 9 Schematic diagram of the optical path of the optical components of the aerial imaging device according to an embodiment of the present invention.

[0033] Fig.10 is a block diagram of a data processing module according to an embodiment of the present invention;

[0034] Fig.11 is a block diagram of a driving module according to an embodiment of the present invention;

[0035] Fig.12 FIG. 1 is a schematic diagram of restricting the jet flow of the jet unit according to an embodiment of the present invention.

[0036] Fig.13 It is a schematic diagram of restricting the jet airflow of the jet unit according to another embodiment of the present invention.

[0037] Fig.14 It is a schematic diagram of restricting the jet flow of the jet unit according to another embodiment of the present invention.

[0038] Fig.15 Schematic diagram of an air beam or air curtain control method according to an embodiment of the present invention.

[0039] Fig.16 Schematic diagram of an air beam or air curtain control method according to another embodiment of the present invention.

[0040] Fig.17 Schematic diagram of an air beam or air curtain control method according to yet another embodiment of the present invention.

[0041] Reference numerals:

[0042] Aerial imaging device 100, imaging subsystem 200, tactile feedback subsystem 300,

[0043] Casing 1, optical component 2, display 3, detection module 4, main control module 5, first optical waveguide array 6, second optical waveguide array 7, transparent substrate 8, reflection strip 9, reflection film 10, photosensitive adhesive 11, shell 12, jet unit 13, data processing module 14, drive module 15, touch area 16, wind knife 17, constraint mechanism 18, pan-tilt head 19, and three-dimensional touch space D where the touch area is located. DETAILED DESCRIPTION

[0044] The embodiments of the present invention are described in detail below. The embodiments described with reference to the accompanying drawings are exemplary. Figures 1 to 15 Embodiments of the present invention are described in detail.

[0045] The aerial imaging device 100 with tactile feedback function according to the embodiment of the present invention includes: an imaging subsystem 200 and a tactile feedback subsystem 300 .

[0046] like Figure 1 As shown, the imaging subsystem 200 is used to image and display the human-machine interaction information in the air target area to form an air interaction interface, and send a touch feedback control instruction and touch point coordinate information when detecting an interaction signal between the user and the air interaction interface. The tactile feedback subsystem 300 is connected to the imaging subsystem 200, and the tactile feedback subsystem 300 is used to spray gas to the touch point according to the touch feedback control instruction and the touch point coordinate information.

[0047] In the embodiment of the present invention, the imaging subsystem 200 adopts interactive aerial imaging technology to form a floating real image, i.e., an aerial interactive interface, at a certain position in the air as a reference plane for user tactile perception, and the three-dimensional space covering the floating real image is the aerial target area. The imaging subsystem 200 gathers the human-computer interaction information and forms an image in the aerial target area to form an aerial interactive interface, and when the interaction signal between the user and the aerial interactive interface is detected, the imaging subsystem 200 sends the touch feedback control instruction and the touch point coordinate information to the tactile feedback subsystem 300.

[0048] The touch area of ​​the tactile feedback subsystem 300 covers the three-dimensional space where the air interaction interface is located, that is, the air target area. Specifically, based on the relatively fixed size and display position of the air interaction interface, the tactile feedback subsystem 300 generates a touch feedback plane of the same size and position as the known air interaction interface. That is, the imaging subsystem 200 provides the air interaction interface to guide the user to touch, and the tactile feedback subsystem 300 provides the touch feedback plane to feedback the user's perception of the touch object.

[0049] According to the aerial imaging device 100 of the embodiment of the present invention, the imaging subsystem 200 displays the human-machine interaction information in the aerial target area to form an aerial interaction interface, and the aerial interaction interface is used as the reference plane of the user's tactile perception to guide the user's touch control, and when the imaging subsystem 200 detects the interaction signal between the user and the aerial interaction interface, the touch feedback control instruction and the touch point coordinate information are sent to the tactile feedback subsystem 300. The tactile feedback subsystem 300 sprays gas to the touch point according to the received touch feedback control instruction and the touch point coordinate information, so that the human body can truly feel the existence of the touch point, and the purpose of non-contact tactile feedback of the user is achieved. In the embodiment of the present invention, based on presenting the aerial interaction interface in the aerial target area, the touch feedback operation can be triggered by the user touching the aerial interaction interface, which satisfies the user's interactive experience in both vision and touch, and the operation mode is more natural and comfortable, without setting additional user operation devices to restrict the user, avoiding the risk of the user touching the device during operation. At the same time, the information security problem caused by the leakage of personal information due to the residual user fingerprint information is avoided. In this way, the non-contact tactile feedback technology is combined with the interactive aerial imaging technology, and the air jet tactile feedback technology is deeply integrated with the interactive aerial imaging technology. Through system integration and development, a new interactive touch feedback device is realized, which creates a new display and interactive experience for users in terms of vision and touch.

[0050] In some embodiments, Figure 2 As shown, the imaging subsystem 200 includes: a housing 1, an imaging component, a detection module 4, and a main control module 5, wherein the imaging component includes an optical component 2 and a display 3. The housing 1 is formed with a display window and a receiving cavity is formed inside; the imaging component is arranged in the receiving cavity, and is used to image and display the human-computer interaction information in the air target area to form an air interaction interface. Specifically, the display 3 and the optical element 2 are both arranged in the receiving cavity, the display 3 is connected to the main control module 5, the display 3 is arranged on the light source side of the optical component 1, and the display window is located on the imaging side of the optical component 2. The display 3 is used to display the human-computer interaction information, and the light carrying the human-computer interaction information emitted by the display 3 is projected to the optical component 2, and the optical component 2 converges the light carrying the human-computer interaction information to form an air interaction interface in the air target area. For example, the display 3 can display a guide screen, and the air interaction interface will present a real image of the guide screen, and the user touches the icon in the real image to send an interaction signal, and the main control module 5 receives the interaction signal and controls the display 3 to display the corresponding interaction information to provide it to the user, thereby realizing contactless human-computer interaction.

[0051] The detection module 4 is used to detect the interaction signal between the user and the air interaction interface. In the embodiment, the sensing form of the detection module 4 includes but is not limited to far-infrared, ultrasonic, laser interference, grating, encoder, fiber or CCD (Charge-coupled Device). The sensing area of ​​the detection module 4 is located in the same plane as the floating real image and covers the three-dimensional space where the floating real image is located. The best sensing form can be selected according to the installation space, viewing angle and use environment, so that the user can operate the floating real image in the best posture, thereby improving the sensitivity and convenience of the user's operation.

[0052] The main control module 5 is connected to the detection module 4, and the Figure 3 As shown, the main control module 5 and the detection module 4 can be connected by wire or wirelessly to transmit digital or analog signals, so that the volume of the aerial imaging device 100 can be flexibly controlled, and the electrical stability of the aerial imaging device 100 can be enhanced. The main control module 5 is used to send touch feedback control instructions and touch point coordinate information in response to the interactive signal. The tactile feedback subsystem 300 receives the touch feedback control instruction and sprays gas to the touch point coordinate position, so that the user can feel the touch feedback and improve the interactive experience.

[0053] The position of the floating real image generated by the imaging component is relatively fixed in the air, and is an excellent interactive guide. The spray area of ​​the tactile feedback subsystem 300 is set to cover the three-dimensional space where the floating real image is located. For example, the path of the tactile feedback subsystem 300 spraying the airflow can cover the area where the floating real image to be touched is located. When the user touches the floating real image, the tactile feedback subsystem 300 sprays an air curtain or air beam at the right time. On the airflow spray path, the human body will feel the impact of the airflow, and then the human body can actually feel the existence of the touch point, realize the perception of the touch object, and make the user more relaxed, natural, efficient, and flexible when performing non-contact interactive operations, and there is no risk of contacting the device body, truly achieving non-contact tactile feedback.

[0054] In some embodiments, Figure 4 As shown, the optical component 2 is mounted on the housing 1 , and the display 3 is located on one side of the optical component 2 and inside the housing 1 , so as to generate an operation interface showing a floating real image on the other side of the optical component 2 .

[0055] Preferably, the angle between the optical component 2 and the display 3 is set to be in the range of 45°±5°, which can make fuller use of the size of the optical component 2 while obtaining relatively good imaging quality and less residual image effect. However, if there are other requirements for the imaging position, other angles can be selected at the expense of some imaging quality. Also preferably, the size of the optical component 2 is set so that the user can see the entire floating real image presented by the display 3 at a glance, but if only part of the content of the display 3 needs to be seen in actual use, the size and position of the optical component 2 can also be freely adjusted according to the actual display screen.

[0056] The imaging mode of the display 3 may include RGB (red, green, blue) light-emitting diodes (LEDs), LCOS (Liquid Crystal On Silicon) devices, OLED (Organic Light-Emitting Diode) arrays, projections, lasers, laser diodes, or any other suitable displays or stereoscopic displays. The display 3 may provide a clear, bright, and high-contrast dynamic image light source. In some embodiments, the brightness of the display 3 is not less than 500 cd / m2, which can reduce the impact of brightness loss during light path propagation.

[0057] In addition, according to some embodiments of the present invention, the viewing angle control processing of the display image surface of the display 3 can reduce the afterimage of the floating real image, improve the picture quality, and prevent others from peeping, so it is widely used in input devices that require privacy information protection.

[0058] In the embodiment of the present invention, the optical component 2 adopts an equivalent negative refractive index optical element, such as Figure 5-Figure 8 As shown, the optical component 2 includes two transparent substrates 8, and a first optical waveguide array 6 and a second optical waveguide array 7 placed between the two transparent substrates 8. The first optical waveguide array 6 and the second optical waveguide array 7 are composed of a plurality of reflective strips 9 with rectangular cross-sections, and a reflective film 10 is provided on one side or both sides along the arrangement direction of the reflective strips 9. The respective reflective strips 9 of the first optical waveguide array 6 and the respective reflective strips 9 of the second optical waveguide array 7 are orthogonal to each other.

[0059] In some embodiments, Figure 6 and Figure 7As shown, the first optical waveguide array 6 and the second optical waveguide array 7 have the same thickness. Setting the first optical waveguide array 6 and the second optical waveguide array 7 to have the same thickness can simplify the complexity of the structure of the first optical waveguide array 6 and the second optical waveguide array 7, reduce the difficulty of manufacturing the first optical waveguide array 6 and the second optical waveguide array 7, improve the production efficiency of the first optical waveguide array 6 and the second optical waveguide array 7, and reduce the production cost of the first optical waveguide array 6 and the second optical waveguide array 7. Note that the same thickness here includes a relative range, not absolutely the same, that is, for the purpose of improving production efficiency, if it does not affect the quality of aerial imaging, the thickness difference between the optical waveguide arrays is acceptable.

[0060] Specifically, Figure 5 As shown, the optical component 2 includes a transparent substrate 8, a first optical waveguide array 6, a second optical waveguide array 7 and another transparent substrate 8 in sequence from the display 3 side to the floating real image side. Both transparent substrates 8 have two optical surfaces. The transparent substrate 8 has a transmittance of about 90%-100% for light with a wavelength between about 390nm and about 760nm. The material used for the transparent substrate 8 may include at least one of glass, plastic, polymer and acrylic resin, which is used to protect the optical waveguide array and filter out excess light. It should be noted that if the strength of the first optical waveguide array 6 and the second optical waveguide array 7 after being tightly orthogonally bonded is sufficient, or the installation environment has thickness restrictions, it is also possible to configure only one transparent substrate 8 or no transparent substrate 8 at all.

[0061] In the embodiment, the length of the reflection strip 9 is limited by the outer size of the optical waveguide array, so the lengths of the reflection strips 9 in the first optical waveguide array 6 and the second optical waveguide array 7 are different. Figure 7 As shown, the extending direction of the reflection strips 9 in the first optical waveguide array 6 is set to be the X direction, the extending direction of the reflection strips 9 in the second optical waveguide array 7 is set to be the Y direction, and the thickness direction of the optical waveguide array is set to be the Z direction. The extending directions (waveguide directions) of the reflection strips 9 in the first optical waveguide array 6 and the second optical waveguide array 7 are perpendicular to each other, that is, from the Z direction (thickness direction), the first optical waveguide array 6 and the second optical waveguide array 7 are orthogonally arranged, so that the light beams in the two orthogonal directions converge at one point, and the object-image plane is ensured to be symmetrical with respect to the equivalent negative refractive index optical component, so as to produce an equivalent negative refractive index phenomenon and realize aerial imaging.

[0062] like Figure 7As shown, the first optical waveguide array 6 or the second optical waveguide array 7 is composed of a plurality of parallel arranged reflective strips 9 that are obliquely arranged at a 45° deflection from the user's perspective. For example, the first optical waveguide array 6 can be composed of reflective strips 9 that are arranged side by side at a 45° angle in the lower left direction and have a rectangular cross-section, and the second optical waveguide array 7 can be composed of reflective strips 9 that are arranged side by side at a 45° angle in the lower right direction and have a rectangular cross-section. The arrangement directions of the reflective strips 9 in the two groups of optical waveguide arrays can be interchanged, that is, the first optical waveguide array 6 is composed of reflective strips 9 that are arranged side by side at a 45° angle in the lower right direction and have a rectangular cross-section, and the second optical waveguide array 7 is composed of reflective strips 9 that are arranged side by side at a 45° angle in the lower left direction and have a rectangular cross-section. In an embodiment of the present invention, the optical waveguide material has an optical refractive index n1, where n1 > 1.4. For example, n1 = 1.5 or n1 = 1.55 or n1 = 1.8 or n1 = 2.

[0063] There are two interfaces between each reflective strip 9 and its adjacent reflective strip 9. As Figure 8 shown, each interface is joined by a photosensitive adhesive 11 or a thermosetting adhesive, and the thickness of the adhesive is T1. In the embodiment, the value range of the adhesive thickness T1 can be T1 > 0.001 mm. For example, T1 = 0.002 or T1 = 0.004 or T1 = 0.005. A photosensitive adhesive 11 is provided between adjacent optical waveguides in the optical component 2 and between the optical waveguide array and the transparent substrate 8.

[0064] The cross-section of the reflective strip 9 is rectangular, and a reflective film 10 is provided on one or both sides along the arrangement direction of the reflective strip 9. Specifically, in the arrangement direction of the optical waveguides, reflective films 10 are plated on both sides of each reflective strip 9. The material used for the reflective film 10 can be a metal material such as aluminum or silver that can achieve total reflection or other non-metal compound materials. The function of the reflective film 10 is to prevent light from entering adjacent optical waveguides due to non-total reflection and forming stray light that affects imaging. Further, a dielectric film can also be added to the reflective film 10, and the function of the dielectric film is to improve the light reflectivity.

[0065] The cross-sectional width a and cross-sectional length b of a single reflective strip 9 satisfy: 0.1 mm < a < 5 mm, 0.1 mm < b < 5 mm. When displaying on a large screen, large-size requirements can be achieved by splicing multiple optical waveguide arrays. The overall shape of the optical waveguide array can be set according to the application scenario requirements. In some embodiments, the two groups of optical waveguide arrays are integrally in a rectangular structure, the reflective strips 9 at the two diagonals are triangular, and the reflective strips 9 in the middle are trapezoidal structures. The lengths of the single reflective strips 9 are not equal, and the reflective strip 9 located on the rectangular diagonal is the longest, and the lengths of the reflective strips 9 at both ends are the shortest.

[0066] In addition, the optical component 2 also includes an anti-reflection component and a viewing angle control component (not shown). The anti-reflection component can improve the overall transmittance of the optical component 2 and improve the clarity and brightness of the floating real image. The viewing angle control component can be used to eliminate the afterimage of the floating real image and reduce the dizziness of the pattern. At the same time, it prevents the observer from peeking into the inside of the non-contact fingerprint collection and aerial imaging device 100 from other angles, thereby improving the overall aesthetics of the device. The anti-reflection component and the viewing angle control component can be arranged in combination, or they can be independently arranged between the transparent substrate 8 and the waveguide array or between two layers of the waveguide array or on the outer layer of the transparent substrate 8.

[0067] Refer to the following Fig. 9 The imaging principle of the optical component according to the embodiment of the present invention is described.

[0068] Take the example of the optical component 2 using two mutually orthogonal optical waveguide arrays. Specifically, at the micrometer scale, a mutually orthogonal double-layer waveguide array structure is used to perform orthogonal decomposition on any optical signal, and the original signal is decomposed into two mutually orthogonal signals, signal X and signal Y. Signal X is totally reflected on the surface of the reflective film 10 at the same reflection angle as the incident angle in the first optical waveguide array 6. At this time, signal Y remains parallel to the first optical waveguide array 6, and after passing through the first optical waveguide array 6, it is totally reflected on the surface of the reflective film 10 at the same reflection angle as the incident angle on the surface of the second optical waveguide array 7. The reflected optical signal composed of the reflected signal Y and the signal X is mirror-symmetrical with the original optical signal. Therefore, light rays from any direction can achieve mirror symmetry when passing through this optical component 2. Divergent light rays from any light source will converge into a floating real image at a symmetrical position when passing through this optical component 2. The imaging distance of the floating real image is the same as the distance from the optical component 2 to the image source (display 3), that is, the optical component 2 is an equidistant imaging. The floating real image is in the air and does not require a specific carrier. The real image can be directly formed in the air. Therefore, the image in the air seen by the user is the convergence of light emitted by actual objects, that is, the floating real image.

[0069] The light source, such as the display 3, emits light that carries the interactive information, and the light passes through the optical component 2, and the above process occurs on the optical component 2. Specifically, Fig. 9As shown, the distance between the light source and the optical component 2 is set to L, the incident angles of the light emitted by the light source on the first optical waveguide array 6 are α1, α2 and α3, the reflection angles of the light on the first optical waveguide array 6 are β1, β2 and β3, wherein α1=β1, α2=β2, α3=β3, the light is reflected by the first optical waveguide array 6 and projected to the second optical waveguide array 7, the incident angles on the second optical waveguide array 7 are γ1, γ2 and γ3, the light is reflected by the second optical waveguide array 7, and the reflection angles are δ1, δ2 and δ3, wherein γ1=δ1, γ2=δ2, γ3=δ3. The light reflected by the second optical waveguide array 7 is emitted, and the emitted light is converged to form an image at the image point, wherein the light emitted from the second optical waveguide array 7 has an emission angle of α1, α2, α3...αn respectively, and the distance between the image and the optical component 2 is L, that is, the image is formed at an equal distance between the optical component 2 and the light source (display 3), and the visual angle ε is 2 times max(α). Therefore, if the size of the optical waveguide array is small, the image can only be seen at a certain distance from the front; if the size of the optical waveguide array becomes larger, a larger imaging distance can be achieved, thereby increasing the field of view.

[0070] It should be noted that the above mainly describes the imaging principle of the optical component 2 using the double-layer structure of the first optical waveguide array 6 and the first optical waveguide array 7. If a plurality of cubic columnar reflective strips 9 with reflective films on all four sides are arranged in an array along the X and Y directions in a layer of optical waveguide array structure, that is, the two layers of optical waveguide arrays are merged into one layer, the imaging principle is the same, and it can also be used as the structure of the optical component 2 of an embodiment of the present invention. Therefore, the structure of the optical component 2 is not specifically limited here.

[0071] The tactile feedback subsystem 300 according to the embodiment of the present invention is described below.

[0072] In some embodiments, Figure 1 and Figure 2As shown, the tactile feedback subsystem 300 includes an air jet unit 13, a data processing module 14 and a driving module 15. The air jet unit 13 is used to spray gas. The data processing module 14 is electrically connected to the main control module 5. The main control module 5 receives the interactive signal detected by the detection module 4 and issues a touch feedback control instruction and touch point coordinate information. That is, when an interactive operation occurs on the interactive interface, the main control module 5 sends the touch point coordinate information of the interactive interface to the data processing module 14. The data processing module 14 is small in size and can be fixed on the driving board through a high-speed connector and connected to the driving module 15 on the driving board. The data processing module 14 can also be connected to the air jet unit 13 through a cable. The data processing module 14 calculates the jet angle and jet intensity of the corresponding touch point of the air jet unit according to the touch point coordinates and the position of the air jet unit 13. The driving module 15 is electrically connected to the data processing module 14 to receive the control signal of the data processing module 14 and output the driving signal. The driving module 15 is electrically connected to the air jet unit 13 to control the air jet unit 13 to spray gas toward the touch area 16 or the current touch point.

[0073] The jet unit 13 is the core unit of the tactile feedback subsystem 300, which is used to generate the air beam or air curtain required for interaction. When the human body contacts the air beam or air curtain, it will sense the impact of the airflow on the skin, thereby achieving tactile feedback. In this system, the data processing module 14 completes the processing and calculation of the focus point coordinate data, and sends the formed control signal to the driving module 15. The driving module 15 amplifies the control signal and generates a driving signal to control the jet unit 13, so that the jet unit 13 sprays airflow at an appropriate time and acts on the coordinate position of the user operation of the interactive interface, so that the user can feel the airflow and achieve tactile feedback.

[0074] In the embodiment, the data processing module 14 is used for receiving coordinate data, calculating phase data and transmitting data in parallel. Its functional block diagram is as follows: Fig.10 As shown. Fig.10As shown, the data processing module 14 mainly includes a data processing unit, a first data storage unit, a first interface unit and a first power supply unit. The data processing unit mainly completes the reception of touch coordinate data and the phase calculation of each channel. In some embodiments, a floating point DSP (Digital Signal Process) chip can be used as the data processing unit. Preferably, the main frequency of the DSP chip is above 200MHz, such as 250MHz or 300MHz or 400MHz, to ensure the real-time requirements of the system. The first data storage unit is divided into a data storage subunit and a program storage subunit, wherein the data storage subunit can be DDR2 (Double Data Rate 2) or SDRAM (synchronous dynamic random-access memory), which is used for data storage during data processing; the program storage subunit uses NAND FLASH (NAND flash memory) memory, which is used for the storage of system boot programs and loader programs. The first interface unit is used to complete the data communication between the data processing unit and the external device, and is connected to the control module 5 through the serial port / USB port to realize the transmission of touch coordinate data and system control instructions; through the Upp parallel port integrated in the DSP, the phase data and feedback data are transmitted. The first power supply unit mainly completes power conversion, converting the input power into various stable and reliable power supplies required by each unit.

[0075] like Fig.11 As shown, the drive module 15 includes a control unit, a second data storage unit, a second interface unit, a drive unit and a second power supply unit. Among them, the control unit completes the control parameter reception, processing and control signal output, and can select ARM (Advanced RISC Machines) with rich pin resources as the main control chip, which has rich interface resources and meets the system design requirements. The second data storage unit is expanded with an SPI FLASH as data storage, and can also be used for power-off storage of initialization parameters. The second interface unit communicates data with the data processing unit through the Upp parallel port. The drive unit is used to amplify the control signal output by ARM and output a drive signal that meets the requirements. The second power supply unit is used to provide a stable and reliable power supply for the entire system. The external power supply is input to the drive board, and the required power is provided to each power unit through DC-DC conversion and linear conversion. Due to the system design requirements, the distance between the drive unit and the jet unit 13 may be far, and the drive signal can be transmitted in the form of differential signals or 485 bus or industrial field bus, and the signal transmission cable uses multiple strands of single-core twisted pair to eliminate signal interference as much as possible.

[0076] In the embodiment, the jet unit 13 may be driven by, but not limited to, a fan, a medium / high pressure centrifugal fan, an air pump or an air compressor to inject gas. According to the form of the injected airflow, the jet unit 13 may be divided into an air beam type and an air curtain type. The air beam type jet unit 13 is used for precise control of scenes, and the air curtain type jet unit 13 is suitable for simple interactive scenes. The layout of the jet units 13 of the two schemes is different. Figure 1 As shown, the layout of the air beam type jet unit 13 is relatively flexible. The jet unit 13 can use a circular hole type jet head, which has two degrees of freedom angle control function. The airflow formed by the jet gas is an air beam. The data processing module 14 obtains the jet angle according to the touch coordinate information to adjust and correct the two-dimensional angle of the jet head, so as to achieve accurate jetting at any point in the three-dimensional space. Figure 2 As shown, the air curtain type jet unit 13 jets gas to form an air curtain, which needs to be in the same plane and overlap with the air interaction interface, namely the touch control area 16, and touch feedback can be achieved through continuous jetting and timely intermittent jetting.

[0077] In some embodiments, the jet unit 13 can use an air compressor, such as a miniature oil-free silent air compressor. The oil-free silent air compressor can drive two screws through a motor to complete air compression and can spray quantitative and directional beam airflow through a special round hole-shaped flexible nozzle. Specifically, the air compressor is set on a gimbal, such as a two-degree-of-freedom gimbal, and the gimbal is constructed to deflect in real time after receiving a signal that the touch point is touched so that the air compressor sprays gas to the current touch point. For example, when the user manipulates the interactive interface in the air, the main control module 5 sends touch coordinate information to the data processing module 14, and the data processing module 14 determines the injection angle according to the touch coordinates and the position of the jet unit 13, and sends a control signal to the drive module 15 to drive the deflection motor of the gimbal to rotate, so that the air compressor nozzle is quickly corrected to the correct injection angle, ensuring that the air compressor injection path covers the touch point, so that the user feels the airflow and realizes touch feedback.

[0078] In other embodiments, Figure 2 As shown, the jet unit 13 may use an air knife 17, which uses the Coanda effect to blow air from a wind source or compressed air to blow out an air curtain with a certain initial thickness, such as 0.05 mm, wherein the wind source blowing can be generated by a fan or a medium / high centrifugal pressure fan, and the compressed gas can be provided by an air pump / air compressor. The width of the air curtain formed by the air knife 17 can be freely customized, which is convenient for integrated installation on the contactless interactive device.

[0079] Furthermore, the air curtain formed by the wind knife 17 has a certain divergence angle, for example, the divergence angle is between 5° and 6°. The farther the air curtain is from the wind knife 17, the thicker the air curtain is. In order to ensure that users have a good experience, optimization can be performed from three aspects. The first aspect is that when laying out the wind knife 17, the wind knife 17 can be offset and installed at half the divergence angle α, such as Fig.12 As shown, when the air curtain is facing the touch area 16, due to the existence of the divergence angle, the air curtain will be dispersed on both sides of the same plane of the touch area 16, which reduces the user experience. In the embodiment of the present invention, it can be as follows Fig.12 As shown in , the boundary surface of the air curtain coincides with the plane where the touch area 16 is located, that is, the spray angle of the wind knife 17 deviates by 1 / 2α, so that the air curtain coincides with the plane where the touch area 16 is located. The second aspect is that Fig.13 As shown, a constraint mechanism 18 is provided, and the constraint mechanism 18 is used to constrain the divergence angle of the air curtain or air beam sprayed by the jet unit 13. The constraint mechanism 18 is arranged between the wind knife 17 and the touch area 16. When the air curtain with a divergence angle passes through, the constraint structure 18 can eliminate or reduce the divergence angle of the air curtain before the constraint, thereby reducing the influence of the divergence angle on the touch feedback and improving the user experience; the third aspect is, as Fig.14 As shown, the wind knife 17 is arranged at a close distance, that is, the distance H between the wind knife 17 and the touch area 16 is reduced. When the air curtain at the touch area 16 is closer to the wind knife 17, the divergence angle of the air curtain at the touch area 16 is less affected, and the effect of the thickness of the air curtain on the touch feedback of the touch area 16 can be ignored. This method is suitable for small devices.

[0080] Of course, the tactile feedback subsystem 300 may also include a housing 12, which is used to carry components such as a fixed jet unit 13, a data processing module 14, and a drive module 15. The housing 12 provides protection and support for the tactile feedback subsystem 300 to prevent external impact and vibration from damaging the system. The structure of the housing 12 includes but is not limited to a cabinet, a chassis, etc., depending on the application scenario and actual needs.

[0081] Combined with the implementation form of the jet unit 13 described above, the control mode of the air beam or air curtain is also diverse, which can be applied to more application scenarios. In the embodiment, the jet mode of the jet unit 13 can be a normally open type or a real-time open type. The real-time open type jet unit 13 is used to spray when the user enters the touch area 16 or the user clicks the touch point. The normally open type jet unit 13 is in a normally open state, that is, in a real-time jet state.

[0082] The following is an example of how to control the air beam or air curtain.

[0083] In the first embodiment, the jet unit 13 jets the air beam for precise control. Fig.15As shown, the jet unit 13 includes an air compressor and a gimbal 19. The air compressor is used to jet gas. The air compressor is arranged on the gimbal 19. The gimbal 19 is used to deflect in real time after receiving a signal that the touch point is touched, so that the air compressor jets gas to the current touch point to realize touch feedback.

[0084] Specifically, the jet unit 13 uses an air compressor, and the direction of the nozzle of the air compressor is fixed relative to the air compressor itself. The air compressor is installed on a two-degree-of-freedom pan-tilt 19. The driving motor of the pan-tilt 19 can drive the pan-tilt 19 to deflect to any angle in the horizontal direction and the vertical direction or freely deflect within a certain angle range under the control of the control signal. Therefore, the pitch angle and horizontal deflection angle of the nozzle of the air compressor are adjustable within a certain range, so that the jet air beam can achieve coverage of any touch point within a certain space. In this embodiment, the jetting of the air beam can be controlled in real time, and only when an object touches the touch area 16 will the air compressor be triggered to move quickly and spray a quantitative air beam. This method is mainly used in scenarios with high-precision touch requirements or occasions with many and small control units, and can be applied to three-dimensional touch objects such as Fig.15 The three-dimensional touch space D where the middle touch area 16 is located has high real-time performance and fast response speed. Timely quantitative injection can save a large amount of compressed gas and improve energy utilization efficiency.

[0085] In the second embodiment, the jet unit 13 is controlled to jet multiple air beams or air curtains to achieve directional control. Fig.16 As shown, the jet unit 13 includes a plurality of jet components, which are air compressors or air knives 17. The plurality of jet components are installed at preset positions, the jet direction of each jet component is fixed, and the jet range of each jet component covers the corresponding touch point.

[0086] Specifically, Fig.16 As shown, multiple air compressors (13) or small-sized air knives 17 (13) are installed in fixed positions to ensure that the gas injection path covers the to-be-touched point corresponding to the three-dimensional touch space D where the touch area 16 is located. In this embodiment, the injection of the air beam or air curtain can be controlled in real time, and only when an object contacts the to-be-touched area 16 will the corresponding injection unit 13 be triggered to inject a quantitative air beam or air curtain. This method is suitable for simple touch objects, such as those with a small number of touch points, and is also suitable for three-dimensional touch objects, such as the three-dimensional touch space D where the touch area 16 is located. If a touch point in the three-dimensional touch space D is operated, the air compressor or air knife 17 at the corresponding coordinate position is controlled to work, and the corresponding air beam or air curtain can be injected to the touch coordinate without adjusting the direction of the injection unit 13, and the control process is simple.

[0087] In the third embodiment, the jet unit 13 is controlled to jet multiple air beams or air curtains to achieve directional normally open jetting. Fig.16As shown, the control method of this embodiment is basically the same as that of the above-mentioned second embodiment. The difference is that, in this embodiment, the spraying mode of the air beam or air curtain is normally open, that is, after the tactile feedback function is started, the jet unit 13 is controlled to be in a state of spraying gas all the time, and there is no need to identify whether there is an object touching the touch area 16 or the three-dimensional touch space D where the touch area 16 is located. The control method of this embodiment further simplifies the control process and the complexity of the equipment.

[0088] In the fourth embodiment, the jet unit 13 is controlled to jet gas to form a single air curtain to achieve directional control. Fig.17 As shown, a large-sized wind knife 17 can be used. For example, the size of the wind knife 17 matches the touch area, so that the air curtain sprayed by the wind knife 17 overlaps with the touch area 16. When an object is detected to be in contact with the touch area 16, the wind knife 17 is quickly controlled to spray the air curtain. For a certain fixed touch area 16, the wind knife 17 can be arranged on any side of the touch area 16, for example Fig.17 As shown, with the touch area 16 as the origin, the wind knife 17 can be set in the +x direction, or in the -x direction, or in the +y direction, or in the -y direction. No matter which direction the wind knife 17 is set, the air curtain sprayed by the wind knife 17 can overlap with the touch area 16. This method is only applicable to planar touch objects, but it is applicable to simple or complex touch units. It is a more general solution, with simple equipment integration, low demand for compressed gas, simple control process, and good control of equipment volume.

[0089] In the fifth embodiment, the jet unit 13 is controlled to jet gas to form a single air curtain to achieve directional normally open control. This embodiment is basically the same as the control of the fourth embodiment above. The difference is that in this embodiment, the jet mode of the air curtain is changed to a normally open type, that is, the jet unit 13 is controlled to be in a state of always jetting gas, without identifying whether an object touches the touch area 16. Compared with the fourth embodiment above, this method can further simplify the control process and the complexity of the device.

[0090] The above is only an example of the arrangement of the jet unit 13 and the jet control method, which is not exhaustive. Other variations of the control method and arrangement method based on the embodiment of the present invention also fall within the protection scope of this application.

[0091] In some embodiments, the tactile feedback subsystem 300 further includes an air source, which is connected to the jet unit 13 to provide gas to the jet unit 13. For example, the air source may be a device for storing the gas to be jetted by the jet unit 13, so as to facilitate processing of the gas to be jetted, such as temperature adjustment or disinfection, and improve the user experience.

[0092] For example, in some embodiments, the tactile feedback subsystem 300 further includes a temperature regulating module, which is used to regulate the temperature of the gas stored in the gas source or sprayed by the jet unit 13 according to the outdoor ambient temperature. Specifically, by setting the temperature regulating module to regulate the temperature of the gas forming the air beam or air curtain, for example, a warm air flow is provided in a low temperature environment, and a cold air flow is provided in a high temperature environment. The temperature of the cold and warm air flows are both in the human body sensing comfort zone, so that the user can be guaranteed to feel the comfort of the air flow. The form of the air source includes but is not limited to a fan, a medium / high pressure centrifugal fan, an air pump or an air compressor. When the jet unit 13 is working normally, the air source needs to provide an air intake input, and then the air beam or air curtain is sprayed through the jet unit 13 to form an air flow impact at the touch area 16 or the touch point to achieve tactile feedback. The temperature of the air beam or air curtain is regulated by the temperature regulating module. When the user touches the air beam or air curtain, he will not feel temperature discomfort, thereby improving the user experience effect.

[0093] In some embodiments, the tactile feedback subsystem 300 also includes a silencer unit, which is arranged at at least one of the positions outside the air source, the air inlet of the jet unit 13, and the air outlet of the jet unit 13. Thus, when the air source and the jet unit 13 are working, the noise influence is eliminated or reduced by the silencer unit. For example, a sealed isolation cover is provided outside the air source to effectively suppress the noise generated when the air source is working. For another example, a silencer is provided at the air inlet and / or the air outlet of the jet unit 13 to effectively suppress the noise generated when the jet unit 13 is working, and the silencer at the air inlet can also play a dust filtering role.

[0094] In some embodiments, when the user touches each touch point, the wind noise emitted by the jet unit 13 can serve as a touch prompt sound. In this way, when the user operates in the touch area 16, the jet unit 13 ejects airflow, and its short-term wind noise can be set as a touch prompt sound, so that the aerial imaging device 100 can provide the user with a more comprehensive interactive experience in terms of vision, touch and hearing.

[0095] In some embodiments, the jet unit 13 also has a carrier for containing disinfectant and an atomizing part for atomizing the disinfectant, so that the jet unit 13 can spray a mixture of gas and disinfectant. In this way, the jet unit 13 can be configured to spray a certain liquid or micro-particles, such as disinfectant. At this time, the air beam or air curtain sprayed by the jet unit 13 is a mixture of air and disinfectant. While experiencing tactile feedback, the user can disinfect the touch operation parts of the human body, such as hands. Among them, the liquid includes but is not limited to water, disinfectant, micro-particles, etc., depending on the application scenario and actual needs.

[0096] Based on the description of the aerial imaging device 100 of the present invention in the above embodiment, the aerial imaging device 100 of the embodiment of the present invention is combined with an imaging subsystem 200 and a tactile feedback subsystem 300, wherein the imaging subsystem 200 adopts floating imaging technology to present a real image in the air, realizes contactless touch, can avoid the spread of viruses or bacteria, and improves the safety of use. The tactile feedback subsystem 300 adopts gas injection and utilizes the impact of airflow to realize tactile feedback, so that the user can perform non-contact interactive operations more easily and naturally, and realize human tactile perception without the help of physical equipment.

[0097] Specifically, when the aerial imaging device 100 of the embodiment of the present invention is working, in the initial state, the main control module 5 controls the display 3 to display the guide picture, and the optical component 2 converges the light carrying the guide picture emitted by the display 3 and images it into the air on the other side of the optical component 2 to guide the user to touch in the correct area. At the same time, the main control module 5 transmits the touch point coordinate information in the interactive interface to the data processing module 14, and the data processing module 14 calculates the two-dimensional angle (such as the pitch angle and deflection angle of the jet head), the jet intensity and the airflow temperature corresponding to each touch point according to the coordinates of each touch point and the position of the jet head of the jet unit 13, wherein the jet intensity is related to the distance between the touch point and the jet unit 13, and the airflow temperature is related to the ambient temperature. The data processing module 14 sends the calculated parameters to the driving module 15 according to the control instruction of the main control module 5. The driving module 15 generates a control signal according to the control instruction and related parameters, and drives and amplifies the control signal to obtain the final required driving signal. The driving module 15 transmits the driving signal to the jet unit 13, and the jet unit 13 deflects to a suitable angle under the control of the driving signal and sprays a certain amount of constant temperature air beam. In some embodiments, if there are multiple touch points, touch feedback can be achieved through high-speed refresh of the system, combined with the real image pattern presented by the optical component 2, to guide the user to perform touch operations; in addition, multiple jet units 13 can also be used to work synchronously, and through combination and splicing, human-computer interaction of complex operating interfaces and even contour perception of three-dimensional display objects can be achieved.

[0098] Among them, in the embodiment, the jet unit 13 can adopt a low-power, miniaturized jet device. According to the distance between the touch object and the jet unit 13, the data processing module 14 and the driving module 15 control the intensity and duration of the airflow jet of the jet unit 13, and the temperature of the jet airflow can be adjusted according to the ambient temperature through the temperature adjustment module. Therefore, the tactile feedback subsystem 300 of the embodiment of the present invention will not cause any harm to the human body.

[0099] In addition, the tactile feedback subsystem 300 adopts a miniaturized and modular design, with simple setup, low cost, and ease of commercial use and integration. For application scenarios with larger touch areas or three-dimensional touch objects, the focus point data of the touch feedback is significantly increased, and multiple tactile feedback subsystems 300 can be combined and spliced ​​to suit more application scenarios and a wider range of applications.

[0100] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0101] In the description of the present invention, "first feature" and "second feature" may include one or more of the features. In the description of the present invention, "plurality" means two or more. In the description of the present invention, a first feature "above" or "below" a second feature may include the first and second features being in direct contact, or may include the first and second features not being in direct contact but being in contact through another feature between them. In the description of the present invention, a first feature "above", "above" and "above" a second feature may include the first feature being directly above and obliquely above the second feature, or may simply mean that the first feature is higher in level than the second feature.

[0102] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example.

[0103] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. An aerial imaging device, characterized in that: include: An imaging subsystem, the imaging subsystem being used to image and display the human-computer interaction information in an aerial target area to form an aerial interaction interface, and to send a touch feedback control instruction and touch point coordinate information when an interaction signal between a user and the aerial interaction interface is detected; The imaging subsystem includes: a housing, the housing is formed with a display window and a receiving cavity formed inside, an imaging component, arranged in the receiving cavity, for imaging and displaying human-computer interaction information in an aerial target area to form an aerial interaction interface, a detection module, for detecting an interaction signal between a user and the aerial interaction interface, and a main control module, connected to the imaging component and the detection module, for sending a touch feedback control instruction and touch point coordinate information in response to the interaction signal; and A tactile feedback subsystem, connected to the imaging subsystem, and configured to spray gas to the touch point according to the touch feedback control instruction and the touch point coordinate information; The tactile feedback subsystem comprises: An injection unit, the injection unit is used to inject gas; A data processing module, wherein the data processing module is electrically connected to the main control module, and the main control module receives the interactive signal detected by the detection module and issues the touch feedback control instruction and the touch point coordinate information, that is, when an interactive operation occurs on the interactive interface, the main control module sends the touch point coordinate information of the interactive interface to the data processing module, and the data processing module calculates the injection angle corresponding to the touch point according to the touch point coordinate and the position of the injection unit; A driving module, the driving module is electrically connected to the data processing module to receive a control signal from the data processing module and obtain a driving signal, and the driving module is electrically connected to the jet unit to jet gas toward the touch area or the current touch point; The airflow formed by the gas sprayed by the jet unit is in the form of an air beam or an air curtain. The jet mode of the jet unit is a normally open type or a real-time open type. The real-time open type jet unit is used to spray when the user enters the touch area or the user clicks the touch point, and the normally open type jet unit is in a normally open state.

2. The aerial imaging device according to claim 1, characterized in that: The imaging assembly comprises: A display, which is arranged in the accommodating cavity, connected to the main control module, and is used to display the human-computer interaction information; An optical component, which is disposed in the accommodating cavity and is used to converge the light carrying the human-machine interaction information to form an image on the aerial target area to form an aerial interaction interface; Wherein, the display is arranged on the light source side of the optical component, and the display window is on the imaging side of the optical component.

3. The aerial imaging device according to claim 2, characterized in that: The optical component includes two transparent substrates, and a first optical waveguide array and a second optical waveguide array placed between the two transparent substrates. The first optical waveguide array and the second optical waveguide array are composed of a plurality of reflective strips with rectangular cross-sections, and a reflective film is provided on one side or both sides along the arrangement direction of the reflective strips. The reflective strips of the first optical waveguide array and the reflective strips of the second optical waveguide array are orthogonal to each other.

4. The aerial imaging device according to claim 1, characterized in that: The jet unit includes an air compressor and a gimbal. The air compressor is used to jet gas. The air compressor is arranged on the gimbal. The gimbal is configured to deflect in real time after receiving a signal indicating that the touch point is touched, so as to jet gas to the current touch point.

5. The aerial imaging device according to claim 4, characterized in that: The jet unit includes a plurality of jet components, which are air compressors or air knives. The plurality of jet components are installed at preset positions, the jet direction of each jet component is fixed, and the jet range of each jet component covers the corresponding touch point.

6. The aerial imaging device according to any one of claims 1 to 5, characterized in that: The invention also comprises a gas source, which is connected to the jet unit to provide gas to the jet unit.

7. The aerial imaging device according to claim 6, characterized in that: It also includes a temperature regulating module, which is used to regulate the temperature of the gas stored in the gas source or injected by the injection unit according to the outdoor ambient temperature.

8. The aerial imaging device according to claim 6, characterized in that: It also includes a silencer unit, which is arranged at at least one position outside the air source, at the air inlet of the jet unit, and at the air outlet of the jet unit.

9. The aerial imaging device according to claim 6, characterized in that: When the user clicks each touch point, the wind noise emitted by the jet unit serves as a touch prompt sound.

10. The aerial imaging device according to any one of claims 1 to 5, characterized in that: The jet unit also has a carrier for containing disinfectant and an atomizer for atomizing the disinfectant, so that the jet unit can spray a mixture of gas and disinfectant.

11. The aerial imaging device according to any one of claims 1 to 5, characterized in that: It also includes a constraint mechanism, which is used to constrain the divergence angle of the air curtain or air beam sprayed by the spray unit.

12. The aerial imaging device according to any one of claims 1 to 5, characterized in that: The data processing module is configured to calculate the pitch angle and yaw angle corresponding to each touch point according to the spatial coordinates of each touch point and the position of the injection head of the injection unit, calculate the injection intensity according to the distance between the touch point and the injection head, and calculate the temperature of the airflow to be injected according to the ambient temperature.

Images