A suspended imaging device and method

Abstract

The application discloses a kind of suspended imaging device and method, it is related to optical imaging and display technical field, suspended imaging device includes rotatable base being arranged in the interior of cabin interior, image source being arranged on rotatable base, light splitter for reflecting the image of image source, curved mirror for receiving the image reflected by light splitter, image acquisition device and microphone array being arranged in the interior of car, and control system, the image reflected by curved mirror passes through light splitter and forms virtual image in car, control system is used to receive the signal of microphone array and image acquisition device, and virtual image is rotated to preset position according to operator position by controlling rotating base, avoid the problem that entity robot protrusion occupies instrument desk space, constraint interior decoration and HUD layout;Realize multi-seat distributed directional interaction and visual feedback, and virtual image can be in the residual light area of driver, reduce sight deviation from road surface, improve driving safety.

Description

Technical Field

[0001] This invention relates to the field of optical imaging and display technology, and specifically to a levitation imaging device and method. Background Technology

[0002] In-vehicle intelligent interactive robots are evolving from voice assistants to more concrete interactive features. For example, in-vehicle physical robots use motors to drive their physical heads to rotate and display facial expressions on a small screen, providing a human-like experience. However, they have the following problems: the physical protrusion takes up dashboard space and restricts the layout of the interior and HUD; visual feedback is mainly directed at the driver, and it is difficult for the passenger and rear passengers to receive targeted feedback; the display is limited by the small screen, and upgrades require hardware replacement. To address the problems mentioned above, those skilled in the art have proposed a suspension imaging device and method. Summary of the Invention

[0003] To address the aforementioned issues, this invention provides a levitation imaging device and method that employs a folding optical path to reconstruct a virtual image in the air using a beam splitter and a curved reflector. By combining sound source localization and visual tracking, it enables independent interaction among multiple seats, thereby solving problems such as poor mechanical reliability, large space occupation, limited interactive coverage, and difficulty in hardware upgrades associated with physical robots.

[0004] To achieve the above objectives, the present invention provides the following solution: A levitation imaging device includes a rotatable base disposed inside the cabin interior, an image source disposed on the rotatable base, a beam splitter for reflecting the image source image, a curved reflector for receiving the image reflected by the beam splitter, an image acquisition device and a microphone array disposed inside the cabin, and a control system communicatively connected to the image acquisition device, the microphone array and the rotatable base. The image reflected by the curved reflector passes through the beam splitter to form a virtual image inside the cabin. The control system is used to receive signals from the microphone array and the image acquisition device, and control the rotatable base to rotate the virtual image to a preset position according to the operator's position.

[0005] Preferably, the image from the image source is emitted to the beam splitter via a microlens.

[0006] Preferably, the angle between the image source and the beam splitter is 55 to 65 degrees.

[0007] Preferably, the angle between the curved reflector and the beam splitter is 60 to 70 degrees.

[0008] Preferably, the beam splitter has a transmittance of 50% and a reflectance of 50%.

[0009] Preferably, the beam splitter includes a first anti-reflective coating, a first glass substrate, a first bonding underlayer, a first functional metal layer, and a first oxygen-resistant protective layer arranged sequentially, wherein the reflective surface of the beam splitter is the side of the first functional metal layer close to the first bonding underlayer.

[0010] Preferably, the curved reflector includes a second glass substrate, a second adhesive underlayer, a second functional metal layer, and a second oxygen-proof protective layer arranged sequentially, wherein the reflective surface of the curved reflector is the side of the second functional metal layer close to the second adhesive underlayer.

[0011] Preferably, a second anti-reflective coating is provided between the second glass substrate and the second adhesive underlayer.

[0012] Preferably, the cabin interior includes an instrument panel, a center armrest, front seat backs, door interior panels, or a roof, and the instrument panel, center armrest, front seat backs, door interior panels, or roof are provided with light-transmitting windows through which the virtual image passes.

[0013] The present invention also discloses a method for using a levitation imaging device, comprising the following steps: Voice signals inside the vehicle are collected via a microphone array, and image information inside the vehicle is collected via an image acquisition device. The control system determines the operator's location and identity based on the voice signal and / or the image information; The control system controls the rotation of the rotatable base, so that the image emitted by the image source is reflected by the beam splitter to the curved mirror, and then reflected by the curved mirror and passed through the beam splitter to form a virtual image at a preset position in front of the corresponding operator. The control system updates the content or form of the virtual image based on the operator's gestures or voice.

[0014] The present invention achieves the following technical effects compared to the prior art: By concealing the rotatable base and image source within the cabin interior, and utilizing a refracting optical path formed by a beam splitter and curved reflector to project virtual images through the beam splitter and cabin interior into the passenger compartment, the system avoids the problems of physical robots protruding and occupying dashboard space, constraining the interior and HUD layout. Simultaneously, with the collaborative perception of the operator's position and identity by the image acquisition device and microphone array, the control system can drive the rotatable base to automatically turn and position the virtual image in a preset position in front of the driver, front passenger, or rear passengers, realizing multi-seat distributed directional interaction and visual feedback. Furthermore, the virtual image can be placed within the driver's peripheral vision area, reducing the deviation of the driver's gaze from the road and improving driving safety. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Appendix Figure 1 A schematic diagram of the imaging principle of the levitation imaging device in one or more embodiments of the present invention; Appendix Figure 2 This is a schematic diagram showing the positional relationship between the curved reflector and the beam splitter in one or more embodiments of the suspended imaging device of the present invention; Appendix Figure 3 This is a schematic diagram of the structure of the beam splitter in one or more embodiments of the levitation imaging device of the present invention; Appendix Figure 4 This is a schematic diagram of the curved reflector in one or more embodiments of the suspended imaging device of the present invention; Among them, 1. Curved reflector; 2. Image source; 3. Beam splitter; 4. Virtual image; 5. First anti-reflective coating; 6. First glass substrate; 7. First bonding underlayer; 8. First functional metal layer; 9. First oxygen protection layer; 10. Second oxygen protection layer; 11. Second functional metal layer; 12. Second bonding underlayer; 13. Second glass substrate. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] The purpose of this invention is to provide a levitation imaging device and method, which adopts a folding optical path, reconstructs a virtual image in the air with a beam splitter and a curved reflector, and combines sound source localization and visual tracking to achieve independent interaction among multiple seats, thereby solving the problems of poor mechanical reliability, large space occupation, limited interaction coverage and difficulty in hardware upgrades of physical robots.

[0019] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0020] It should be understood that the structures, proportions, sizes, etc., depicted in the accompanying drawings of this specification are merely for illustrative purposes to aid those skilled in the art and are not intended to limit the implementation conditions of the invention. Therefore, they have no substantial technical significance. Any modifications to the structure, changes in proportions, or adjustments to size, without affecting the effectiveness and purpose of the invention, should still fall within the scope of the technical content disclosed in this invention. In the description of this invention, it should be understood that the terms "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings. They are merely for the convenience of describing the invention and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. Furthermore, the terms "first," "second," and "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Thus, features defined with "first," "second," etc., may explicitly or implicitly include one or more of those features. In the description of this invention, unless otherwise stated, "a plurality of" means two or more.

[0021] refer to Figures 1-4 The levitation imaging device disclosed in this embodiment of the invention includes at least a rotatable base disposed inside the cabin interior. An image source 2 is disposed on the rotatable base. The image from the image source 2 is emitted to a beam splitter 3. The image reflected by the reflector is emitted to a curved reflector 1. The image reflected by the curved reflector 1 passes through the beam splitter 3 and the cabin interior, forming a virtual image 4 inside the cabin. An image acquisition device and a microphone array are disposed inside the cabin, and a control system is disposed inside the cabin. The control system is communicatively connected to the image acquisition device, the microphone array, and the rotatable base. The control system is used to receive signals from the microphone array and the image acquisition device, and to control the rotatable base to rotate the virtual image 4 to a preset position according to the operator's position. The system hides the rotatable base and image source 2 inside the cabin interior, and uses a refracting optical path formed by the beam splitter 3 and the curved reflector 1 to project the virtual image 4 through the beam splitter 3 and the cabin interior into the passenger compartment. This avoids the problems of physical robots protruding and occupying dashboard space, and constraining the interior and HUD layout. At the same time, with the help of the image acquisition device and microphone array to collaboratively perceive the operator's position and identity, the control system can drive the rotatable base to automatically turn and position the virtual image 4 in a preset position in front of the driver, front passenger or rear passenger, realizing multi-seat distributed directional interaction and visual feedback. Moreover, the virtual image 4 can be in the driver's peripheral vision area, reducing the deviation of the eyes from the road and improving driving safety.

[0022] It should be noted that the rotatable base includes a support platform on which the image source 2, beam splitter 3, and curved reflector 1 are mounted. Three telescopic rods are connected circumferentially at the bottom of the support platform via ball joints. A rotating disk is located at the end of each telescopic rod furthest from the support platform, and a drive motor is located at the bottom of the rotating disk. By integrating the image source 2, beam splitter 3, and curved reflector 1 onto the same support platform, the relative positions of the three components remain fixed after factory calibration, preventing optical path misalignment due to separate installation or vehicle vibration. The three telescopic rods connected circumferentially at the bottom of the support platform via ball joints, together with the rotating disk and drive motor, constitute a multi-degree-of-freedom system. The parallel support structure for attitude adjustment can precisely adjust the pitch, yaw, and height of the support platform through the coordinated extension and retraction of the telescopic rods, and can also drive the overall horizontal rotation through the rotating disk. This allows the virtual image 4 to be accurately rotated and positioned in a preset position in front of the driver, front passenger, or rear passenger according to the operator's position. At the same time, the circumferential arrangement of the three telescopic rods and the ball joint connection improve the support stiffness and vibration resistance, maintaining the stability of the optical path even under vehicle vibration. Furthermore, the entire structure can be hidden inside the cabin interior without occupying visible space, ultimately achieving comprehensive improvements in imaging accuracy, multi-seat interactive coverage, automotive-grade reliability, and space utilization.

[0023] In addition, Image Source 2 is a software-driven display device that can load multi-view images, light field images, or computed holograms. Virtual images and interactive content can be flexibly updated via OTA, and can form a near-far layered interactive system with AR-HUD, thereby achieving comprehensive improvements in space utilization, reliability, interactive coverage, driving safety, and functional evolution.

[0024] In one implementation, the image from image source 2 is emitted to beam splitter 3 via a microlens. By placing a microlens between image source 2 and beam splitter 3, the image emitted from image source 2 is first modulated by the microlens before being projected onto beam splitter 3. This projects the micro-unit image array on image source 2 at different viewing angles. After being reflected by beam splitter 3 and focused by curved mirror 1, the image passes through beam splitter 3 and reconstructs a three-dimensional light field carrying directional information within the vehicle. This allows the virtual image 4 to no longer be limited to a planar floating image, but to present a stereoscopic visual effect with full parallax or binocular parallax. When the observer moves their head, they can see different sides of the virtual image, significantly enhancing the three-dimensionality, realism, and immersive interactive experience of the floating sprite. At the same time, the microlens, image source 2, beam splitter 3, and curved mirror 1 are integrated into a rotatable base. After optical path calibration at the factory, the entire assembly can be rotated to maintain the relative positions of each optical element, avoiding optical field misalignment caused by vehicle vibration, thus balancing three-dimensional imaging quality and automotive-grade reliability.

[0025] refer to Figure 2As one implementation method, the angle between the image source 2 and the beam splitter 3 is 55 to 65 degrees, preferably 60 degrees, so that the image light emitted from the image source 2 is incident on the beam splitter 3 at a suitable angle. While ensuring that the beam splitter 3 effectively reflects the image light and guides it to the curved mirror 1, it reduces light energy loss, polarization effect and stray light caused by excessive or insufficient incident angle, and improves the brightness and contrast of the virtual image 4 in the air.

[0026] refer to Figure 2 In one implementation, the angle between the curved mirror 1 and the beam splitter 3 is 60 to 70 degrees, preferably 65 degrees, so that the image light reflected from the beam splitter 3 enters the curved mirror 1 at a suitable angle, and after being focused and reflected by the curved mirror 1, it passes through the beam splitter 3 again at an optimized incident angle. This reduces light energy loss, stray light and ghosting while ensuring high transmission efficiency, and improves the brightness and contrast of the aerial virtual image 4.

[0027] As a preferred approach, the beam splitter 3 has a transmittance of 50% and a reflectance of 50%. It can provide sufficient reflected light flux to the curved reflector 1 when the light from the image source 2 is first incident, and provide sufficient transmitted light flux to pass through the beam splitter 3 and the cabin interior to form the virtual image 4 when the reflected light from the curved reflector 1 is second incident. This balances the light distribution between reflection and transmission, avoiding low image brightness or optical path mismatch caused by an excessively biased splitting ratio towards reflection or transmission. At the same time, the beam splitter 3 has a simple structure, low cost, and is easy to integrate with the image source 2 and the curved reflector 1 into a rotatable base. It can achieve a compact folding optical path with an angle of 55 to 65 degrees and 60 to 70 degrees, and maintain stable splitting performance when the whole system rotates, ensuring brightness consistency and automotive-grade reliability for the floating image of the driver, passenger, and rear seats.

[0028] refer to Figure 3In one embodiment, the beam splitter 3 includes a first anti-reflection coating 5, a first glass substrate 6, a first bonding layer 7, a first functional metal layer 8, and a first anti-oxidation protective layer 9, arranged sequentially. The reflective surface of the beam splitter 3 is the side of the first functional metal layer 8 closest to the first bonding layer 7. The first anti-reflection coating 5 reduces the reflection loss of incident light on the outer surface of the beam splitter 3, improving the transmittance of the image source 2. The first glass substrate provides rigid support and a stable optical surface shape, ensuring that the beam splitter 3 is not easily deformed under vehicle vibration and temperature changes. The first bonding layer 7 enhances the bonding between the first functional metal layer 8 and the first glass substrate 9. The adhesion between the glass substrates prevents the metal layer from peeling off or delaminating; the first functional metal layer 8 realizes the functions of beam splitting, reflection and transmission; the first anti-oxidation protective layer 9 protects the metal layer from oxidation and corrosion, improving long-term reliability; at the same time, the reflective surface of the beam splitter 3 is defined as the side of the first functional metal layer 8 close to the first bonding underlayer 7, so that the light from the image source 2 is reflected at this interface after entering from the side of the first anti-reflection anti-reflection film 5. The reflective surface is not directly exposed to air and moisture, and is protected by multiple layers of glass substrate, bonding underlayer and anti-oxidation protective layer, thereby improving the stability of reflectivity and environmental durability, and reducing stray light and ghosting.

[0029] refer to Figure 4 In one embodiment, the curved reflector 1 includes a second glass substrate 13, a second bonding layer 12, a second functional metal layer 11, and a second oxygen-resistant protective layer 10 arranged sequentially. The reflective surface of the curved reflector 1 is the side of the second functional metal layer 11 closest to the second bonding layer 12. The second glass substrate 13 provides rigid support and a stable curved surface shape, ensuring that the reflector is not easily deformed under vehicle vibration and temperature changes. The second bonding layer 12 enhances the adhesion between the second functional metal layer 11 and the second glass substrate 13, preventing the metal layer from falling off or delaminating. The second functional metal layer 11 achieves high reflectivity imaging. The second oxygen-resistant protective layer 10 protects the metal layer from oxidation and corrosion, improving long-term reliability. At the same time, by defining the reflective surface as the side of the second functional metal layer 11 closest to the second bonding layer 12, the image light reflected by the beam splitter 3 is incident from the second glass substrate 13 side and reflected at this interface. The reflective surface is not directly exposed to air and moisture and is protected by multiple layers of glass substrate and bonding layer, thereby improving reflectivity stability and environmental durability, and reducing stray light and ghosting.

[0030] As one implementation, a second anti-reflection coating is provided between the second glass substrate 13 and the second bonding substrate 12. When the image light reflected by the beam splitter 3 is incident from one side of the second glass substrate 13, the reflection loss at the interface between the glass substrate and the bonding substrate is significantly reduced. More light can pass through the interface to reach the second functional metal layer 11 for reflection, and then pass through the interface again after reflection, thereby improving the reflected light flux and light utilization efficiency of the curved mirror 1.

[0031] As one implementation method, the cabin interior includes the dashboard, center armrest, front seat backs, door trim panels, or ceiling. The dashboard, center armrest, front seat backs, door trim panels, or ceiling are equipped with light-transmitting windows through which the virtual image 4 passes. This provides a stable, enclosed, and protected installation environment for levitation imaging without occupying visible space such as the dashboard and center console, avoiding the constraints of the physical robot protrusion on the interior design and HUD layout. The light-transmitting windows ensure that the virtual image 4, after being reflected by the curved reflector 1 and passing through the beam splitter 3, can be smoothly projected and form a levitation image in the cabin. They can also be concealed by semi-transparency, blackening, coating, or mesh treatments, making it difficult for occupants to notice the internal optical components from the outside, maintaining the aesthetics and integrity of the interior. At the same time, the windows can be sealed with dustproof and moisture-proof designs to protect the image source 2, beam splitter 3, and curved reflector 1 from dust, moisture, and external forces, meeting automotive-grade vibration, temperature, and long-term use requirements.

[0032] This invention also discloses a suspension imaging method, comprising the following steps: S1: Real-time acquisition of in-vehicle image information and voice signals via image acquisition devices and microphone arrays installed inside the carriage; S2: The control system receives signals from the image acquisition device and the microphone array, and determines the operator's position, identity and gaze direction through sound source localization, face recognition and / or eye tracking; S3: The control system controls the rotation of the rotatable base set inside the cabin interior, so that the image emitted by the image source 2 installed on the rotatable base is reflected by the beam splitter 3 to the curved reflector 1, and then reflected by the curved reflector 1 and passes through the beam splitter 3 and the light-transmitting window on the cabin interior to form a virtual image 4 at a preset position in front of the corresponding operator. S4: The image of image source 2 is modulated by a microlens placed between image source 2 and beam splitter 3, so that the micro-unit image array on image source 2 is projected in different viewing directions, and a three-dimensional virtual image 4 with binocular parallax or full parallax is reconstructed in the carriage. S5: Control the system to update the content, form or interactive feedback of virtual image 4 according to the operator's voice commands or air gestures; S6: When the operator's position changes, the control system controls the rotatable base to drive the image source 2, beam splitter 3 and curved reflector 1 to rotate as a whole, so that the virtual image 4 automatically turns and positions itself in front of the new operator. S7: Multiple image sources 2, beam splitters 3, and curved reflectors 1 are set inside the cabin interior, corresponding to the driver, passenger, and rear seats respectively. The control system activates the image source 2 and the rotatable base at the corresponding position according to the operator's position to achieve multi-seat distributed floating imaging. S8: Update the virtual image, special effects and interaction logic displayed by image source 2 via OTA, and use the virtual image 4 as a near-field interaction layer to work in conjunction with the far-field information layer displayed by AR-HUD to form a near-field layered interaction system.

[0033] By adopting the above method, it is possible to achieve multi-seat directional floating display, three-dimensional stereoscopic presentation and continuous functional evolution of virtual image 4, thereby achieving comprehensive improvement in space utilization, reliability, interactive coverage, driving safety and functional evolution.

[0034] It should be noted that, for those skilled in the art, it is obvious that the present invention is not limited to the details of the exemplary embodiments described above, and that the invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be included within the invention. No reference numerals in the claims should be construed as limiting the scope of the claims.

Claims

1. A levitation imaging device, characterized in that, The system includes a rotatable base installed inside the cabin interior, an image source (2) installed on the rotatable base, a beam splitter (3) for reflecting the image source (2), a curved reflector (1) for receiving the image reflected by the beam splitter (3), an image acquisition device and a microphone array installed inside the cabin, and a control system that is communicatively connected to the image acquisition device, the microphone array and the rotatable base. The image reflected by the curved reflector (1) passes through the beam splitter (3) to form a virtual image (4) inside the cabin. The control system is used to receive signals from the microphone array and the image acquisition device, and control the rotatable base to rotate the virtual image (4) to a preset position according to the operator's position.

2. The levitation imaging device according to claim 1, characterized in that, The image from the image source (2) is emitted to the beam splitter (3) through a microlens.

3. The levitation imaging device according to claim 1, characterized in that, The angle between the image source (2) and the beam splitter (3) is 55 to 65 degrees.

4. The levitation imaging device according to claim 1, characterized in that, The angle between the curved reflector (1) and the beam splitter (3) is 60 to 70 degrees.

5. The levitation imaging device according to claim 1, characterized in that, The beam splitter (3) has a transmittance of 50% and a reflectance of 50%.

6. The levitation imaging device according to claim 1, characterized in that, The beam splitter (3) includes a first anti-reflection coating (5), a first glass substrate (6), a first bonding substrate (7), a first functional metal layer (8), and a first oxygen protection layer (9) arranged sequentially. The reflective surface of the beam splitter (3) is the side of the first functional metal layer (8) close to the first bonding substrate (7).

7. The levitation imaging device according to claim 1, characterized in that, The curved reflector (1) includes a second glass substrate (13), a second adhesive underlayer (12), a second functional metal layer (11), and a second oxygen-proof protective layer (10) arranged in sequence. The reflective surface of the curved reflector (1) is the side of the second functional metal layer (11) close to the second adhesive underlayer (12).

8. The levitation imaging device according to claim 7, characterized in that, A second anti-reflective coating is provided between the second glass substrate (13) and the second adhesive underlayer (12).

9. The levitation imaging device according to claim 1, characterized in that, The cabin interior includes an instrument panel, a center armrest, front seat backrests, door interior panels, or a roof. The instrument panel, center armrest, front seat backrests, door interior panels, or roof are provided with light-transmitting windows through which the virtual image (4) passes.

10. A method of using a levitation imaging device, characterized in that, Includes the following steps: Voice signals inside the vehicle are collected via a microphone array, and image information inside the vehicle is collected via an image acquisition device. The control system determines the operator's location and identity based on the voice signal and / or the image information; The control system controls the rotating base to rotate, so that the image emitted by the image source (2) is reflected by the beam splitter (3) to the curved mirror (1), and then reflected by the curved mirror (1) and passes through the beam splitter (3) to form a virtual image (4) at a preset position in front of the corresponding operator. The control system updates the content or form of the virtual image (4) based on the operator's gestures or voice.

Images