Steerable vehicle-mounted interactive suspension space display device and vehicle

Abstract

The invention discloses a steerable vehicle-mounted interactive suspension space display device and a vehicle. The device comprises an image display unit, an optical folding unit, a multidirectional voice pickup unit, a rotary driving mechanism and a control processing unit. A suspension virtual image is formed through the optical folding unit, the direction of a sound source is judged through the multidirectional voice pickup unit, the display interface is driven by the rotary driving mechanism to automatically turn to an instructor, and intelligent interaction of who calling and facing to who is achieved. According to the design, a fixed interaction point is upgraded into an interaction center shared by the whole vehicle, the problems that an existing vehicle-mounted display interaction object is single, experience is poor, potential safety hazards exist and the like are effectively solved, and driving safety and passenger experience are remarkably improved.

Description

Technical Field

[0001] This invention relates to the field of vehicle-mounted human-machine interaction technology, specifically to a steerable vehicle-mounted interactive floating space display device and vehicle. It is an interactive device with spatial floating display and multi-directional voice interaction functions, and the display interface can be rotated to serve different passengers in the vehicle. Background Technology

[0002] With the development of smart cockpit technology, in-vehicle virtual personal assistants have become an important component in enhancing the driving experience and the level of vehicle intelligence. Currently, in-vehicle information (such as vehicle speed, navigation, and entertainment information) is mainly displayed through LCD instrument panels or central control screens, and virtual assistants mostly appear on the screen as two-dimensional animated figures (such as NIO's Nomi).

[0003] However, the existing display method has the following problems: 1. The information display is too simple, and the information is confined to a two-dimensional screen, lacking depth and three-dimensionality, resulting in a less intuitive and immersive visual experience.

[0004] 2. In terms of driving safety, drivers need to shift their gaze significantly from the road ahead to the screen to see the information, which increases driving risks.

[0005] 3. The interactive experience is unnatural; the virtual assistant's image is isolated from the real physical space, making it difficult to give users a sense of "real presence."

[0006] 4. The experience lacks cohesion; the fixed display cannot flexibly switch between "driver-only mode" and "vehicle-wide sharing mode." For example, in autonomous driving mode, it is not easy to switch entertainment content to all passengers for sharing.

[0007] Therefore, there is an urgent need in this field for an integrated in-vehicle interaction solution that can dynamically adjust the service objects, integrate floating displays and multi-directional voice interaction without significantly occupying physical space. Summary of the Invention

[0008] This invention provides a steerable in-vehicle interactive floating space display device and vehicle to solve the problems of existing in-vehicle display interaction objects being singular, having poor experience, and posing safety hazards. It can not only generate a floating virtual image, but also change the display direction through physical rotation. Combined with omnidirectional sound pickup technology, it can dynamically serve the driver, front passenger, and even rear passengers, achieving true whole-vehicle collaborative interaction.

[0009] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is: a steerable in-vehicle interactive floating space display device, comprising: An image display unit is used to generate an initial image; An optical folding unit, located at the optical path output end of the image display unit, is used to reflect image light to the human eye to form a suspended virtual image; A multi-directional voice pickup unit is used to collect voice signals from multiple directions inside the vehicle; A rotary drive mechanism, connected to the image display unit and the optical folding unit, is used to drive the two to rotate as a single component. The control processing unit is electrically connected to the image display unit, the multi-directional voice pickup unit, and the rotation drive mechanism, respectively. The control processing unit is configured to: determine the direction of the sound source based on the voice signal collected by the multi-directional voice pickup unit, and control the rotation drive mechanism to drive the entire component to rotate so that the suspended virtual image faces the direction of the sound source.

[0010] The rotary drive mechanism includes a drive unit, a transmission unit, and a rotating base. The drive unit is a stepper motor or a servo motor, the transmission unit is a gear set, and the rotating base is a gear ring structure that meshes with the gear set. The rotating base is used to fix the image display unit and the optical folding unit and rotates around the vertical axis under the drive.

[0011] The rotary drive mechanism also includes pins and bearings for limiting and supporting the rotation of the overall assembly.

[0012] The multi-directional voice pickup unit is a ring microphone array.

[0013] The optical folding unit is a dual-optical-path cemented prism or a semi-transparent, semi-reflective wave plate placed at a certain angle.

[0014] The image display unit uses a micro OLED, Micro-LED, or backlit TFT LCD screen.

[0015] The control processing unit is further configured to switch the display content of the image display unit according to the direction of the sound source.

[0016] The present invention, employing the above-mentioned technical solution, provides a steerable in-vehicle interactive floating space display device and vehicle. Compared with the prior art, its advantages are as follows: 1. Multi-functional and dynamic service: Through the physical rotating display interface, a single device can flexibly serve users in different locations within the vehicle, achieving a leap from "exclusive to a single person" to "shared by all," greatly enhancing the utilization value of the device and the fairness of interaction.

[0017] 2. Natural and intelligent interaction: Combining sound source localization technology, the device can automatically identify the user who issues the command and automatically turn the display interface to that user, providing an intelligent and natural interactive experience of "facing whoever calls".

[0018] 3. Optimize space and cost: Instead of installing a separate screen for each seat, multiple "virtual screens" are created using a movable high-tech device, saving interior space and hardware costs.

[0019] 4. Enhanced Safety and Experience: Passengers can clearly see the display facing them without leaning forward or shifting their gaze significantly, reducing the risk of driver distraction. In autonomous driving scenarios, it can be switched to a shared entertainment mode for the entire vehicle, further enhancing the riding experience. Attached Figure Description

[0020] Figure 1 This is a schematic diagram of the structure of the present invention; Figure 2 This is a schematic diagram of the light rays of the present invention; Figure 3 This is a schematic diagram of the rotary drive mechanism of the present invention.

[0021] In the diagram, 1-image display unit, 2-optical folding unit, 3-control processing unit, 4-rotation drive mechanism, 5-multi-directional voice pickup unit, 401-stepper motor, 402-gear set, 403-rotating seat, 404-shaft pin, 405-bearing. Detailed Implementation

[0022] The following description, in conjunction with the accompanying drawings, details a steerable in-vehicle interactive floating space display device and a vehicle according to the present invention.

[0023] This invention relates to a steerable in-vehicle interactive floating space display device and vehicle, see [link / reference]. Figures 1 to 3 , include: Image display unit 1 is used to generate an initial image and employs a micro OLED, Micro-LED, or backlit TFTLCD screen.

[0024] Optical folding unit 2, located at the optical path output end of the image display unit, is used to reflect image light to the human eye to form a suspended virtual image. The core function of optical folding unit 2 is optical path folding. It uses a double-optical-path cemented prism or a semi-transparent and semi-reflective wave plate placed at a certain angle to reflect the light emitted by the image display unit to the human eye, forming a virtual image suspended in the air.

[0025] Multi-directional voice pickup unit 5: Employs a 360° sound pickup device, such as a circular microphone array. This array consists of multiple microphones evenly arranged circumferentially, enabling it to collect voice signals from all directions inside the vehicle without blind spots, thus determining the user's location.

[0026] The rotary drive mechanism 4 is a key improvement of this invention. Connected to the image display unit and the optical folding unit, it drives the image display unit 1 and the optical folding unit 2 as a single assembly to rotate horizontally relative to the device base. This mechanism may include a drive unit, a transmission unit, and a rotating base. The drive unit may be a stepper motor or servo motor 401. The transmission unit may be a gear set 402. The rotating base 403 is a gear ring structure that meshes with the gear set 402, fixed to the main body, and used to transmit power. The rotating base 403 is used to fix the image display unit 1 and the optical folding unit 2, and can rotate around a vertically arranged rotation axis under the drive of the drive unit. A pin 404 and a bearing 405 serve as limiting structures to limit and support the rotation of the entire assembly.

[0027] The control processing unit 3 is the intelligent core of the device, and its functions include: controlling the content output of the image display unit 1; processing the audio signals of the multi-directional voice pickup unit 5 and determining the direction of the voice command source (e.g., from the driver's area or the passenger's area) through sound source localization technology; sending control signals to the rotation drive mechanism 4 according to the source of the voice command or preset commands (such as manual switching by the user), driving the optical display component to rotate so that the suspended virtual image is aligned with the target user; and adjusting the display content in a coordinated manner, for example, displaying driving information when the direction is towards the driver and entertainment information when the direction is towards the passenger, i.e., switching the display content of the image display unit according to the direction of the sound source.

[0028] This invention Figure 2 This illustrates the light propagation path from the image display unit to the human eye and the image display location. Figure 3 The signal from the multi-directional voice pickup unit drives the motor to rotate the main structure through a built-in program, thus meeting the usage needs of different drivers and passengers. Example

[0029] Referring to Figure 1, the housing of this device consists of a fixed base and a rotatable top cover. The image display unit 1 (in this example, a 3.92-inch micro OLED) and the optical folding unit 2 (in this example, a 45° dual-optical-path laminated prism with a semi-transparent, semi-reflective coating on the laminated surface) form a core optical module, fixed inside the rotatable top cover. The multi-directional voice pickup unit 5 is a circular array consisting of six MEMS microphones, mounted on the top of the top cover. The main control PCB board of the control processing unit 3 is located inside the base.

[0030] Reference Figure 3 The specific working process of the rotary drive mechanism 4 is as follows: The stepper motor 401 starts as the power source, and through the gear set 402, it is decelerated and the torque is amplified, thereby driving the rotating seat 403 with gears to rotate. The rotating seat 403 is rigidly connected to the upper cover of the fixed optical module, thereby driving the entire display interface to rotate. The shaft pin 404 and the bearing 405 ensure the smoothness and precise positioning of the rotation process.

[0031] Work process: By default, the device's display faces the driver, showing specific expressions or driving reminders. When the front passenger says "Turn on the music," the ring microphone array 5 captures the sound, and the control processing unit 3 uses a sound source localization algorithm to determine that the sound source is in the front passenger's direction. The control unit then sends a command to the stepper motor 401, driving the upper cover and its internal optical components to rotate by a corresponding angle (e.g., 60 degrees), causing the resulting floating virtual image to turn towards the front passenger. Simultaneously, the display automatically switches to the music playback interface. The entire process requires no manual operation, achieving intelligent interactive switching.

Claims

1. A steerable in-vehicle interactive floating space display device, characterized in that: include: An image display unit is used to generate an initial image; An optical folding unit, located at the optical path output end of the image display unit, is used to reflect image light to the human eye to form a suspended virtual image; A multi-directional voice pickup unit is used to collect voice signals from multiple directions inside the vehicle; A rotary drive mechanism, connected to the image display unit and the optical folding unit, is used to drive the two to rotate as a single component. The control processing unit is electrically connected to the image display unit, the multi-directional voice pickup unit, and the rotation drive mechanism, respectively. The control processing unit is configured to: determine the direction of the sound source based on the voice signal collected by the multi-directional voice pickup unit, and control the rotation drive mechanism to drive the entire component to rotate so that the suspended virtual image faces the direction of the sound source.

2. The steerable in-vehicle interactive floating space display device according to claim 1, characterized in that: The rotary drive mechanism includes a drive unit, a transmission unit, and a rotating base. The drive unit is a stepper motor or a servo motor, the transmission unit is a gear set, and the rotating base is a gear ring structure that meshes with the gear set. The rotating base is used to fix the image display unit and the optical folding unit and rotates around the vertical axis under the drive.

3. A steerable in-vehicle interactive floating space display device according to claim 2, characterized in that: The rotary drive mechanism also includes pins and bearings for limiting and supporting the rotation of the overall assembly.

4. A steerable in-vehicle interactive floating space display device according to claim 1, characterized in that: The multi-directional voice pickup unit is a ring microphone array.

5. A steerable in-vehicle interactive floating space display device according to claim 1, characterized in that: The optical folding unit is a dual-optical-path cemented prism or a semi-transparent, semi-reflective wave plate placed at a certain angle.

6. A steerable in-vehicle interactive floating space display device according to claim 1, characterized in that: The image display unit uses a micro OLED, Micro-LED, or backlit TFT LCD screen.

7. A steerable in-vehicle interactive floating space display device according to claim 1, characterized in that: The control processing unit is further configured to switch the display content of the image display unit according to the direction of the sound source.

8. A vehicle characterized by: Includes the steerable in-vehicle interactive floating space display device as described in any one of claims 1 to 7.

Images