In-vehicle image acquisition module, virtual interaction device, virtual interaction system and virtual interaction method

By setting up a movable car-end camera and holographic projection module in the vehicle, the problem that people outside the vehicle cannot see the images in the vehicle is solved, and the immersive interactive experience in the car and the vehicle is enhanced. The vehicle's sense of technology and Interactive.

CN119031224APending Publication Date: 2024-11-26MERCEDES BENZ GRP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411269768.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-11
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The holographic projection device in the existing vehicle cannot transmit the images inside the vehicle to the personnel outside the vehicle, which affects the interactive experience of personnel outside the vehicle.

Method used

A virtual interactive device in-vehicle image acquisition module is designed, including a vehicle-end camera, a driving mechanism and a controller. By receiving position signals, the camera moves, photographs and transmits the in-vehicle images to the outside of the vehicle, and realizes immersion with a holographic projection module. interactive experience.

Benefits of technology

It enhances the immersive interactive experience of the outside of the car, enhances the fun of the interaction and the sense of technology of the vehicle, and realizes the real interaction between the inside and outside of the car.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031224A_ABST
    Figure CN119031224A_ABST
Patent Text Reader

Abstract

The invention relates to an in-vehicle image acquisition module for a virtual interaction device of a vehicle, and the in-vehicle image acquisition module at least comprises a vehicle end camera which is arranged in the vehicle and is configured to be suitable for shooting an in-vehicle image; the driving mechanism is configured to be suitable for driving the vehicle end camera to move; and the controller is configured to be suitable for generating a control instruction for the driving mechanism according to the received position signal so as to realize the movement, corresponding to the position signal, of the vehicle end camera. The invention also relates to a corresponding virtual interaction device for a vehicle, a virtual interaction system for a vehicle and a virtual interaction method for a vehicle. The immersive interactive experience feeling can be realized, and the science and technology feeling and the mobile internet attribute of the vehicle are enhanced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle communication, and in particular to an in-vehicle image acquisition module for a virtual interaction device for a vehicle. The present invention also relates to a corresponding virtual interaction device for a vehicle, a corresponding virtual interaction system for a vehicle, and a corresponding virtual interaction method for a vehicle. Background Art

[0002] In recent years, with the improvement of living standards and the development of technology, the way people interact with each other has changed significantly. Even at long distances, real-time interaction is possible. Among them, as the main means of transportation, vehicles have increasingly higher requirements in terms of interaction.

[0003] In order to achieve a more realistic interactive experience, there is a holographic projection device installed inside the vehicle in the prior art, so that the passengers inside the vehicle can see the three-dimensional dynamic image of the person outside the vehicle who is interacting with them. However, the person outside the vehicle cannot see the image inside the vehicle, which adversely affects the interactive experience of the person outside the vehicle. Summary of the invention

[0004] Therefore, the purpose of the present invention is to propose an improved in-vehicle image acquisition module for a virtual interaction device for a vehicle, through which the in-vehicle image acquisition module can provide the required in-vehicle images for external interaction personnel, so that the external interaction personnel have the feeling of being in the vehicle, thereby achieving an immersive interactive experience and enhancing the technological sense and mobile Internet attributes of the vehicle. In addition, the purpose of the present invention is also to propose a corresponding virtual interaction device for a vehicle, a corresponding virtual interaction system for a vehicle, and a corresponding virtual interaction method for a vehicle.

[0005] According to a first aspect of the present invention, there is provided an in-vehicle image acquisition module for a virtual interaction device of a vehicle, wherein the in-vehicle image acquisition module at least comprises:

[0006] - a vehicle-side camera, which is arranged inside the vehicle and is configured to capture images inside the vehicle;

[0007] - a driving mechanism, the driving mechanism being configured to drive the vehicle-end camera to move; and

[0008] - A controller, the controller being configured to generate a control instruction for the driving mechanism according to the received position signal, so as to realize the movement of the vehicle-side camera corresponding to the position signal.

[0009] In the framework of the present invention, "virtual interaction" should be understood as an interaction method that can provide a highly immersive three-dimensional interactive experience and is suitable for application scenarios that require complex interactions and simulation experiences.

[0010] Compared with the prior art, in the in-vehicle image acquisition module of the virtual interaction device for vehicles according to the present invention, the vehicle-side camera is not fixed, but can move accordingly with the help of a driving mechanism according to a received position signal, and the position signal indicates the desired viewing angle of the person interacting outside the vehicle, so that the vehicle-side camera can capture the in-vehicle image according to the needs of the person interacting outside the vehicle, and the in-vehicle image is provided to the person interacting outside the vehicle, thereby enabling the person interacting outside the vehicle to view the in-vehicle image from the desired first-person perspective and interact with the occupants in the vehicle, thereby providing the person interacting outside the vehicle with an immersive interactive experience as if they were in the vehicle, which can not only enhance the fun of the interaction, but also enhance the vehicle's sense of technology and mobile Internet attributes.

[0011] Exemplarily, the driving mechanism includes at least a driving motor and a first rotating shaft, wherein the first rotating shaft is configured to convert the rotational motion of the driving motor into the rotational motion of the vehicle-end camera in a horizontal plane.

[0012] Exemplarily, the first rotating shaft is connected to the output shaft of the driving motor in a rotationally fixed manner and is meshingly connected to the housing of the vehicle-end camera via gears.

[0013] Exemplarily, the driving mechanism includes a second rotating shaft, which is configured to convert the rotational motion of the driving motor into a swinging motion of the vehicle-end camera in a vertical plane.

[0014] Exemplarily, the first rotating shaft is constructed to be axially telescopic so as to drive the vehicle-end camera to translate up and down along the height direction.

[0015] Exemplarily, the in-vehicle image acquisition module includes a first shell, wherein, in the working state of the in-vehicle image acquisition module, the vehicle-end camera is extended from the first shell by extending the first rotating shaft, and in the parking state of the in-vehicle image acquisition module, the vehicle-end camera is retracted into the first shell by shortening the first rotating shaft.

[0016] According to a second aspect of the present invention, there is provided a virtual interaction device for a vehicle, wherein the virtual interaction device at least comprises:

[0017] - an in-vehicle image acquisition module according to the present invention; and

[0018] - A communication module configured to be suitable for realizing a wireless communication connection with a paired virtual interaction device outside the vehicle.

[0019] Exemplarily, the virtual interaction device also includes a holographic projection module, which includes at least one holographic imaging unit, and the holographic imaging unit has a holographic imaging film and a projection screen, and the projection screen is configured to project the received image onto the holographic imaging film to generate a holographic projection.

[0020] Exemplarily, the holographic projection module includes four holographic imaging units uniformly distributed in a circumferential direction, and the holographic imaging units are constructed in exactly the same manner, wherein, in the unfolded position of the holographic projection module, the holographic imaging film of the holographic imaging unit forms an angle of 45° with the projection screen.

[0021] Exemplarily, the holographic projection module also includes a hinge mechanism and a second shell, wherein the hinge structure is centrally arranged in the second shell and is configured to be suitable for converting the holographic projection film between an extended position and a retracted position through a pivoting movement of the holographic projection film around the hinge mechanism.

[0022] Exemplarily, the holographic projection module and the in-vehicle image acquisition module are integrated into one body.

[0023] Exemplarily, the virtual interaction device is arranged on the roof of the vehicle.

[0024] According to a third aspect of the present invention, there is provided a virtual interaction system for a vehicle, wherein the virtual interaction system at least comprises:

[0025] - a virtual interaction device according to the present invention, said virtual interaction device being arranged in said vehicle;

[0026] - a paired virtual interaction device, which is located outside the vehicle and is wirelessly connected to the virtual interaction device, wherein the paired virtual interaction device at least includes a remote control display module, and the remote control display module is configured to be suitable for sending a position signal to the controller of the in-vehicle image acquisition module and displaying the in-vehicle image captured by the vehicle-side camera.

[0027] Exemplarily, the remote control display module is configured as a wearable virtual reality device.

[0028] Exemplarily, the remote control display module is configured with a position sensor, which is configured to detect the head position and / or eye position of a person interacting outside the vehicle and generate a corresponding position signal.

[0029] Exemplarily, the virtual interaction device includes a holographic projection module, and the paired virtual interaction device includes an outside-vehicle image acquisition module, which is configured to capture outside-vehicle images in a surround manner and send data about the outside-vehicle images to the holographic projection module.

[0030] According to a fourth aspect of the present invention, a virtual interaction method for a vehicle is provided, wherein the virtual interaction method is implemented by a virtual interaction system according to the present invention, wherein the virtual interaction method at least comprises the following steps:

[0031] S11: The remote control display module of the paired virtual interaction device of the virtual interaction system sends a position signal to the in-vehicle image acquisition module of the virtual interaction device;

[0032] S12: the controller of the in-vehicle image acquisition module generates a control instruction for a driving mechanism according to the position signal, so that the vehicle-end camera moves corresponding to the position signal;

[0033] S13: Capturing the image inside the vehicle by using the vehicle-side camera;

[0034] S14: sending the in-vehicle image to the remote control display module through the communication module of the virtual interaction device, and the remote control display module displays the in-vehicle image.

[0035] Exemplarily, in step S11, the position signal is generated according to the head position and / or eye position of the person interacting outside the vehicle detected by the position sensor of the remote control display module.

[0036] Exemplarily, when the position signal shows horizontal rotation, the rotational motion of the drive motor is converted into the rotational motion of the vehicle-end camera in a horizontal plane through the first rotating shaft of the drive mechanism; and / or, when the position signal shows vertical movement, the rotational motion of the drive motor is converted into the swinging motion of the vehicle-end camera in a vertical plane through the second rotating shaft of the drive mechanism.

[0037] Exemplarily, the virtual interaction method additionally comprises the following steps:

[0038] S21: The vehicle exterior image acquisition module of the paired virtual interaction device captures the vehicle exterior image in a surround view manner and sends the vehicle exterior image to the virtual interaction device;

[0039] S22: Projecting the received vehicle exterior image onto a holographic imaging film via a projection screen of a holographic projection module of the virtual interaction device to generate a holographic projection. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The present invention will be described in more detail below with reference to the accompanying drawings, so that the principles, features and advantages of the present invention can be better understood. The accompanying drawings include:

[0041] Figure 1 A schematic diagram of an in-vehicle image acquisition module of a virtual interaction device for a vehicle according to an exemplary embodiment of the present invention is shown;

[0042] Figure 2 A schematic diagram showing a virtual interaction device for a vehicle according to an exemplary embodiment of the present invention;

[0043] Figure 3 Shows Figure 2 A schematic stereoscopic perspective view of a virtual interactive device in a stopped state;

[0044] Figure 4a and Figure 4b They are shown respectively Figure 2 A front view and a stereoscopic perspective view of the virtual interactive device in a working state;

[0045] Figure 5 A schematic block diagram of a virtual interaction system for a vehicle according to an exemplary embodiment of the present invention is shown;

[0046] Figure 6a and Figure 6b Schematic flow charts of a virtual interaction method for a vehicle according to an exemplary embodiment of the present invention are respectively shown. DETAILED DESCRIPTION

[0047] In order to make the technical problems, technical solutions and beneficial technical effects to be solved by the present invention more clearly understood, the present invention will be further described in detail below in conjunction with the accompanying drawings and multiple exemplary embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the scope of protection of the present invention.

[0048] This specification provides method operation steps as described in the embodiments or flow charts, but more or fewer operation steps may be included based on routine or non-creative work. The order of steps listed in the embodiments is only one way of executing the steps among many orders, and does not represent the only order of execution.

[0049] In this specification, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate, or the internal communication of two elements. For ordinary technicians in this field, the meanings of the above terms in this disclosure can be understood according to the circumstances.

[0050] It should be understood that, in this document, the expressions "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance, nor should they be understood as implicitly indicating the number of technical features indicated. Features defined as "first" or "second" may explicitly or implicitly indicate that at least one of the features is included.

[0051] Figure 1 A schematic diagram of an in-vehicle image acquisition module 10 of a virtual interaction device 100 for a vehicle according to an exemplary embodiment of the present invention is shown.

[0052] like Figure 1 As shown, the in-vehicle image acquisition module 10 includes a vehicle-end camera 11, which is arranged inside the vehicle and is configured to capture in-vehicle images, and the in-vehicle images can be transmitted in real time to a display device of a person interacting outside the vehicle.

[0053] like Figure 1 As shown, the in-vehicle image acquisition module 10 includes a driving mechanism 12 and a controller 13, wherein the driving mechanism 12 is configured to drive the movement of the vehicle-end camera 11 so that the vehicle-end camera 11 can comprehensively capture images of different positions in the vehicle as needed, and the controller 13 is configured to generate a control instruction for the driving mechanism 12 according to the received position signal, so as to realize the movement of the vehicle-end camera 11 corresponding to the position signal, wherein the position signal is given by the person interacting outside the vehicle and reflects the desired viewing angle of the person interacting outside the vehicle, thereby the vehicle-end camera 11 can capture the in-vehicle image according to the needs of the person interacting outside the vehicle, so that the person interacting outside the vehicle can view the in-vehicle image from the desired first viewing angle and interact with the occupants in the vehicle, which can realize an immersive interactive experience for the person interacting outside the vehicle.

[0054] For example, Figure 1 As shown, the driving mechanism 12 includes a driving motor 1 and a first rotating shaft 2, wherein the first rotating shaft 2 can convert the rotational motion of the driving motor 1 into the rotational motion of the vehicle-end camera 11 in a horizontal plane, wherein the first rotating shaft 2 is particularly connected to the output shaft of the driving motor 1 in a torsion-proof manner and is meshedly connected to the housing of the vehicle-end camera 11 through a gear 3. When the received position signal shows horizontal rotation, the rotational motion of the driving motor 1 is converted into the rotational motion of the vehicle-end camera 11 in a horizontal plane through the first rotating shaft 2 of the driving mechanism 12, so as to capture images of the interior of the vehicle in different horizontal directions.

[0055] For example, Figure 1As shown, the drive mechanism 12 also includes a second rotating shaft 4, which is also operatively connected to the drive motor 1 and is configured to convert the rotational motion of the drive motor 1 into the swinging motion of the vehicle-end camera 11 in the vertical plane. When the received position signal shows vertical movement, the rotational motion of the drive motor 1 is converted into the swinging motion of the vehicle-end camera 11 in the vertical plane by the second rotating shaft 4 of the drive mechanism 12 to capture the in-vehicle images at different height directions. Here, for example, a clutch can be provided to realize a selectable operative connection between the drive motor 1 and the first rotating shaft 2 and the second rotating shaft 4.

[0056] For example, Figure 1 As shown, the first rotating shaft 2 of the driving mechanism 12 is telescopically constructed to drive the vehicle-end camera 11 to move vertically up and down in the height direction, which can achieve height adjustment of the vehicle-end camera 11.

[0057] For example, Figure 1 As shown, the in-vehicle image acquisition module 10 includes a first housing 14, which is configured to protect the vehicle-end camera 11 from damage. In particular, in the working state of the in-vehicle image acquisition module 10, the vehicle-end camera 11 is extended from the first housing 14 by extending the first rotating shaft 2 to capture the in-vehicle image without hindrance, and in the in-vehicle image acquisition module 10 The in-vehicle image acquisition module 10 is stopped, and the vehicle-end camera 11 is retracted into the first housing 14 by shortening the first rotating shaft 2 to save space and protect the vehicle-end camera 11.

[0058] Figure 2 A schematic view of a virtual interaction device 100 for a vehicle according to an exemplary embodiment of the present invention is shown. Figure 3 Shows Figure 2 Schematic stereoscopic perspective view of the virtual interaction device 100 in the idle state. Figure 4a and Figure 4b They are shown respectively Figure 2 A front view and a stereoscopic perspective view of the virtual interaction device 100 in a working state.

[0059] like Figures 2 to 4b As shown, the virtual interaction device 100 according to the present invention includes an in-vehicle image acquisition module 10, which can capture in-vehicle images according to the needs of the outside-vehicle interaction personnel, and the in-vehicle images can be provided to the paired virtual interaction device 200 of the outside-vehicle interaction personnel.

[0060] like Figures 2 to 4bAs shown, the virtual interaction device 100 includes a holographic projection module 20, and the holographic projection module 20 includes at least one holographic imaging unit, and the holographic imaging unit has a holographic imaging film 21 and a projection screen 22, and the projection screen 22 can project the received image onto the holographic imaging film 21 to generate a holographic projection. As a result, the passengers in the car can see the images outside the car in the form of a three-dimensional holographic projection, especially the people interacting outside the car, through the holographic projection module 20, which greatly enhances the interactive experience. Through the in-car image acquisition module 10 and the holographic projection module 20, virtual reality technology and holographic projection technology can be combined, making the interactive experience between the passengers in the car and the people interacting outside the car more real and interesting.

[0061] like Figure 2 As shown, the virtual interaction device 100 includes a communication module 30, which is configured to achieve a wireless communication connection with a paired virtual interaction device 200 outside the vehicle, wherein the communication module 30 can transmit the image captured by the in-vehicle image acquisition module 10 to the paired virtual interaction device 200 via a wireless network, and transmit the image from the paired virtual interaction device 200 to the front projection module 20.

[0062] For example, Figures 3 to 4b As shown, the holographic projection module 20 includes four holographic imaging units uniformly distributed along the circumferential direction, and these holographic imaging units are constructed in exactly the same manner. In the expanded position of the holographic projection module 20, the holographic imaging film 21 of the holographic imaging unit forms a 45° angle with the projection screen 22, so that the light emitted from the projection screen 22 through the 45° conical light-transmitting surface of the holographic imaging film 21 is refracted and forms a virtual image that forms a 45° angle with the light-transmitting surface. When the passengers in the vehicle observe the holographic projection film 21, they can see an image that is perpendicular to the projection screen 22, that is, a vertical image. The virtual images formed by the four holographic projection films 21 can be combined to form a three-dimensional stereoscopic image, and the stereoscopic image can truly restore the image outside the vehicle.

[0063] For example, Figures 3 to 4b As shown, the holographic projection module 20 further includes a hinge mechanism 23 and a second shell 24, wherein the hinge mechanism 23 is centrally arranged in the second shell 24 and is configured to realize the pivoting movement of the holographic projection film 21, wherein the holographic projection film 21 can be switched between an extended position and a retracted position by the pivoting movement of the holographic projection film 21 around the hinge mechanism 23, in which the holographic projection film 21 is pivoted out of the second shell 24 and forms a 45° angle with the projection screen 22, and in the retracted position, the holographic projection film 21 is pivoted back into the second shell 24 to avoid damage. In particular, as Figure 4a and Figure 4bAs shown, in the working state of the virtual interactive device 100, the in-vehicle image acquisition module 10 extends the vehicle-end camera 11 downward from the first housing 14 by extending the first rotating shaft 2, and the holographic projection film 21 of the holographic projection module 20 is in the extended state, while in the shutdown state of the virtual interactive device 100, the in-vehicle image acquisition module 10 retracts the vehicle-end camera 11 into the first housing 14 by shortening the first rotating shaft 2, and the holographic projection film 21 of the holographic projection module 20 is in the retracted state. It can be considered that the hinge mechanism 23 of the holographic projection module 20 is also controlled by the controller 13 of the in-vehicle image acquisition module 10. However, it is also possible that the holographic projection module 20 has a separate controller.

[0064] For example, Figures 2 to 4b As shown, the in-vehicle image acquisition module 10 and the holographic projection module 20 are integrally constructed, wherein the first housing 14 of the in-vehicle image acquisition module 10 and the second housing 24 of the holographic projection module 20 can be manufactured by a single injection molding process. This enables the virtual interaction device 100 to be compactly constructed and simplifies the manufacturing and assembly process of the virtual interaction device 100.

[0065] Exemplarily, the virtual interaction device 100 is arranged on the roof of the vehicle, especially in the middle of the roof, to correspond to different areas of the vehicle. However, it is also conceivable that the virtual interaction device 100 is arranged above the front passenger seat or the rear seat.

[0066] Figure 5 A schematic block diagram of a virtual interaction system 1000 for a vehicle according to an exemplary embodiment of the present invention is shown.

[0067] like Figure 5 As shown, the virtual interaction system 1000 includes a virtual interaction device 100 arranged in a vehicle and a paired virtual interaction device 200 located outside the vehicle, wherein the paired virtual interaction device 200 is wirelessly connected to the virtual interaction device 100 to realize image data transmission between each other, wherein the paired virtual interaction device 200 includes a remote control display module 210, and the remote control display module is configured to send a position signal given by an interacting person outside the vehicle to the controller 13 of the in-vehicle image acquisition module 10 of the virtual interaction device 100 and receive and display the in-vehicle image captured by the vehicle-end camera 11 of the virtual interaction device 100.

[0068] Exemplarily, the remote control display module 210 is configured as a wearable virtual reality device, such as VR glasses or a head mounted display. Figure 5As shown, the remote control display module 210 is configured with a position sensor 211, and the position sensor 211 is configured to detect the head position of the person interacting outside the vehicle or the person interacting outside the vehicle and generate a position signal corresponding to the head position. It is also possible that the position sensor 211 detects the eye position of the person interacting outside the vehicle as an eye tracking sensor and generates a position signal corresponding to the eye position. Here, the position signal can reflect the expected viewing angle of the person interacting outside the vehicle. Specifically, when the head position of the person interacting outside the vehicle is detected to be turned to the left by the position sensor 211, the generated position signal reflects that the expected viewing angle of the person interacting outside the vehicle is turned to the left, so the controller 13 of the in-vehicle image acquisition module 10 controls the vehicle-end camera 11 to turn to the left according to the position signal, which can realize the synchronization of the vehicle-end camera 11 with the head movement of the person interacting outside the vehicle and enable the person interacting outside the vehicle to view the image inside the vehicle dynamically and according to their own needs, thereby maximizing the field of view of the person interacting outside the vehicle and improving the interaction experience of the person interacting outside the vehicle.

[0069] For example, Figure 5 As shown, the paired virtual interaction device 200 further includes an outside-vehicle image acquisition module 220, which works together with the holographic projection module 20 of the virtual interaction device 100, wherein the outside-vehicle image acquisition module 220 is configured to capture the outside-vehicle image, especially the outside-vehicle interaction personnel, in a surround manner and send data about the outside-vehicle image to the holographic projection module 20, and the projection screen 22 of the holographic projection module 20 projects the received image onto the holographic imaging film 21 to generate a holographic projection corresponding to the outside-vehicle image. In particular, the outside-vehicle image acquisition module 220 captures the front, back, left, and right plane images of the outside-vehicle interaction personnel in real time and sends these images to the holographic projection module 20, and the four holographic projection units of the holographic projection module 20 respectively generate these plane images on their respective holographic projection films 21 and collect them together into a three-dimensional stereoscopic image.

[0070] Figure 6a and Figure 6b Schematic flow charts of a virtual interaction method for a vehicle according to an exemplary embodiment of the present invention are respectively shown. Here, the virtual interaction method is implemented by a virtual interaction system 1000 according to the present invention.

[0071] like Figure 6a As shown, the virtual interaction method at least includes the following steps:

[0072] S11: The remote control display module 210 of the paired virtual interaction device 200 of the virtual interaction system 1000 sends a position signal to the controller 13 of the in-vehicle image acquisition module 10 of the virtual interaction device 100, wherein the position signal of the remote control display module 210 can be generated in particular according to the head position and / or eyeball position of the person interacting outside the vehicle detected by the position sensor 211 of the remote control display module 210, and the position signal reflects the desired viewing angle of the person interacting outside the vehicle, but it is also possible that the position signal of the remote control display module 210 is manually set by the person interacting outside the vehicle;

[0073] S12: The controller 13 of the in-vehicle image acquisition module 10 generates a control instruction for the driving mechanism 12 according to the received position signal, so that the vehicle-end camera 11 moves corresponding to the position signal;

[0074] S13: Capture the image inside the vehicle through the vehicle-side camera 11;

[0075] S14: The captured in-vehicle image is sent to the remote control display module 210 via the communication module 30 of the virtual interaction device 100 , and the remote control display module 210 displays the in-vehicle image.

[0076] Exemplarily, when the position signal of the remote control display module 210 shows horizontal rotation, the rotational motion of the drive motor 1 is converted into the rotational motion of the vehicle-end camera 11 in the horizontal plane through the first rotating shaft 2 of the drive mechanism 12, so as to synchronize the horizontal rotation of the head of the person interacting outside the vehicle; and when the position signal shows vertical movement, the rotational motion of the drive motor 1 is converted into the swinging motion of the vehicle-end camera 11 in the vertical plane through the second rotating shaft 4 of the drive mechanism 12, so as to synchronize the vertical movement of the head of the person interacting outside the vehicle.

[0077] like Figure 6b As shown, the virtual interaction method further includes the following steps:

[0078] S21: the vehicle exterior image acquisition module 220 of the paired virtual interaction device 200 captures the vehicle exterior image in a surround view manner, especially captures the front, back, left, and right plane images of the person interacting with the vehicle exterior, and sends the vehicle exterior image to the holographic projection module 20 of the virtual interaction device 100;

[0079] S22: Projecting the received vehicle exterior image onto the holographic imaging film 21 via the projection screen 22 of the holographic projection module 20 of the virtual interaction device 100 to generate a holographic projection.

[0080] Here, steps S11 to S14 and steps S21 to S22 can be implemented in parallel, wherein during the implementation of these steps, the virtual interaction device 100 is in a working state, the in-vehicle image acquisition module 10 extends the vehicle-end camera 11 downward from the first shell 14 through the extension of the first rotating shaft 2, and the holographic projection film 21 of the holographic projection module 20 is in an expanded position, and the holographic imaging film 21 forms a 45° angle with the projection screen 22.

[0081] The above explanation of the embodiments only describes the invention within the framework of the examples. Of course, the individual features of the embodiments can be freely combined with one another as long as it makes technical sense, without departing from the framework of the invention.

[0082] Other advantages and alternative embodiments of the present invention are obvious to those skilled in the art. Therefore, the present invention in its broader sense is not limited to the specific details, representative structures and exemplary embodiments shown and described. On the contrary, those skilled in the art can make various modifications and substitutions without departing from the basic spirit and scope of the present invention.

Claims

1. An in-vehicle image acquisition module (10) for a virtual interaction device (100) for a vehicle, characterized in that: The in-vehicle image acquisition module (10) at least comprises: - a vehicle-side camera (11), which is arranged inside the vehicle and is configured to capture images inside the vehicle; - a driving mechanism (12), the driving mechanism (12) being configured to drive the vehicle-end camera (11) to move; and - A controller (13), wherein the controller (13) is configured to generate a control instruction for the driving mechanism (12) according to the received position signal, so as to realize the movement of the vehicle-side camera (11) corresponding to the position signal.

2. The in-vehicle image acquisition module (10) according to claim 1, characterized in that: The driving mechanism (12) comprises at least a driving motor (1) and a first rotating shaft (2), wherein the first rotating shaft (2) is configured to convert the rotational motion of the driving motor (1) into the rotational motion of the vehicle-end camera (11) in a horizontal plane.

3. The in-vehicle image acquisition module (10) according to claim 2, characterized in that: The first rotating shaft (2) is connected to the output shaft of the driving motor (1) in a rotationally fixed manner and is meshingly connected to the housing of the vehicle-end camera (11) via a gear (3).

4. The in-vehicle image acquisition module (10) according to claim 2, characterized in that: The driving mechanism (12) comprises a second rotating shaft (4), and the second rotating shaft (4) is configured to convert the rotational motion of the driving motor (1) into the swinging motion of the vehicle-end camera (11) in a vertical plane.

5. The in-vehicle image acquisition module (10) according to any one of claims 2 to 4, characterized in that: The first rotating shaft (2) is constructed to be axially telescopic so as to drive the vehicle-end camera (11) to move vertically in the height direction.

6. The in-vehicle image acquisition module (10) according to claim 5, characterized in that: The in-vehicle image acquisition module (10) comprises a first shell (14), wherein, in the working state of the in-vehicle image acquisition module (10), the vehicle-end camera (11) is extended from the first shell (14) by extending the first rotating shaft (2), and in the stopped state of the in-vehicle image acquisition module (10), the vehicle-end camera (11) is retracted into the first shell (14) by shortening the first rotating shaft (2).

7. A virtual interaction device (100) for a vehicle, characterized in that: The virtual interaction device (100) comprises at least: - an in-vehicle image acquisition module (10) according to any one of claims 1 to 6; and - A communication module (30) configured to be suitable for realizing a wireless communication connection with a paired virtual interaction device (200) outside the vehicle.

8. The virtual interaction device (100) according to claim 7, characterized in that: The virtual interaction device (100) further comprises a holographic projection module (20), wherein the holographic projection module (20) comprises at least one holographic imaging unit, wherein the holographic imaging unit has a holographic imaging film (21) and a projection screen (22), wherein the projection screen (22) is configured to project a received image onto the holographic imaging film (21) to generate a holographic projection.

9. The virtual interaction device (100) according to claim 8, characterized in that: The holographic projection module (20) comprises four holographic imaging units evenly distributed in a circumferential direction, the holographic imaging units being constructed identically, wherein in an unfolded state of the holographic projection module (20), the holographic imaging film (21) of the holographic imaging unit forms an angle of 45° with the projection screen (22).

10. The virtual interaction device (100) according to claim 9, characterized in that: The holographic projection module (20) further comprises a hinge mechanism (23) and a second shell (24), wherein the hinge structure (23) is centrally arranged in the second shell (24) and is configured to be suitable for switching the holographic projection film (21) between an extended position and a retracted position by pivoting the holographic projection film (21) around the hinge mechanism (23).

11. The virtual interaction device (100) according to any one of claims 7 to 10, characterized in that: The holographic projection module (20) and the in-vehicle image acquisition module (10) are constructed in an integrated manner.

12. The virtual interaction device (100) according to any one of claims 7 to 10, characterized in that: The virtual interaction device (100) is arranged on the roof of the vehicle.

13. A virtual interaction system (1000) for a vehicle, characterized in that: The virtual interactive system (1000) comprises at least: - A virtual interaction device (100) according to any one of claims 7 to 12, wherein the virtual interaction device (100) is arranged in the vehicle; - a paired virtual interaction device (200), the paired virtual interaction device (200) being located outside the vehicle and being wirelessly connected to the virtual interaction device (100), wherein the paired virtual interaction device (200) at least comprises a remote control display module (210), the remote control display module (210) being configured to be suitable for sending a position signal to a controller (13) of an in-vehicle image acquisition module (10) of the virtual interaction device (100) and displaying an in-vehicle image captured by a vehicle-side camera (11).

14. The virtual interaction system (1000) according to claim 13, characterized in that: The remote control display module (210) is constructed as a wearable virtual reality device.

15. The virtual interaction system (1000) according to claim 14, characterized in that: The remote control display module (210) is configured with a position sensor (211), and the position sensor (211) is configured to detect the head position and / or eyeball position of a person interacting outside the vehicle and generate a corresponding position signal.

16. The virtual interaction system (1000) according to any one of claims 13 to 15, characterized in that: The virtual interaction device (100) comprises a holographic projection module (20), and the paired virtual interaction device (200) comprises an off-vehicle image acquisition module (220), wherein the off-vehicle image acquisition module (220) is configured to capture an off-vehicle image in a surround-view manner and to send data about the off-vehicle image to the holographic projection module (20).

17. A virtual interaction method for a vehicle, characterized in that: The virtual interaction method is implemented by a virtual interaction system (1000) according to any one of claims 13 to 16, wherein the virtual interaction method at least comprises the following steps: S11: The remote control display module (210) of the paired virtual interaction device (200) of the virtual interaction system (1000) sends a position signal to the in-vehicle image acquisition module (10) of the virtual interaction device (100); S12: the controller (13) of the in-vehicle image acquisition module (10) generates a control instruction for a driving mechanism (12) according to the position signal, so that the vehicle-end camera (11) moves in response to the position signal; S13: photographing the image inside the vehicle through the vehicle-side camera (11); S14: The in-vehicle image is sent to the remote control display module (210) via the communication module (30) of the virtual interaction device (100), and the in-vehicle image is displayed by the remote control display module (210).

18. The virtual interaction method according to claim 17, characterized in that: In step S11, the position signal is generated based on the head position and / or eye position of the person interacting outside the vehicle detected by the position sensor (211) of the remote control display module (210).

19. The virtual interaction method according to claim 18, characterized in that: When the position signal shows horizontal rotation, the rotational movement of the drive motor (1) is converted into the rotational movement of the vehicle-end camera (11) in a horizontal plane through the first rotating shaft (2) of the drive mechanism (12); and / or When the position signal shows vertical movement, the rotational movement of the drive motor (1) is converted into a swinging movement of the vehicle-end camera (11) in a vertical plane through the second rotating shaft (4) of the drive mechanism (12).

20. The virtual interaction method according to any one of claims 17 to 19, characterized in that: The virtual interaction method additionally comprises the following steps: S21: the vehicle exterior image acquisition module (220) of the paired virtual interaction device (200) captures the vehicle exterior image in a surround view manner and sends the vehicle exterior image to the virtual interaction device (100); S22: Projecting the received vehicle exterior image onto a holographic imaging film (11) via a projection screen (22) of a holographic projection module (20) of the virtual interaction device (100) to generate a holographic projection.