Vehicles and vehicle control methods

Abstract

This application provides a vehicle and a vehicle control method. The vehicle includes a vehicle body, an image acquisition device, a vehicle controller, and virtual reality glasses. The image acquisition device is arranged around the periphery of the vehicle body to acquire images of the vehicle's surrounding environment and transmits these images to the virtual reality glasses. The virtual reality glasses generate a panoramic image of the vehicle's environment based on the images. The virtual reality glasses have an embedded vehicle control interface and are also used to determine vehicle control signals based on the position of the vehicle control interface and the user's eye gaze point, and then transmit these signals to the vehicle controller. The vehicle controller adjusts the vehicle's state based on the control signals. With this vehicle, occupants can obtain more comprehensive vehicle environment information, resulting in greater driving flexibility.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a vehicle and a vehicle control method. Background Technology

[0002] As vehicle-related technologies continue to develop and mature, people's demands for the driving experience are increasing. With the continuous development of virtual reality technology, more and more engineers are focusing on combining virtual reality with vehicles to improve the driving experience.

[0003] In related technologies, based on the principle of head-up display, the windshield of the vehicle is used as the display screen of the head-up display device, so that driving prompts and other information can be displayed on the windshield, eliminating the need for the driver to frequently look down and up, thus improving the driver's driving experience.

[0004] However, the information that head-up displays can provide to drivers is limited to speed and navigation, and drivers still receive relatively little driving-related information. Summary of the Invention

[0005] In view of this, this application provides a vehicle and a vehicle driving method, which enables occupants to obtain more comprehensive vehicle environment information and improve driving flexibility.

[0006] Specifically, the following technical solutions are included:

[0007] On the one hand, this application provides a vehicle, including a vehicle body, an image acquisition device, a vehicle controller, and virtual reality glasses;

[0008] The image acquisition device is arranged around the vehicle body to acquire images of the vehicle's surrounding environment and send the acquired images to the virtual reality glasses device.

[0009] The virtual reality glasses device is used to generate a panoramic image of the vehicle environment based on the image of the vehicle's external environment.

[0010] The virtual reality glasses device has a built-in vehicle control interface. The virtual reality glasses device is also used to determine the vehicle control signal based on the vehicle control interface and the position of the human eye's gaze point, and send the vehicle control signal to the vehicle controller.

[0011] The vehicle controller is used to control the vehicle to adjust its state based on the vehicle control signal.

[0012] Optionally, the vehicle control interface has virtual buttons corresponding to at least one of forward, backward, left turn, right turn, acceleration, deceleration, or stop.

[0013] The virtual reality glasses device is used to use the control signal corresponding to the target virtual button as the vehicle control signal when the duration of the human eye's gaze on the target virtual button exceeds a preset duration threshold.

[0014] Optionally, the vehicle may also include: a holographic projection device and an information host;

[0015] The holographic projection device is used to obtain holographic projection data of the target object from the information host, and to perform a three-dimensional holographic projection of the target object in the passenger cabin of the vehicle. The target object includes at least one of a virtual image, a vehicle entertainment page, or a vehicle control page.

[0016] Optionally, the vehicle may further include: motion capture equipment;

[0017] The motion capture device is used to capture the movements of occupants in the passenger cabin, generate motion interaction commands, and send the motion interaction commands to the information host.

[0018] The information host receives the action interaction command and updates the holographic projection data of the target object in response to the action interaction command, thereby updating the state of the target object projected by the holographic projection device.

[0019] Optionally, the motion capture device includes a 3D model generation component for the occupant cabin and a gesture recognition component;

[0020] The 3D model generation component for the passenger cabin is used to obtain the 3D coordinate information of objects inside the passenger cabin and generate a 3D model of the passenger cabin.

[0021] The gesture recognition component is used to capture the occupant's hand coordinate information, and based on the hand coordinate information and the three-dimensional model of the occupant cabin, to determine the occupant's gesture actions, and based on the gesture actions, to generate the action interaction commands.

[0022] Optionally, the vehicle also includes a voice detection component;

[0023] The voice detection component is used to detect sounds inside the passenger cabin, identify voice interaction commands from them, and send the voice interaction commands to the information host.

[0024] The information host receives the voice interaction command and updates the holographic projection data of the target object in response to the voice interaction command, thereby updating the state of the target object projected by the holographic projection device.

[0025] Optionally, there may be multiple image acquisition devices, which are used to acquire images of the vehicle's surrounding environment from the front, rear, left, right, above, or below the vehicle.

[0026] Optionally, the vehicle also includes a braking system and a drive motor controller;

[0027] The vehicle controller is used to send a first control command to the drive motor controller based on the vehicle control signal, so that the drive motor controller adjusts the operating state of the vehicle motor based on the first control command.

[0028] Alternatively, the vehicle controller may issue a second control command to the braking system based on the vehicle control signal, so that the braking system controls the braking state of the vehicle.

[0029] Optionally, the vehicle may also include radar;

[0030] The radar is used to detect obstacle information around the vehicle and transmit the obstacle information to the virtual reality glasses device;

[0031] The virtual reality glasses device is used to display corresponding obstacle markers in the panoramic image of the vehicle environment based on the obstacle information.

[0032] On the other hand, this application provides a vehicle control method applied to a vehicle, the vehicle including a body body, an image acquisition device, a vehicle controller and a virtual reality glasses device, the image acquisition device being arranged around the body body, and the virtual reality glasses device having a vehicle control interface embedded in it;

[0033] The method includes:

[0034] The image acquisition device acquires images of the vehicle's external environment and sends these images to the virtual reality glasses device.

[0035] Using the virtual reality glasses device, a panoramic image of the vehicle environment is generated based on the image of the vehicle's surrounding environment;

[0036] Using the virtual reality glasses device, based on the vehicle control interface and the position of the human eye's gaze point, the vehicle control signal is determined and sent to the vehicle controller;

[0037] The vehicle controller adjusts the vehicle's status based on the vehicle control signals.

[0038] This application provides a vehicle and a vehicle control method. An image acquisition device is arranged around the vehicle's exterior. A virtual reality (VR) glasses device inside the vehicle can generate a panoramic image of the vehicle's environment based on the images of the surrounding environment acquired by the image acquisition device. This allows vehicle occupants to observe the vehicle's environment more intuitively and obtain more comprehensive information about the vehicle's surroundings, thus improving the accuracy of driving decisions. Furthermore, the VR glasses device also embeds a vehicle control interface. Occupants can operate this interface by changing the position of their gaze, adjusting the vehicle's status without manual intervention, effectively improving driving flexibility and enhancing the user's driving experience. Attached Figure Description

[0039] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0040] Figure 1 A schematic diagram of the logical structure of a vehicle provided in an embodiment of this application;

[0041] Figure 2 A schematic diagram of a vehicle control interface for a virtual reality glasses device in a vehicle, provided as an embodiment of this application;

[0042] Figure 3 This is a partial structural schematic diagram of a vehicle provided in an embodiment of this application;

[0043] Figure 4 This is a partial structural schematic diagram of another vehicle provided in an embodiment of this application;

[0044] Figure 5 This is a partial structural schematic diagram of another vehicle provided in an embodiment of this application;

[0045] Figure 6 A logic block diagram of holographic projection in a vehicle provided in an embodiment of this application;

[0046] Figure 7 A flowchart of a vehicle control method provided in an embodiment of this application.

[0047] The reference numerals in the figure are respectively:

[0048] 100-Vehicle body; 101-Image acquisition equipment; 102-Vehicle controller; 103-Virtual reality glasses; 1031-Vehicle control interface; 10311-Virtual buttons; 104-Holographic projection equipment; 1041-Front-facing holographic projection equipment; 1042-Rear-facing holographic projection equipment; 105-Motion capture equipment; 1051-Passenger cabin 3D model generation component; 1052-Gesture recognition component; 106-Voice detection component; 107-Braking system; 108-Drive motor controller; 109-Radar; 110-Information host;

[0049] 111-Center console; 112-Signal line; 113-Seat.

[0050] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0051] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0052] The directional terms used in the embodiments of this application, such as "up," "down," and "side," are generally based on the orientation shown in the figure or the relative orientation between structures when the vehicle is habitually arranged. These directional terms are used merely to more clearly describe the relationships between structures, not to describe absolute orientation. When the vehicle is placed in different postures, the orientation may change; for example, "up" and "down" may be interchanged.

[0053] Unless otherwise defined, all technical terms used in the embodiments of this application have the same meaning as commonly understood by one of ordinary skill in the art.

[0054] To make the technical solutions and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0055] Firstly, this application provides a vehicle. (See reference) Figure 1 The vehicle includes a body 100, an image acquisition device 101, a vehicle controller 102, and a virtual reality glasses device 103;

[0056] The image acquisition device 101 is arranged around the vehicle body 100 to acquire images of the vehicle's surrounding environment and send the acquired images of the vehicle's surrounding environment to the virtual reality glasses device 103.

[0057] Virtual reality glasses device 103 is used to generate a panoramic image of the vehicle environment based on images of the vehicle's surrounding environment;

[0058] The virtual reality glasses device 103 has a vehicle control interface 1031 embedded in it. The virtual reality glasses device 103 is also used to determine the vehicle control signal based on the vehicle control interface 1031 and the position of the human eye's gaze point, and send the vehicle control signal to the vehicle controller 102.

[0059] The vehicle controller 102 is used to control the vehicle to adjust its state based on vehicle control signals.

[0060] In this embodiment, the vehicle has an image acquisition device 101 arranged around the periphery of the vehicle body 100. The image acquisition device 101 can acquire environmental images of the vehicle's periphery. The virtual reality glasses device 103 can generate a panoramic image of the vehicle's environment based on the environmental images of the vehicle's periphery. Thus, when the occupant wears the virtual reality glasses device 103, they can see a panoramic image of the vehicle's surroundings, instead of being limited to the view from the vehicle's window. Furthermore, with the help of the virtual reality glasses device, the occupant can also dynamically observe the environment around the vehicle, or view the relationship between the vehicle and its surroundings from a higher perspective, such as observing the relationship between the vehicle and its surroundings from a high altitude.

[0061] Furthermore, the virtual reality glasses device 103 has an embedded vehicle control interface 1031. Passengers can adjust the vehicle's status by controlling the position of their gaze point through this interface, thus enabling virtual reality-assisted driving. In practical applications, the virtual reality glasses device 103 can be worn directly by the primary driver, who can then drive the vehicle using the vehicle control interface 1031. Alternatively, the virtual reality glasses device 103 can be worn by a secondary driver, such as a front passenger, allowing for collaborative driving between the secondary and primary drivers.

[0062] In summary, this application provides a vehicle and a vehicle control method. The vehicle's exterior is equipped with image acquisition devices. Virtual reality glasses within the vehicle can generate a panoramic image of the vehicle's environment based on the images captured by the image acquisition devices. This allows vehicle occupants to observe the vehicle's environment more intuitively and obtain more comprehensive environmental information, improving the accuracy of driving decisions. Furthermore, the virtual reality glasses also embed a vehicle control interface. Occupants can operate this interface by changing the position of their gaze, adjusting the vehicle's status without manual intervention, effectively improving driving flexibility and enhancing the user's driving experience.

[0063] In some embodiments, there are multiple image acquisition devices 101, which are used to acquire images of the vehicle's surrounding environment from the front, rear, left, right, above, or below the vehicle. By combining multiple image acquisition devices 101, 360-degree, 540-degree, or 720-degree panoramic images can be generated, providing occupants with more comprehensive information.

[0064] Optional, see reference Figure 2 The vehicle control interface 1031 has virtual buttons 10311 corresponding to at least one of the following: forward, backward, left turn, right turn, acceleration, deceleration, or stop;

[0065] The virtual reality glasses device 103 is used to use the control signal corresponding to the target virtual button as the vehicle control signal when the duration of the detected human eye gaze on the target virtual button exceeds a preset duration threshold.

[0066] Based on the above settings, users can purposefully control the position of their gaze point and the duration of their gaze. By using the virtual buttons 10311 in the vehicle control interface 1031, the virtual reality glasses device 103 can send out corresponding vehicle control signals to achieve convenient vehicle control.

[0067] Optionally, the preset duration threshold can be 3 seconds. The vehicle control interface 1031 can be floating on the panoramic image of the vehicle environment and presented in a relatively transparent form to avoid obscuring the panoramic image. Furthermore, when the displayed content of the panoramic image of the vehicle environment changes with the movement of the occupant's head, the position of the vehicle control interface 1031 can remain unchanged to ensure that the occupant can control the vehicle in real time.

[0068] In some embodiments, reference Figure 1 The vehicle also includes: a holographic projection device 104 and an information host 110;

[0069] The holographic projection device 104 is used to obtain holographic projection data of the target object from the information host 110 and perform three-dimensional holographic projection of the target object in the passenger compartment of the vehicle. The target object includes at least one of the following: a virtual image, a vehicle entertainment page, or a vehicle control page.

[0070] In this embodiment, the holographic projection device 104 in the vehicle can obtain holographic projection data of the target object from the information host 110 and project the target object inside the vehicle. For example, it can project virtual 3D characters or in-vehicle games, providing occupants with more diverse entertainment options. Alternatively, the holographic projection device 104 can project the vehicle's control page into the passenger compartment, allowing each occupant to access vehicle information such as the vehicle's control status.

[0071] In some embodiments, the virtual reality glasses device 103 can also obtain virtual reality data from the information host 110 to generate corresponding virtual reality images, enabling occupants to engage in some entertainment activities or experience virtual driving in the vehicle using the virtual reality glasses device.

[0072] In some embodiments, reference Figure 1 The vehicle also includes: motion capture equipment 105;

[0073] The motion capture device 105 is used to capture the movements of the occupants in the occupant cabin, generate motion interaction commands, and send the motion interaction commands to the information host 110.

[0074] The information host 110 receives the action interaction command and updates the holographic projection data of the target object in response to the action interaction command, so that the state of the target object projected by the holographic projection device 104 is updated.

[0075] In this embodiment, the movements of occupants within the passenger compartment can be captured, generating corresponding action interaction commands. These commands can be used to adjust the state of a target object, thus achieving virtual interaction between the occupant and the target object. For example, when the target object is a virtual 3D character, the occupant can interact with it, such as shaking hands; when the target object is a car infotainment game, the game can be a 3D game; when the target object is the vehicle's control screen, the occupant can control the vehicle's status from any seat position, such as turning on the air conditioning, increasing the volume, or adjusting the windows. As can be seen, the above settings make the vehicle's usage more flexible and provide a better user experience.

[0076] Optionally, the motion capture device 105 includes an information transmission unit. After the motion capture device 105 generates motion interaction commands, the information transmission unit can transmit the motion interaction commands to the information host 110 and also to the virtual reality glasses device 103. The virtual reality glasses device 103 can change the displayed screen in response to the motion interaction commands, such as adjusting the screen's viewing angle or zoom level.

[0077] Optionally, users can control the zoom level of the screen by moving two fingers close together or far apart, and switch between a first-person perspective and a third-person perspective by swiping up or down with their palm. The first-person perspective is the view of the driver sitting in the driver's seat when looking at the external environment of the vehicle, while the third-person perspective is the view of the relationship between the vehicle and the external environment when observing it from a high altitude.

[0078] Of course, to avoid misoperation, the information host 110 or the virtual reality glasses device 103 may have a judgment unit to determine whether the action interaction command is used to control the holographic projection device 104 or the virtual reality glasses device 103. The information host 110 will only update the holographic projection data of the target object when the judgment result is that the action interaction command is applied to the holographic projection device 104; and the virtual reality glasses device 103 will only update the virtual reality display screen when it is determined that the action interaction command is applied to the virtual reality glasses device 103.

[0079] Optional, see reference Figure 1 The motion capture device 105 includes a 3D model generation component for the occupant cabin 1051 and a gesture recognition component 1052;

[0080] The 3D model generation component 1051 for the crew cabin is used to obtain the 3D coordinate information of objects inside the crew cabin and generate a 3D model of the crew cabin.

[0081] The gesture recognition component 1052 is used to capture the hand coordinate information of the occupant, and based on the hand coordinate information and the three-dimensional model of the occupant cabin, to determine the occupant's gesture actions, and to generate action interaction commands based on the gesture actions.

[0082] Based on the above settings, it is possible to generate a 3D model of the passenger cabin, and on the basis of the 3D model of the passenger cabin, accurately obtain the occupants' hand gestures and generate action interaction commands.

[0083] Optionally, the 3D model generation component 1051 for the passenger compartment may include a depth sensor or a depth camera. To ensure the accuracy of the 3D model, depth sensors or depth cameras can be installed at multiple locations within the vehicle's passenger compartment. The 3D model generation component 1051 for the passenger compartment may also have a model calculation and generation unit, which integrates and processes the data collected by the depth sensors or depth cameras to generate a 3D model of the passenger compartment. Optionally, the 3D model generation component 1051 for the passenger compartment may operate in real-time, meaning that after generating the 3D model of the passenger compartment, it responds in real-time to the latest detected data to calculate and update the 3D model, resulting in high accuracy of the 3D model.

[0084] Optionally, the gesture recognition component 1052 may include a depth sensor, a depth camera, or a regular camera. The gesture recognition component 1052 may be installed facing the occupant's seat, such as on the center console or between two rows of seats; and / or, the gesture recognition component 1052 may be installed on the top of the occupant compartment directly facing the occupant's seat. The gesture recognition component 1052 may further include a gesture matching unit, which determines the occupant's hand coordinates based on the depth information of the hand obtained by the depth sensor or depth camera, determines the occupant's gesture based on the hand coordinates and the 3D model of the occupant compartment, matches the occupant's gesture with pre-stored or acquired gesture templates (multiple gesture templates and their corresponding interaction commands can be pre-stored), and determines the interaction command corresponding to the gesture template with the highest matching degree as the interaction command corresponding to the occupant's current gesture. Wherein, if all calculated matching degree values ​​are below a threshold, it is determined that the match is unsuccessful, and the gesture control process (i.e., the process of controlling the state of the target object through the interaction command) is not performed. Alternatively, the unit can recognize occupant hand gestures from images acquired by a regular camera or a depth camera. Optionally, the gesture recognition component 1052 can also be located at any position in the vehicle where occupant hand gestures can be captured.

[0085] In some embodiments, reference Figure 1 The vehicle also includes a voice detection component 106;

[0086] The voice detection component 106 is used to detect sounds in the passenger cabin, identify voice interaction commands from them, and send the voice interaction commands to the information host 110;

[0087] The information host 110 receives voice interaction commands and updates the holographic projection data of the target object in response to the voice interaction commands, thereby updating the status of the target object projected by the holographic projection device 104.

[0088] In this embodiment, passengers can also interact with the target object directly through voice, updating the target object's status and improving the flexibility of the interaction.

[0089] Optionally, the voice detection component 106 can pre-store or acquire the correspondence between different voice segments and voice interaction commands. When sound is detected in the passenger cabin, the detected sound is preprocessed, such as by muting or segmenting. The preprocessed audio segment is then compared with different voice segments in the aforementioned correspondence to calculate similarity, and the most similar voice segment is determined. The voice interaction command corresponding to the most similar voice segment is then used as the voice interaction command corresponding to the detected audio. If all calculated similarity values ​​are below a threshold, a match is deemed unsuccessful, and the voice control process (i.e., the process of controlling the state of the target object through voice interaction commands) is not performed.

[0090] In some embodiments, reference Figure 1 The vehicle also includes a braking system 107 and a drive motor controller 108;

[0091] The vehicle controller 102 is used to send a first control command to the drive motor controller 108 based on the vehicle control signal, so that the drive motor controller 108 adjusts the operating state of the vehicle motor based on the first control command.

[0092] Alternatively, the vehicle controller 102 may issue a second control command to the braking system 107 based on the vehicle control signal, so that the braking system 107 controls the braking state of the vehicle.

[0093] In this embodiment, the vehicle controller 102 adjusts the operating state of the vehicle drive motor through the drive motor controller 108 according to the content of the received vehicle control signal, so as to increase or decrease the vehicle power, etc.; or controls the braking state of the vehicle through the braking system 107, such as to make the vehicle brake and decelerate.

[0094] Optionally, the braking system 107 can be a linear braking system, typically installed on the vehicle chassis, used for overall chassis braking and four-wheel dynamic torque control, capable of controlling the vehicle's forward, reverse, left, right turns, deceleration, acceleration, or stopping. The drive motor controller 108 is generally located around the vehicle motor and is used to control the motor's speed, etc.

[0095] In some embodiments, reference Figure 1 The vehicle also includes radar 109;

[0096] Radar 109 is used to detect obstacle information around the vehicle and transmit the obstacle information to virtual reality glasses device 103;

[0097] The virtual reality glasses device 103 is used to display corresponding obstacle markers in a panoramic image of the vehicle environment based on obstacle information.

[0098] In this embodiment, the vehicle's radar 109 can provide the virtual reality glasses device 103 with obstacle information around the vehicle, enabling a more comprehensive display of obstacle markers around the vehicle in the panoramic image of the vehicle environment, providing occupants with more comprehensive driving information. Furthermore, the radar has a long detection range, effectively expanding the detection range of vehicle environment information, allowing users to be aware of potential obstacles earlier, and providing more time for avoidance in emergency situations.

[0099] Optionally, radar 109 can be an external radar, i.e., deployed around the vehicle's perimeter, allowing for more precise acquisition of information about the vehicle's external environment. Radars include, but are not limited to, millimeter-wave radar, ultrasonic radar, or corner radar.

[0100] Optionally, the vehicle's speed sensor can also transmit the vehicle's current speed to the virtual reality glasses device 103, so that the virtual reality glasses device 103 can display the vehicle's current speed information. The vehicle's navigation system can also send navigation information to the virtual reality glasses device 103, so that the virtual reality glasses device 103 can display the navigation information.

[0101] Optionally, the information host 110 can be connected to the vehicle controller 102, voice detection component 106, radar 109, holographic projection device 104, image acquisition device 101, virtual reality glasses device 103, and motion capture device 105, respectively, and act as an information transmission medium between these devices or components. For example, the information host 110 can acquire data from the image acquisition device 101 or radar 109 and transmit the data to the virtual reality glasses device 103; vehicle control signals emitted by the virtual reality glasses device 103 can be sent to the information host 110, and then the information host 110 performs certain judgments and recognitions before sending them to the vehicle controller 102.

[0102] Optional, see reference Figures 3-5 The vehicle's passenger compartment can have two rows of seats 113, one in front and one behind, and at least two holographic projection devices 104. When there are two holographic projection devices 104, they can be installed on the ceiling of the passenger compartment, corresponding to the driver's seat and the front passenger seat, respectively. When there are more than two holographic projection devices, at least one can be designated as the master device, and the rest as slave devices. The master device is connected to the information host via the central control panel, or directly to the information host, while the slave devices transmit data to the master device via wired or wireless means, realizing a combined holographic projection driver's cockpit.

[0103] Optionally, the number of virtual reality glasses devices 103 can be one, two, or even more. When there is only one, it can be set between the driver's seat and the passenger seat. When there are at least two, one can be set for the driver's seat and one for the passenger seat.

[0104] Optionally, the vehicle may also have a battery to power the aforementioned electrical devices (holographic projection device 104, virtual reality glasses device 103, image acquisition device 101, radar 109, motion capture device, information host, braking system, vehicle controller, main drive motor controller, and motor, etc.). (Reference) Figures 3-5 The vehicle may have a center console 111, which can be connected to the virtual reality glasses device 103 or the holographic projection device 104 via a signal line 112 or directly via wireless connection. The center console 111 can also be connected to the information host 110 to obtain information from the information host 110 and send it to the virtual reality glasses device 103 or the holographic projection device 104.

[0105] Optional, see reference Figure 6 The vehicle can have a front-facing holographic projection device 1041 and a rear-facing holographic projection device 1042. After the central control unit 111 obtains the holographic projection data of the target object from the information host 110, the front-facing holographic projection device 1041 can obtain the holographic projection data from the central control unit 111; the rear-facing holographic projection device 1042 can obtain the holographic projection data from the front-facing holographic projection device 1041, or directly from the central control unit 111. Finally, the front-facing holographic projection device 1041 and the rear-facing holographic projection device 1042 can collaboratively or independently project holographic data onto the target object.

[0106] In summary, based on the vehicle provided in this application embodiment, passengers can, on the one hand, use virtual reality glasses to immerse themselves in viewing images of the vehicle's surrounding environment or obstacle information and conveniently control the vehicle's status; on the other hand, they can use holographic projection equipment to interact and entertain with virtual objects, making the vehicle's usage more flexible and improving the passengers' driving experience.

[0107] On the other hand, this application provides a vehicle control method. This method is applied to any of the vehicles described above. The vehicle includes a vehicle body 100, an image acquisition device 101, a vehicle controller 102, and a virtual reality glasses device 103. The image acquisition device 101 is arranged around the periphery of the vehicle body 100, and the virtual reality glasses device 103 has a vehicle control interface 1031 embedded within it.

[0108] refer to Figure 7 The method includes:

[0109] Step 701: Acquire images of the vehicle's external environment using the image acquisition device 101, and send the acquired images of the vehicle's external environment to the virtual reality glasses device 103;

[0110] Step 702: Using virtual reality glasses device 103, generate a panoramic image of the vehicle environment based on the image of the vehicle's surrounding environment;

[0111] Step 703: Using the virtual reality glasses device 103, based on the vehicle control interface 1031 and the position of the human eye's gaze point, determine the vehicle control signal and send the vehicle control signal to the vehicle controller 102;

[0112] Step 704: The vehicle controller 102 adjusts the vehicle's status based on the vehicle control signal.

[0113] The details of the method in this application correspond to the control logic of each component in the vehicle in the foregoing embodiments. For more details, please refer to the foregoing vehicle embodiments, which will not be elaborated further here.

[0114] Through the method described in this application embodiment, occupants can more intuitively observe the vehicle's environmental images using virtual reality glasses, obtaining more comprehensive vehicle environmental information, which helps improve the accuracy of driving decisions. Furthermore, the virtual reality glasses also embed a vehicle control interface, which occupants can operate by changing the position of their gaze point, adjusting the vehicle's status without manual intervention, effectively improving driving flexibility and enhancing the user's driving experience.

[0115] In this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance. The term "multiple" refers to two or more unless otherwise expressly defined.

[0116] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only.

[0117] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A vehicle characterized by comprising: The vehicle includes a vehicle body (100), an image acquisition device (101), a vehicle controller (102) and a virtual reality glasses device (103); The image acquisition device (101) is arranged on the periphery of the vehicle body (100) and is used to acquire a vehicle peripheral environment image and send the acquired vehicle peripheral environment image to the virtual reality glasses device (103); The virtual reality glasses device (103) is used to generate a vehicle environment panoramic image based on the vehicle peripheral environment image and display the vehicle environment panoramic image; The virtual reality glasses device (103) is embedded with a vehicle control interface (1031), and the virtual reality glasses device (103) is further used to determine a vehicle control signal based on the vehicle control interface (1031) and the position of a human eye fixation point, and send the vehicle control signal to the vehicle controller (102); The vehicle controller (102) is used to control the vehicle to adjust the state based on the vehicle control signal; The vehicle control interface (1031) is displayed on the vehicle environment panoramic image; when the virtual reality glasses device (103) changes the content of the displayed vehicle environment panoramic image following the head movement of the passenger, the display position of the vehicle control interface (1031) in the virtual reality glasses device (103) remains unchanged; The virtual reality glasses device (103) is further configured to change the perspective or zoom ratio of the displayed image in response to the motion interaction instruction, wherein changing the perspective of the displayed image includes controlling the perspective to switch between a first-person perspective or a third-person perspective, the first-person perspective being the perspective when the driver sits on the driver seat, and the third-person perspective being the perspective when observing the relationship between the vehicle as a whole and the external environment from a high altitude.

2. The vehicle of claim 1, wherein The vehicle control interface (1031) has at least one virtual button (10311) corresponding to the forward, backward, left turn, right turn, acceleration, deceleration or stop in the vehicle control interface (1031); The virtual reality glasses device (103) is used to determine the control signal corresponding to the target virtual button as the vehicle control signal when the time length that the human eye fixation point falls on the target virtual button is greater than a preset time length threshold.

3. The vehicle of claim 1, wherein The vehicle further includes a holographic projection device (104) and an information host (110); The holographic projection device (104) is used to obtain holographic projection data of a target object from the information host (110), and perform three-dimensional holographic projection of the target object in the passenger cabin of the vehicle, the target object including at least one of a virtual image, a car entertainment page or a vehicle control page.

4. The vehicle of claim 3, wherein The vehicle further includes a motion capture device (105); The motion capture device (105) is used to capture the motion of the passenger in the passenger cabin, generate a motion interaction instruction, and send the motion interaction instruction to the information host (110); The information host (110) receives the action interaction instruction, updates the holographic projection data of the target object in response to the action interaction instruction, and updates the state of the target object projected by the holographic projection device (104).

5. The vehicle of claim 4, wherein, The action capture device (105) comprises a passenger compartment three-dimensional model generation component (1051) and a gesture recognition component (1052); The passenger compartment three-dimensional model generation component (1051) is configured to acquire three-dimensional coordinate information of objects in the passenger compartment and generate a three-dimensional model of the passenger compartment; The gesture recognition component (1052) is configured to capture hand coordinate information of the passenger and determine a gesture action of the passenger based on the hand coordinate information and the three-dimensional model of the passenger compartment, and generate the action interaction instruction based on the gesture action.

6. The vehicle of claim 3, wherein The vehicle further comprises a voice detection component (106); The voice detection component (106) is configured to detect sound in the passenger compartment, identify a voice interaction instruction therefrom, and send the voice interaction instruction to the information host (110); The information host (110) receives the voice interaction instruction and updates the holographic projection data of the target object in response to the voice interaction instruction, so as to update the state of the target object projected by the holographic projection device (104).

7. The vehicle of claim 1, wherein The number of the image acquisition devices (101) is multiple, and the multiple image acquisition devices (101) are configured to acquire vehicle peripheral environment images in front, rear, left, right, top or bottom of the vehicle.

8. The vehicle of claim 1, wherein The vehicle further comprises a braking system (107) and a drive motor controller (108); The vehicle controller (102) is configured to send a first control instruction to the drive motor controller (108) based on the vehicle control signal, so that the drive motor controller (108) adjusts the operating state of the vehicle motor based on the first control instruction. Alternatively, the vehicle controller (102) is configured to send a second control instruction to the braking system (107) based on the vehicle control signal, so that the braking system (107) controls the braking state of the vehicle.

9. The vehicle of claim 1, wherein, The vehicle further comprises a radar (109); The radar (109) is configured to detect obstacle information around the vehicle and transmit the obstacle information to the virtual reality glasses device (103); The virtual reality glasses device (103) is configured to display a corresponding obstacle identifier in the vehicle environment panoramic image based on the obstacle information.

10. A vehicle control method characterized by, The vehicle comprises a vehicle body (100), an image acquisition device (101), a vehicle controller (102) and a virtual reality glasses device (103), the image acquisition device (101) is arranged on the periphery of the vehicle body (100), and the virtual reality glasses device (103) is inlaid with a vehicle control interface (1031); The method comprises: The image acquisition device (101) acquires a vehicle peripheral environment image and sends the acquired vehicle peripheral environment image to the virtual reality glasses device (103); The virtual reality glasses device (103) is used to generate a vehicle environment panoramic image based on the vehicle peripheral environment image and display the vehicle environment panoramic image; The virtual reality glasses device (103) is used to determine a vehicle control signal based on the vehicle control interface (1031) and the position of the human eye fixation point, and send the vehicle control signal to the vehicle controller (102); The vehicle controller (102) is used to control the vehicle to adjust the state based on the vehicle control signal; The vehicle control interface (1031) is displayed on the vehicle environment panoramic image; when the virtual reality glasses device (103) changes the content of the displayed vehicle environment panoramic image following the head movement of the passenger, the display position of the vehicle control interface (1031) in the virtual reality glasses device (103) remains unchanged; The virtual reality glasses device (103) is further configured to change the perspective or zoom ratio of the displayed image in response to the action interaction instruction, wherein changing the perspective of the displayed image includes controlling the perspective to switch between a first-person perspective and a third-person perspective, the first-person perspective being the perspective when the driver sits on the driver seat, and the third-person perspective being the perspective when observing the relationship between the vehicle as a whole and the external environment from a high altitude.

Images