A virtual reality driving system and method based on outdoor scenes

Abstract

The present invention provides a virtual reality driving system based on outdoor scenes, including a communication module, an environmental information acquisition module, a vehicle information acquisition module, an information processing module, and an entertainment recommendation module; the communication module is used to obtain external communication data; the environmental information acquisition module includes a drone unit and a vehicle sensor unit for obtaining environmental information; the vehicle information acquisition module is used to obtain vehicle status information; the entertainment recommendation module is used to obtain basic information data and personal preference data, and output entertainment recommendation information to users based on the basic information data and personal preference data; the information processing module is used to generate and output scene information data, game status information, and driving operation suggestions to users. The present invention can utilize real scenes and real vehicle information and generate virtual scene information to meet the user's entertainment needs in the vehicle use scene, and at the same time give driving operation suggestions to guide users to safely pass through complex roads.

Description

Technical Field

[0001] The present invention relates to the automotive field, and in particular to a virtual reality driving system and method based on outdoor scenes. Background Art

[0002] Nowadays, digital twin technology, digital enhancement technology and virtual reality technology are becoming more and more advanced, which can realize the mapping of real-world digital twins into 3D virtual scenes and the real world, thereby improving the authenticity and fun of displayed images or videos. Related technologies have been applied in many fields of society.

[0003] However, the single local audio and video playback device in the existing in-vehicle entertainment system is increasingly unable to meet the entertainment needs of vehicle users. The existing technology cannot combine digital twin technology, digital enhancement technology, and virtual reality technology with driving scenarios, lacks interaction between real scenarios and real vehicles, and the user experience of vehicle users is average. In addition, when vehicle drivers encounter more dangerous or difficult roads, it is difficult to provide targeted guidance and suggestions to drivers in the existing technology. Summary of the invention

[0004] In view of the defects in the prior art, the purpose of the present invention is to provide a virtual reality driving system and method based on outdoor scenes, which aims to utilize real scenes and real vehicle information and generate virtual scene information to meet the user's entertainment needs in the car use scenario, and at the same time give driving operation suggestions to guide users to safely pass through complex roads.

[0005] In order to achieve the above-mentioned object of the invention, the present invention adopts the following technical solution:

[0006] According to a first aspect of the present invention, there is provided a virtual reality driving system based on an outdoor scene, comprising a communication module, an environment information acquisition module, a vehicle information acquisition module, an information processing module, and an entertainment recommendation module;

[0007] The communication module is used to obtain external communication data;

[0008] The environmental information acquisition module includes a drone unit and a vehicle sensor unit, which are used to acquire environmental information, and the environmental information includes sound environmental information and image environmental information;

[0009] The vehicle information acquisition module is used to acquire vehicle status information;

[0010] The entertainment recommendation module is used to obtain basic information data and personal preference data, and output entertainment recommendation information to the user based on the basic information data and personal preference data;

[0011] The information processing module is used to generate and output scene information data, game status information and driving operation suggestions to the user based on the information provided by the communication module, the environment information acquisition module, the vehicle information acquisition module and the entertainment recommendation module, combined with the map information of the vehicle;

[0012] The information processing module generates scene information data according to the following environment acquisition rules:

[0013] The vehicle sensor unit acquires the first environmental information and transmits it to the information processing module; the information processing module determines the completeness of the first environmental information, and if the determination result is complete, generates scene information data according to the first environmental information; if the determination result is incomplete, the drone unit is enabled to supplement the acquisition of the second environmental information, and the information processing module generates scene information data according to the first environmental information and the second environmental information;

[0014] The game status information includes vehicle information and game information, wherein: the vehicle information includes vehicle appearance, vehicle speed, and vehicle posture; and the game information includes information related to the game program.

[0015] Preferably, the communication module comprises a vehicle-mounted satellite antenna.

[0016] Preferably, the vehicle sensor unit includes at least an on-board microphone, an internal camera, and an external camera; the on-board microphone is used to obtain real sound environment information, the internal camera is used to obtain real passenger movements, and the external camera is used to obtain real external image environment information.

[0017] Preferably, the communication module is also used to receive and transmit to the cloud the information output by the information processing module, and to receive and transmit to the cloud data to the information processing module.

[0018] According to another aspect of the present invention, a virtual reality driving method based on an outdoor scene is provided, comprising the following steps:

[0019] Using a vehicle detector unit and a drone unit to obtain environmental information, the environmental information includes sound environmental information and image environmental information;

[0020] Obtain vehicle status information and external communication data;

[0021] Obtain basic information data and personal preference data, and output entertainment recommendation information to users based on the basic information data and personal preference data;

[0022] Get the vehicle's own map information;

[0023] Based on the environmental information, vehicle status information, external communication data, basic information data, personal preference data, and the vehicle's own map information, scene information data, game status information, and driving operation suggestions are generated and output to the user;

[0024] When generating scene information data, firstly, the vehicle sensor unit is enabled to obtain the first environment information; the completeness of the first environment information is judged: if the judgment result is complete, the scene information data is generated according to the first environment information; if the judgment result is incomplete, the drone unit is enabled to supplement the second environment information, and the scene information data is generated according to the first environment information and the second environment information;

[0025] The game status information includes vehicle information and game information, wherein: the vehicle information includes vehicle appearance, vehicle speed, and vehicle posture; and the game information includes information related to the game program.

[0026] Preferably, the method further comprises: a tool for acquiring external communication data comprises a vehicle-mounted satellite antenna.

[0027] Preferably, it also includes: the vehicle sensor unit includes at least an on-board microphone, an internal camera, and an external camera; the on-board microphone is used to obtain real sound environment information, the internal camera is used to obtain real passenger movements, and the external camera is used to obtain real external image environment information.

[0028] Preferably, it also includes: receiving and transmitting the scene information data and game status information to the cloud, and receiving and transmitting cloud data to the information processing module.

[0029] Compared with the prior art, the present invention has the following beneficial effects:

[0030] The present invention, through the cooperation of multiple modules, utilizes real scene information and real vehicle information to generate and output virtual scene data information, game status information, and driving operation suggestions to the user. This can not only enhance the user's vehicle driving experience and meet the user's entertainment needs in the vehicle use scenario, but also provide the user with targeted driving operation suggestions to assist the user to pass through complex roads smoothly and safely. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0032] Figure 1 It is a structural schematic diagram of the system described in the first embodiment;

[0033] Figure 2 It is a schematic diagram of the operation process of the system described in the first embodiment;

[0034] Figure 3 This is a schematic diagram of the operation process of the environment acquisition rule described in the first embodiment.

[0035] The figure shows:

[0036] 1- Communication module;

[0037] 2-environmental information acquisition module; 21-vehicle detector unit; 22-drone unit;

[0038] 3-Vehicle information acquisition module;

[0039] 4- Information processing module;

[0040] 5-Entertainment recommendation module. DETAILED DESCRIPTION

[0041] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0042] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0043] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings. In addition, all directional indications in this application (such as up, down, left, right, front, back, bottom...) are only used to explain the relative position relationship, movement, etc. between the components in a certain specific posture (as shown in the drawings). If the specific posture changes, the directional indication will also change accordingly.

[0044] First Embodiment

[0045] This embodiment provides a virtual reality driving system based on outdoor scenes, which allows consumers to have more fun when actually traveling by car, and at the same time provides certain social and competitive experiences through the Internet of Vehicles and the cloud. Figure 1 As shown, it mainly includes: communication module 1, environment information acquisition module 2, vehicle information acquisition module 3, information processing module 4, entertainment recommendation module 5. Among them:

[0046] The communication module 1 is used to obtain external communication data. The external communication data may include cloud information and satellite positioning information. The communication module 1 may be provided with a remote communication module (T-box) to obtain external communication data. At the same time, the communication module 1 may include a vehicle-mounted satellite antenna to provide positioning, communication and data transmission for vehicles in areas without signals, thereby enhancing the versatility of the system provided by this embodiment.

[0047] Furthermore, the communication module 1 can receive and transmit to the cloud the information output by the information processing module 4. For example, the user may generate pictures, images, and text information (check-in, dynamics, etc.) during a task or game. After the information is output to the communication module 1 by the information processing module 4, it can be uploaded to the cloud by the communication module 1 for users to publish information in real time to meet the user's information sharing needs and improve the user's experience. The communication module 1 can also receive and transmit cloud data to the information processing module. For example, the cloud may confirm the completion of the task based on the actual vehicle operation and evaluation standards, and transmit the relevant information to the information processing module 4 through the communication module 1 to output to the user to meet the user's information acquisition needs and enhance the user's interest.

[0048] The environmental information acquisition module 2 includes a drone unit 22 and a vehicle sensor unit 21, which are used to acquire environmental information. The vehicle sensor unit 21 may include a vehicle microphone to acquire real sound environment information; may include an internal camera to acquire real passenger movements; may include an external camera to acquire real external image environment information; and may also include other environmental sensors to detect real rain, snow, wind, altitude, location and other environmental information. As for the specific design of the drone unit 22, the drone can be placed in the front hood of the vehicle. When the drone is required to work, the drone automatically takes off to acquire real surrounding information and provide real-time feedback. The structure and operation logic design of the drone unit 22 can save vehicle space and enhance the integration of the drone and the vehicle in terms of physical structure and operation process.

[0049] The vehicle information acquisition module 3 is used to obtain vehicle status information. Specifically, the vehicle information acquisition module 3 can obtain vehicle status information such as vehicle status, vehicle posture, whether it is in off-road mode, etc. through the VCU (vehicle control unit), air suspension controller, etc. For example, the VCU controls the vehicle speed, the air suspension adjusts the ground clearance and vehicle height, the off-road mode controls the torque distribution, the height of the vehicle's center of mass, and the passability, so as to be reflected in the information processing module 4 through the digital twin technology synchronously, so that the vehicle in the digital twin model runs synchronously with the real vehicle.

[0050] The information processing module 4 is used to generate and output scene information data and game status information to the user based on the information provided by the communication module 1, the environmental information acquisition module 2, the vehicle information acquisition module 3, and the entertainment recommendation module 5, combined with the vehicle's own map information (such as the vehicle-mounted 3D map). The information processing module 4 may include a CDC module (i.e., a cockpit domain control module). Among them, the scene information data is 3D scene information, so that the driver can identify the surrounding parameterized environment by viewing the 3D view and judge how to drive the vehicle. The game status information includes vehicle information and game information to enhance the authenticity of the game content, make the user more immersed, and optimize the user's entertainment experience. Among them: vehicle information includes vehicle appearance, vehicle speed, and vehicle posture, such as vehicle ground clearance, wheel steering, vehicle roll angle, front and rear axle locking and operation information; game information includes information related to the game program, such as game unlocking, level distribution, competition data, game progress, etc.

[0051] The information processing module 4 generates scene information data through environment acquisition rules, such as Figure 3 The following is a detailed explanation of the environment acquisition rules:

[0052] First, the vehicle sensor unit 21 acquires the first environmental information and transmits it to the information processing module 4;

[0053] The information processing module 4 determines the completeness of the first environment information:

[0054] If the judgment result is complete, the information processing module 4 generates scene information data according to the first environment information;

[0055] If the judgment result is incomplete, the drone unit 22 is activated to supplement the second environment information, and the information processing module 4 generates scene information data according to the first environment information and the second environment information.

[0056] By acquiring rules from the environment, it is possible to effectively and comprehensively generate scene information data that conforms to reality, thereby greatly improving the accuracy of data output to users and improving the user experience.

[0057] The information processing module 4 can also output driving operation suggestions to the user based on the information provided by the communication module 1, the environmental information acquisition module 2, the vehicle information acquisition module 3, and the entertainment recommendation module 5. For example, the information processing module 4 can analyze the front scene data and give corresponding driving operation suggestions. When the front scene data exceeds the vehicle performance requirements, such as the approach angle and ground clearance exceed the vehicle performance, the driver can be given corresponding operational suggestions. For example, based on the actual performance of the vehicle and the user's driving experience, the driver can be guided on how to pass this outdoor road surface, when to lift the chassis, disconnect the stabilizer bar, quickly decelerate, accelerate, etc., to avoid vehicle damage, assist the user to pass through complex roads safely and smoothly, and improve the user's driving level at the same time.

[0058] The system provided in this embodiment also includes an entertainment recommendation module 5, which is used to obtain basic information data and personal preference data, and output entertainment recommendation information to the user based on the basic information data and personal preference data. Among them, the entertainment recommendation module 5 can call the existing personal preference data, or obtain personal preference data based on the user's hobbies. The entertainment recommendation information can be a list of game tasks or events, and the user can browse the relevant list and choose to participate. For example, it can recommend to the user where to play, check in or go off-road, and present it in the virtual game, so that the user can more quickly select a game plan that suits his personal needs, thereby improving the user's experience.

[0059] The operating principle of the system provided in this embodiment is described as follows: Figure 2 As shown:

[0060] First, the in-vehicle program is started. The entertainment recommendation module 5 calls or evaluates the user's possible hobbies through the personal preference database, pushes game tasks or events according to the user's hobbies, and the information processing module 4 pushes a list of browsable events to the user for him to choose to participate. The information processing module 4 obtains and displays task information, vehicle status, vehicle posture, off-road mode, off-road level, driver skill level, etc., and provides comprehensive suggestions to customers. For example, power performance, vehicle passability performance, whether the suspension height is adjustable, differential capability, etc. Different vehicle performance and driver skills correspond to different scene tasks. For example, vehicles without off-road capabilities and customers without off-road experience will not be recommended rock climbing scenes.

[0061] Subsequently, the information processing module 4 obtains the graphic data of the vehicle's exterior shape, positioning information, vehicle posture control and other information, generates vehicle information in the digital twin model of the virtual device and loads it into the program, and triggers the scene game when it recognizes that the vehicle enters the off-road mode; when the vehicle is actually running, the virtual digital twin model is synchronously presented to the real scene, which not only reflects the vehicle's appearance and speed, but also the vehicle's posture. For example, the air suspension module is used to increase the vehicle's ground clearance, the steering module obtains wheel steering, the tank turns around, the suspension sensor obtains a large tilt of the entire vehicle, and the front and rear axles are locked and operated.

[0062] The information processing module 4 obtains the vehicle's own 3D map, while the environmental information acquisition module 2 obtains the external environmental information, corrects and supplements the 3D scene outside the vehicle. For the scene that the vehicle cannot directly obtain, the drone flies over the vehicle to obtain the 3D data around the vehicle, which is finally processed by the information processing module 4 and output to the outside. The vehicle-mounted satellite antenna of the communication module 1 can further serve as a supplement to the vehicle's mobile signal to locate, communicate and transmit data to vehicles in signal-free areas.

[0063] During the game process, the vehicle starts to travel in the designated starting area, and the information processing module 4 simultaneously presents the game status to the user as part of the game, for example, showing the user the cross-axis operation process when the vehicle passes through a shell crater road surface; at the same time, when it is found that the scene data ahead exceeds the vehicle performance requirements, such as the approach angle and ground clearance exceed the vehicle performance, the information processing module 4 can give the driver corresponding operational suggestions to avoid vehicle damage.

[0064] With the help of communication module 1, data can be transmitted to and from the cloud. For example, during the task / game process, users can generate pictures, images, etc. At the same time, users can check in, entertain themselves, and publish information to the outside world, such as climbing a certain slope and reaching a scenic spot that ordinary vehicles cannot reach. The cloud confirms the completion of the task based on the actual vehicle operation and evaluation standards, and synchronously updates the vehicle data or opens the next level. The vehicle drives in the designated starting area, which is presented in the task / game program and is part of the game. For example, the cross-axis operation process when passing through the shell pit road surface.

[0065] This embodiment provides consumers with a virtual reality scene presentation through real vehicles, real scenes, real maps, digital twin vehicles combined with game programs, network interconnection, and the cloud. Users can publish event pictures and images to the outside world, and at the same time guide drivers on how to operate to pass off-road roads more easily and safely.

[0066] Second Embodiment

[0067] This embodiment provides a virtual reality driving method based on an outdoor scene, comprising the following steps:

[0068] In step 1, a vehicle detector unit and a drone unit are used to obtain environmental information, wherein the environmental information includes sound environmental information and image environmental information;

[0069] Obtain vehicle status information and external communication data;

[0070] Obtain basic information data and personal preference data, and output entertainment recommendation information to users based on the basic information data and personal preference data to improve the user's experience;

[0071] In step 2, the map information of the vehicle is obtained.

[0072] In step 3, based on the environmental information, vehicle status information, external communication data, basic information data, personal preference data, combined with the vehicle's own map information, scene information data, game status information and driving operation suggestions are generated and output to the user. The game status information includes vehicle information and game information, wherein: the vehicle information includes vehicle appearance, vehicle speed, and vehicle posture; the game information includes information related to the game program. This enriches the user's entertainment experience, guides the user to overcome complex roads, reduces the probability of vehicle damage, and assists in improving the driver's driving level.

[0073] When generating scene information data, firstly, the vehicle sensor unit is enabled to obtain first environment information;

[0074] Performing a completeness judgment on the first environment information: if the judgment result is complete, generating scene information data according to the first environment information;

[0075] If the judgment result is incomplete, the drone unit is enabled to supplement the second environmental information and generate scene information data based on the first environmental information and the second environmental information.

[0076] Furthermore, the external communication data acquisition tool includes a vehicle-mounted satellite antenna to acquire external communication data in a signal-free area.

[0077] Furthermore, the vehicle sensor unit includes at least an on-board microphone, an internal camera, and an external camera; the on-board microphone is used to obtain real sound environment information, the internal camera is used to obtain real passenger movements, and the external camera is used to obtain real external image environment information.

[0078] Furthermore, it can also receive and transmit the scene information data and game status information to the cloud, and receive and transmit cloud data to the information processing module to meet the user's information acquisition and sharing needs.

[0079] The above describes the specific embodiments of the present invention. Based on the above description, relevant personnel can make various changes and modifications without departing from the technical concept of the present invention.

Claims

1. A virtual reality driving system based on outdoor scenes, characterized in that: It includes communication module, environment information acquisition module, vehicle information acquisition module, information processing module and entertainment recommendation module; The communication module is used to obtain external communication data; The environmental information acquisition module includes a drone unit and a vehicle sensor unit, which are used to acquire environmental information, and the environmental information includes sound environmental information and image environmental information; The vehicle information acquisition module is used to acquire vehicle status information; The entertainment recommendation module is used to obtain basic information data and personal preference data, and output entertainment recommendation information to the user based on the basic information data and personal preference data; The information processing module is used to generate and output scene information data, game status information and driving operation suggestions to the user based on the information provided by the communication module, the environment information acquisition module, the vehicle information acquisition module and the entertainment recommendation module, combined with the map information of the vehicle; The information processing module generates scene information data according to the following environment acquisition rules: The vehicle sensor unit acquires the first environmental information and transmits it to the information processing module; the information processing module determines the completeness of the first environmental information, and if the determination result is complete, generates scene information data according to the first environmental information; if the determination result is incomplete, the drone unit is enabled to supplement the acquisition of the second environmental information, and the information processing module generates scene information data according to the first environmental information and the second environmental information; The game status information includes vehicle information and game information, wherein: the vehicle information includes vehicle appearance, vehicle speed, and vehicle posture; and the game information includes information related to the game program.

2. The virtual reality driving system based on outdoor scenes as claimed in claim 1, characterized in that: The communication module includes a vehicle-mounted satellite antenna.

3. The virtual reality driving system based on outdoor scenes as claimed in claim 1, characterized in that: The vehicle sensor unit includes at least an on-board microphone, an internal camera, and an external camera; the on-board microphone is used to obtain real sound environment information, the internal camera is used to obtain real passenger movements, and the external camera is used to obtain real external image environment information.

4. The outdoor scene-based virtual reality driving system according to claim 1, characterized in that: The communication module is also used to receive and transmit to the cloud the information output by the information processing module, and to receive and transmit to the cloud data of the information processing module.

5. A virtual reality driving method based on outdoor scenes, characterized in that: The steps include: Using a vehicle detector unit and a drone unit to obtain environmental information, the environmental information includes sound environmental information and image environmental information; Obtain vehicle status information and external communication data; Obtain basic information data and personal preference data, and output entertainment recommendation information to users based on the basic information data and personal preference data; Get the vehicle's own map information; Based on the environmental information, vehicle status information, external communication data, basic information data, personal preference data, and the vehicle's own map information, scene information data, game status information, and driving operation suggestions are generated and output to the user; When generating scene information data, firstly, the vehicle sensor unit is enabled to obtain first environment information; The completeness of the first environment information is judged: if the judgment result is complete, the scene information data is generated according to the first environment information; if the judgment result is incomplete, the drone unit is enabled to supplement the second environment information, and the scene information data is generated according to the first environment information and the second environment information; The game status information includes vehicle information and game information, wherein: the vehicle information includes vehicle appearance, vehicle speed, and vehicle posture; The game information includes information related to the game program.

6. The virtual reality driving method based on outdoor scenes as claimed in claim 5, characterized in that: Also includes: Tools for acquiring external communication data include vehicle-mounted satellite antennas.

7. The virtual reality driving method based on outdoor scenes as claimed in claim 5, characterized in that: Also includes: The vehicle sensor unit includes at least an on-board microphone, an internal camera, and an external camera; the on-board microphone is used to obtain real sound environment information, the internal camera is used to obtain real passenger movements, and the external camera is used to obtain real external image environment information.

8. The virtual reality driving method based on outdoor scenes as claimed in claim 5, characterized in that: Also includes: Receive and transmit the scene information data and game status information to the cloud, and receive and transmit cloud data to the information processing module.

Images