Method and related control device for assisting virtual reality in vehicles

Abstract

The present invention relates to a method for assisting virtual reality in a vehicle. The method comprises: acquiring first characteristic data associated with virtual reality displayed in a virtual reality device; generating first control data for a functional system in the vehicle based on the acquired first characteristic data; and sending the first control data for operating the functional system in the vehicle. In addition, the present invention also relates to a related control device, a data processing device and a vehicle. Further, the present invention also relates to a method for operating a vehicle. According to the present invention, the virtual reality experience in the vehicle can be well improved.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology. More specifically, the present invention relates to a method for assisting virtual reality in a vehicle, a control device for assisting virtual reality in a vehicle, a data processing device, and a vehicle with the control device or the data processing device. In addition, the present invention also relates to a method for operating a vehicle. Background Art

[0002] Nowadays, virtual reality (VR) has been applied in many fields, such as entertainment games, real estate development, education and training, industrial simulation, etc. However, so far, virtual reality devices have only been limitedly applied in transportation.

[0003] Document CN105344101A relates to a racing simulation game based on virtual reality technology. However, the racing simulation game is limited to a game device fixedly installed in a game hall, is separated from actual transportation, has a single function and lacks interaction with users.

[0004] Document CN206193684U relates to a virtual reality system, which uses multiple optical markers in a motion capture device installed on a vehicle body to reflect or send optical information of the motion capture device to a motion capture camera of the virtual reality system, and then outputs it to a server for processing and presents it to the user through a head display. However, the virtual reality system cannot realize the interaction between the vehicle and the user, and the effect is limited.

[0005] The existing virtual reality experience usually involves users holding a VR headset or wearing a VR headset to experience the VR scene. However, there are still some problems with the virtual reality experience, especially in transportation, such as lack of immersion and easy dizziness. Summary of the invention

[0006] The object of the present invention is to improve the experience of virtual reality in a vehicle.

[0007] According to a first aspect of the present invention, a method for assisting virtual reality in a vehicle is described. The method comprises: acquiring first characteristic data associated with a virtual reality displayed in a virtual reality device; generating first control data for a functional system in the vehicle based on the acquired first characteristic data; and sending the first control data for operating the functional system in the vehicle.

[0008] According to the present invention, the functional system in the vehicle can respond in association with or matching the virtual reality displayed in the virtual reality device, so that the user can experience the virtual reality visually, auditorily, tactilely and / or olfactorily, thereby further improving the user experience.

[0009] Furthermore, it is also possible that only functional systems already installed in the vehicle need to be appropriately controlled without the need to additionally install expensive equipment for virtual reality, thereby improving the virtual reality experience in a cost-effective manner.

[0010] In some embodiments, the first feature data may include data characterizing at least one of the following features of the virtual reality displayed in the virtual reality device: weather conditions in the virtual reality, movement of objects in the virtual reality, scenes in the virtual reality, brightness and darkness in the virtual reality, and atmosphere in the virtual reality.

[0011] In some embodiments, the weather conditions may include at least one of the following parameters: temperature, humidity, wind speed, rainfall, snowfall, hail, haze, and sandstorm.

[0012] In some embodiments, the movement of an object in virtual reality may include at least one of the following parameters: a velocity of the object, an acceleration of the object, and a posture of the object.

[0013] In some embodiments, the scene may include at least one of the following parameters: glacier, sea, field, grassland, forest, beach, desert, city, zoo, underwater world, cinema, KTV, conference room and shopping mall.

[0014] In some embodiments, the brightness level may include at least one of the following parameters: a scotopic range, a mesopic range, and a photopic range.

[0015] In some embodiments, the atmosphere may include at least one of the following parameters: relaxed, intense, serious, and quiet.

[0016] In some embodiments, the first control data can be used to control at least one of the following functional systems in the vehicle: a seat system, a window system, a sound system, an air conditioning system, a lighting system, and a driver assistance system.

[0017] In some embodiments, the step of “generating first control data for a functional system in a vehicle based on the acquired first characteristic data” includes:

[0018] Generate first control data according to the movement of an object in virtual reality displayed in the virtual reality device, so as to cause the seat system to perform at least one of the following actions: longitudinal movement, longitudinal rotation, lateral movement, lateral rotation, vertical movement, vertical rotation (such as tilting, pushing back and vibration); and / or

[0019] Generate first control data according to the weather conditions and / or scenes in the virtual reality displayed in the virtual reality device, so as to cause the window system to perform at least one of the following actions: movement in an opening direction and movement in a closing direction; and / or

[0020] Generate first control data according to a scene and / or atmosphere in a virtual reality displayed in a virtual reality device, so as to cause a sound system and / or a window system and / or an air conditioning system to perform at least one of the following actions: active noise reduction and active noise enhancement; and / or

[0021] Generate first control data according to the weather conditions and / or scenes and / or atmospheres in the virtual reality displayed in the virtual reality device, so as to prompt the air conditioning system to perform at least one of the following actions: temperature control, humidity control and ventilation; and / or

[0022] The first control data is generated according to the brightness and darkness level and / or scene and / or atmosphere in the virtual reality displayed in the virtual reality device, so as to prompt the lighting system to perform at least one of the following actions: dimming, brightening and providing a lighting atmosphere.

[0023] In some embodiments, when the atmosphere is serious or quiet or when the scene is a conference room, the first control data prompts the sound system and / or the window system and / or the air conditioning system to implement active noise reduction.

[0024] In some embodiments, when the atmosphere is serious or quiet or when the scene is a conference room, the first control data prompts the sound system to generate reverse sound waves about the external noise. Thus, the noise can be neutralized by the sound system, thereby achieving a noise reduction effect. In addition, it can also prompt the closing of windows, so that the external noise is further suppressed. In addition, it can also prompt the turning off of the air conditioner, thereby further reducing the noise generated inside the vehicle.

[0025] In some embodiments, the first characteristic data includes data characterizing an operation of a user in a virtual reality displayed in a virtual reality device.

[0026] In some embodiments, the operation includes at least one of the following operations: viewing a map, specifying a navigation path, specifying a point of interest, and purchasing a service or a product.

[0027] In some embodiments, first control data is generated according to a user's operation in a virtual reality displayed in a virtual reality device, so as to cause a driver assistance system to display or implement a new navigation route.

[0028] In some embodiments, before sending the first control data, the first control data is checked, and sending the first control data is allowed only when the check result is positive.

[0029] In some embodiments, the check includes: - a safety check, in which it is checked whether the manipulation of the functional system by the first control data complies with the driving safety of the vehicle; and / or

[0030] - A conflict check, in which it is checked whether the manipulation of the functional system by the first control data conflicts with the current operating state of the vehicle and / or the traffic regulations and / or user-preset state of the area where the vehicle is currently located.

[0031] In some embodiments, during a safety check, it is prohibited to send the following first control data, which may cause the vehicle to pass through a dangerous area or a construction area; and / or during a conflict check, when the current remaining energy of the vehicle is lower than a predetermined threshold, it is prohibited to send the following first control data, which may cause the vehicle to increase energy consumption.

[0032] According to the present invention, the improved experience of virtual reality and the safe and reliable driving of vehicles can be coordinated with each other. The virtual reality experience is fully improved without violating the safe and reliable driving of vehicles.

[0033] In some embodiments, the method further comprises:

[0034] - acquiring second characteristic data associated with the position and / or operating status of the vehicle;

[0035] - generating second control data for virtual reality displayed in the virtual reality device based on the acquired second feature data; and

[0036] - Sending second control data for controlling the virtual reality displayed in the virtual reality device.

[0037] In some embodiments, the method further comprises:

[0038] - acquiring third characteristic data associated with the movement and / or expression of the virtual reality user in the vehicle;

[0039] - generating third control data for virtual reality displayed in the virtual reality device based on the acquired third feature data; and

[0040] - Sending third control data for controlling the virtual reality displayed in the virtual reality device.

[0041] In some embodiments, the method further comprises: interacting with a remote communication device and / or a portable smart device within the vehicle.

[0042] In this way, on the one hand, the user can have a feeling of being directly connected with the movement he is in; on the other hand, the visual images received by the user when watching virtual reality are coordinated with the actual movement felt, so that motion sickness does not occur.

[0043] According to a second aspect of the present invention, a control device for implementing virtual reality in a vehicle is described. The control device can interact with the virtual reality device via a first communication connection, and the control device can interact with the functional system via a second communication connection, wherein the control device is configured to: acquire first characteristic data associated with the virtual reality displayed in the virtual reality device from a data memory for virtual reality; generate first control data for the functional system in the vehicle based on the acquired first characteristic data; and send the first control data for controlling the functional system in the vehicle in association with the virtual reality displayed in the virtual reality device.

[0044] In some embodiments, the first feature data includes data characterizing at least one of the following features of the virtual reality displayed in the virtual reality device: weather conditions in the virtual reality, movement of objects in the virtual reality, scenes in the virtual reality, brightness and darkness in the virtual reality, and atmosphere in the virtual reality.

[0045] In some embodiments, the first control data can be used to control at least one of the following functional systems in the vehicle: a seat system, a window system, a sound system, an air conditioning system, a lighting system, and a driver assistance system.

[0046] In some embodiments, the control device is configured to: generate first control data according to the movement of an object in virtual reality displayed in the virtual reality device, so as to cause the seat system to perform at least one of the following actions: move longitudinally, rotate longitudinally, move laterally, rotate laterally, move vertically, rotate vertically; and / or

[0047] Generate first control data according to the weather conditions and / or scenes in the virtual reality displayed in the virtual reality device, so as to cause the window system to perform at least one of the following actions: movement in an opening direction and movement in a closing direction; and / or

[0048] Generate first control data according to a scene and / or atmosphere in a virtual reality displayed in a virtual reality device, so as to cause a sound system and / or a window system and / or an air conditioning system to perform at least one of the following actions: active noise reduction and active noise enhancement; and / or

[0049] Generate first control data according to the weather conditions and / or scenes and / or atmospheres in the virtual reality displayed in the virtual reality device, so as to prompt the air conditioning system to perform at least one of the following actions: temperature control, humidity control and ventilation; and / or

[0050] The first control data is generated according to the brightness and darkness level and / or scene and / or atmosphere in the virtual reality displayed in the virtual reality device, so as to prompt the lighting system to perform at least one of the following actions: dimming, brightening and providing a lighting atmosphere.

[0051] In some embodiments, the control device is configured to generate first control data for causing the sound system and / or the window system and / or the air conditioning system to perform active noise reduction when the atmosphere is serious or quiet or when the scene is a conference room.

[0052] In some embodiments, the first characteristic data includes data characterizing an operation of a user in a virtual reality displayed in a virtual reality device.

[0053] In some exemplary embodiments, the control device is configured to generate first control data as a function of a user's operation in a virtual reality displayed in a virtual reality device, for causing the driver assistance system to display or execute a new navigation route.

[0054] In some embodiments, the control device is configured to check the first control data before sending the first control data, and only allow the first control data to be sent if the check result is positive.

[0055] In some embodiments, the check includes: a safety check, in which it is checked whether the manipulation of the functional system by the first control data complies with the driving safety of the vehicle; and / or

[0056] A conflict check is performed to check whether the manipulation of the functional system by the first control data conflicts with the current operating state of the vehicle and / or the traffic regulations and / or user preset state of the area where the vehicle is currently located.

[0057] In some embodiments, during the safety check, it is prohibited to send the following first control data, which may cause the vehicle to pass through a dangerous area or a construction area; and / or

[0058] In the conflict check, when the current remaining energy of the vehicle is lower than a predetermined threshold, it is prohibited to send the following first control data, which will cause the energy consumption of the vehicle to increase.

[0059] In some embodiments, the control device is configured to: acquire second characteristic data associated with the orientation and / or operating status of the vehicle; generate second control data for a virtual reality displayed in a virtual reality device based on the acquired second characteristic data; and send the second control data for controlling the virtual reality displayed in the virtual reality device.

[0060] In some embodiments, the control device is configured to: acquire third characteristic data associated with the movements and / or expressions of a virtual reality user in a vehicle; generate third control data for the virtual reality displayed in the virtual reality device based on the acquired third characteristic data; and send the third control data for controlling the virtual reality displayed in the virtual reality device.

[0061] According to a third aspect of the present invention, a data processing device is described, comprising: one or more processors; and one or more memories, wherein the one or more memories are configured to store a series of computer-executable instructions and computer-accessible data associated with the series of computer-executable instructions. When the series of computer-executable instructions are executed by the one or more processors, the one or more processors are caused to perform the method as described in the first aspect of the present invention.

[0062] According to a fourth aspect of the present invention, a vehicle is described, wherein the vehicle comprises the control device according to the second aspect of the present invention or comprises the data processing device according to the third aspect of the present invention.

[0063] In some embodiments, the means of transportation include land vehicles, air vehicles or water vehicles, wherein land vehicles specifically refer to motor vehicles, rail vehicles, motorcycles, etc., air vehicles specifically refer to airplanes, airships, etc., and water vehicles specifically refer to ships, yachts, etc.

[0064] According to a fifth aspect of the present invention, a method for operating a vehicle is described. The method comprises: displaying a virtual reality in a virtual reality device in the vehicle; executing the method according to the first aspect of the present invention; a control unit for a functional system in the vehicle controls an assigned execution device based on first control data. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Embodiments of the present invention are schematically described below with the aid of the accompanying drawings. In the drawings:

[0066] Figure 1A schematic diagram showing an embodiment of the present invention is shown;

[0067] Figure 2 A block diagram showing one embodiment of a system for assisting virtual reality in a vehicle according to the present invention;

[0068] Figure 3 A flow chart of an exemplary embodiment of the method according to the invention for assisting virtual reality in a vehicle is shown. DETAILED DESCRIPTION

[0069] The present disclosure will be described below with reference to the accompanying drawings, wherein the accompanying drawings illustrate several embodiments of the present disclosure. However, it should be understood that the present disclosure can be presented in a variety of different ways and is not limited to the embodiments described below; in fact, the embodiments described below are intended to make the disclosure of the present disclosure more complete and fully illustrate the scope of protection of the present disclosure to those skilled in the art. It should also be understood that the embodiments disclosed herein can be combined in various ways to provide more additional embodiments.

[0070] It should be understood that the terms used herein are only used to describe specific embodiments and are not intended to limit the present disclosure. All terms (including technical terms and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. For the sake of simplicity and / or clarity, well-known functions or structures may not be described in detail.

[0071] Herein, the term "A or B" includes "A and B" and "A or B" rather than exclusively including only "A" or only "B", unless specifically stated otherwise.

[0072] As used herein, the term "exemplary" means "serving as an example, instance, or illustration". Any implementation described as an example herein is not necessarily to be construed as preferred or advantageous over other implementations. Furthermore, the present disclosure is not to be limited by any stated or implied theory presented in the above technical field, background technology, summary of the invention, or detailed description.

[0073] In addition, for reference purposes only, the terms "first", "second" and the like may also be used herein, and "first" and "second" may also refer to multiple "firsts" and "seconds". For example, the terms "first", "second" and other such numerical terms referring to structures or elements do not imply a sequence or order unless the context clearly indicates otherwise.

[0074] It should also be understood that when the term “include / comprises” is used in this document, it indicates the presence of the specified features, integers, steps, operations, units and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, units and / or components and / or their combinations.

[0075] Figure 1 A schematic diagram according to an embodiment of the present invention is shown. In this embodiment, the means of transport is a motor vehicle 1. Persons 2 in the motor vehicle (hereinafter also referred to as users, i.e., virtual reality users) each wear a virtual reality device 3 for realizing virtual reality. Here, the virtual reality device 3 is a head-mounted display, i.e., a head display.

[0076] exist Figure 1 In the automatic driving mode, the user 2 wearing the virtual reality device in the motor vehicle may generally include a person riding in the motor vehicle, such as a person sitting in the front passenger seat or a person sitting in the back seat. In the automatic driving mode, the user 2 wearing the virtual reality device in the motor vehicle also includes a driver sitting in the driving seat. In this case, the motor vehicle may automatically drive according to the driver's pre-set parameters such as the destination and itinerary, and the driver's intervention is basically not required during driving. In the automatic driving mode, if the motor vehicle recognizes that the driver needs to take over the motor vehicle, the driver may be notified to take off the virtual reality device to operate the motor vehicle.

[0077] In other embodiments, the transportation means may also be any other equipment with a movable cabin, such as an aircraft, a ship, and a bumper car.

[0078] Next, combine Figure 2 and 3 A system and method for assisting virtual reality in a vehicle according to the present invention are described in detail.

[0079] like Figure 2 As shown, the system may include a virtual reality device 3, a control device 4 and a functional system 5. A first communication connection 8 is provided between the virtual reality device 3 and the control device 4, and the virtual reality device 3 and the control device 4 can interact with each other via the first communication connection 8. A second communication connection 9 is provided between the control device 4 and the functional system 5, and the control device 4 and the functional system 5 can interact with each other via the second communication connection 9.

[0080] In the current embodiment, the virtual reality device 3 can be configured as a head display as described above. The head display can send optical signals to the eyes, and can achieve different effects such as virtual reality, augmented reality, and mixed reality. In the present disclosure, virtual reality should not be understood restrictively, and virtual reality should be understood as including "augmented reality" and "mixed reality".

[0081] In the current embodiment, the control device 4 may include a computer loaded on the vehicle itself, such as a vehicle-mounted computer (Head Unit). Additionally or alternatively, the control device 4 may also include a vehicle control module. The vehicle control module may, for example, be configured as a vehicle controller (sometimes also referred to as a body domain controller) of the motor vehicle 1. The vehicle control module and the vehicle-mounted computer may interact with each other via a feasible communication connection. In other words, according to different embodiments, the control device 4 according to the present invention may be configured as a vehicle-mounted computer or as a vehicle controller, or as a combination of a vehicle-mounted computer and a vehicle controller.

[0082] In the current embodiment, the functional system 5 may include: a seat system 501, a window system 502, a sound system 503, an air conditioning system 504, a lighting system 505 and a driver assistance system 506. Here, each subsystem in the functional system 5 may include its own control unit, sensor, actuator and communication connection. Optionally, each subsystem in the functional system 5 may be directly connected to the vehicle computer of the control device 4 via a feasible communication connection. Optionally, each subsystem in the functional system 5 may also be directly connected to the vehicle controller of the control device 4 via a feasible communication connection. Exemplarily, for example, the lighting system 505 may be directly connected to the vehicle computer via an Ethernet bus, receive instructions from the vehicle computer and execute accordingly; while the driver assistance system 506 may be directly connected to the vehicle controller via a FlexRay bus, receive instructions from the vehicle controller and execute accordingly.

[0083] Additionally or alternatively, the system may further include a remote communication unit 6 and a portable smart device 7. The remote communication unit 6 may be, for example, a cloud server. The portable smart device 7 may be, for example, a smart phone or a tablet computer.

[0084] Additionally or alternatively, a third communication connection 10 may be provided between the control device 4 and the remote communication unit 6, via which the control device 4 and the remote communication unit 6 can interact with each other. A fourth communication connection 11 may be provided between the control device 4 and the portable intelligent device 7, via which the control device 4 and the portable intelligent device 7 can interact with each other.

[0085] Here, each communication connection may, for example, involve a wired connection (e.g., an MHL / HDMI data cable, a local area interconnect network (LIN) bus, a controller area network (CAN) bus, a FlexRay bus, or an Ethernet bus). In addition, each communication connection may, for example, also involve a wireless connection, which may be a wireless connection in accordance with the following standards, such as a WLAN or Bluetooth, in particular Bluetooth V2.0, Bluetooth V3.0, or Bluetooth V4.0, in accordance with GSM, CDMA, LTE, NR, IEEE802.11a, IEEE802.11b, IEEE802.11ac, IEEE802.11ad, IEEE802.11g, IEEE802.11h, IEEE802.11n. The above examples are not restrictive and are only used to illustrate the communication connections according to the present invention. In a specific implementation, it can be flexibly adapted according to a specific application scenario.

[0086] Figure 3 A flow chart shows a method according to the present invention for assisting virtual reality in a vehicle, in particular a flow chart shows a method of a control device according to the present invention for assisting virtual reality in a vehicle.

[0087] According to the present invention, the method comprises: acquiring 101 first characteristic data associated with a virtual reality displayed in a virtual reality device; generating 102 first control data for a functional system in a vehicle based on the acquired first characteristic data; and sending 103 the first control data for operating the functional system in the vehicle.

[0088] In the current embodiment, the first feature data may be data stored in a data storage device for virtual reality. These first feature data may be stored in the virtual reality device together with the virtual reality data. Of course, the first feature data may also be stored separately from the virtual reality data in different locations. When the virtual reality is displayed in the virtual reality device, the relevant first feature data may be obtained from the virtual reality device. The first feature data may characterize the current state of the virtual reality displayed in the virtual reality device, for example, it may involve weather conditions, movement, scene, brightness, atmosphere in the virtual reality. Alternatively or additionally, the first feature data may also involve active operations of the user in the virtual reality.

[0089] Here, the weather state may include at least one of the following parameters: temperature, humidity, wind speed, rainfall, snowfall, hail, haze and sandstorm. Movement may include at least one of the following parameters: speed, acceleration and posture. Scene may include at least one of the following parameters: glacier, sea, field, grassland, forest, beach, desert, city, zoo, underwater world, cinema, KTV, conference room and shopping mall. Brightness may include at least one of the following parameters: dark vision range, intermediate vision range and bright vision range. Atmosphere may include at least one of the following parameters: relaxed, intense, serious and quiet. Operation may include at least one of the following operations: viewing a map, determining a navigation path, specifying a point of interest and purchasing a service or commodity.

[0090] Here, the first control data may prompt the seat system to implement at least one of the following actions: moving in the longitudinal direction, rotating in the longitudinal direction, moving in the transverse direction, rotating in the transverse direction, moving in the vertical direction, and rotating in the vertical direction (such as pushing back and vibrating). The first control data may prompt the window system to implement at least one of the following actions: moving in the opening direction and moving in the closing direction. The first control data may prompt the sound system to implement at least one of the following actions: active noise reduction, active noise increase, and playing music. The first control data may prompt the air conditioning system to implement at least one of the following actions: temperature control, humidity control, and ventilation. The first control data may prompt the lighting system to implement at least one of the following actions: dimming, brightening, and providing a lighting atmosphere. The first control data may prompt the automatic navigation system to display or implement a new navigation path.

[0091] Next, the present invention is further described with illustrative examples.

[0092] Example 1: Virtual reality game. A user can experience a racing game based on virtual reality in a motor vehicle with the help of a head display. Here, the user can use a mobile phone as a steering wheel (based on the fourth communication connection 11 between the control device 4 and the mobile phone 7) to control the driving of his own racing car in virtual reality. In the game, as the racing car drives, the scene can be changed in stages, for example, it is in a glacier at the beginning and then enters a tropical forest. Here, the air conditioning system can be controlled based on the change of the scene to more realistically match the displayed virtual reality and achieve an immersive experience. Specifically, when in a glacier scene, the first control data can be sent to prompt the air conditioning system to perform cooling and blow cold air; when in a tropical forest scene, the first control data can be sent to prompt the air conditioning system to perform heating and humidification. In addition. In the game, as the racing car drives, the movement (such as acceleration, deceleration, turning) and / or posture (such as forward tilt, backward tilt, left tilt and right tilt, etc.) of the racing car itself will also change with the user's control and the change of the scene. Here, the seat system and / or window system can be manipulated based on the change of movement and / or posture to more realistically match the displayed virtual reality and achieve an immersive experience. Specifically, when the racing car accelerates, the first control data can be sent to cause the seat system to move forward in the longitudinal direction of the motor vehicle so as to apply a thrust to the back of the user, thereby simulating a push-back feeling. At the same time, the first control data can also cause the window to open further, so that the user can truly experience the wind generated by the racing car. In addition, when the racing car collides, the first control data can also be sent to cause the seat system to vibrate.

[0093] Example 2: Virtual reality conference. Users can experience virtual reality-based conferences in motor vehicles with the help of head-mounted displays. During a meeting, the atmosphere will change as the meeting progresses. When the atmosphere is serious or quiet, the first control data can be sent to prompt the sound system to implement active noise reduction. Specifically, the vehicle's sound system can be used to generate reverse sound waves about external noise to neutralize the noise, thereby achieving a noise reduction effect. In addition, it can also prompt the closing of windows to further suppress external noise. Of course, it can also prompt the air conditioner to be turned off, thereby further reducing the noise generated inside the vehicle.

[0094] Example 3: Virtual reality travel. Users can experience virtual reality-based travel in a motor vehicle with the help of a head display. During the journey, points of interest along the way can be displayed to the user, and these points of interest (such as places of interest, gas stations, and large department stores) can be pre-set by the user. When the user observes in real virtual reality (for example, in a 3D digital map) that there are interesting attractions less than 2 kilometers away from the current location, the user can operate on the points of interest displayed in the virtual reality device, thereby generating first control data to prompt the driver assistance system (such as an automatic navigation system) to implement a new navigation path, so that the vehicle temporarily changes its itinerary and drives to the attraction for a visit. This is particularly advantageous in fully autonomous driving, as the occupants only need to operate in virtual reality without having to take off the head display to change the navigation path, which improves the user experience and enhances the fun.

[0095] Additionally or alternatively, the method may further include: before sending the first control data, checking the first control data, and only when the checking result is positive, allowing the first control data to be sent.

[0096] Here, the inspection may include a safety inspection, in which it is checked whether the manipulation of the functional system by the first control data complies with the driving safety of the vehicle. For example, when the new navigation path implemented by the vehicle needs to pass through a dangerous area or a construction area, it is prohibited to send the first control data, thereby prohibiting the manipulation of the driver assistance system to implement the new navigation path. Here, a voice prompt may be given to the relevant user to drive to the destination by himself, or to prompt the relevant user to change the current path.

[0097] Here, the check may include a conflict check, in which it is checked whether the manipulation of the functional system by the first control data conflicts with the current operating state of the vehicle and / or the traffic rules and / or the user's preset state in the area where the vehicle is currently located. For example, when the vehicle currently has insufficient energy (insufficient fuel or insufficient power), it is prohibited to send the following first control data, which will cause the vehicle to increase energy consumption (such as heating or cooling the air conditioner), or the first control data will cause the vehicle to travel a longer distance.

[0098] Additionally or alternatively, the method may further include: acquiring second characteristic data associated with the position and / or operating status of the vehicle;

[0099] - generating second control data user of the virtual reality displayed in the virtual reality device based on the acquired second feature data; and

[0100] - Sending second control data for controlling the virtual reality displayed in the virtual reality device.

[0101] Additionally or alternatively, the method may further include: acquiring third feature data associated with the movement and / or expression of the virtual reality user in the vehicle;

[0102] - generating third control data for virtual reality displayed in the virtual reality device based on the acquired third feature data; and

[0103] - Sending third control data for controlling the virtual reality displayed in the virtual reality device.

[0104] In this embodiment, a head display posture sensor may also be provided in the head display, for example, one or more of an acceleration sensor and a gyroscope, for detecting the posture of the head display, for example, turning the head, lowering the head, raising the head, etc.

[0105] In this embodiment, a vehicle position sensor and a vehicle attitude sensor may also be provided in the motor vehicle 1. The vehicle position sensor collects the position data of the motor vehicle 1, and the vehicle attitude sensor collects the attitude data of the motor vehicle 1; wherein the vehicle attitude data includes: pitch angle, yaw angle and tilt angle, etc.

[0106] In this embodiment, the control device 4 can receive various characteristic data from various sensors and generate corresponding control data accordingly, so as to control the perspective and / or movement in the virtual reality image to match the perspective and / or movement of the user in the motor vehicle 1. In this way, on the one hand, the user can have a feeling of being directly connected with the movement he is in; on the other hand, the visual image received by the user when watching the virtual reality is coordinated with the actual movement felt, so that motion sickness does not occur.

[0107] The present invention is not limited to the embodiments shown, but includes or extends to all technical equivalents that can fall within the effective scope of the attached claims. The selected position descriptions in the specification, such as, for example, upper, lower, etc., refer to the direct description and the drawings shown and can be transferred to the new position according to the meaning when the position changes.

Claims

1. A method for assisting virtual reality in a vehicle (1), characterized in that The method comprises: - obtaining (101) first feature data stored and associated with the virtual reality displayed in the virtual reality device (3), the first feature data comprising data characterizing at least one of the following features of the virtual reality displayed in the virtual reality device: weather conditions in the virtual reality, movement of objects in the virtual reality, scenes in the virtual reality, brightness and darkness in the virtual reality, and atmosphere in the virtual reality; - generating (102) first control data for a functional system (5) in the vehicle (1) based on the acquired first characteristic data; and - sending (103) first control data for controlling a functional system (5) in the vehicle (1) so as to more realistically match the displayed virtual reality, The first control data can be used to control at least one of the following functional systems (5) in the vehicle (1): a window system (502), a sound system (503), an air conditioning system (504), and a lighting system (505). The step of "generating first control data for a functional system in a vehicle based on the acquired first characteristic data" includes: Generate first control data according to the weather conditions and / or scenes in the virtual reality displayed in the virtual reality device (3) to cause the window system (502) to perform at least one of the following actions: movement in an opening direction and movement in a closing direction; and / or First control data is generated based on a scene and / or atmosphere in a virtual reality displayed in a virtual reality device (3) to cause a sound system (503) and / or a window system (502) and / or an air conditioning system (504) to implement at least one of the following actions: active noise reduction and active noise increase, wherein when the atmosphere is serious or quiet or when the scene is a conference room, the first control data causes the sound system (503) and / or the window system (502) and / or the air conditioning system (504) to implement active noise reduction; and / or First control data is generated according to the brightness and darkness level and / or scene and / or atmosphere in the virtual reality displayed in the virtual reality device (3), so as to cause the lighting system (505) to perform at least one of the following actions: dimming, brightening and providing a lighting atmosphere, The method further includes: before sending the first control data, checking the first control data, and only when the checking result is positive, allowing the first control data to be sent, The inspection includes: A safety check, in which it is checked whether the manipulation of the functional system by the first control data complies with driving safety of the vehicle; and A conflict check is performed to check whether the manipulation of the functional system by the first control data conflicts with the current operating state of the vehicle, traffic regulations of the area where the vehicle is currently located, and / or a user-preset state.

2. The method according to claim 1, characterized in that The first control data can be used to actuate at least one of the following functional systems (5) in a vehicle (1): a seat system (501) and a driver assistance system (506).

3. The method according to claim 2, characterized in that The step of "generating first control data for a functional system in a vehicle based on the acquired first characteristic data" includes: First control data is generated according to the movement of an object in virtual reality displayed in the virtual reality device (3) to cause the seat system (501) to perform at least one of the following actions: longitudinal movement, longitudinal rotation, transverse movement, transverse rotation, vertical movement, vertical rotation; and / or First control data is generated according to the weather conditions and / or scenes and / or atmosphere in the virtual reality displayed in the virtual reality device (3), so as to prompt the air conditioning system (504) to perform at least one of the following actions: temperature control, humidity control and ventilation.

4. The method according to any one of claims 1 to 3, characterized in that The first characteristic data includes data characterizing the user's operation in the virtual reality displayed in the virtual reality device (3).

5. The method according to claim 4, characterized in that First control data is generated according to a user's operation in a virtual reality displayed in a virtual reality device, for causing a driver assistance system (506) to display or implement a new navigation route.

6. The method according to any one of claims 1 to 3, characterized in that The method further comprises: - acquiring second characteristic data associated with the position and / or operating status of the vehicle; - generating second control data for virtual reality displayed in the virtual reality device based on the acquired second feature data; and - sending second control data for controlling the virtual reality displayed in the virtual reality device, and / or the method further comprises: - acquiring third feature data associated with the movement and / or expression of the virtual reality user in the vehicle; - generating third control data for virtual reality displayed in the virtual reality device based on the acquired third feature data; and - Sending third control data for controlling the virtual reality displayed in the virtual reality device.

7. A control device (4) for realizing virtual reality in a vehicle, characterized in that: The control device (4) is capable of interacting with the virtual reality device (3) via a first communication connection (8), and the control device (4) is capable of interacting with the functional system (5) via a second communication connection (9), The control device (4) is configured to: Retrieving first characteristic data stored and associated with the virtual reality displayed in the virtual reality device (3) from a data storage device for virtual reality, wherein the first characteristic data includes data characterizing at least one of the following characteristics of the virtual reality displayed in the virtual reality device: weather conditions in the virtual reality, movement of objects in the virtual reality, scenes in the virtual reality, brightness and darkness in the virtual reality, and atmosphere in the virtual reality; generating first control data for a functional system (5) in a vehicle (1) based on the acquired first characteristic data; sending the first control data for controlling a functional system (5) in the vehicle (1) in association with the virtual reality displayed in the virtual reality device (3) so as to more realistically match the displayed virtual reality, The first control data can be used to control at least one of the following functional systems (5) in the vehicle (1): a window system (502), a sound system (503), an air conditioning system (504), and a lighting system (505). Wherein, the control device is configured to: Generate first control data according to the weather conditions and / or scenes in the virtual reality displayed in the virtual reality device, so as to cause the window system to perform at least one of the following actions: movement in an opening direction and movement in a closing direction; and / or Generate first control data based on a scene and / or atmosphere in a virtual reality displayed in a virtual reality device, so as to cause a sound system and / or a window system and / or an air conditioning system to perform at least one of the following actions: active noise reduction and active noise increase, wherein the control device is configured to: generate first control data for causing the sound system and / or the window system and / or the air conditioning system to perform active noise reduction when the atmosphere is serious or quiet or when the scene is a conference room; and / or Generate first control data according to the brightness and / or darkness level and / or scene and / or atmosphere in the virtual reality displayed in the virtual reality device, so as to cause the lighting system to perform at least one of the following actions: dimming, brightening and providing a lighting atmosphere, The control device is configured to: check the first control data before sending the first control data, and only allow the first control data to be sent if the check result is positive, wherein the check includes: A safety check, in which it is checked whether the manipulation of the functional system by the first control data complies with driving safety of the vehicle; and A conflict check is performed to check whether the manipulation of the functional system by the first control data conflicts with the current operating state of the vehicle, traffic regulations of the area where the vehicle is currently located, and / or a user-preset state.

8. The control device according to claim 7, characterized in that: The first control data can be used to control at least one of the following functional systems in a vehicle: a seat system (501) and a driver assistance system (506).

9. The control device according to claim 8, characterized in that: The control device is configured to: Generate first control data according to the movement of an object in virtual reality displayed in the virtual reality device, so as to cause the seat system to perform at least one of the following actions: move longitudinally, rotate longitudinally, move transversely, rotate transversely, move vertically, and rotate vertically; and / or The first control data is generated according to the weather conditions and / or scenes and / or atmospheres in the virtual reality displayed in the virtual reality device, so as to prompt the air conditioning system to perform at least one of the following actions: temperature control, humidity control and ventilation.

10. The control device according to any one of claims 7 to 9, characterized in that: The first characteristic data includes data characterizing an operation of a user in a virtual reality displayed in a virtual reality device.

11. The control device according to claim 10, characterized in that: The control device is designed to generate first control data as a function of an operation of a user in a virtual reality displayed in a virtual reality device, for causing a driver assistance system to display or execute a new navigation route.

12. The control device according to any one of claims 7 to 9, characterized in that: The control device is configured to: - acquiring second characteristic data associated with the position and / or operating status of the vehicle; - generating second control data for virtual reality displayed in the virtual reality device based on the acquired second feature data; and - sending second control data for controlling the virtual reality displayed in the virtual reality device, and / or the control device is configured to: - acquiring third feature data associated with the movement and / or expression of the virtual reality user in the vehicle; - generating third control data for virtual reality displayed in the virtual reality device based on the acquired third feature data; and - Sending third control data for controlling the virtual reality displayed in the virtual reality device.

13. A data processing device, comprising: one or more processors; as well as one or more memories configured to store a series of computer-executable instructions and computer-accessible data associated with the series of computer-executable instructions, It is characterized in that when the series of computer-executable instructions are executed by the one or more processors, the one or more processors are caused to perform the method according to one of claims 1 to 6.

14. A means of transport, characterized in that: The vehicle comprises a control device according to one of claims 7 to 12 or comprises a data processing device according to claim 13 .

Images