System, method and computer storage medium for realizing vehicle-mounted virtual reality

By designing inspection, service and control modules in the vehicle and combining the functions of the interface module, an on-board virtual reality system is realized, solving the problem that the existing technology cannot meet the entertainment needs of vehicles, providing an immersive entertainment experience and improving the driving experience Effect.

CN115242827BActive Publication Date: 2024-11-01NIO TECH ANHUI CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210629770.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-06
Publication Date
2024-11-01
Estimated Expiration
2042-06-06

AI Technical Summary

Technical Problem

Existing local audio and video playback devices cannot meet the entertainment needs of users of autonomous driving and advanced assisted driving vehicles, especially in the application of virtual reality and augmented reality technologies.

Method used

A system for realizing in-vehicle virtual reality is designed, including detection module, service module and control module. It accesses and provides in-vehicle services through detection equipment, and uses interface modules to search, control and upgrade, and operates based on observer mode. Supports video data projection, live broadcast, synchronous playback and remote viewing, and provides functions such as automatic IP address allocation, streaming media transmission, link management and Bluetooth control.

Benefits of technology

Realize the application of virtual reality and augmented reality technology in vehicles at zero cost, provide immersive entertainment experience, support multi-user synchronous viewing, real-time live broadcast of the vehicle's surrounding environment, two-way screen projection of video data and remote control of in-car equipment, improving driving and riding Experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115242827B_ABST
    Figure CN115242827B_ABST
Patent Text Reader

Abstract

The present invention relates to a system for implementing in-vehicle virtual reality, a method for implementing in-vehicle virtual reality, and a computer storage medium. The system for implementing in-vehicle virtual reality according to one aspect of the present invention comprises: a detection module configured to detect the access of an augmented reality device or a virtual reality device and generate an activation signal in response to detecting the access of the augmented reality device or the virtual reality device; a service module configured to provide in-vehicle services for the augmented reality device or the virtual reality device; and a control module configured to operate in response to receiving the activation signal from the detection module to control the in-vehicle services provided by the service module for the augmented reality device or the virtual reality device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicles, and more particularly to a system for implementing in-vehicle virtual reality, a method for implementing in-vehicle virtual reality, and a computer storage medium. Background Art

[0002] At present, in the in-vehicle entertainment system, local audio and video playback devices are usually used to provide viewing services for vehicle users. However, with the continuous development of autonomous driving and advanced driver assistance, a single local audio and video playback device is increasingly unable to meet the entertainment needs of vehicle users.

[0003] In recent years, virtual reality and / or augmented reality technologies have been used to improve user experience in various fields such as games, healthcare, retail, education, social media, etc. Virtual reality technology is a computer simulation technology that can create a virtual reality environment, which can use a computer to generate a virtual reality environment. The basic implementation method of virtual reality technology is that a computer obtains data (such as images, sounds, videos, etc.) used to create a virtual reality environment and converts it into electronic signals, and a virtual reality display device receives the electronic signals and constructs a virtual reality environment based on the electronic signals. Virtual reality and / or augmented reality technology usually uses a virtual reality display device to display images or videos to a user. The displayed images or videos may include a completely digital view (virtual reality) or may include information overlaid on the user's field of view (augmented reality), thereby enhancing the authenticity and fun of the displayed images or videos.

[0004] Therefore, it is expected that virtual reality and / or augmented reality technology can also be applied to vehicles to meet the entertainment needs of vehicle users. Summary of the invention

[0005] In order to solve or at least alleviate one or more of the above problems, the following technical solutions are provided.

[0006] According to a first aspect of the present invention, a system for implementing in-vehicle virtual reality is provided, the system for implementing in-vehicle virtual reality comprising: a detection module configured to detect access to an augmented reality device or a virtual reality device and generate an enabling signal in response to detecting access to the augmented reality device or the virtual reality device; a service module configured to provide in-vehicle services for the augmented reality device or the virtual reality device; and a control module configured to operate in response to receiving the enabling signal from the detection module to control the in-vehicle services provided by the service module for the augmented reality device or the virtual reality device.

[0007] According to the system for realizing in-vehicle virtual reality according to one embodiment of the present invention or any of the above embodiments, the system for realizing in-vehicle virtual reality also includes an interface module, and the interface module is configured to: provide search and scan access for the augmented reality device or the virtual reality device; provide call for the augmented reality device or the virtual reality device to control the in-vehicle device; and provide call for the vehicle to control the brightness and upgrade of the augmented reality device or the virtual reality device.

[0008] In the system for implementing in-vehicle virtual reality according to one embodiment or any one of the above embodiments of the present invention, the service module and the control module operate based on an observer mode, and the service module is further configured to: observe the state change of the control module; and execute the in-vehicle service associated with the indication of the state change of the control module in response to receiving the indication of the state change from the control module.

[0009] According to the system for realizing in-vehicle virtual reality of one embodiment or any one of the above embodiments of the present invention, the service module further includes: a vehicle control unit, which is configured to synchronize the control information of the user on the in-vehicle device to the augmented reality device or virtual reality device, so as to control the in-vehicle device via the augmented reality device or virtual reality device; a projection unit, which is configured to project the video data played by the vehicle computer to the augmented reality device or virtual reality device for playback, and to project the video data played by the augmented reality device or virtual reality device to the vehicle computer for playback; a viewing unit, which is configured to be remotely called by the augmented reality device or virtual reality device, so that the augmented reality device or virtual reality device remotely views the video data of the vehicle-mounted terminal; a live broadcast unit, which is configured to upload the video data of the vehicle surrounding environment captured by the vehicle's camera device to the cloud in real time, so that the augmented reality device or virtual reality device can obtain the video data from the cloud for playback; a synchronous playback unit, which is configured to keep the video data of the vehicle-mounted terminal or the video data obtained from the cloud synchronized between multiple augmented reality devices or virtual reality devices; and an upgrade unit, which is configured to perform an upgrade operation on the augmented reality device or virtual reality device.

[0010] According to the system for realizing in-vehicle virtual reality according to one embodiment of the present invention or any one of the above embodiments, the system for realizing in-vehicle virtual reality also includes a service support module, and the service support module is configured to provide one or more of the following support functions for the augmented reality device or the virtual reality device: automatic allocation of IP address, registration and discovery of the in-vehicle service, streaming media transmission, link management and Bluetooth control.

[0011] According to the system for realizing in-vehicle virtual reality according to one embodiment of the present invention or any one of the above embodiments, the service support module further includes: an IP address allocation unit, which is configured to create a local area network for the vehicle computer to allocate the IP address of the augmented reality device or the virtual reality device to the local area network created for the vehicle computer; a service registration and discovery unit, which is configured to register the in-vehicle service to the server of the augmented reality device or the virtual reality device, so that the augmented reality device or the virtual reality device can discover and access the in-vehicle service; a streaming media transmission unit, which is configured to transmit the video data created by the in-vehicle service; a link management unit, which is configured to perform access authentication and certification operations on the augmented reality device or the virtual reality device; and a Bluetooth control unit, which is configured for the augmented reality device or the virtual reality device to connect to the vehicle computer via Bluetooth to control the operation of the projection unit.

[0012] According to a second aspect of the present invention, a method for implementing in-vehicle virtual reality is provided, the method for implementing in-vehicle virtual reality comprising: detecting access to an augmented reality device or a virtual reality device via a detection module and generating an activation signal in response to detecting access to the augmented reality device or the virtual reality device; providing in-vehicle services for the augmented reality device or the virtual reality device via a service module; and operating via a control module in response to receiving the activation signal from the detection module to control the in-vehicle services provided by the service module for the augmented reality device or the virtual reality device.

[0013] According to the method for realizing in-vehicle virtual reality according to one embodiment of the present invention or any of the above embodiments, the method for realizing in-vehicle virtual reality also includes configuring an interface module to: provide the augmented reality device or the virtual reality device with search and scan access; provide the augmented reality device or the virtual reality device with a call to control the in-vehicle device; and provide the vehicle with a call to control the brightness and upgrade of the augmented reality device or the virtual reality device.

[0014] According to the method for implementing in-vehicle virtual reality according to one embodiment of the present invention or any one of the above embodiments, the method for implementing in-vehicle virtual reality further includes operating the service module and the control module based on an observer mode, so that the service module: observes the state change of the control module; and executes the in-vehicle service associated with the indication of the state change of the control module in response to receiving the indication of the state change from the control module.

[0015] According to the method for realizing in-vehicle virtual reality in one embodiment or any one of the above embodiments of the present invention, the following operations are further performed via the service module: synchronizing the control information of the user on the in-vehicle device to the augmented reality device or the virtual reality device, so as to control the in-vehicle device via the augmented reality device or the virtual reality device; projecting the video data played by the vehicle computer to the augmented reality device or the virtual reality device for playback, and projecting the video data played by the augmented reality device or the virtual reality device to the vehicle computer for playback; remotely viewing the video data of the vehicle-mounted terminal through the augmented reality device or the virtual reality device; uploading the video data of the vehicle's surrounding environment captured by the vehicle's camera device to the cloud in real time, so that the augmented reality device or the virtual reality device can obtain the video data from the cloud for playback; keeping the video data of the vehicle-mounted terminal or the video data obtained from the cloud synchronized for playback between multiple augmented reality devices or virtual reality devices; and performing an upgrade operation on the augmented reality device or the virtual reality device.

[0016] According to the method for realizing in-vehicle virtual reality according to one embodiment of the present invention or any of the above embodiments, the method for realizing in-vehicle virtual reality also includes providing one or more of the following supporting functions for the augmented reality device or the virtual reality device via a service support module: automatic allocation of IP addresses, registration and discovery of the in-vehicle service, streaming media transmission, link management and Bluetooth control.

[0017] According to the method for realizing in-vehicle virtual reality according to one embodiment of the present invention or any one of the above embodiments, the supporting functions include: creating a local area network for the vehicle computer to assign the IP address of the augmented reality device or virtual reality device to the local area network created for the vehicle computer; registering the in-vehicle service to the server of the augmented reality device or virtual reality device, so that the augmented reality device or virtual reality device can discover and access the in-vehicle service; transmitting the video data created by the in-vehicle service; performing access authentication and certification operations on the augmented reality device or virtual reality device; and providing a Bluetooth connection to the vehicle computer for the augmented reality device or virtual reality device so that the augmented reality device or virtual reality device controls the screen projection operation performed by the service module via the Bluetooth connection.

[0018] According to a third aspect of the present invention, a computer storage medium is provided, the computer storage medium comprising instructions, which, when run, execute the method for implementing in-vehicle virtual reality according to the second aspect of the present invention.

[0019] According to one or more embodiments of the present invention, the solution for realizing in-vehicle virtual reality can apply virtual reality and / or augmented reality technology to vehicles at zero cost with the help of a software development kit, thereby realizing the access of augmented reality devices or virtual reality devices and the use of in-vehicle services in the vehicle, thereby providing an immersive entertainment experience for vehicle users. In addition, according to one or more embodiments of the present invention, the solution for realizing in-vehicle virtual reality can realize the synchronous viewing of multiple vehicle users, the real-time live broadcast of the vehicle's surrounding environment, the two-way projection of video data between the augmented reality device or virtual reality device and the vehicle computer, the remote viewing of video data on the vehicle side, and the remote control of the in-vehicle equipment through the augmented reality device or virtual reality device, thereby further improving the driving experience of vehicle users. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and / or other aspects and advantages of the present invention will become clearer and easier to understand through the following description of various aspects in conjunction with the accompanying drawings, in which the same or similar units are represented by the same reference numerals. In the accompanying drawings:

[0021] Figure 1 A schematic diagram of a system for implementing in-vehicle virtual reality according to one or more embodiments of the present invention is shown.

[0022] Figure 2 A schematic diagram of a system for implementing in-vehicle virtual reality according to one or more embodiments of the present invention is shown.

[0023] Figure 3 A flow chart of a method for implementing in-vehicle virtual reality according to one or more embodiments of the present invention is shown. DETAILED DESCRIPTION

[0024] The description of the following specific embodiments is merely exemplary in nature and is not intended to limit the disclosed technology or the application and use of the disclosed technology. In addition, it is not intended to be bound by any express or implied theory presented in the aforementioned technical field, background technology or the following specific embodiments.

[0025] In the following detailed description of the embodiments, many specific details are set forth in order to provide a more thorough understanding of the disclosed technology. However, it is apparent to one of ordinary skill in the art that the disclosed technology can be practiced without these specific details. In other instances, well-known features are not described in detail to avoid unnecessarily complicating the description.

[0026] Terms such as "comprising" and "including" indicate that in addition to the units and steps directly and clearly stated in the specification, the technical solution of the present invention does not exclude the situation of having other units and steps that are not directly or clearly stated. Terms such as "first" and "second" do not indicate the order of units in terms of time, space, size, etc., but are only used to distinguish between units.

[0027] Hereinafter, exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

[0028] Figure 1 A schematic diagram of a system for implementing in-vehicle virtual reality according to one or more embodiments of the present invention is shown.

[0029] like Figure 1 As shown in , the system 10 for implementing in-vehicle virtual reality includes a detection module 110, a control module 120, and a service module 130. The detection module 110 can be configured to detect the access of an augmented reality device or a virtual reality device and generate an enable signal in response to detecting the access of the augmented reality device or the virtual reality device, and send the enable signal to the control module 120. The service module 130 can be configured to provide in-vehicle services for the augmented reality device or the virtual reality device. The control module 120 can be configured to operate in response to receiving the enable signal from the detection module 110 to control the in-vehicle services provided by the service module 130 for the augmented reality device or the virtual reality device.

[0030] Optionally, the service module 130 and the control module 120 can operate based on the observer pattern. It should be noted that the observer pattern is a pattern that defines a one-to-many relationship between objects, which can reduce the coupling between objects. The observer pattern includes the observed and the observer. In the observer pattern, the observed manages each observer that depends on it, and actively issues a notification when its own state changes. It usually manages each observer by calling the method provided by each observer, and each observer actively updates itself according to the notification issued by the observed. In the system 10 for implementing in-vehicle virtual reality, the service module 130 operates as an observer and the control module 120 operates as an observed. The service module 130 can be further configured to observe the state change of the control module 120, and execute the in-vehicle service associated with the indication of the state change of the control module 120 in response to receiving an indication of the state change from the control module 120.

[0031] In one example, when the service module 130 receives an indication of a state change from the control module 120 notifying that its state change is to project the video data played by the vehicle computer to an augmented reality device or a virtual reality device for playback, the service module 130 may enable processing associated with the projection operation (e.g., encoding, decoding, transmission, etc.) to support the operation of projecting the video data played by the vehicle computer to the augmented reality device or the virtual reality device for playback. In another example, when the service module 130 receives an indication of a state change from the control module 120 notifying that its state change is to perform an upgrade operation on the augmented reality device, the service module 130 may enable processing associated with the upgrade operation (e.g., networking, downloading, etc.) to support the upgrade operation on the augmented reality device. In yet another example, when the service module 130 receives an indication of a state change from the control module 120 notifying that its state change is to broadcast a video of the vehicle's surroundings through an augmented reality device or a virtual reality device, the service module 130 may enable processing associated with the live broadcast operation (e.g., collecting video data, splicing video data, uploading video data to the cloud, etc.) to support the operation of broadcasting a video of the vehicle's surroundings through an augmented reality device or a virtual reality device.

[0032] Optionally, the in-vehicle services provided by the service module 130 for the augmented reality device or the virtual reality device may include but are not limited to: synchronizing the user's control information of the in-vehicle device to the augmented reality device or the virtual reality device, so as to control the in-vehicle device via the augmented reality device or the virtual reality device; projecting the video data played by the vehicle computer to the augmented reality device or the virtual reality device for playback, and allowing the augmented reality device or the virtual reality device to project the video data it plays to the vehicle computer for playback; allowing the augmented reality device or the virtual reality device to remotely view the video data of the vehicle-mounted terminal; uploading the video data of the vehicle's surrounding environment captured by the vehicle's camera device to the cloud in real time, so that the augmented reality device or the virtual reality device can obtain the video data from the cloud for playback; keeping the video data of the vehicle-mounted terminal or the video data obtained from the cloud synchronized for playback between multiple augmented reality devices or virtual reality devices; and performing upgrade operations on the augmented reality device or the virtual reality device.

[0033] For example, the in-vehicle equipment may include but is not limited to an audio system, a camera, a display screen, an air conditioning system, a lighting system, a fragrance system, a seat system, etc. For example, controlling the in-vehicle equipment via an augmented reality device or a virtual reality device may include but is not limited to air conditioning adjustment, volume adjustment, seat adjustment, lighting adjustment, etc.

[0034] In one embodiment, the service module 130 can be configured to receive video data depicting the vehicle's surroundings from the vehicle's camera device and stitch the video data to generate a 360-degree view of the vehicle's surroundings. For example, the service module 130 can be configured to stitch the video data based on the position of each vehicle's camera device relative to the vehicle and the pixel imaging technology according to the feature matching and random sampling consistency (RANSAC) method, and transmit the stitched video data to the cloud in real time. For example, the vehicle's camera device can be set at different positions on the outside of the vehicle's body and / or the inside of the vehicle and directionally sense different parts of the surrounding environment near the vehicle to collect video data of the vehicle's surroundings. By uploading the video data depicting the vehicle's surroundings collected by the vehicle's camera device to the cloud in real time for an augmented reality device or a virtual reality device to obtain video data from the cloud for playback, the image of the surrounding environment during the vehicle's driving process can be presented to the vehicle user through the augmented reality device or the virtual reality device, thereby bringing an immersive experience to the vehicle user during the driving process.

[0035] Optionally, the system 10 for implementing in-vehicle virtual reality may further include an interface module ( Figure 1 (not shown in the figure), the interface module can be configured to: provide search and scan access for augmented reality devices or virtual reality devices; provide call for augmented reality devices or virtual reality devices to control in-vehicle devices; and provide call for the vehicle to control the brightness and upgrade of augmented reality devices or virtual reality devices.

[0036] Optionally, the system 10 for implementing in-vehicle virtual reality may further include a service support module ( Figure 1 (not shown in the figure), the service support module can be configured to provide one or more of the following support functions for the augmented reality device or the virtual reality device: automatic allocation of IP addresses, registration and discovery of in-vehicle services, streaming media transmission, link management and Bluetooth control.

[0037] Figure 2 A schematic diagram of a system for implementing in-vehicle virtual reality according to one or more embodiments of the present invention is shown.

[0038] like Figure 2 As shown in , the system 20 for implementing in-vehicle virtual reality includes an interface module 200 , a detection module 210 , a control module 220 , a service module 230 and a service support module 240 . Figure 2 The various modules or units included in the system 20 for realizing in-vehicle virtual reality shown in the figure can be realized with the help of a software development kit, thereby enabling the access of augmented reality devices or virtual reality devices and the use of in-vehicle services in the vehicle, while reducing the development cost of the augmented reality devices or virtual reality devices accessing the vehicle.

[0039] The interface module 200 can be configured to allow the augmented reality device or virtual reality device to search and scan for access, to allow the augmented reality device or virtual reality device to call to control the in-vehicle device, and to allow the vehicle to call to control the brightness and upgrade of the augmented reality device or virtual reality device.

[0040] The detection module 210 may be configured to detect access to an augmented reality device or a virtual reality device and generate an enable signal in response to detecting access to the augmented reality device or the virtual reality device, and send the enable signal to the control module 220 .

[0041] The service module 230 may be configured to provide in-vehicle services for augmented reality devices or virtual reality devices.

[0042] The control module 220 may be configured to operate in response to receiving an enable signal from the detection module 210 to control the in-vehicle service provided by the service module 230 for the augmented reality device or the virtual reality device.

[0043] Optionally, the service module 230 and the control module 220 can operate based on the observer mode. In the system 20 for implementing in-vehicle virtual reality, the service module 230 operates as an observer and the control module 220 operates as an observed. The service module 230 can be further configured to observe the state change of the control module 220, and in response to receiving an indication of the state change from the control module 220, execute an in-vehicle service associated with the indication of the state change of the control module 220.

[0044] The service support module 240 can be configured to provide one or more of the following support functions for the augmented reality device or the virtual reality device: automatic allocation of IP addresses, registration and discovery of the in-vehicle services, streaming media transmission, link management, and Bluetooth control.

[0045] like Figure 2As shown in , the service module 230 may include a vehicle control unit 2301, a screen projection unit 2302, a viewing unit 2303, a live broadcast unit 2304, a synchronous playback unit 2305 and an upgrade unit 2306. Optionally, the vehicle control unit 2301 can be configured to synchronize the user's control information of the in-vehicle device to the augmented reality device or the virtual reality device, so as to control the in-vehicle device via the augmented reality device or the virtual reality device; the projection unit 2302 can be configured to project the video data played by the vehicle computer to the augmented reality device or the virtual reality device for playback, and to project the video data played by the augmented reality device or the virtual reality device to the vehicle computer for playback; the viewing unit 2303 can be configured to be remotely called by the augmented reality device or the virtual reality device, so that the augmented reality device or the virtual reality device remotely views the video data of the vehicle-mounted terminal; the live broadcast unit 2304 can be configured to upload the video data of the vehicle's surrounding environment captured by the vehicle's camera device to the cloud in real time, so that the augmented reality device or the virtual reality device can obtain the video data from the cloud for playback; the synchronous playback unit 2305 can be configured to keep the video data of the vehicle-mounted terminal or the video data obtained from the cloud synchronized between multiple augmented reality devices or virtual reality devices; and the upgrade unit 2306 can be configured to perform an upgrade operation on the augmented reality device or the virtual reality device.

[0046] like Figure 2 As shown in , the control module 220 may include a virtual reality device control unit 2201 and an augmented reality device control unit 2202. The virtual reality device control unit 2201 may be configured to control various in-vehicle services provided by the service module 230 for the virtual reality device, and the augmented reality device control unit 2202 may be configured to control various in-vehicle services provided by the service module 230 for the augmented reality device. In one embodiment, the virtual reality device control unit 2201 may be configured to control various in-vehicle services provided by the vehicle control unit 2301, the screen projection unit 2302, the viewing unit 2303, the live broadcast unit 2304, and the synchronous playback unit 2305 in the service module 230 for the virtual reality device, and the augmented reality device control unit 2202 may be configured to control various in-vehicle services provided by the screen projection unit 2302, the synchronous playback unit 2305, and the upgrade unit 2306 in the service module 230 for the augmented reality device.

[0047] like Figure 2As shown in , the service support module 240 may include an IP address allocation unit 2401, a service registration and discovery unit 2402, a streaming transmission unit 2403, a link management unit 2404, and a Bluetooth control unit 2405. Optionally, the IP address allocation unit 2401 may be configured to create a local area network for the vehicle machine to allocate the IP address of the augmented reality device or virtual reality device to the local area network created for the vehicle machine; the service registration and discovery unit 2402 may be configured to register the vehicle service to the server of the augmented reality device or virtual reality device, so that the augmented reality device or virtual reality device can discover and access the vehicle service; the streaming transmission unit 2403 may be configured to transmit the video data created by the vehicle service (for example, the video data transmitted by the projection unit 2302, the live broadcast unit 2304, and the synchronous playback unit 2305); the link management unit 2404 may be configured to perform access authentication and certification operations on the augmented reality device or virtual reality device; and the Bluetooth control unit 2405 may be configured to allow the augmented reality device or virtual reality device to connect to the vehicle machine via Bluetooth to control the operation of the projection unit 2302.

[0048] Optionally, the service support module 240 may also include a service registration and discovery unit ( Figure 2 ), which can implement service registration and discovery of DLNA devices based on the DLNA protocol.

[0049] Exemplarily, the IP address allocation unit 2401 can negotiate the allocation of IP addresses between the vehicle computer and the augmented reality device or virtual reality device based on a private protocol, so that the vehicle computer and the augmented reality device or virtual reality device can communicate in the same network segment within the created local area network. Exemplarily, the service registration and discovery unit 2402 can be implemented based on a standard service registration and discovery protocol to register the vehicle service to the server of the augmented reality device or virtual reality device, so that the augmented reality device or virtual reality device can discover and access the vehicle service.

[0050] It should be noted that Figure 2 The block diagram of the system for implementing vehicle-mounted virtual reality according to one or more embodiments of the present invention is merely illustrative and will not depart from the spirit and scope of the present invention. Figure 2 The various units shown in the figure may be integrated into one unit, or separated into other sub-units. Alternatively, different Figure 2 Other components of the various units shown in the figure implement the system for implementing in-vehicle virtual reality according to one or more embodiments of the present invention.

[0051] According to one aspect of the present invention, a system for realizing in-vehicle virtual reality can apply virtual reality and / or augmented reality technology to vehicles at zero cost with the help of a software development kit, thereby realizing the access of augmented reality devices or virtual reality devices and the use of in-vehicle services in the vehicle, thereby providing an immersive entertainment experience for vehicle users. In addition, according to one or more embodiments of the present invention, a solution for realizing in-vehicle virtual reality can realize the synchronous viewing of multiple vehicle users, the real-time live broadcast of the vehicle's surrounding environment, the two-way projection of video data between the augmented reality device or virtual reality device and the vehicle computer, the remote viewing of video data on the vehicle side, and the remote control of the in-vehicle equipment through the augmented reality device or virtual reality device, thereby further improving the driving experience of vehicle users.

[0052] Figure 3 A flow chart of a method for implementing in-vehicle virtual reality according to one or more embodiments of the present invention is shown.

[0053] like Figure 3 As shown in , the method for implementing in-vehicle virtual reality according to one or more embodiments of the present invention includes the following steps:

[0054] Step S310: Detecting access of an augmented reality device or a virtual reality device via a detection module and generating an activation signal in response to detecting access of the augmented reality device or the virtual reality device;

[0055] Step S320: Providing in-vehicle services for the augmented reality device or the virtual reality device via the service module; and

[0056] Step S330: In response to receiving the activation signal from the detection module, the control module operates to control the in-vehicle service provided by the service module for the augmented reality device or the virtual reality device.

[0057] Figure 3 The various steps of the method for implementing in-vehicle virtual reality shown in the figure can be implemented with reference to the system 10 for implementing in-vehicle virtual reality and the system 20 for implementing in-vehicle virtual reality described above, and the relevant contents are incorporated herein.

[0058] According to one aspect of the present invention, the method for realizing in-vehicle virtual reality proposed can apply virtual reality and / or augmented reality technology to vehicles at zero cost with the help of a software development kit, thereby realizing the access of augmented reality devices or virtual reality devices and the use of in-vehicle services in the vehicle, thereby providing an immersive entertainment experience for vehicle users. In addition, according to one or more embodiments of the present invention, the solution for realizing in-vehicle virtual reality can realize the synchronous viewing of multiple vehicle users, the real-time live broadcast of the vehicle's surrounding environment, the two-way projection of video data between the augmented reality device or virtual reality device and the vehicle computer, the remote viewing of video data on the vehicle side, and the remote control of the in-vehicle equipment through the augmented reality device or virtual reality device, thereby further improving the driving experience of vehicle users.

[0059] In addition, as described above, the present invention may also be implemented as a computer storage medium, in which a message is stored for causing a computer to execute the method for realizing in-vehicle virtual reality according to one aspect of the present invention.

[0060] Here, as computer storage media, various types of computer storage media can be used, such as disks (for example, magnetic disks, optical disks, etc.), cards (for example, memory cards, optical cards, etc.), semiconductor memories (for example, read-only memories, non-volatile memories, etc.), and tapes (for example, magnetic tapes, cassette tapes, etc.).

[0061] Where applicable, hardware, software or a combination of hardware and software may be used to implement the various embodiments provided by the present disclosure. Moreover, where applicable, without departing from the scope of the present disclosure, the various hardware components and / or software components set forth herein may be combined into composite components comprising software, hardware and / or both. Where applicable, without departing from the scope of the present disclosure, the various hardware components and / or software components set forth herein may be divided into subcomponents comprising software, hardware or both. In addition, where applicable, it is contemplated that software components may be implemented as hardware components, and vice versa.

[0062] Software (such as program code and / or data) according to the present disclosure may be stored on one or more computer storage media. It is also contemplated that the software identified herein may be implemented using one or more general or special purpose computers and / or computer systems, networked and / or otherwise. Where applicable, the order of the various steps described herein may be changed, combined into composite steps, and / or divided into sub-steps to provide the features described herein.

[0063] The embodiments and examples set forth herein are provided to best illustrate embodiments according to the present invention and its specific applications, and thereby enable those skilled in the art to make and use the present invention. However, those skilled in the art will appreciate that the above description and examples are provided for ease of illustration and example only. The description set forth is not intended to cover all aspects of the present invention or to limit the present invention to the precise form disclosed.

Claims

1. A system for realizing in-vehicle virtual reality, characterized in that: The system for realizing vehicle-mounted virtual reality comprises: a detection module configured to detect access of an augmented reality device or a virtual reality device and to generate an enable signal in response to detecting access of the augmented reality device or the virtual reality device; a service module configured to provide an in-vehicle service for the augmented reality device or the virtual reality device; and a control module configured to operate in response to receiving the enabling signal from the detection module to control the in-vehicle service provided by the service module for the augmented reality device or the virtual reality device, The system for implementing in-vehicle virtual reality further comprises a service support module, wherein the service support module is configured to provide the following support functions for the augmented reality device or virtual reality device: automatic allocation of IP addresses, registration and discovery of in-vehicle services, streaming media transmission, link management, and Bluetooth control. The service support module further comprises: An IP address allocation unit is configured to create a local area network for the vehicle computer so as to allocate the IP address of the augmented reality device or virtual reality device to the local area network created for the vehicle computer; A service registration and discovery unit, configured to register the in-vehicle service with a server of the augmented reality device or the virtual reality device, so that the augmented reality device or the virtual reality device can discover and access the in-vehicle service; a streaming media transmission unit configured to transmit video data created by the in-vehicle service; a link management unit configured to perform access authentication and certification operations on the augmented reality device or the virtual reality device; and A Bluetooth control unit is configured to allow the augmented reality device or virtual reality device to be connected to the vehicle computer via Bluetooth to control the operation of the projection unit.

2. The system for implementing in-vehicle virtual reality according to claim 1, wherein the system for implementing in-vehicle virtual reality further comprises an interface module, wherein the interface module is configured to: Provide search and scanning access for the augmented reality device or virtual reality device; The augmented reality device or virtual reality device is used to control the in-vehicle device; and The vehicle can call to control the brightness and upgrade of the augmented reality device or virtual reality device.

3. The system for implementing in-vehicle virtual reality according to claim 1, wherein the service module and the control module operate based on an observer mode, and the service module is further configured to: Observe the state changes of the control module: and In response to receiving the indication of a change of state from the control module, an in-vehicle service associated with the indication of a change of state of the control module is executed.

4. The system for implementing in-vehicle virtual reality according to claim 1, wherein the service module further comprises: A vehicle control unit configured to synchronize user control information of an in-vehicle device to the augmented reality device or the virtual reality device, so as to control the in-vehicle device via the augmented reality device or the virtual reality device; A screen projection unit, configured to project the video data played by the vehicle computer to the augmented reality device or the virtual reality device for playback, and to project the video data played by the augmented reality device or the virtual reality device to the vehicle computer for playback; A viewing unit configured to be remotely called by the augmented reality device or the virtual reality device so that the augmented reality device or the virtual reality device remotely views the video data of the vehicle-mounted terminal; A live broadcast unit configured to upload video data depicting the vehicle's surroundings collected by the vehicle's camera device to the cloud in real time, so that the augmented reality device or virtual reality device can obtain the video data from the cloud for playback; A synchronous playback unit configured to play the video data of the vehicle-mounted terminal or the video data obtained from the cloud synchronously between the plurality of augmented reality devices or virtual reality devices; as well as An upgrading unit is configured to perform an upgrading operation on the augmented reality device or the virtual reality device.

5. A method for realizing in-vehicle virtual reality, characterized in that: The method for realizing vehicle-mounted virtual reality comprises: detecting, via a detection module, access of an augmented reality device or a virtual reality device and generating an enable signal in response to detecting access of the augmented reality device or the virtual reality device; Providing in-vehicle services for the augmented reality device or virtual reality device via a service module; and in response to receiving the enabling signal from the detection module, operating via the control module to control the in-vehicle service provided by the service module for the augmented reality device or the virtual reality device, The method for implementing in-vehicle virtual reality further includes providing the following supporting functions for the augmented reality device or virtual reality device via a service support module: automatic allocation of IP addresses, registration and discovery of in-vehicle services, streaming media transmission, link management, and Bluetooth control. The supporting functions include: Creating a local area network for the vehicle computer to assign the IP address of the augmented reality device or virtual reality device to the local area network created for the vehicle computer; Registering the in-vehicle service to a server of the augmented reality device or virtual reality device, so that the augmented reality device or virtual reality device can discover and access the in-vehicle service; transmitting video data created by the in-vehicle service; Performing access authentication and certification operations on the augmented reality device or virtual reality device; and Provide a Bluetooth connection to the vehicle computer for the augmented reality device or virtual reality device so that the augmented reality device or virtual reality device controls the screen projection operation performed by the service module via the Bluetooth connection.

6. The method for implementing in-vehicle virtual reality according to claim 5, wherein the method for implementing in-vehicle virtual reality further comprises configuring an interface module to: Provide search and scanning access for the augmented reality device or virtual reality device; The augmented reality device or virtual reality device is used to control the in-vehicle device; and The vehicle can call to control the brightness and upgrade of the augmented reality device or virtual reality device.

7. The method for implementing in-vehicle virtual reality according to claim 5, wherein the method for implementing in-vehicle virtual reality further comprises operating the service module and the control module based on an observer mode, so that the service module: Observe the state changes of the control module: and In response to receiving the indication of a change of state from the control module, an in-vehicle service associated with the indication of a change of state of the control module is executed.

8. The method for implementing in-vehicle virtual reality according to claim 5, wherein the following operations are further performed via the service module: Synchronizing the control information of the user on the in-vehicle device to the augmented reality device or the virtual reality device, so as to control the in-vehicle device via the augmented reality device or the virtual reality device; Projecting the video data played by the vehicle computer to the augmented reality device or virtual reality device for playback, and projecting the video data played by the augmented reality device or virtual reality device to the vehicle computer for playback; Remotely viewing the video data of the vehicle-mounted terminal through the augmented reality device or virtual reality device; Uploading video data of the vehicle's surrounding environment captured by the vehicle's camera device to the cloud in real time, so that the augmented reality device or virtual reality device can obtain the video data from the cloud for playback; Keeping the video data on the vehicle side or the video data obtained from the cloud synchronized between the multiple augmented reality devices or virtual reality devices; and An upgrade operation is performed on the augmented reality device or the virtual reality device.

9. A computer storage medium, characterized in that The computer storage medium comprises instructions, which, when executed, execute the method for implementing in-vehicle virtual reality according to any one of claims 5 to 8.