Augmented reality and virtual reality devices, vehicle systems, and vehicles

Abstract

The application relates to an augmented reality and virtual reality device, a vehicle-mounted system, a vehicle, and a method for realizing augmented reality and virtual reality and a storage medium. The augmented reality and virtual reality device is used for running an augmented reality and virtual reality system; the device has a first interface and at least one second interface, wherein the first interface is used for connecting with a vehicle-mounted device running a vehicle-mounted information entertainment system, and the at least one second interface is used for connecting with at least one head-mounted display device. Therefore, multimedia content in the vehicle-mounted device is transmitted to the connected augmented reality and virtual reality device through the first interface for processing to generate a corresponding virtual reality scene, and is transmitted to the at least one head-mounted display device through the at least one second interface for playing, so that a user can experience an AR or VR scene in a vehicle-mounted device. In addition, no additional modification is needed for the vehicle-mounted device, thereby saving cost.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of automobiles, in particular to an augmented reality and virtual reality device, a vehicle-mounted system, a vehicle, and a method and a storage medium for implementing augmented reality and virtual reality. BACKGROUND

[0002] With the rapid development of new energy vehicles, users are increasingly hoping that new energy vehicles can meet more entertainment needs. In daily life, virtual reality (VR) technology or augmented reality (AR) technology can meet most of the entertainment needs of users, so combining VR or AR technology with new energy vehicles has great market potential.

[0003] In traditional technology, the computing power of most vehicle machines cannot support rich VR or AR content. In order to combine new energy vehicles with VR or AR technology and implement a vehicle-mounted augmented reality system, a vehicle-grade chip is generally additionally added to the vehicle machine end at present to realize communication and data transmission with VR or AR. However, this method requires modification of the vehicle machine end, resulting in high cost. SUMMARY

[0004] Therefore, it is necessary to provide an augmented reality and virtual reality device, a vehicle-mounted system, a vehicle, and a method and a storage medium for implementing augmented reality and virtual reality, which can implement augmented reality and virtual reality on a vehicle.

[0005] In a first aspect, the present application provides an augmented reality and virtual reality device, which is used to run an augmented reality and virtual reality system; the device has a first interface and at least one second interface, the first interface is used to connect with a vehicle-mounted device running a vehicle information entertainment system, and the at least one second interface is used to connect with at least one head-mounted display device.

[0006] In one of the embodiments, the first interface is configured to receive multimedia data transmitted by the vehicle-mounted device.

[0007] In one of the embodiments, the at least one second interface is configured to transmit the multimedia data to the at least one head-mounted display device to instruct the at least one head-mounted display device to play the multimedia data.

[0008] In one of the embodiments, the at least one second interface is further configured to obtain the playing content of the at least one head-mounted display device; and the first interface is further configured to transmit the playing content to the vehicle-mounted device to instruct the vehicle-mounted device to perform corresponding playing according to the playing content.

[0009] In one of the embodiments, the at least one second interface is further configured to acquire a first control signal for controlling the in-vehicle device, which is sent by the at least one head-mounted display device and is generated by the at least one head-mounted display device according to the acquired control information; and the first interface is further configured to transmit the first control signal to the in-vehicle device to instruct the in-vehicle device to perform the control over the in-vehicle device according to the first control signal.

[0010] In one of the embodiments, the device further has at least one third interface for connecting with an external control device; the at least one third interface is configured to acquire a second control signal for controlling the in-vehicle device, which is sent by the control device; and the first interface is further configured to transmit the second control signal to the in-vehicle device to instruct the in-vehicle device to perform the control over the in-vehicle device according to the second control signal.

[0011] In one of the embodiments, the at least one third interface is further configured to acquire a third control signal for controlling the at least one head-mounted display device, which is sent by the control device; and the at least one second interface is further configured to transmit the third control signal to the at least one head-mounted display device to instruct the at least one head-mounted display device to perform the corresponding control according to the third control signal.

[0012] In a second aspect, the present application provides a vehicle-mounted system, which comprises a vehicle-mounted device and the augmented reality and virtual reality device according to any one of the first aspect.

[0013] In a third aspect, the present application provides a vehicle-mounted system, which comprises a vehicle-mounted device, at least one head-mounted display device and the augmented reality and virtual reality device according to any one of the first aspect; the vehicle-mounted device is used to run a vehicle-mounted information entertainment system; and the at least one head-mounted display device is used to play multimedia data.

[0014] In one of the embodiments, the system further comprises a control device, which is connected with the augmented reality and virtual reality device through the at least one third interface.

[0015] In a fourth aspect, the present application further provides a vehicle, which comprises the vehicle-mounted system according to any one of the second aspect or the third aspect.

[0016] In a fifth aspect, the present application further provides a method for implementing augmented reality and virtual reality, which is applied to an augmented reality and virtual reality device and comprises the following steps.

[0017] receiving multimedia data transmitted by a vehicle-mounted device through a first interface; and

[0018] transmitting the multimedia data to at least one head-mounted display device for display through at least one second interface.

[0019] In one of the embodiments, the method further comprises: acquiring, through the at least one second interface, a playing content currently played by the at least one head-mounted display device; and transmitting the playing content to the vehicle-mounted device through the first interface to instruct the vehicle-mounted device to perform corresponding playing according to the playing content.

[0020] In one of the embodiments, the method further comprises: receiving, through at least one third interface, a control signal transmitted by a control device for controlling an in-vehicle device; and transmitting the control signal to the vehicle-mounted device through the first interface to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the control signal.

[0021] In the sixth aspect, the present application further provides a computer readable storage medium. The computer readable storage medium has a computer program stored thereon, and the computer program is executed by a processor to implement the steps of the method in the fifth aspect.

[0022] The above-mentioned augmented reality and virtual reality device, vehicle-mounted system, vehicle, and method of implementing augmented reality and virtual reality, and storage medium, wherein the augmented reality and virtual reality device is used to run an augmented reality and virtual reality system. The device has a first interface and at least one second interface, wherein the first interface is used to connect with a vehicle-mounted device running a vehicle-mounted information entertainment system, and the at least one second interface is used to connect with at least one head-mounted display device. Thus, the multimedia content in the vehicle-mounted device is transmitted to the connected augmented reality and virtual reality device through the first interface for processing to generate a corresponding virtual reality scene, and is transmitted to the at least one head-mounted display device through the at least one second interface for playing, so that a user can experience an AR or VR scene in the vehicle-mounted device. Moreover, no additional modification is needed for the vehicle-mounted device, thereby saving cost. BRIEF DESCRIPTION OF DRAWINGS

[0023] Figure 1 a structural block diagram of the augmented reality and virtual reality device in one of the embodiments;

[0024] Figure 2 a structural block diagram of the augmented reality and virtual reality device in another of the embodiments;

[0025] Figure 3 a structural block diagram of the vehicle-mounted system in one of the embodiments;

[0026] Figure 4 A structural block diagram of a vehicle-mounted system in another embodiment;

[0027] Figure 5 A structural block diagram of a vehicle-mounted system in another embodiment;

[0028] Figure 6 A flowchart of a method for implementing augmented reality and virtual reality in an embodiment;

[0029] Figure 7 An internal structural diagram of a computer device in an embodiment. DETAILED DESCRIPTION

[0030] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application.

[0031] In the description of the embodiments of the present application, unless otherwise explicitly specified and limited, the technical term "connection" should be understood broadly, for example, it can be fixed connection, or detachable connection, or integral; it can be mechanical connection, or electrical connection, or bridging, or network connection; it can be direct connection, or indirect connection through intermediate medium, or internal connection of two elements or interaction relationship between two elements. For those skilled in the art, the specific meaning of the above-mentioned term in the embodiments of the present application can be understood according to the specific circumstances.

[0032] In an embodiment, the present application provides an augmented reality and virtual reality device for running an augmented reality and virtual reality system, which can provide virtual reality scenes including games, meetings and movie watching, etc. In the present embodiment, the augmented reality and virtual reality device can be implemented by using a special central processor with corresponding processing capability, or can also be implemented by using a general central processor, which is not limited in the present embodiment.

[0033] As Figure 1As shown, the augmented reality and virtual reality device 10 has a first interface 11 and at least one second interface 12. The first interface 11 is configured to connect with a vehicle device running an in-vehicle infotainment (IVI) system, and the at least one second interface 12 is configured to connect with at least one head-mounted display device to drive the at least one head-mounted display device to play a corresponding virtual reality scene. Specifically, the vehicle device can be a vehicle integrated information processing system implemented by a vehicle-specific central processor and based on a vehicle body bus system and Internet services, and can implement a series of applications including three-dimensional navigation, real-time traffic, IPTV (Interactive Personality TV), auxiliary driving, fault detection, vehicle information, vehicle body control, mobile office, wireless communication, online-based entertainment functions, and TSP (Telematics Service Provider) services. The head-mounted display device can be used to play augmented reality and virtual reality content.

[0034] In this embodiment, the augmented reality and virtual reality device 10 can realize data communication with the vehicle device through the first interface 11, and in addition, the first interface 11 can also transmit operating power to the augmented reality and virtual reality device 10. The augmented reality and virtual reality device 10 can also be connected with at least one head-mounted display device through the at least one second interface 12. Specifically, each second interface 12 is connected with one head-mounted display device, for example, when there are two second interfaces A and B, one of the second interfaces A can be connected with one head-mounted display device, and the other second interface B can be connected with another head-mounted display device. Similarly, when there are more second interfaces, more head-mounted display devices can be connected.

[0035] For example, in one scenario, the number of second interfaces 12 in the augmented reality and virtual reality device 10 described above can be set to different numbers according to the actual scenario. Specifically, when it is applied in a vehicle, the corresponding number of second interfaces 12 can be adapted according to the number of seats of the vehicle in which it is applied. For example, when the augmented reality and virtual reality device 10 is applied in a four-seat vehicle, at least four second interfaces 12 can be provided, each of which is connected with a head-mounted display device corresponding to a seat, so as to realize the function of providing augmented reality and virtual reality for users in each seat of the vehicle, thereby improving the user experience. By analogy, when the augmented reality and virtual reality device 10 is applied in a five-seat vehicle or a seven-seat vehicle, at least five or seven second interfaces 12 can be provided. The embodiment of the present application Figure 1 For example, four second interfaces 12 are taken as an example for description, which does not mean a limitation of the present application.

[0036] In the above embodiment, the augmented reality and virtual reality device 10 can be connected with the vehicle-mounted device through the first interface 11, and connected with the at least one head-mounted display device through the at least one second interface 12, so that the user can experience the AR or VR scene in the vehicle machine, and no additional modification is needed for the vehicle machine, thus greatly saving the cost.

[0037] In an embodiment, the first interface 11 and the second interface 12 can both be implemented by a universal serial bus (USB) interface, which can specifically be a USB Type-C interface. Since the USB Type-C is a USB interface shape standard, and has a smaller size than Type-A and Type-B, the USB Type-C can be applied to both master devices and slave devices. For example, in the embodiment, the augmented reality and virtual reality device can be connected with the vehicle-mounted device through the USB Type-C interface, and the augmented reality and virtual reality device can also be connected with the at least one head-mounted display device through the at least one USB Type-C interface, so as to realize compatible connection of multiple devices.

[0038] In an embodiment, the first interface 11 can be configured to receive multimedia data transmitted by the vehicle-mounted device. The at least one second interface 12 can be configured to transmit the multimedia data to the at least one head-mounted display device, so as to instruct the at least one head-mounted display device to play the multimedia data.

[0039] The multimedia data can be data stored in the vehicle-mounted device, including text, sound, image and other media forms. In the embodiment, when the augmented reality and virtual reality device 10 establishes a connection with the vehicle-mounted device through the first interface 11, the two devices can communicate through the first interface 11. For example, the vehicle-mounted device can transmit the multimedia data stored therein to the augmented reality and virtual reality device 10 through the first interface 11. If the augmented reality and virtual reality device 10 is connected with the at least one head-mounted display device through the at least one second interface 12 at this time, the augmented reality and virtual reality device 10 can also process the received multimedia data to generate a virtual reality scene, and synchronously transmit the virtual reality scene to the at least one head-mounted display device connected through the at least one second interface 12, so that the at least one head-mounted display device can play the virtual reality scene based on the multimedia data. In this way, the multimedia data stored in the vehicle machine can be converted into a virtual reality scene for playing, and when the augmented reality and virtual reality device is connected with multiple head-mounted display devices, multiple users in the vehicle machine can also experience the augmented reality and virtual reality effect together, so as to improve the user experience.

[0040] In an embodiment, the at least one second interface 12 can also be configured to acquire playing content of the at least one head-mounted display device. The first interface 11 can also be configured to transmit the playing content to the vehicle-mounted device to instruct the vehicle-mounted device to perform corresponding playing according to the playing content.

[0041] The playing content can be content of a virtual reality scene currently played by a head-mounted display device of a user in the vehicle. In this embodiment, the user can share the content of the virtual reality scene currently played by the head-mounted display device of the user. Specifically, the user can initiate a sharing instruction of the content of the virtual reality scene currently played by the head-mounted display device of the user, and the head-mounted display device can transmit the content of the virtual reality scene currently played (i.e. the content to be shared) to the augmented reality and virtual reality device 10 in response to the sharing instruction. If the augmented reality and virtual reality device 10 is connected to the vehicle-mounted device through the first interface 11 at this time, the augmented reality and virtual reality device 10 can also transmit the content to be shared to the vehicle-mounted device through the first interface 11, and the vehicle-mounted device can play the received content to be shared through multimedia devices in the vehicle (including but not limited to audio devices, display devices, etc. in the vehicle). Thus, the content of the virtual reality scene currently played by the head-mounted display device of a user in the vehicle can be shared and played through the multimedia devices in the vehicle.

[0042] In an embodiment, the at least one second interface 12 can also be configured to acquire a first control signal sent by the at least one head-mounted display device for controlling the in-vehicle device. The first interface 11 can also be configured to transmit the first control signal to the vehicle-mounted device to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the first control signal.

[0043] The in-vehicle device includes but is not limited to at least one of an audio device, a camera device, a display device, an air conditioning device, a lighting device, a fragrance device, and a seat adjustment device in the vehicle. For example, the first control signal can be an instruction or command for controlling the in-vehicle device generated when the at least one head-mounted display device performs various dynamic operations. Specifically, the first control signal can be a signal for adjusting the volume of the audio device in the vehicle, a signal for adjusting the temperature of the air conditioning device in the vehicle, a signal for adjusting the brightness of the lighting device in the vehicle, etc.

[0044] Specifically, when the augmented reality and virtual reality device 10 obtains a first control signal for controlling the in-vehicle device, the first control signal can be transmitted to the vehicle-mounted device through the first interface 11, and the vehicle-mounted device can perform control on the in-vehicle device according to the received first control signal. For example, when the first control signal is a signal for increasing the temperature of the in-vehicle air conditioning device, the vehicle-mounted device can control the in-vehicle air conditioning device to increase the temperature according to the first control signal, thereby achieving effective control on the in-vehicle device.

[0045] In one scenario, the first control signal can be generated by the at least one head-mounted display device according to the obtained control information and sent to the augmented reality and virtual reality device 10 through the at least one second interface 12. The control information can be information obtained by the user performing various dynamic operations to control the in-vehicle device. When the augmented reality and virtual reality device 10 is connected to the vehicle-mounted device through the first interface 11 and connected to the at least one head-mounted display device through the at least one second interface 12, the user can perform dynamic operations through the head-mounted display device to initiate control information for controlling the in-vehicle device. For example, the user can initiate corresponding control information through the control buttons provided on the head-mounted display device, or can initiate corresponding voice control information through the voice control component on the head-mounted display device. The head-mounted display device can generate a corresponding first control signal according to the received control information and transmit the first control signal to the augmented reality and virtual reality device 10 through the second interface 12, and the augmented reality and virtual reality device 10 can transmit the first control signal to the vehicle-mounted device through the first interface 11, so that the vehicle-mounted device can perform control on the in-vehicle device according to the received first control signal.

[0046] In one embodiment, as shown in FIG. 1, Figure 2 The augmented reality and virtual reality device 10 can also have at least one third interface 13, which can be implemented as a short-range communication interface. For example, it can be implemented as at least one of Bluetooth, RFID (Radio Frequency Identification), and NFC (Near Field Communication). The at least one third interface 13 can be used to connect with an external control device. The control device can be a wearable device such as a control handle, a bracelet, a ring, etc.

[0047] Specifically, the at least one third interface 13 can be configured to obtain a second control signal for controlling the in-vehicle device sent by the control device. The first interface 11 can also be configured to transmit the second control signal to the vehicle-mounted device to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the second control signal.

[0048] The second control signal can be generated by the control device according to the obtained control information and transmitted to the augmented reality and virtual reality device 10 through the at least one third interface 13. Specifically, the user can perform dynamic operation through the control device to initiate control information for controlling the in-vehicle device, and the control device can generate a corresponding second control signal according to the received control information and transmit the second control signal to the augmented reality and virtual reality device 10 through the third interface 13. The augmented reality and virtual reality device 10 can also transmit the second control signal to the in-vehicle device through the first interface 11, so that the in-vehicle device can execute control of the in-vehicle device according to the received second control signal.

[0049] In one scenario, the control device can also be a wearable device such as a control handle, a bracelet, a ring, etc. that is paired with the head-mounted display device for use. For example, the head-mounted display device can be used only for display, and the control device can be used to receive and transmit corresponding control information to control the content displayed by the head-mounted display device or control the state of the in-vehicle device.

[0050] In one scenario, the at least one third interface 13 can also be configured to obtain a third control signal transmitted by the control device for controlling the at least one head-mounted display device. The at least one second interface 12 can also be configured to transmit the third control signal to the at least one head-mounted display device to instruct the at least one head-mounted display device to perform corresponding control according to the third control signal.

[0051] The augmented reality (AR) and virtual reality (VR) device 10 can connect to a head-mounted display device via a second interface 12, and transmit the processed VR scene content to the connected head-mounted display device for display via the second interface 12. The AR and VR device 10 can also connect to a control device via a third interface 13. Specifically, the control device can acquire a third control signal for playing content on at least one head-mounted display device. This third control signal can control the playback content of the head-mounted display device (e.g., the specific VR scene content to be played), or it can control the playback status of the head-mounted display device (e.g., pause status, playback status, playback volume, etc.). When the control device acquires the third control signal for playing content on at least one head-mounted display device, it can send the third control signal to the AR and VR device 10 via at least one third interface 13. The AR and VR device 10 can then execute playback control on at least one head-mounted display device according to the third control signal. For example, when the control device receives a third control signal for controlling the playback of one of the head-mounted display devices, which is to increase its playback volume, the control device sends the third control signal to the augmented reality and virtual reality device 10 through the corresponding third interface 13. The augmented reality and virtual reality device 10 can then transmit the third control signal to the corresponding head-mounted display device through the second interface 12, so that the corresponding head-mounted display device can increase its playback volume according to the third control signal, thereby realizing the control of the head-mounted display device.

[0052] The modules in the aforementioned augmented reality and virtual reality devices can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the computer device's memory as software, so that the processor can call and execute the operations corresponding to each module.

[0053] In one embodiment, such as Figure 3 As shown, based on the same inventive concept, this application also provides an in-vehicle system, which specifically may include: as shown in the figure. Figure 1 , Figure 2The enhanced reality and virtual reality device 10 and the vehicle-mounted device 20 are shown. The vehicle-mounted device 20 can have a fourth interface 21 matched with the first interface 11 in the enhanced reality and virtual reality device 10, and the vehicle-mounted device 20 can be connected with the first interface 11 of the enhanced reality and virtual reality device 10 through the fourth interface 21, so as to realize the connection with the enhanced reality and virtual reality device 10. Specifically, through the connection, the multimedia content in the vehicle-mounted device 20 can be processed through the connected enhanced reality and virtual reality device 10 to generate a corresponding virtual reality scene, so that the user can experience the AR or VR scene in the vehicle, and no additional modification is needed for the vehicle, thus greatly saving the cost.

[0054] It can be understood that the implementation scheme for solving the problem provided by the vehicle-mounted system is similar to the implementation scheme described in the enhanced reality and virtual reality device, and thus the embodiment will not be described again.

[0055] In one embodiment, as shown in Figure 4 Based on the same inventive concept, the embodiment of the present application further provides a vehicle-mounted system, which can specifically include: the enhanced reality and virtual reality device 10, the vehicle-mounted device 20, and at least one head-mounted display device 30 as shown in Figure 1 、 Figure 2 The vehicle-mounted device 20 can have a fourth interface 21 matched with the first interface 11 in the enhanced reality and virtual reality device 10. The at least one head-mounted display device 30 has a fifth interface 31 matched with the second interface 12 in the enhanced reality and virtual reality device 10.

[0056] Specifically, the vehicle-mounted device 20 can be connected with the first interface 11 of the enhanced reality and virtual reality device 10 through the fourth interface 21, and the enhanced reality and virtual reality device 10 can also be connected with the fifth interface 31 of the at least one head-mounted display device 30 through the at least one second interface 12, so as to realize the interconnection of the enhanced reality and virtual reality device 10 with the vehicle-mounted device 20 and the at least one head-mounted display device 30 respectively.

[0057] In this embodiment, through the connection, it can be realized that the multimedia content in the vehicle-mounted device 20 is processed by the connected augmented reality and virtual reality device 10 to generate a corresponding virtual reality scene, and transmitted to at least one head-mounted display device 30 for playing; it can also be realized that the playing content of the at least one head-mounted display device 30 is transmitted to the vehicle-mounted device 20 for playing by the augmented reality and virtual reality device 10; it can also be realized that the first control signal for controlling the in-vehicle device sent by the at least one head-mounted display device 30 is acquired by the augmented reality and virtual reality device 10 and transmitted to the vehicle-mounted device 20, and the vehicle-mounted device 20 performs control on the in-vehicle device according to the first control signal. Thus, the user can experience the AR or VR scene in the vehicle, and no additional modification of the vehicle is required, thereby greatly saving the cost.

[0058] In one embodiment, as shown in Figure 5 the vehicle-mounted system shown in Figure 4 the vehicle-mounted system can further include a control device 40, wherein the control device 40 can also have a sixth interface 41 matched with the third interface 13 in the augmented reality and virtual reality device 10. Specifically, the augmented reality and virtual reality device 10 can also be connected with the sixth interface 41 of the control device 40 through the third interface 13, so as to realize the interconnection of the augmented reality and virtual reality device 10 and the control device 40.

[0059] In this embodiment, through the connection, it can be realized that the multimedia content in the vehicle-mounted device 20 is processed by the connected augmented reality and virtual reality device 10 to generate a corresponding virtual reality scene, and transmitted to at least one head-mounted display device 30 for playing; it can also be realized that the playing content of the at least one head-mounted display device 30 is transmitted to the vehicle-mounted device 20 for playing by the augmented reality and virtual reality device 10; it can also be realized that the first control signal for controlling the in-vehicle device sent by the at least one head-mounted display device 30 is acquired by the augmented reality and virtual reality device 10 and transmitted to the vehicle-mounted device 20, and the vehicle-mounted device 20 performs control on the in-vehicle device according to the first control signal. Thus, the user can experience the AR or VR scene in the vehicle, and no additional modification of the vehicle is required, thereby greatly saving the cost.

[0060] In one embodiment, a vehicle is also provided, which can include the vehicle-mounted system described in any of the above embodiments. The vehicle provides a solution to the problem similar to the implementation described in the above vehicle-mounted system, and therefore this embodiment will not be described in detail.

[0061] Based on the same inventive concept, the embodiments of the present application further provide a method for implementing augmented reality and virtual reality, which can be applied to the augmented reality and virtual reality device described in any of the above embodiments. The method provides a solution to the problem similar to the solution provided by the augmented reality and virtual reality device described above. Therefore, the specific definitions in one or more embodiments of the method for implementing augmented reality and virtual reality provided below can refer to the definitions of the augmented reality and virtual reality device described above, which will not be repeated here.

[0062] In one embodiment, as shown in Figure 6 a method for implementing augmented reality and virtual reality is provided, which can specifically include the following steps:

[0063] Step 602: receiving multimedia data transmitted by the vehicle-mounted device through the first interface.

[0064] The multimedia data can be data stored in the vehicle-mounted device, including text, sound, image and other media forms. In this embodiment, after the augmented reality and virtual reality device establishes a connection with the vehicle-mounted device through the first interface, the two devices can communicate through the first interface. For example, the vehicle-mounted device can transmit the multimedia data stored therein to the connected augmented reality and virtual reality device through the first interface, and the augmented reality and virtual reality device can receive the multimedia data transmitted by the vehicle-mounted device.

[0065] Step 604: transmitting the multimedia data to at least one head-mounted display device through at least one second interface for display.

[0066] Specifically, if the augmented reality and virtual reality device is connected to at least one head-mounted display device through at least one second interface, when the augmented reality and virtual reality device receives the multimedia data transmitted by the vehicle-mounted device, it can also process the received multimedia data in a virtual reality scene, and synchronize the processed multimedia data to the connected at least one head-mounted display device through at least one second interface. The at least one head-mounted display device can then play a virtual reality scene based on the multimedia data. Thus, the multimedia data stored in the vehicle-mounted device can be converted into a virtual reality scene for playing, so that the user in the vehicle can experience the augmented reality and virtual reality effect, thereby improving the user experience.

[0067] In one embodiment, the augmented reality and virtual reality device can further acquire, through the at least one second interface, playing content currently played by the at least one head-mounted display device, and transmit the playing content to the vehicle-mounted device through the first interface to instruct the vehicle-mounted device to perform corresponding playing according to the playing content. The playing content can be content currently played by the at least one head-mounted display device, and the at least one head-mounted display device is connected to the augmented reality and virtual reality device through the at least one second interface.

[0068] In this embodiment, a user can share content of a virtual reality scene currently played by his head-mounted display device. Specifically, the user can initiate a sharing instruction for the content of the virtual reality scene currently played by his head-mounted display device, and the head-mounted display device can respond to the sharing instruction and transmit the content of the virtual reality scene currently played (i.e., the content to be shared) to the augmented reality and virtual reality device through the second interface. The augmented reality and virtual reality device can further transmit the content to be shared to the vehicle-mounted device through the first interface, and the vehicle-mounted device can play the received content to be shared through multimedia devices in the vehicle (including but not limited to audio devices, display devices, etc. in the vehicle). Thus, content of a virtual reality scene currently played by a head-mounted display device of a user in the vehicle can be shared and played through multimedia devices in the vehicle.

[0069] In one embodiment, the augmented reality and virtual reality device can further acquire, through the at least one second interface, a first control signal for controlling the in-vehicle device sent by the at least one head-mounted display device, and transmit the first control signal to the vehicle-mounted device through the first interface to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the first control signal.

[0070] The in-vehicle device includes but is not limited to at least one of an audio device, a camera device, a display device, an air conditioning device, a lighting device, a fragrance device, and a seat adjustment device in the vehicle. The control signal is an instruction or command for controlling the in-vehicle device when implementing various dynamic operations, for example, the control signal can be a signal for adjusting the volume of the audio device in the vehicle, a signal for adjusting the temperature of the air conditioning device in the vehicle, or a signal for adjusting the brightness of the lighting device in the vehicle, etc.

[0071] Specifically, when the augmented reality and virtual reality device acquires the first control signal for controlling the in-vehicle device, the first control signal can be transmitted to the vehicle-mounted device through the first interface, and the vehicle-mounted device can perform control on the in-vehicle device according to the received first control signal. For example, when the first control signal is a signal for increasing the temperature of the air conditioning device in the vehicle, the vehicle-mounted device can control the temperature of the air conditioning device in the vehicle to increase according to the first control signal, thereby effectively controlling the in-vehicle device.

[0072] In an embodiment, the augmented reality and virtual reality device can further receive, through the at least one third interface, a second control signal transmitted by the control device for controlling the in-vehicle device; and transmit, through the first interface, the second control signal to the vehicle-mounted device to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the second control signal.

[0073] Specifically, the user can perform dynamic operation through the control device to initiate control information for controlling the in-vehicle device, and the control device can generate a corresponding second control signal according to the received control information, and transmit the control signal to the augmented reality and virtual reality device through the third interface. The augmented reality and virtual reality device can further transmit the control signal to the vehicle-mounted device through the first interface, so that the vehicle-mounted device can perform control on the in-vehicle device according to the received control signal.

[0074] In an embodiment, the augmented reality and virtual reality device can further receive, through the at least one third interface, a third control signal transmitted by the control device for controlling the at least one head-mounted display device, and transmit the third control signal to the at least one head-mounted display device through the at least one second interface to instruct the at least one head-mounted display device to perform corresponding control according to the third control signal.

[0075] Specifically, the control device can obtain a third control signal for playing control on the at least one head-mounted display device. The third control signal can be control on playing content of the head-mounted display device (for example, control on playing content of a specific virtual reality scene), or control on playing state of the head-mounted display device (for example, pause state, playing state, playing volume, etc.). When the control device obtains the third control signal for playing control on the at least one head-mounted display device, the control device can transmit the third control signal to the augmented reality and virtual reality device through the at least one third interface. The augmented reality and virtual reality device can perform playing control on the at least one head-mounted display device according to the third control signal, so as to realize control on the head-mounted display device.

[0076] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0077] In one embodiment, a computer device is provided, which may be an augmented reality or virtual reality device, and its internal structure diagram may be as follows: Figure 7 As shown, the computer device includes a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements an augmented reality or virtual reality method. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the computer device casing, or an external keyboard, touchpad, or mouse.

[0078] Those skilled in the art will understand that Figure 7 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0079] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0080] Receives multimedia data transmitted from the vehicle-mounted equipment through the first interface; and

[0081] transmit, through at least one second interface, the multimedia data to at least one head-mounted display device for display.

[0082] In one embodiment, the computer program, when executed by the processor, further implements the following steps: acquiring, through the at least one second interface, playing content currently played by the at least one head-mounted display device; and transmitting, through the first interface, the playing content to the vehicle-mounted device to instruct the vehicle-mounted device to perform corresponding playing according to the playing content.

[0083] In one embodiment, the computer program, when executed by the processor, further implements the following steps: receiving, through at least one third interface, a control signal transmitted by a control device for controlling an in-vehicle device; and transmitting, through the first interface, the control signal to the vehicle-mounted device to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the control signal.

[0084] In one embodiment, a computer-readable storage medium is provided, and the computer-readable storage medium has stored thereon a computer program, and the computer program, when executed by a processor, implements the following steps:

[0085] receiving, through a first interface, multimedia data transmitted by a vehicle-mounted device; and

[0086] transmitting, through at least one second interface, the multimedia data to at least one head-mounted display device for display.

[0087] In one embodiment, the computer program, when executed by the processor, further implements the following steps: acquiring, through the at least one second interface, playing content currently played by the at least one head-mounted display device; and transmitting, through the first interface, the playing content to the vehicle-mounted device to instruct the vehicle-mounted device to perform corresponding playing according to the playing content.

[0088] In one embodiment, the computer program, when executed by the processor, further implements the following steps: receiving, through at least one third interface, a control signal transmitted by a control device for controlling an in-vehicle device; and transmitting, through the first interface, the control signal to the vehicle-mounted device to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the control signal.

[0089] In one embodiment, a computer program product is provided, and the computer program product includes a computer program, and the computer program, when executed by a processor, implements the following steps:

[0090] receiving, through a first interface, multimedia data transmitted by a vehicle-mounted device; and

[0091] transmitting, through at least one second interface, the multimedia data to at least one head-mounted display device for display.

[0092] In one embodiment, the computer program, when executed by the processor, implements the following steps: obtaining, through the at least one second interface, a currently played playing content of the at least one head-mounted display device; and transmitting, through the first interface, the playing content to the vehicle-mounted device to instruct the vehicle-mounted device to perform corresponding playing according to the playing content.

[0093] In one embodiment, the computer program, when executed by the processor, implements the following steps: receiving, through at least one third interface, a control signal transmitted by a control device for controlling an in-vehicle device; and transmitting, through the first interface, the control signal to the vehicle-mounted device to instruct the vehicle-mounted device to perform control on the in-vehicle device according to the control signal.

[0094] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties.

[0095] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0096] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist contradictory, it should be considered as the scope of the present application.

[0097] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are within the scope of protection of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. An augmented reality and virtual reality device, characterized in that, The device is used to run augmented reality and virtual reality systems; the device has a first interface and at least one second interface, the first interface and the second interface are implemented using a universal serial bus interface, the first interface is used to connect to an in-vehicle device running an in-vehicle infotainment system to communicate data with the in-vehicle device, and the at least one second interface is used to connect to at least one head-mounted display device to drive at least one head-mounted display device to play a corresponding virtual reality scene. The device also has at least one third interface, which is implemented using a near-field communication interface for connecting to an external control device; the at least one third interface is configured to: acquire a second control signal sent by the control device for controlling the in-vehicle equipment; the first interface is further configured to: transmit the second control signal to the in-vehicle equipment to instruct the in-vehicle equipment to perform control of the in-vehicle equipment according to the second control signal; The at least one second interface is further configured to: acquire playback content of the at least one head-mounted display device; the first interface is further configured to: transmit the playback content of the at least one head-mounted display device to the vehicle-mounted device, so as to instruct the vehicle-mounted device to perform corresponding playback according to the playback content; The at least one second interface is further configured to: acquire a first control signal sent by the at least one head-mounted display device for controlling in-vehicle equipment, the first control signal being generated by the at least one head-mounted display device based on the acquired control information; the first interface is further configured to: transmit the first control signal to the in-vehicle equipment to instruct the in-vehicle equipment to perform control of the in-vehicle equipment based on the first control signal.

2. The device according to claim 1, characterized in that, The first interface is configured as follows: Receive multimedia data transmitted by the vehicle-mounted device.

3. The device according to claim 2, characterized in that, The at least one second interface is configured as follows: The multimedia data is transmitted to the at least one head-mounted display device to instruct the at least one head-mounted display device to play the multimedia data.

4. The device according to claim 1, characterized in that, The at least one third interface is further configured to: acquire a third control signal sent by the control device for controlling the at least one head-mounted display device; The at least one second interface is further configured to transmit the third control signal to the at least one head-mounted display device to instruct the at least one head-mounted display device to perform corresponding control according to the third control signal.

5. A vehicle-mounted system, characterized in that, The system includes in-vehicle equipment and augmented reality and virtual reality equipment as described in any one of claims 1 to 4, wherein the in-vehicle equipment is used to operate an in-vehicle infotainment system.

6. A vehicle-mounted system, characterized in that, The system includes an in-vehicle device, at least one head-mounted display device, and an augmented reality and virtual reality device as described in any one of claims 1 to 4; the in-vehicle device is used to operate an in-vehicle infotainment system; and the at least one head-mounted display device is used to play multimedia data.

7. The system according to claim 6, characterized in that, The system also includes a control device that is connected to the augmented reality and virtual reality devices via at least one third interface.

8. A vehicle, characterized in that, The vehicle system included in any one of claims 5 to 7.

9. A method for realizing augmented reality and virtual reality, characterized in that, The method is applied to augmented reality and virtual reality devices, and the method includes: The system receives multimedia data transmitted from an in-vehicle device via a first interface; and transmits the multimedia data to at least one head-mounted display device for display via at least one second interface; the first interface and the second interface are implemented using a universal serial bus interface. The at least one second interface is used to obtain the playback content currently being played by the at least one head-mounted display device; and the playback content is transmitted to the vehicle-mounted device through the first interface to instruct the vehicle-mounted device to perform corresponding playback according to the playback content. The system receives a second control signal for controlling in-vehicle equipment transmitted by a control device through at least one third interface, wherein the at least one third interface is implemented using a short-range communication interface; and transmits the second control signal to the in-vehicle equipment through the first interface to instruct the in-vehicle equipment to perform control of the in-vehicle equipment according to the second control signal. The at least one second interface is used to acquire a first control signal sent by the at least one head-mounted display device for controlling in-vehicle equipment, the first control signal being generated by the at least one head-mounted display device based on the acquired control information; and the first control signal is transmitted to the vehicle-mounted equipment through the first interface to instruct the vehicle-mounted equipment to perform control of the in-vehicle equipment according to the first control signal.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method of claim 9.

Images