VR picture display method and system, VR equipment and storage medium

Abstract

The embodiment of the invention provides a VR picture display method and system, VR equipment and a storage medium, and belongs to the technical field of VR. The method comprises the following steps: receiving an operation instruction of a VR object, and changing a display state of the VR object on a screen according to the operation instruction; and generating a VR picture of the VR object in the target display state, and sending the VR picture to a routing device, so that the VR picture is sent to an audience side VR device through the routing device and displayed on the audience side VR device. The method can eliminate the limitation of the number of onlookers, and improves the user experience.

Description

Technical Field

[0001] The present application relates to the field of VR technology, and in particular to a VR picture display method and system, VR equipment and storage medium. Background Art

[0002] Traditional teaching methods are limited to text and pictures. With the development of science and technology, multimedia technologies including VR (Virtual Reality) technology are gradually integrated into teaching activities. Various learning tools enrich teachers' teaching methods and enhance students' interest in learning.

[0003] VR-based devices can simulate real environments and allow operators to operate in an immersive way. For example, operators can interact with the VR all-in-one machine in three dimensions, as if they were actually there. At the same time, the screen can display VR images, supporting multiple people to watch and experience 3D (3-dimension) display effects at the same time.

[0004] However, the screen size of existing VR all-in-one machines is limited and can only accommodate a small number of viewers. When the number of viewers exceeds a certain number, some viewers will not be able to see the screen. In addition, for viewers who are not directly in front of the screen, the 3D display effect is poor and the audience experience is poor. Summary of the invention

[0005] The embodiments of the present application provide a VR screen display method and system, a VR device and a storage medium, which can solve the problem that the number of supported spectators is limited and some viewers have poor viewing experience. To achieve the above purpose, the technical solutions provided by the embodiments of the present application are as follows:

[0006] In a first aspect, a VR picture display method is provided, which is applied to an operating end VR all-in-one machine, and the method includes:

[0007] receiving an operation instruction of a VR object, and changing a display state of the VR object on a screen according to the operation instruction;

[0008] Generate a VR picture of the VR object in a target display state, and send the VR picture to a routing device, so that the VR picture is sent to a viewer-end VR device through the routing device and displayed on the viewer-end VR device.

[0009] In a second aspect, another VR picture display method is provided, which is applied to a VR device at a viewer end, and the method includes:

[0010] Receive the VR picture sent by the routing device, and display the VR picture on the screen of the VR device at the viewer end; wherein the VR picture is sent by the VR all-in-one device at the operating end to the routing device;

[0011] The steps performed by the VR all-in-one operating terminal include:

[0012] Receive an operation instruction of a VR object, and change the display state of the VR object on the screen of the VR all-in-one machine at the operating end according to the operation instruction;

[0013] Acquire the VR picture of the VR object in the target display state, and send the VR picture to the routing device.

[0014] In a third aspect, a VR picture display system is provided, including an operation-end VR all-in-one machine and an audience-end VR device; wherein the operation-end VR all-in-one machine is used to implement the method described in the first aspect, and the audience-end VR device is used to implement the method described in the second aspect.

[0015] In a fourth aspect, a VR device is provided, comprising a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method described in the first aspect or the second aspect.

[0016] According to a fifth aspect, a computer storage medium is provided, wherein the computer storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the method described in the first aspect or the second aspect.

[0017] The embodiment of the present application separates operation from viewing. Specifically, VR operation can be performed on the VR all-in-one machine at the operation end, and the VR screen of the VR all-in-one machine at the operation end can be projected to the VR device at the audience end, and the VR operation can be displayed to the audience through the VR device at the audience end. In this way, the audience no longer has to watch the operator's VR all-in-one machine, and can watch the VR operation demonstration in real time on other terminal devices. On the one hand, the limit on the number of viewers of the existing VR all-in-one machine is eliminated, avoiding repeated operations and wasting resources by the operator. On the other hand, each audience can obtain a better viewing effect through the VR device at the audience end, which improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 A structural diagram of a VR picture display system provided in one embodiment of the present application;

[0020] Figure 2A flowchart of a VR screen display method provided in one embodiment of the present application;

[0021] Figure 3 A timing diagram of a VR screen display method provided in another embodiment of the present application;

[0022] Figure 4 A schematic diagram of horizontal splicing and splitting of dual-viewpoint images provided in one embodiment of the present application;

[0023] Figure 5 A schematic diagram of vertical splicing and splitting of dual-viewpoint images provided in another embodiment of the present application;

[0024] Figure 6 A schematic diagram of nine-grid splicing and splitting of nine-viewpoint images provided in one embodiment of the present application;

[0025] Figure 7 A schematic diagram of image distortion provided by one embodiment of the present application;

[0026] Figure 8 A schematic diagram of the structure of a VR device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0027] The terms "first" and "second" etc. in the specification, claims and the above-mentioned drawings of the embodiments of the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, the process, method, system, product or equipment comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0028] It should be understood that the term "and / or" used in this article is only a way to describe the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. " / " means the relationship of "or".

[0029] In reality, some mechanical equipment has a complex structure, such as automobiles. To demonstrate the disassembly and assembly methods of automobile parts, it is usually necessary to perform disassembly and assembly operations on the parts entity. The cost of physical production or procurement is high, and it is time-consuming and laborious to operate on the entity, and the demonstration effect is not good. With the development of science and technology, VR technology has gradually been integrated into various demonstration activities such as teaching, conferences, lectures, exhibitions, and academic exchanges. VR devices such as VR all-in-one machines, naked-eye 3D large screens, and VR headsets (i.e. virtual reality head-mounted display devices, or VR glasses) have enriched the demonstration form, improved the demonstration efficiency, and enhanced the audience's viewing experience.

[0030] Taking the demonstration of the disassembly and assembly method of a certain automobile engine as an example, the VR all-in-one machine can display the VR picture of the automobile engine on its screen, presenting a 3D display effect. The operator can perform the disassembly and assembly operation of the automobile engine on the VR all-in-one machine, and the audience can watch the VR operation process in real time through the screen of the VR all-in-one machine, making the abstract concept concrete and tangible, which can improve the quality of the demonstration. However, the screen size of the existing VR all-in-one machine is limited and can only be watched by a small number of viewers. When the number of viewers exceeds a certain number, some viewers will not be able to see the screen. In this way, the operator must repeatedly operate the VR interactive all-in-one machine to meet the viewing needs of many viewers, which is time-consuming and laborious. In addition, for viewers who are not directly in front of the screen, the 3D display effect is not good and the audience experience is poor.

[0031] Based on this, the embodiments of the present application provide a VR screen display method and system, VR device and storage medium. The VR screen of the operator's VR all-in-one machine is projected to other VR devices for the audience to watch. In this way, the spectator limit of the existing VR all-in-one machine is eliminated, the operator is prevented from repeating operations and wasting resources, and each audience can obtain a better viewing effect through the audience-side VR device, thereby improving the user experience.

[0032] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0033] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0034] See also Figure 1, a VR screen display system provided by one embodiment of the present application may include an operating-end VR all-in-one machine and an audience-end VR device, and realize data interaction between the operating-end VR all-in-one machine and the audience-end VR device through a routing device. Among them, the audience-end VR device may be any one or more VR devices among a VR all-in-one machine, a naked-eye 3D large screen and a VR head display. And there may be one or more VR devices at the audience end. It can be understood that the VR screen display system provided by the embodiment of the present application can support one-to-one screen projection, and can also support one-to-many screen projection. In other words, the operating-end VR all-in-one machine can project the VR screen to one audience-end VR device, or it can project the VR screen to multiple audience-end VR devices at the same time. The category and quantity of the audience-end VR device can be set and adjusted according to demand, and this application does not limit this.

[0035] In one embodiment, see Figure 2 The VR screen display method provided in this application may include the following steps:

[0036] S100: The operating end VR all-in-one machine receives an operation instruction of a VR object, and changes a display state of the VR object on the screen according to the operation instruction.

[0037] In implementation, the VR all-in-one machine at the operating end can display the VR screen of the VR object on the screen in real time. When the operator interacts with the VR all-in-one machine, the VR object can be touched, rotated, dragged and other VR operations can be performed through the control components of the VR all-in-one machine (for example, a three-dimensional control pen). When any VR operation is performed on a VR object, the control component of the VR all-in-one machine at the operating end can generate a corresponding operation instruction and transmit the operation instruction to the VR all-in-one machine, and the VR all-in-one machine can change the display state of the VR object on the screen according to the operation instruction. Among them, the VR object can be any virtual object, such as a car, auto parts, experimental equipment, etc.; the change of display state can refer to the change of color, position, size, assembly relationship of parts and components of the VR object, etc.

[0038] Taking the rotation operation of a car engine as an example, the operator can send a rotation operation instruction to the VR all-in-one machine at the operating end through a three-dimensional control pen. After receiving the rotation instruction, the VR all-in-one machine at the operating end displays the entire rotation process of the car engine on the screen in real time. During the entire rotation process, the VR all-in-one machine at the operating end can generate multiple frames of VR images, and different frames of VR images can correspond to different display states. For example, the VR all-in-one machine at the operating end generates 100 frames of VR images during a rotation operation, and these 100 frames of VR images can correspond to 100 display states respectively. For the sake of ease of understanding and description, any display state of a VR object during the change process can be called a target display state.

[0039] S200: The VR all-in-one machine at the operating end generates a VR picture of the VR object in a target display state, and sends the VR picture to the routing device.

[0040] In implementation, the operating-end VR all-in-one machine can display VR objects on its screen in real time, and can generate VR images displayed on the screen in real time, and send these VR images to the routing device so that the VR images of the VR objects can be projected to each audience-end VR device through the routing device.

[0041] In one embodiment, the VR all-in-one machine at the operating end can send all the multiple frames of VR images generated during a VR operation to the routing device. In this way, the VR device at the viewer end can obtain all the continuously changing VR images through the routing device, thereby displaying a higher quality VR video.

[0042] In another embodiment, in order to reduce the amount of transmitted data, the VR all-in-one machine at the operating end may also only send VR images of key frames, and the display state corresponding to the key frames may be referred to as the key display state. Specifically, in the process of the VR all-in-one machine at the operating end changing the display state of the VR object based on the received operation instructions, the VR object has multiple display states that change continuously. The VR all-in-one machine at the operating end may only generate the key VR images of the VR object in the key display state, and send the key frame VR images corresponding to the key display state to the routing device. Among them, the frequency of selecting key frames can be pre-set according to the experience of technical personnel, or it can be set according to the frame rate (or refresh rate) requirements of the VR device at the audience end, and this application is not limited here.

[0043] For example, when operating on the VR all-in-one machine at the operating end and rotating the VR object by 30°, the VR all-in-one machine at the operating end can rotate the VR object by 1° each time. After 30 consecutive rotation changes, the VR object rotated by 30° is finally presented. In this way, for this operation, the VR object can have 30 continuously changing display states, and the VR all-in-one machine at the operating end can generate and display 30 frames of VR images in sequence. In order to reduce the amount of transmitted data, the number of displayed frames can be appropriately reduced. Specifically, the display state corresponding to each 5° rotation of the VR object is used as a key display state, and the VR image in each key display state is sent to the routing device as a key frame VR image. In this way, the viewer-end device can obtain 6 frames of key frame VR images that change in sequence from the routing device and display them.

[0044] It is worth mentioning that in some application scenarios where the smoothness of the VR object's picture changes is not high, the viewer's end device can directly display the acquired key frame VR picture. Of course, in order to improve the smoothness of the picture changes, the viewer's end device can also use the software that automatically adds intermediate frames to create and add intermediate frames between two adjacent key frames, and then display each key frame VR picture and the intermediate frame VR picture to the audience in sequence.

[0045] In one embodiment, the VR images used for screen projection may be multiple projection images of the VR object at preset viewpoints. Figure 3 , step S200 may include:

[0046] S210, generating a plurality of projection images of the VR object at preset viewpoints in a target display state according to the transformation of the display state of the VR object;

[0047] S220, stitching the multiple projection images into a single image according to a preset stitching rule;

[0048] S230: Send the single image to the routing device.

[0049] In practice, the VR all-in-one machine at the operating end can upload data to the routing device. Due to unreliable factors such as delay and jitter in network transmission, sending multiple projected images in the same display state separately may cause the images to be out of order or missing. Based on this, VR images from multiple perspectives in the same display state can be spliced ​​into one picture, and the spliced ​​picture can be sent to the routing device. This ensures that multiple projected images in the same display state can be transmitted simultaneously, thereby ensuring that each frame of the VR picture is displayed normally in sequence on the VR device at the viewer end.

[0050] It is worth mentioning that VR devices such as VR all-in-one machines, VR head displays, and naked-eye 3D large screens can present a three-dimensional effect. The basic principle is usually to use binocular parallax. Various VR devices can simultaneously display two images with parallax for the left and right eyes. The left eye of the operator and the audience will see the left eye image, and the right eye will see the right eye image, thus forming a three-dimensional visual effect. Among them, the left eye image can be understood as the projected image of the VR object visible to the left eye, and the right eye image can be understood as the projected image of the VR object visible to the right eye.

[0051] It is worth mentioning that generating two images with parallax can be understood as placing the mobile phone at the position of the left eye of a person, taking a photo to obtain the left eye image, that is, obtaining the projection image of the VR object along the left eye to the VR object, and then placing the mobile phone at the position of the right eye of a person, taking a photo to obtain the right eye image, that is, obtaining the projection image of the VR object along the right eye to the VR object. For the convenience of description, the two images with binocular parallax for left eye and right eye viewing are collectively referred to as binocular parallax images.

[0052] In one embodiment, the viewer-side VR device may include an all-in-one VR device and / or a VR headset. The VR image is a binocular parallax image, and the preset stitching rule includes stitching the left-eye image and the right-eye image in a first preset direction. Refer to Figure 4 , the first preset direction may be the horizontal direction. Correspondingly, the preset stitching rule may be to stitch the left-eye image and the right-eye image in the horizontal direction, that is, the width of the VR image becomes twice that of a single projection image. Refer to Figure 5 , the first preset direction may be the vertical direction. Correspondingly, the preset stitching rule may also be to stitch the left-eye image and the right-eye image in the vertical direction, that is, the height of the VR image becomes twice that of a single projection image. Of course, other preset stitching rules may also be used to stitch multiple projection images of the preset viewpoints, and the present application does not limit this.

[0053] In practice, a certain model of the viewer-side all-in-one VR device adopts polarized 3D display technology, and the viewer can view the screen of the all-in-one VR device through polarized lenses. A certain model of VR headset can display the left-eye image and the right-eye image through the left-eye screen and the right-eye screen respectively. In this way, the left-eye image will enter the viewer's left eye, and the right-eye image will enter the viewer's right eye, thus presenting a stereoscopic VR image.

[0054] In one embodiment, the viewer-side VR device may include a naked-eye 3D large screen. Since the naked-eye 3D large screen can support a large number of viewers to watch, there may be significant differences in the positions of different viewers, and the viewers can move in front of the naked-eye 3D large screen. In order to ensure that a better 3D viewing effect can be obtained in the conical area directly in front of the naked-eye 3D large screen, multiple preset viewpoints may be set. In this way, the operator-side all-in-one VR device can simultaneously generate multiple VR images corresponding to multiple preset viewpoints, and then stitch the multiple VR images into one image according to the preset stitching rule for transmission.

[0055] For example, the preset viewpoints may be nine. Refer to Figure 6 , the preset stitching rule may include stitching the VR images of the VR object at the nine preset viewpoints in a nine-square grid (i.e., the "well" character), that is, both the width and height of the VR image become three times that of a single projection image. Again, for example, the preset viewpoints may be four, then the preset stitching rule may include stitching the VR images of the VR object at the four preset viewpoints in a four-square grid (i.e., the "field" character). Of course, the VR images at multiple viewpoints may also be stitched using other stitching rules, such as horizontal stitching or vertical stitching, and the present application does not limit this.

[0056] In one embodiment, the VR all-in-one machine at the operating end can generate nine VR images based on nine preset viewpoints. It can be understood that nine projection images are taken of the three-dimensional object at nine different positions. Afterwards, the nine projection images can be spliced ​​into a single image, and subsequent processing can be performed based on the single image.

[0057] In another embodiment, the naked eye 3D large screen can also perform 3D stereoscopic display based on binocular parallax. For the VR screen corresponding to each viewpoint, the VR all-in-one machine at the operating end can generate binocular parallax images. In addition, the VR all-in-one machine at the operating end can follow the above-mentioned splicing rules for binocular parallax images, for example Figure 4 The horizontal stitching rules shown or Figure 5 The vertical stitching rule shown is used to stitch the binocular disparity images corresponding to each viewpoint.

[0058] In one embodiment, encoding the VR images, that is, compressing the VR images to a certain extent, can reduce the amount of data and speed up network transmission. Based on this, the VR all-in-one machine at the operating end can encode the generated VR images in each display state and send them to the routing device in sequence, or encode a group of VR images in multiple display states at one time and send them to the routing device together.

[0059] If the operating-end VR all-in-one sends a group of VR images to the routing device at one time, step S200 may specifically include: generating a group of VR images of the VR object in multiple display states that change continuously; encoding the group of VR images according to preset encoding and decoding rules to obtain a group of encoded VR images; sending the group of encoded VR images to the routing device, so that the group of encoded VR images are sent to the viewer-end VR device through the routing device, and are decoded and displayed on the viewer-end VR device according to the preset encoding and decoding rules.

[0060] It is worth mentioning that when encoding a group of VR pictures, if the data changes of each VR picture are small, the amount of data after encoding will be correspondingly smaller, which is significantly lower than encoding multiple VR pictures separately, further reducing the amount of data transmitted during the screen projection process.

[0061] In implementation, the encoding format may be H264, etc., and this application does not limit this. Taking the H264 encoding format as an example, the preset encoding and decoding rule may be to encode the original format data into the H264 format, and decode the H264 format data into the original format.

[0062] For example, the VR picture generated by the VR all-in-one machine at the operating end can be in YUV format, and the data in YUV format can be encoded into H264 and sent to the routing device, so that a set of VR pictures encoded in H264 format is sent to the VR device at the viewer end through the routing device. After receiving the data in H264 format (i.e., the encoded VR picture), the VR device at the viewer end can decode the data in H264 format according to the preset encoding and decoding rules to obtain the original VR picture in YUV format. In other words, the VR device at the viewer end can decompress the compressed VR picture to obtain the original image. Afterwards, the VR device at the viewer end can display the decoded VR picture to present a stereoscopic display effect.

[0063] S300: The routing device sends the VR image to the VR device at the viewer end.

[0064] In implementation, the audience-side VR device can download data from the routing device. The routing device can be a router or a switch, which can play the role of transferring data between the operating-side VR all-in-one machine and the audience-side VR device. It can be understood that the operating-side VR all-in-one machine and the audience-side VR device are connected to the same local area network through the routing device, and support the same screen projection protocol, thereby realizing the screen projection of the operating-side VR all-in-one machine to the audience-side VR device. Among them, the screen projection protocol may include DLNA, Miracast, airplay, etc., which is not limited in this application.

[0065] S400: The VR device at the audience end displays the VR image on the screen.

[0066] In implementation, the VR device at the audience end can receive the VR picture sent by the routing device, and display the VR picture on the screen of the VR device at the audience end. When the VR device at the audience end is a VR all-in-one machine, the VR picture can be obtained through the windows specific API, and finally two binocular parallax images can be displayed on the screen to present a stereoscopic effect.

[0067] In one embodiment, see Figure 3 In one embodiment, the VR screen received by the VR device at the viewer end may be a plurality of projection images of the VR object at a preset viewpoint, and the plurality of projection images are spliced ​​into a single image by the VR all-in-one device at the operating end according to a preset splicing rule and then sent to the routing device. Accordingly, step S400 may specifically include:

[0068] S410, splitting a single image into multiple projection images according to a preset splitting rule corresponding to the preset splicing rule;

[0069] S420: Display multiple projection images on the screen.

[0070] In implementation, after receiving the VR picture sent by the router, the VR device at the viewer end can split the single image into multiple projection images according to the preset splitting rules corresponding to the preset splicing rules, and display the multiple projection images obtained on its screen at the same time.

[0071] In one embodiment, the multiple projection images of the VR object at the preset viewpoints may be binocular parallax images. Figure 4 ,If the left-eye image and the right-eye image of the VR all-in-one machine at the operating end are spliced ​​in the horizontal direction, the VR device at the viewer end will split the single image horizontally into the left-eye image and the right-eye image.

[0072] For example, see Figure 5 If the left-eye image and the right-eye image of the VR all-in-one machine at the operating end are spliced ​​in the vertical direction, the VR device at the viewer end will vertically split the single image into the left-eye image and the right-eye image.

[0073] In one embodiment, there may be nine preset viewpoints, and the preset splicing rule of the VR all-in-one machine at the operating end may include splicing the VR images of the VR object at the nine preset viewpoints according to a nine-square grid. Correspondingly, the preset splitting rule of the VR device at the viewer end may include splitting the single image into nine VR images of different viewpoints according to a nine-square grid.

[0074] In one embodiment, the VR all-in-one machine at the operating end can send a group of VR images to the routing device at one time, and the routing device can send the received group of encoded VR images to the VR device at the viewer end. Accordingly, step S400 may include: decoding the group of encoded VR images according to the preset encoding and decoding rules to obtain a group of decoded VR images; and sequentially displaying the group of decoded VR images on the screen of the VR device at the viewer end.

[0075] In implementation, the preset encoding and decoding rule may be to encode the original format data into the H264 format, and decode the H264 format data into the original format. That is, the operating end VR all-in-one machine may encode a set of original format VR images into the H264 format, and correspondingly, the viewer end VR device may decode the received H264 format VR images into the original format for subsequent processing.

[0076] In one embodiment, the audience-side VR device may include a VR head-mounted display. Figure 7Since the screen of the VR headset is very close to the human eye, in order to make people see clearly, the VR headset is equipped with a lens in front of the screen. The picture seen through the lens will produce pincushion distortion, so the image is barrel distorted in advance, and a normal image can be seen after passing through the lens. Accordingly, step S400 may include: performing barrel distortion processing on the multiple projected images to obtain multiple barrel distorted images; and displaying the multiple barrel distorted images on the screen of the VR device at the viewer end.

[0077] In implementation, the VR headset can convert the received normal image into a barrel-distorted image based on an algorithm adapted thereto. Afterwards, the barrel-distorted image will undergo a pincushion distortion in the VR headset, thereby ultimately presenting a normal stereoscopic effect. Different VR headset manufacturers or different models of VR headsets may use different barrel distortion algorithms, which are not limited in this application.

[0078] In one embodiment, the VR device at the audience end may include a naked-eye 3D large screen. The VR all-in-one machine at the operating end may generate VR images of multiple viewpoints for display on the naked-eye 3D large screen. Accordingly, step S400 may include: interlacing the multiple projection images corresponding to the multiple preset viewpoints to obtain an interlaced image; and displaying the interlaced image on the screen of the VR device at the audience end.

[0079] In practice, the naked-eye 3D large screen can interleave the VR images received from multiple viewpoints based on an algorithm adapted thereto, and display the interleaved images obtained after the interleaving process on the screen of the VR device at the viewer end. In this way, the naked-eye 3D large screen will support multi-viewing, and viewers at different positions in front of the naked-eye 3D large screen can all obtain a better viewing experience.

[0080] By adopting this application, operation and viewing can be separated. Specifically, VR operation can be performed on the VR all-in-one machine at the operating end, and the VR screen of the VR all-in-one machine at the operating end can be projected to the VR device at the audience end, and the VR operation can be displayed to the audience through the VR device at the audience end. In this way, the audience no longer has to watch the operator's VR all-in-one machine, and can watch the VR operation demonstration in real time on other terminal devices. On the one hand, the limit on the number of onlookers of the existing VR all-in-one machine is eliminated, avoiding repeated operations and waste of resources by the operator. On the other hand, each audience can obtain a better viewing effect through the VR device at the audience end, which improves the user experience.

[0081] Based on the same technical concept, the present application embodiment also provides a VR device. Figure 8 The VR device may include a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor to perform the processing of the above-mentioned operation-end VR all-in-one machine or the audience-end VR device.

[0082] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware. Based on this understanding, the above technical solution can essentially or contribute to the prior art in the form of a software product. The software product that implements VR screen display can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including storing a number of instructions to enable a VR device to execute the methods described in each embodiment or some parts of the embodiments.

[0083] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A VR picture display method, characterized in that: Applied to the operating end VR all-in-one machine, the method includes: receiving an operation instruction of a VR object, and changing a display state of the VR object on a screen according to the operation instruction; Generate a VR picture of the VR object in a target display state, and send the VR picture to a routing device, so that the VR picture is sent to a viewer-end VR device through the routing device and displayed on the viewer-end VR device.

2. The method according to claim 1, characterized in that The VR screen is a plurality of projection images of the VR object at a preset viewpoint; The generating a VR picture of the VR object in a target display state and sending the VR picture to a routing device comprises: Generating the plurality of projection images of the VR object in a target display state according to the transformation of the display state of the VR object; The plurality of projection images are spliced ​​into a single image according to a preset splicing rule, and the single image is sent to the routing device.

3. The method according to claim 2, characterized in that The VR picture is a left-eye image and a right-eye image with binocular parallax, and the preset splicing rule includes splicing the left-eye image and the right-eye image in a horizontal direction or in a vertical direction.

4. The method according to claim 2, characterized in that: There are multiple preset viewpoints; and the preset splicing rule includes splicing the VR images of the VR object at the multiple preset viewpoints in a multi-grid manner.

5. The method according to claim 1, characterized in that: The step of generating a VR picture of the VR object in a target display state and sending the VR picture to a routing device so that the VR picture is sent to a viewer-end VR device through the routing device and displayed on the viewer-end VR device comprises: generating a set of VR images of the VR object in a plurality of continuously changing display states; Encoding the set of VR pictures according to a preset encoding and decoding rule to obtain a set of encoded VR pictures; The set of encoded VR images is sent to a routing device, so that the set of encoded VR images is sent to a viewer-end VR device through the routing device, and is decoded and displayed on the viewer-end VR device according to the preset encoding and decoding rules.

6. The method according to claim 1, characterized in that In the process of the operating-end VR all-in-one machine changing the display state of the VR object based on the operation instruction, the VR object has multiple display states that change continuously, the target display state is a key display state among the multiple display states, and the VR picture of the VR object in the target display state is a key frame VR picture corresponding to the key display state.

7. A VR picture display method, characterized in that: Applied to a VR device at the audience end, the method includes: Receive the VR picture sent by the routing device, and display the VR picture on the screen of the VR device at the viewer end; wherein the VR picture is sent by the VR all-in-one device at the operating end to the routing device; The steps performed by the VR all-in-one operating terminal include: Receive an operation instruction of a VR object, and change the display state of the VR object on the screen of the VR all-in-one machine at the operating end according to the operation instruction; Generate the VR picture of the VR object in the target display state, and send the VR picture to the routing device.

8. The method according to claim 7, characterized in that The VR screen is a plurality of projection images of the VR object at a preset viewpoint, and the plurality of projection images are spliced ​​into a single image by the VR all-in-one machine at the operating end according to a preset splicing rule and then sent to the routing device; The receiving of the VR picture sent by the routing device and displaying the VR picture on the screen of the VR device at the viewer end includes: receiving the single image sent by the routing device, and splitting the single image into a plurality of projection images according to a preset splitting rule corresponding to the preset splicing rule; Display a plurality of the projection images on the screen of the VR device at the audience end.

9. The method according to claim 8, characterized in that The VR picture is a left-eye image and a right-eye image with binocular parallax, and the preset splitting rule is to splice the single image in the horizontal direction or split it into the left-eye image and the right-eye image in the vertical direction.

10. The method according to claim 8, characterized in that There are multiple preset viewpoints; and the preset splitting rule includes splitting the single image into multiple VR images with different viewpoints according to multiple grids.

11. The method according to claim 7, characterized in that The receiving of the VR picture sent by the routing device and displaying the VR picture on the screen of the VR device at the viewer end includes: Receiving a group of encoded VR pictures sent by the routing device; Decoding the set of encoded VR pictures according to a preset encoding and decoding rule to obtain a set of decoded VR pictures; The set of decoded VR images are sequentially displayed on the screen of the VR device at the viewer end.

12. The method according to claim 8, characterized in that The displaying of the plurality of projection images on the screen of the VR device at the audience end includes: Performing barrel distortion processing on the plurality of projection images to obtain a plurality of barrel distorted images; A plurality of the barrel-distorted images are displayed on the screen of the VR device at the viewer end.

13. The method according to claim 8, characterized in that The preset viewpoints are multiple; and the displaying of the multiple projection images on the screen of the VR device at the viewer end includes: Interweaving the plurality of projection images corresponding to the plurality of preset viewpoints to obtain an interleaved image; The interlaced image is displayed on the screen of the VR device at the audience end.

14. A VR picture display system, characterized in that: It includes an operating-end VR all-in-one machine and an audience-end VR device; wherein the operating-end VR all-in-one machine is used to implement the method described in any one of claims 1-6, and the audience-end VR device is used to implement the method described in any one of claims 7-13.

15. A VR device, characterized in that: It comprises a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method according to any one of claims 1-6 and 7-13.

16. A computer storage medium, characterized in that: The computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method according to any one of claims 1-6 and 7-13.

Images