Monocular screen projection method in VR scene and virtual reality equipment

Abstract

The invention relates to the technical field of VR, provides a monocular screen projection method in a VR scene and virtual reality equipment, and is used for improving the quality and efficiency of a screen projection picture. According to the method, the aspect ratio of the screen projection camera in the virtual reality equipment is set through the screen resolution and direction of the screen projection equipment, so that the screen projection picture obtained by the screen projection camera can be directly transmitted to the screen projection equipment to be displayed, picture cutting and filling are not needed, the screen projection quality and efficiency are improved, and by setting the field angle of the screen projection camera, the screen projection effect is improved. Therefore, more picture contents are projected to the virtual reality equipment, the screen projection quality is further improved, and a user can obtain better watching experience.

Description

Technical Field

[0001] The present application relates to the field of virtual reality (VR) technology, and provides a monocular screen projection method and a virtual reality device in a VR scene. Background Art

[0002] VR technology uses virtual imaging in three-dimensional space to give people an immersive experience. If you want to watch the content played by the VR device on a projection device (such as a TV, projector, etc.), you can project the screen played by the VR device to the projection device in real time to obtain a larger viewing field. At the same time, other users can also see the content played by the VR device and participate in the VR social experience, obtaining a more realistic shared experience.

[0003] Currently, there are three main ways to project the images played by VR devices to projection devices:

[0004] (1) Cast the screen played by the VR device directly to the projection device, such as Figure 1A As shown, this screen projection method is simple, but because the images played by the VR device are distorted and binocularly displayed, the display effect of directly projecting the screen to the projection device is abnormal;

[0005] (2) Project the image played by the VR device to the middle part of the screen of the projection device, and fill the areas on both sides with black, such as Figure 1B As shown, although this screen projection method is relatively simple to handle, this filling method will reduce the user's sense of immersion.

[0006] (3) According to the screen aspect ratio of the projection device, the screen played by the VR device is captured and displayed on the projection device, such as Figure 1C As shown, the screen projection effect is improved compared to the previous two methods, but image cropping will increase the time consumption of screen projection, and the content displayed on the screen of the projection device after capture is less than the content seen in the VR device.

[0007] Therefore, ensuring the quality of VR projection images while improving the efficiency of VR projection is an urgent problem to be solved in large-screen experience and shared experience. Summary of the invention

[0008] The embodiments of the present application provide a monocular screen projection method and a virtual reality device in a VR scene, which are used to improve the image quality and efficiency of VR screen projection.

[0009] On the one hand, an embodiment of the present application provides a monocular screen projection method in a VR scene, which is applied to a virtual reality device, including:

[0010] After connecting with the screen projection device, obtaining screen information of the screen projection device, wherein the screen of the screen projection device serves as a secondary screen of the virtual reality device, and is used to display the projection screen of the virtual reality device, and the screen information at least includes a first resolution and a direction of the secondary screen;

[0011] According to the screen information, the aspect ratio of the built-in projection camera is set, and the viewport size of the projection camera is obtained in combination with the second resolution of the virtual reality device;

[0012] Create a demonstration object of the secondary screen, and transmit the projection picture obtained by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders the projection picture transmitted by the projection camera to full screen and displays it on the secondary screen.

[0013] On the other hand, an embodiment of the present application provides a virtual reality device, including a processor, a memory, a display, and a communication interface, wherein the communication interface, the display, the memory, and the processor are connected via a bus;

[0014] The memory stores a computer program, and the processor performs the following operations according to the computer program:

[0015] After connecting with the screen projection device through the communication interface, obtaining screen information of the screen projection device, wherein the screen of the screen projection device serves as a sub-screen of the virtual reality device, and is used to display the projection picture displayed by the display, and the screen information at least includes a first resolution and a direction of the sub-screen;

[0016] According to the screen information, the aspect ratio of the built-in projection camera is set, and the viewport size of the projection camera is obtained in combination with the second resolution of the virtual reality device;

[0017] Create a demonstration object of the secondary screen, and transmit the projection picture obtained by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders the projection picture transmitted by the projection camera to full screen and displays it on the secondary screen.

[0018] On the other hand, an embodiment of the present application provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to enable a computer device to execute the steps of a monocular screen projection method in a VR scene provided in an embodiment of the present application.

[0019] The beneficial effects of a monocular screen projection method in a VR scene provided by an embodiment of the present application are as follows:

[0020] In the process of projecting the screen of the virtual reality device to the projection device, the screen of the projection device is used as the sub-screen of the virtual reality device to display the projected screen. By obtaining the first resolution and direction of the sub-screen, setting the aspect ratio of the projection camera built into the virtual reality device, and combining the second resolution of the virtual reality device, the viewport size of the projection camera is obtained. In this way, after obtaining the demonstration object of the sub-screen, the projection screen obtained by the projection camera according to the viewport size can be directly transmitted to the demonstration object without processing the projection screen, which effectively reduces the projection delay. Moreover, since the viewport size is set according to the first resolution and direction of the sub-screen, the demonstration object can render the received projection screen full screen on the sub-screen for display, thereby improving the quality of the projection screen and further improving the user's viewing experience.

[0021] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0023] Figure 1A A schematic diagram of a binocular display effect of direct screen projection provided in an embodiment of the present application;

[0024] Figure 1B A schematic diagram of a screen-filling projection effect provided in an embodiment of the present application;

[0025] Figure 1C A schematic diagram of a screen projection effect of screen cropping provided in an embodiment of the present application;

[0026] Figure 2 A schematic diagram of a wireless screen projection scenario provided in an embodiment of the present application;

[0027] Figure 3 A flowchart of a monocular screen projection method in a VR scene provided in an embodiment of the present application;

[0028] Figure 4 A schematic diagram of the setting interface of the projection camera provided in an embodiment of the present application;

[0029] Figure 5AThis is a projection screen image when the field of view angle of the projection camera provided in the embodiment of the present application is 90 degrees;

[0030] Figure 5B This is a projection screen image when the field of view of the projection camera provided in the embodiment of the present application is 60 degrees;

[0031] Fig. 6A This is a projection screen diagram when the aspect ratio of the projection camera provided in the embodiment of the present application is 1:1;

[0032] Figure 6B This is a projection screen diagram when the aspect ratio of the projection camera provided in the embodiment of the present application is 4:3;

[0033] Figure 7 A complete method flow chart for simultaneously adjusting the screen projection ratio and screen projection range provided in an embodiment of the present application;

[0034] Figure 8 This is a rendering of the effect of projecting the screen displayed by the virtual reality device onto the smart TV provided in the embodiment of the present application;

[0035] Fig. 9 A structural diagram of a virtual reality device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the technical solution of the present application, rather than all of the embodiments. Based on the embodiments recorded in the application documents, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the technical solution of the present application.

[0037] VR projection technology can enable users to have a better large-screen viewing experience. At the same time, it can also realize a social experience shared by multiple people. It has been widely used in various fields such as tourism, education, and games.

[0038] Currently, there are two main ways to project the screen of a VR device to a projection device: wireless projection (e.g., through the Miracast function) and wired projection (e.g., through an HDMI interface).

[0039] Take wireless screen projection as an example. Figure 2 As shown, for a VR device 100 and a smart TV 200 connected to the same WiFi network, a screen projection operation instruction can be executed through the VR device to send the image displayed on the VR device to the smart TV in the form of a video stream, so as to utilize the large screen of the smart TV to obtain a better user experience.

[0040] See also Figure 3 , is a flow chart of a monocular screen projection method in a VR scene provided in an embodiment of the present application. The process is executed by a virtual reality device and mainly includes the following steps:

[0041] S301: After connecting to the screen projection device, obtain screen information of the screen projection device.

[0042] In one example, the virtual reality device can be wirelessly connected to the projection device via Miracast, and can also be wiredly connected to the projection device via HDMI. After the connection is successful, the virtual reality device can project the screen to the projection device.

[0043] Optionally, screen projection devices generally have the advantage of large-screen display, and a better multi-person sharing experience can be obtained through screen projection, including but not limited to smart TVs, projectors, etc.

[0044] Generally, virtual reality devices and screen projection devices are mostly Android systems. When the Android system supports multi-screen display, it includes three types of screens, namely the main screen, the external screen and the virtual screen. Among them, the external screen is the screen connected via HDMI, and the virtual screen is the screen connected via Miracast. The external screen and the virtual screen are collectively referred to as the secondary screen. Therefore, after the connection is successful, the screen of the screen projection device is used as the secondary screen of the virtual reality device to display the screen projection image of the virtual reality device.

[0045] In one example, the screen information of the projection device acquired by the virtual reality device includes at least a first resolution and a direction of the secondary screen.

[0046] S302: According to the screen information, the aspect ratio of the built-in projection camera is set, and the viewport size of the projection camera is obtained in combination with the second resolution of the virtual reality device.

[0047] In the rendering engine of the virtual reality device (such as Unity3D), each monocular screen corresponds to a virtual projection camera. Since the projection device is generally a 2D device, the monocular projection camera can be set according to the screen information of the projection device.

[0048] The first resolution of the secondary screen includes the first horizontal resolution (i.e., width) and the first vertical resolution (i.e., height) of the secondary screen. By obtaining the first resolution, the aspect ratio of the secondary screen can be obtained, and the aspect ratio of the secondary screen is used as the aspect ratio of the projection camera to determine the projection ratio. The display buffer in the virtual reality device includes the second resolution of the virtual reality device itself. Similarly, the second resolution includes the second horizontal resolution and the second vertical resolution, and the ratio of the second horizontal resolution to the second vertical resolution is 1:1, that is, the picture displayed by the virtual reality device is a square.

[0049] In actual applications, the screen resolutions of projection devices are different. For example, the aspect ratio of some secondary screens is 16:9, some is 4:3, and some is 1:. In addition, the direction of the secondary screen will also affect the picture displayed by the projection device. Therefore, the viewport size of the projection camera can be dynamically set according to the actual aspect ratio and direction of the secondary screen.

[0050] like Figure 4 As shown, it is a schematic diagram of the setting interface of the projection camera. The information in ViewportRect can be set according to the aspect ratio of the secondary screen, where X and Y are used to control the starting position of the projection camera viewport, and W and H are used to set the aspect ratio of the projection camera viewport.

[0051] In one example, the resolution of the long side in the aspect ratio of the projection camera is directly set to the resolution of the corresponding direction in the second resolution, and the resolution of the short side in the aspect ratio of the projection camera is determined with reference to the resolution of the long side to obtain the viewport size of the projection camera.

[0052] For example, assuming that the second resolution is 1024*1024 pixels and the aspect ratio of the secondary screen is 4:3, at this time, the width of the viewport of the projection camera is the long side, and the height of the viewport is the short side. Therefore, the width of the viewport (that is, the resolution of the long side) is set to 1024 pixels, and the height of the viewport (that is, the resolution of the short side) is set to 768 pixels, that is, the viewport size is 1024*768 pixels.

[0053] S303: Create a demonstration object for the secondary screen, and transmit the projection image obtained by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders the projection image transmitted by the projection camera on the secondary screen for full-screen display.

[0054] In one example, after the Viewport Rect item of the projection camera is set, the projection camera can obtain the projection screen of the virtual reality device according to the determined viewport size, and transmit the projection screen to the demonstration object of the secondary screen. The demonstration object directly renders the received projection screen in full screen on the secondary screen for display, and there is no need to crop the projection screen of the virtual reality device, which saves the amount of calculation and thus reduces the projection delay. Moreover, since the viewport size of the projection camera is set according to the first resolution and direction of the secondary screen, the demonstration object can render the received projection screen in full screen on the secondary screen for display, thereby improving the quality of the projection screen and further improving the user's viewing experience.

[0055] During screen projection, when setting the projection camera, you can also set the field of view of the projection camera to determine the projection range. For example, by sliding Figure 4Use the scroll bar of Field of View to set the field of view of the projection camera.

[0056] In one example, the field of view angle is used to determine the range of the projection screen captured by the projection camera. The larger the field of view angle, the larger the range of the projection screen, and the more projection content the user sees. On the contrary, the smaller the field of view angle, the smaller the range of the projection screen, and the less projection content the user sees. By increasing the field of view angle of the projection camera, more screen content can be obtained than that displayed by the virtual reality device. In this way, more content can be projected onto the projection device, and the viewing effect is more realistic.

[0057] In actual applications, when the viewport and field of view of the projection camera are set at the same time, the projection camera can obtain the projection image according to the set viewport and field of view. At this time, in step S303, the projection image obtained by the projection camera according to the viewport size and field of view can be transmitted to the demonstration object, and the demonstration object directly renders the received projection image full-screen on the secondary screen for display.

[0058] like Figure 5A Shown and Figure 5B As shown in FIG. 1 , it is a schematic diagram of the effect of adjusting the projection screen range by adjusting the field of view angle of the projection camera, where: Figure 5A When the field of view is 90 degrees, the secondary screen displays the projection image. Figure 5B This is the projection image displayed on the secondary screen when the field of view is 60 degrees. Figure 5A The content of the screen being cast is more than Figure 5B The content of the projected screen is displayed.

[0059] like Fig. 6A Shown and Figure 6B As shown in the figure, it is a schematic diagram of the effect of adjusting the aspect ratio of the projection screen by adjusting the aspect ratio of the projection camera, where: Fig. 6A When the aspect ratio of the viewport is 1:, the secondary screen displays the projection image. Figure 6B When the aspect ratio of the viewport is 4:3, the projection screen displayed on the secondary screen can be seen to adjust the aspect ratio of the viewport. Figure 5B Relative to Figure 5A The content of the projection screen in the height direction remains unchanged, but the content of the screen in the width direction increases.

[0060] In some embodiments, when the virtual object detects that the demonstration object has disappeared, the projection camera is turned off to end the projection to the projection device.

[0061] Take the smart TV as an example, see Figure 7 , which is a flow chart of a complete method for simultaneously adjusting the screen projection ratio and screen projection range provided in an embodiment of the present application, mainly includes the following steps:

[0062] S701: The virtual reality device is connected to the smart TV via Miracast or HDMI, so that the screen of the smart TV is used as a sub-screen of the virtual reality device to display the projected image.

[0063] S702: The virtual reality device obtains the first resolution and direction of the secondary screen through the DisplayManager class.

[0064] Among them, the DisplayManager service is a display device management service, which manages the logical display service in the Android system and mainly responds to the acquisition of display parameters (such as resolution and screen orientation, etc.) and related states (such as connection, disconnection, etc.). Therefore, the virtual reality device can use the DisplayManager class as the management class of the secondary screen to obtain the screen information of the secondary screen.

[0065] S703: The virtual reality device turns on the projection camera and sets the aspect ratio and field of view of the projection camera, wherein the aspect ratio of the projection camera is determined according to the first resolution and direction of the secondary screen.

[0066] S704: The projection camera determines the range of the projection image according to the set field of view angle, and determines the viewport size of the projection image according to the set aspect ratio and its own second resolution.

[0067] S705: The projection camera obtains the projection image according to the determined viewport size and range.

[0068] S706 The virtual reality device creates a DisplayPresentation object of the secondary screen by instantiating the Presentation class.

[0069] Among them, Presentation is a special dialog box used to display content on the secondary screen.

[0070] S707: The virtual reality device transmits the projection image obtained by the projection camera to the DisplayPresentation object.

[0071] S708: The DisplayPresentation object directly renders the received projection image to full screen for display on the secondary screen.

[0072] S709: The virtual reality device detects that the DisplayPresentation object disappears, and turns off the screen projection camera to end the screen projection.

[0073] like Figure 8As shown, this is a diagram of the effect of projecting the picture displayed by the virtual reality device onto the smart TV using the method provided in the embodiment of the present application. By setting the aspect ratio of the projection camera, problems such as black edge filling and picture cropping delay in monocular projection can be solved. By setting the field of view of the projection camera, more picture content can be projected onto the smart TV, allowing users to have a better viewing experience.

[0074] In the implementation of this application, the virtual reality device dynamically adjusts the range and proportion of the projection image obtained by the projection camera by setting the field of view and aspect ratio of the projection camera. In this way, the virtual reality device can directly transmit the projection image obtained by the projection camera according to the set field of view and aspect ratio to the demonstration object on the secondary screen without the need for image cropping, thereby effectively reducing the projection delay. Moreover, since the aspect ratio of the projection camera is set according to the resolution and direction of the secondary screen, the demonstration object can fully display the received projection image on the secondary screen of the virtual reality device without the need for edge filling, thereby improving the projection quality and thereby enhancing the user's viewing experience.

[0075] Based on the same technical concept, an embodiment of the present application provides a virtual reality device, which can implement the steps of the monocular screen projection method in the above-mentioned VR scene and achieve the same technical effect.

[0076] See also Fig. 9 , the virtual reality device includes a processor 901, a memory 902, a display 903 and a communication interface 904, wherein the communication interface 904, the display 903, the memory 902 and the processor 901 are connected via a bus 905;

[0077] The memory 902 stores a computer program, and the processor 901 performs the following operations according to the computer program:

[0078] After connecting with the screen projection device through the communication interface 904, the screen information of the screen projection device is obtained, wherein the screen of the screen projection device serves as the secondary screen of the virtual reality device, and is used to display the projection picture displayed by the display 903, and the screen information at least includes the first resolution and direction of the secondary screen;

[0079] According to the screen information, the aspect ratio of the built-in projection camera is set, and the viewport size of the projection camera is obtained in combination with the second resolution of the virtual reality device;

[0080] Create a demonstration object of the secondary screen, and transmit the projection picture obtained by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders the projection picture transmitted by the projection camera to full screen and displays it on the secondary screen.

[0081] Optionally, the processor 901 further executes: setting a field of view angle of the projection camera, where the field of view angle is used to determine a range of a projection image acquired by the projection camera;

[0082] The processor 901 transmits the projection screen acquired by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders and displays the projection screen transmitted by the projection camera on the secondary screen. The specific operation is:

[0083] The projection image obtained by the projection camera according to the viewport size and the field of view angle is transmitted to the demonstration object, so that the demonstration object directly renders the projection image transmitted by the projection camera to full screen and displays it on the secondary screen.

[0084] Optionally, after connecting to the projection device through the communication interface, the processor 901 obtains screen information of the projection device, and sets the aspect ratio of the built-in projection camera according to the screen information, and obtains the viewport size of the projection camera in combination with the resolution of the projection screen. The specific operations are as follows:

[0085] Obtaining the first resolution and direction of the secondary screen through the DisplayManager class, and obtaining the second resolution of the virtual reality device through the display buffer of the virtual reality device, wherein the ratio of the second horizontal resolution to the second vertical resolution in the second resolution is 1:1;

[0086] Setting the aspect ratio of the projection camera according to the first resolution and orientation of the secondary screen;

[0087] The resolution of the long side in the aspect ratio is directly set to the resolution of the corresponding direction in the second resolution, and the resolution of the short side in the aspect ratio is determined with reference to the resolution of the long side to obtain the viewport size of the projection camera.

[0088] Optionally, the processor 901 further executes:

[0089] When the demonstration object disappears, the projection camera is turned off to end the projection to the projection device.

[0090] Optionally, the connection method between the virtual reality device and the screen projection device includes wired connection or wireless connection.

[0091] in, Fig. 9The memory 902 in the embodiment may be a volatile memory, such as a random-access memory (RAM); the memory 902 may also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD); or the memory 902 may be any other medium that can be used to carry or store a desired computer program in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may be a combination of the above memories; the processor 901 may include one or more central processing units (CPU) or a digital processing unit, etc.

[0092] It should be noted that Fig. 9 This is just an example, and provides the necessary hardware for a virtual reality device to execute the steps of a monocular screen projection method in a VR scene provided in an embodiment of the present application. If not shown, the virtual reality device may also include hardware of a conventional VR device such as a speaker, a microphone, an IMU, a camera, and a power supply.

[0093] An embodiment of the present application also provides a computer-readable storage medium for storing some instructions, which, when executed, can complete a monocular screen projection method in a VR scene in the aforementioned embodiment.

[0094] An embodiment of the present application also provides a computer program product for storing a computer program, wherein the computer program is used to execute a monocular screen projection method in a VR scene in the aforementioned embodiment.

[0095] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0096] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each flow process and / or box in the flow chart and / or block diagram, and the combination of the flow process and / or box in the flow chart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for realizing the function specified in one flow chart or multiple flows and / or one box or multiple boxes in the block diagram.

[0097] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0098] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0099] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A monocular screen projection method in a VR scene, characterized in that: Applied to virtual reality devices, including: After connecting with the screen projection device, obtaining screen information of the screen projection device, wherein the screen of the screen projection device serves as a secondary screen of the virtual reality device, and is used to display the projection screen of the virtual reality device, and the screen information at least includes a first resolution and a direction of the secondary screen; According to the screen information, the aspect ratio of the built-in projection camera is set, and the viewport size of the projection camera is obtained in combination with the second resolution of the virtual reality device; Create a demonstration object of the secondary screen, and transmit the projection picture obtained by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders the projection picture transmitted by the projection camera to full screen and displays it on the secondary screen.

2. The method according to claim 1, characterized in that The method further includes setting a field of view angle of the projection camera, wherein the field of view angle is used to determine a range of a projection image acquired by the projection camera; The step of transmitting the projection screen acquired by the projection camera according to the viewport size to the demonstration object so that the demonstration object directly renders and displays the projection screen transmitted by the projection camera on the secondary screen includes: The projection image obtained by the projection camera according to the viewport size and the field of view angle is transmitted to the demonstration object, so that the demonstration object directly renders the projection image transmitted by the projection camera to full screen and displays it on the secondary screen.

3. The method according to claim 1, characterized in that After connecting to the projection device, the screen information of the projection device is obtained, and according to the screen information, the aspect ratio of the built-in projection camera is set, and the viewport size of the projection camera is obtained in combination with the resolution of the projection screen, including: After connecting with the projection device, the first resolution and direction of the secondary screen are obtained through the DisplayManager class, and the second resolution of the virtual reality device is obtained through the display buffer of the virtual reality device, wherein the ratio of the second horizontal resolution to the second vertical resolution in the second resolution is 1:1; Setting the aspect ratio of the projection camera according to the first resolution and orientation of the secondary screen; The resolution of the long side in the aspect ratio is directly set to the resolution of the corresponding direction in the second resolution, and the resolution of the short side in the aspect ratio is determined with reference to the resolution of the long side to obtain the viewport size of the projection camera.

4. The method according to claim 1, characterized in that The method further comprises: When the demonstration object disappears, the projection camera is turned off to end the projection to the projection device.

5. The method according to any one of claims 1 to 4, characterized in that The connection method between the virtual reality device and the screen projection device includes wired connection or wireless connection.

6. A virtual reality device, characterized in that: It includes a processor, a memory, a display and a communication interface, wherein the communication interface, the display, the memory and the processor are connected via a bus; The memory stores a computer program, and the processor performs the following operations according to the computer program: After connecting with the screen projection device through the communication interface, obtaining screen information of the screen projection device, wherein the screen of the screen projection device serves as a sub-screen of the virtual reality device, and is used to display the projection picture displayed by the display, and the screen information at least includes a first resolution and a direction of the sub-screen; According to the screen information, the aspect ratio of the built-in projection camera is set, and the viewport size of the projection camera is obtained in combination with the second resolution of the virtual reality device; Create a demonstration object of the secondary screen, and transmit the projection picture obtained by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders the projection picture transmitted by the projection camera to full screen and displays it on the secondary screen.

7. The virtual reality device according to claim 6, characterized in that: The processor further executes: setting a field of view angle of the projection camera, where the field of view angle is used to determine a range of a projection image acquired by the projection camera; The processor transmits the projection screen acquired by the projection camera according to the viewport size to the demonstration object, so that the demonstration object directly renders and displays the projection screen transmitted by the projection camera on the secondary screen, and the specific operation is: The projection image obtained by the projection camera according to the viewport size and the field of view angle is transmitted to the demonstration object, so that the demonstration object directly renders the projection image transmitted by the projection camera to full screen and displays it on the secondary screen.

8. The virtual reality device according to claim 6, characterized in that: After connecting to the projection device through the communication interface, the processor obtains the screen information of the projection device, and sets the aspect ratio of the built-in projection camera according to the screen information, and obtains the viewport size of the projection camera in combination with the resolution of the projection screen. The specific operations are as follows: Obtaining the first resolution and direction of the secondary screen through the DisplayManager class, and obtaining the second resolution of the virtual reality device through the display buffer of the virtual reality device, wherein the ratio of the second horizontal resolution to the second vertical resolution in the second resolution is 1:1; Setting the aspect ratio of the projection camera according to the first resolution and orientation of the secondary screen; The resolution of the long side in the aspect ratio is directly set to the resolution of the corresponding direction in the second resolution, and the resolution of the short side in the aspect ratio is determined with reference to the resolution of the long side to obtain the viewport size of the projection camera.

9. The virtual reality device according to claim 6, characterized in that: The processor also executes: When the demonstration object disappears, the projection camera is turned off to end the projection to the projection device.

10. The virtual reality device according to any one of claims 6 to 9, characterized in that: The connection method between the virtual reality device and the screen projection device includes wired connection or wireless connection.

Images