Screen capture method in virtual world and virtual reality device

Abstract

The present application relates to the field of VR technology, and provides a method for capturing screenshots in a virtual world and a virtual reality device for realizing partial screenshots. When capturing a screenshot, the method displays an operation box that changes with the user's viewpoint in the current virtual screen, so that the target area for capturing or recording the screen that meets the needs can be flexibly selected by adjusting the position information of the user's viewpoint relative to the current virtual screen, thereby realizing partial screenshots; and by creating a layer, the screen of the target area is superimposed and displayed on the current virtual screen, so that the user can preview the effect of the partial screenshot and ensure the accuracy of the partial screenshot. When the screenshot operation is received, the layer is hidden to avoid interference with the current virtual screen. Since the screenshot or recording operation is directly performed on the target area of ​​the current virtual screen, the original resolution of the partial screenshot image or the partial screen recording image can be guaranteed, thereby improving the quality of the partial screenshot image or the partial screen recording image.

Description

Technical Field

[0001] The present application relates to the field of virtual reality (VR) technology and provides a method for capturing screenshots in a virtual world and a virtual reality device. Background Art

[0002] When using VR devices, the virtual world seen by the user is isolated from the real world, and there are obvious differences in the environmental content of the two. When the wearer wants to share the content of the three-dimensional virtual scene currently displayed by the VR device, he or she can share it by taking screenshots or recording the screen.

[0003] However, due to the conversion of 3D scenes into 2D images during the screenshot or screen recording process, existing VR / AR devices can only perform global operations on the entire display area of ​​the three-dimensional virtual scene in the wearer's field of view when taking screenshots or screen recordings. In this way, when the wearer wants to share some scene details that need to be highlighted in the field of view, he can only partially crop the global screenshot image or screen recording image, but this will cause the resolution of the shared local screenshot image or screen recording image to decrease, affecting the quality of the shared image, thereby reducing the user experience of the screenshot function. Summary of the Invention

[0004] The embodiments of the present application provide a method for capturing screenshots in a virtual world and a virtual reality device, which are used to achieve partial screenshot or screen recording while ensuring image resolution.

[0005] In one aspect, an embodiment of the present application provides a method for capturing a screenshot in a virtual world, comprising:

[0006] Enable the dynamic screenshot function to display an operation box in the current virtual screen, which changes with the user's viewpoint;

[0007] In response to a field of view adjustment operation triggered by the user, adjusting position information of the user's viewpoint relative to the current virtual screen so that the operation box selects a target area in the current virtual screen;

[0008] Creating a layer on the current virtual screen in a direction close to the viewpoint, and starting another rendering thread to render and display the image of the target area at a corresponding position in the current virtual screen in the layer, so that the image of the target area at the corresponding position is superimposed on the current virtual screen for display;

[0009] In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from blocking the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

[0010] On the other hand, an embodiment of the present application provides a virtual reality device, including a processor, a memory, and a display, wherein the display, the memory, and the processor are connected via a bus:

[0011] The memory stores a computer program, and the processor performs the following operations according to the computer program:

[0012] Turning on the dynamic screenshot function to display an operation box in the current virtual screen displayed on the display, wherein the operation box changes as the user's viewpoint changes;

[0013] In response to a field of view adjustment operation triggered by the user, adjusting position information of the user's viewpoint relative to the current virtual screen so that the operation box selects a target area in the current virtual screen;

[0014] Creating a layer on the current virtual screen in a direction close to the viewpoint, and starting another rendering thread, rendering a picture of a corresponding position of the target area in the current virtual screen in the layer, and displaying the picture on the display so that the picture of the corresponding position of the target area is superimposed on the current virtual screen for display;

[0015] In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from blocking the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

[0016] Optionally, the operation box is displayed in the current virtual screen displayed on the display, and the specific operation is:

[0017] Obtaining an initial distance from the user's viewpoint to the current virtual screen, and determining an initial size of the operation box based on the initial distance, so that the user can quickly find the operation box for selecting an area for partial screenshot or partial recording in the current virtual screen;

[0018] The operation frame of the initial size is displayed at a preset position on the current virtual screen.

[0019] Optionally, after determining the target area selected by the operation box, the processor further executes:

[0020] The target area selected by the operation box is recorded, and the operation box is hidden.

[0021] Optionally, after the image of the target area selected by the operation box is superimposed on the current virtual image using the layer for display, the processor further executes:

[0022] Start the timer;

[0023] If no screenshot or screen recording operation is received within the preset time, the dynamic screen recording function will be turned off.

[0024] Optionally, after the image at the position corresponding to the target area is superimposed on the current virtual image for display, the processor further executes:

[0025] In response to the return operation triggered by the user, the layer is hidden, and the screen corresponding to the target area in the layer is stopped from being displayed, and the display of the operation box is restored in the current virtual screen to redefine the target area.

[0026] Optionally, after hiding the layer and starting to take a partial screenshot or partial screen recording of the image in the layer, the processor further executes:

[0027] If the number of frames of the saved partial virtual image meets the preset threshold, the dynamic screen capture function is automatically turned off; or

[0028] In response to the stop operation triggered by the user, a prompt box pops up in the current virtual screen, and when the user confirms the content in the prompt box, the dynamic screen capture function is turned off.

[0029] Optionally, after displaying the operation box, the processor further executes:

[0030] In response to the configuration operation triggered by the user, the initial parameters of the operation box are changed according to the target parameters selected by the user, and the parameters include at least color and shape.

[0031] Optionally, the position information includes direction and distance, the size of the operation box is negatively correlated with the distance from the user viewpoint to the current virtual screen, and the moving direction of the operation box is the same as the moving direction of the user viewpoint.

[0032] Optionally, the field of view adjustment operation is implemented through a joystick key of the virtual reality device itself or a joystick key of a handle connected to the virtual reality device, and the screenshot or screen recording operation is implemented through a function key of the virtual reality device itself or a function key of a handle connected to the virtual reality device.

[0033] On the other hand, an embodiment of the present application provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to enable a computer device to execute the steps of a method for capturing screenshots in a virtual world provided in an embodiment of the present application.

[0034] In a method for capturing a screenshot in a virtual world and a virtual reality device provided by an embodiment of the present application, an operation box is displayed in the current virtual screen by turning on a dynamic screenshot function. Since the operation box can change with the change of the user's viewpoint, the user can adjust the position information of the user's viewpoint relative to the current virtual screen by triggering a field of view adjustment operation, so that the user can flexibly select the target area to be captured or recorded according to their own needs, and superimpose the image corresponding to the target area selected by the operation box on the current virtual screen by creating a layer. In this way, the user can preview the effect of the partial screenshot or partial screen recording, ensuring the accuracy of the partial screenshot or partial screen recording. After the user triggers the screenshot or screen recording operation, the layer is hidden to avoid interference with the current virtual screen, thereby improving the user's viewing experience during the partial screenshot or partial screen recording process. Moreover, since the screenshot or screen recording operation is directly performed on the target area of ​​the current virtual screen, the original resolution of the partial screenshot image or partial screen recording image can be guaranteed, thereby improving the quality of the partial screenshot image or partial screen recording image.

[0035] Other features and advantages of the present application will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present application. The purposes and other advantages of the present application can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0037] Figure 1 A schematic diagram of the process of taking a screenshot or recording the entire display area in a three-dimensional virtual scene;

[0038] Figure 2 This is the effect of taking a screenshot of the entire display area;

[0039] Figure 3 A schematic diagram of the process of dynamically capturing or recording the progress of a local area in a three-dimensional virtual scene;

[0040] Figure 4 A flowchart of a method for capturing screenshots in a virtual world;

[0041] Figure 5 Schematic diagram of the operation box for selecting the target area;

[0042] Figure 6 Adjust schematics for user viewpoint;

[0043] Figure 7 A schematic diagram of the target area for screenshot or screen recording;

[0044] Figure 8 A layered display effect diagram of the captured screen and the current virtual screen;

[0045] Figure 9 This is a schematic diagram of a partial screen shot of a dynamic screenshot;

[0046] Figure 10 A flowchart of a method for taking a screenshot of a local area;

[0047] Figure 11 This is the structure of the virtual reality device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0048] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of the technical solutions of this application, but not all of them. Based on the embodiments described in this application document, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the technical solutions of this application.

[0049] Screen capture and recording are essential operations for VR / AR devices, allowing them to share the same virtual scene content with different users. Currently, in actual products, VR / AR devices can only capture or record the entire display area of ​​the virtual scene within the wearer's field of view.

[0050] like Figure 1 The figure below shows a schematic diagram of the global screenshot process for a single field of view. While rendering and displaying the 3D virtual scene within the current field of view, an image of the size of the eye buffer on the screen is captured. The eye buffer size determines the resolution of the screenshot or recording image. When a screenshot or recording operation is triggered, a full image with the same resolution as the field of view is generated based on the image size corresponding to the eye buffer and written to the file system for storage.

[0051] Take the screenshot operation as an example. Figure 2As shown in the figure, when the screenshot operation of the virtual scene in the monocular field of view is triggered, a screen shot with the same field of view resolution (such as 1832 1030 pixels) for the entire screenshot.

[0052] Since existing VR / AR devices do not provide partial screenshot and partial screen recording functions, when the wearer wants to share some scene details that need to be highlighted in the field of view, he can only partially crop the global screenshot image or screen recording image, but this will cause the resolution of the shared partial screenshot image or screen recording image to decrease, affecting the quality of the shared image, thereby reducing the user experience of the screenshot function.

[0053] In view of this, an embodiment of the present application provides a method for capturing screenshots in a virtual world. For a three-dimensional scene in the virtual world, partial screenshot or partial screen recording operations are implemented through human-computer interaction, and the resolution of the partial screenshot image or screen recording image can be guaranteed.

[0054] The overall architecture of the method for capturing screenshots in a virtual world provided by the embodiment of the present application is shown in FIG. Figure 3 As shown, during the rendering and display of the 3D virtual scene within the current field of view, an image of the size of the on-screen eyebuffer is captured. When a screenshot or recording of a portion of the 3D virtual scene is required, the field of view is altered by adjusting the distance between the user's viewpoint and the content through human-computer interaction, so that only a local area of ​​the 3D virtual scene is visible. A new layer is then added to the image corresponding to this local area. By rendering this new layer, a local screenshot or recording image corresponding to the field of view is generated, ensuring that the resolution of the local screenshot or recording image remains unchanged. Finally, the local screenshot or recording image is written to the file system for storage.

[0055] See also Figure 4 , is a flowchart of a method for capturing screenshots in a virtual world provided by an embodiment of the present application. This process is executed by a virtual reality device and mainly includes the following steps:

[0056] S401: Turn on the dynamic screenshot function and display an operation box in the current virtual screen.

[0057] Compared with global screenshot or global recording of the entire display area within the field of view, the dynamic screenshot function can support local screenshot or local recording of the three-dimensional virtual scene, and the screenshot or recording area is variable. In this way, the selected screenshot or recording area needs to be indicated.

[0058] In one example, an embodiment of the present application uses an operation box to select a screenshot or recording area in a three-dimensional virtual scene and presents it to the user by displaying it in the current virtual screen. The operation box changes as the user's viewpoint changes.

[0059] In specific implementations, the initial distance between the user's viewpoint and the current virtual screen is obtained. Based on the visual characteristic that objects appear smaller when far away and larger when near, the initial size of the operation box is determined based on this initial distance. The operation box is used to select the area within the current virtual screen for partial screenshot or recording. This initial size is set based on the initial distance between the user's viewpoint and the current virtual screen. This ensures that the operation box is neither too large nor too small, making it easier for the user to quickly find it. After determining the initial size of the operation box, the initial-sized operation box is displayed at a preset position on the current virtual screen.

[0060] Optionally, the initial size of the operation box may also be a pre-set default value.

[0061] It should be noted that the embodiment of the present application does not impose any restrictive requirements on the preset position of the operation box. It can be the center of the current virtual screen, the four corners of the current virtual screen, or the edge of the current virtual screen.

[0062] like Figure 5 The figure shows the initial display effect of the operation box in the current virtual screen. The rectangular operation box is displayed in the center of the current virtual screen.

[0063] After the operation box is displayed in the current virtual screen, at least one of the color and shape of the operation box may be adjusted.

[0064] In one example, when the initial color of the operation box is the same as or similar to the color of the current virtual screen, it is not easy for the user to find the operation box. At this time, the user can personalize the operation box by clicking the configuration option of the operation box. The virtual reality device changes the initial color of the operation box according to the target color selected by the user to increase the color difference between the operation box and the current virtual screen, making it easier for the user to watch.

[0065] For example, assuming that the initial color of the operation box is blue, when the user wants to share the blue sky and white clouds in the current virtual screen with other users, since the blue sky is usually blue, it is not convenient for the user to observe the operation box. At this time, the color of the operation box can be changed to red.

[0066] It should be noted that the embodiment of the present application does not make specific requirements on the color of the operation box, including but not limited to blue, red, gray, green, etc.

[0067] In one example, considering that the shapes of objects in the virtual screen are diverse, when the shape of the object the current user wants to share is quite different from the shape of the operation box, in order to ensure the physical integrity of the sharing, the area selected by the operation box may contain some unnecessary pictures. At this time, the user can personalize the operation box by clicking the configuration option of the operation box. The virtual reality device changes the initial shape of the operation box according to the target shape selected by the user so that the shape of the operation box meets the sharing requirements.

[0068] For example, assuming that the initial shape of the operation box is a rectangle, when the user wants to share the triangular iron tower in the current virtual screen with other users, the shape of the operation box can be changed to a triangle.

[0069] It should be noted that the embodiment of the present application does not make specific requirements on the shape of the operation frame, including but not limited to rectangle, triangle, circle, square, trapezoid, star, and ellipse.

[0070] S402: In response to a field of view adjustment operation triggered by the user, adjust the position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture.

[0071] Based on the visual characteristics of VR devices where objects far away appear smaller and objects near appear larger, the field of view can be affected by adjusting the position of the user's viewpoint. For example, Figure 6 As shown, when the user's viewpoint is at position A, the current field of view (the area of ​​screenshot or screen recording in the embodiment of the present application) contains three five-pointed stars. Since the parameters of the human eye (such as the size of the field of view angle) are fixed, if the user only wants to share the middle five-pointed star, a feasible solution is to adjust the distance from the user's viewpoint to the five-pointed star, such as position B. At this time, only the local area containing the middle five-pointed star can be seen in the field of view.

[0072] Based on the above principles, the embodiment of the present application can adjust the position information of the user's viewpoint relative to the current virtual screen through user operation, thereby dynamically adjusting the area for screenshot or screen recording. Because the operation box changes with the change of the user's viewpoint, the operation box selects the target area in the current virtual screen that needs to be screenshot or screen recording.

[0073] In an embodiment of the present application, the position information includes the direction of the user's viewpoint relative to the current virtual screen and the distance from the user's viewpoint to the current virtual screen, wherein the size of the operation box is negatively correlated with the distance from the user's viewpoint to the current virtual screen, that is, the closer the distance from the user's viewpoint to the current virtual screen, the larger the operation box, and the moving direction of the operation box is the same as the moving direction of the user's viewpoint. For example, if the user's viewpoint moves to the upper left relative to the current virtual screen, the operation box also moves to the upper left.

[0074] like Figure 7As shown, it is a rendering of the target area to be screenshot or recorded selected in the operation box in the current virtual screen. The target area contains the three-dimensional scene content that the user wants to share with other users.

[0075] In an embodiment of the present application, the size of the operation box is less than or equal to the size of the current area screen. When the two are equal, the effect is consistent with taking a screenshot or recording the entire display area of ​​the three-dimensional virtual scene.

[0076] In one example, the user can use a joystick key to adjust the position information of the user's viewpoint relative to the current virtual screen, where the joystick key can be a joystick key of the VR device itself or a joystick key of a handle connected to the VR device.

[0077] In an embodiment of the present application, by displaying an operation box that changes with the user's viewpoint in the current virtual screen, the position information of the user's viewpoint relative to the current virtual screen can be adjusted, so that the user can flexibly select the target area to be screenshot or recorded according to their own needs, thereby realizing the local screenshot or local recording function.

[0078] In one example, after the target area selected by the operation box is determined, the target area selected by the operation box is recorded, including but not limited to the location of the target area, the size of the target area, the aspect ratio of the target area, etc. At the same time, to ensure the user's viewing experience, after the target area selected by the operation box is determined, the operation box can also be hidden, and the target area can be captured or recorded directly based on the recorded operation box information, thereby preventing the operation box from interfering with the playing virtual image.

[0079] S403: Create a layer on the current virtual screen near the viewpoint direction, and start another rendering thread, and render and display the image of the corresponding position of the target area in the current virtual screen in the layer, so that the image of the corresponding position of the target area is superimposed on the current virtual screen for display.

[0080] After the target area for screenshot or screen recording is selected, a layer is created for rendering the corresponding position of the target area in the current virtual screen. The layer is located above the current virtual screen near the viewpoint direction, that is, the layer is located above the layer used to render the current virtual screen, thereby ensuring that the user can preview the screenshot or screen recording effect.

[0081] After the layer is created, another rendering thread is started to render the image of the target area at the corresponding position in the current virtual screen into this layer. Since this layer is above the layer of the current virtual screen, the image of the target area at the corresponding position can be superimposed on the current virtual screen for display.

[0082] like Figure 8 As shown, the image in the target area after screenshot or screen recording is superimposed and displayed in the center on the current virtual screen.

[0083] It should be noted that the embodiment of the present application does not impose any restrictive requirements on the position of the layer. For example, it can be located in the middle of the current virtual screen, at the edge of the current virtual screen, or at the four corners of the current virtual screen.

[0084] In an embodiment of the present application, a layer is created to superimpose the image of the selected target area on the current virtual image for display, so that the user can preview the effect of the partial screenshot or partial screen recording, ensuring the accuracy of the partial screenshot or partial screen recording.

[0085] In one example, the user can determine whether the screenshot or recording area meets the requirements based on the display effect of the target area image superimposed on the current virtual screen, and if it does not meet the requirements, trigger the return operation through the return key. At this time, the virtual reality device hides the created image and stops displaying the image corresponding to the target area in the layer. At the same time, the display of the operation box is restored in the current virtual screen. In this way, the user can reselect the target area for screenshot or recording by readjusting the position information of the user's viewpoint relative to the current virtual screen until the user's needs are met.

[0086] S404: In response to the screenshot or screen recording operation triggered by the user, perform a partial screenshot or partial screen recording according to the picture in the layer, obtain and save the partial virtual picture, and hide the layer to avoid the partial screenshot or partial screen recording operation from blocking the current virtual picture.

[0087] When the user determines that the screenshot or screen recording area meets the requirements based on the overlay display effect, the screenshot or screen recording operation is triggered by pressing a function key (such as the "OK" key or the "Confirm" key).

[0088] Optionally, the function key may be a function key of the virtual reality device itself, or a function key of a handle connected to the virtual reality device.

[0089] Upon receiving a screenshot or screen recording operation command, the virtual reality device hides the created layer within the current virtual screen and, based on the target area selected in the recorded operation box, takes a partial screenshot or screen recording of the screen within the layer, obtaining a partial virtual screen. The partial virtual screen is then written to the file system for storage. During the partial screenshot or screen recording operation, the created layer can be hidden to prevent the partial screenshot or screen recording operation from obstructing the current virtual screen, thereby ensuring normal viewing for the user.

[0090] In the embodiment of the present application, since the current virtual screen and the local virtual screen are rendered in two independent layers based on the size of the eye buffer on the screen, the resolution of the local virtual screen is consistent with the resolution of the current virtual screen.

[0091] like Figure 9 As shown, based on Figure 7 Schematic diagram of a partial virtual screen captured from the target area selected in the operation box.

[0092] In an embodiment of the present application, after a screenshot or screen recording operation is triggered by the user, the layer is hidden to avoid interference of the screenshot image or screen recording image with the current virtual screen, thereby improving the user's viewing experience. Moreover, since the screenshot or screen recording operation is performed directly on the target area of ​​the current virtual screen, compared to cropping the screenshot image or screen recording image of the entire display area of ​​the three-dimensional virtual scene, the resolution of the local screenshot image or local screen recording image can be ensured to be consistent with the resolution of the current virtual screen, thereby improving the quality of the local screenshot image or local screen recording image.

[0093] In one example, after the image of the target area selected by the operation box is superimposed on the current virtual image for display, a timer can also be started to count whether a screenshot or screen recording operation triggered by the user is received within a preset time period. If no screenshot or screen recording operation is received, the dynamic screenshot function is turned off to prevent the dynamic screenshot function from being turned on by accident.

[0094] In some embodiments, after hiding the created layer and starting to take a partial screenshot or partial screen recording of the screen in the layer, you can also exit the partial screenshot or partial screen recording operation. Among them, the return method can be automatic exit or active exit. Specifically, before starting a partial screenshot or partial screen recording, the user can set the number of frames for the screenshot or screen recording. In this way, when the number of frames of the saved partial virtual screen meets the preset number of frames, the virtual reality device can automatically turn off the dynamic screenshot function; or, when the user wants to stop the partial screenshot or partial screen recording, click the stop option to trigger the stop operation. Based on the stop operation, the virtual reality device pops up a prompt box in the current virtual screen to prompt the user whether to exit the partial screenshot or partial screen recording operation. After the user confirms the content in the prompt box, the virtual reality device turns off the dynamic screenshot function.

[0095] In one embodiment, the user can click on the screenshot or screen recording icon in the current virtual screen, such as Figure 5 As shown, the screenshot or screen recording function is switched.

[0096] In the embodiment of the present application, since the layer occupies very few resources, it can be saved in the memory for backup after creation and destroyed when the virtual reality device is shut down.

[0097] The following takes the screenshot process as an example: Figure 10 As shown, it mainly includes the following steps:

[0098] S1001: Enable the screenshot function.

[0099] S1002: Determine whether the dynamic screen capture function is supported, if not, execute S1003, if so, execute S1004.

[0100] S1003: Take a screenshot of the entire display area, obtain a global screenshot image, and save it.

[0101] S1004: In the current virtual screen, an operation box that changes with the user's viewpoint is displayed according to an initial size corresponding to an initial distance from the user's viewpoint to the current virtual screen.

[0102] S1005: Detect whether the joystick key is pressed, if so, execute S1006, if not, execute S1009.

[0103] S1006: Adjusting the position information of the user's viewpoint relative to the current virtual screen according to the joystick key, so that the operation box selects the target area in the current virtual screen.

[0104] S1007: Record the target area selected by the adjusted operation box and hide the operation box.

[0105] S1008: Create a layer, and use the layer to overlay the image of the target area selected by the operation box on the current virtual image for display.

[0106] S1009: Check whether the confirmation key is pressed. If so, execute S1010; if not, execute S1011.

[0107] S1010: Hide the layer, and take a partial screenshot or partial screen recording of the target area in the current virtual screen to obtain and save the partial virtual screen.

[0108] S1011: Start the timer.

[0109] S1012: Determine whether the time during which no screenshot operation is received exceeds a preset time period. If so, execute S1013; if not, continue waiting.

[0110] S1013: Disable the dynamic screenshot function.

[0111] Based on the same technical concept, an embodiment of the present application provides a virtual reality device, which can implement the steps of the above-mentioned screenshot method in the virtual world and achieve the same technical effect.

[0112] See also Figure 11 The virtual reality device includes a processor 1101, a memory 1102, and a display 1103. The display 1103, the memory 1102, and the processor 1101 are connected via a bus 1104.

[0113] The memory 1102 stores a computer program, and the processor 1101 performs the following operations according to the computer program:

[0114] The dynamic screenshot function is turned on, and an operation box is displayed in the current virtual screen displayed by the display 1103. The operation box changes as the user's viewpoint changes;

[0115] In response to a field of view adjustment operation triggered by the user, adjusting the position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture;

[0116] A layer is created on the current virtual screen near the viewpoint, and a rendering thread is started. The image of the target area at the corresponding position in the current virtual screen is rendered in the layer, and displayed on the display 1103, so that the image of the target area at the corresponding position is superimposed on the current virtual screen for display;

[0117] In response to a screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from blocking the current virtual picture. The resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

[0118] Optionally, an operation box is displayed in the current virtual screen displayed by the display 1103, and the specific operations are:

[0119] Obtaining the initial distance between the user's viewpoint and the current virtual screen, and determining the initial size of the operation box based on the initial distance, so that the user can quickly find the operation box for selecting the area for partial screenshot or partial recording in the current virtual screen;

[0120] Display the operation frame of the initial size at the preset position of the current virtual screen.

[0121] Optionally, after determining the target area selected by the operation box, the processor 1101 further executes:

[0122] Record the target area selected by the operation box and hide the operation box.

[0123] Optionally, after the image of the target area selected by the operation box is superimposed on the current virtual image by using a layer for display, the processor 1101 further executes:

[0124] Start the timer;

[0125] If no screenshot or screen recording operation is received within the preset time, the dynamic screen recording function will be turned off.

[0126] Optionally, after the image at the position corresponding to the target area is superimposed on the current virtual image for display, the processor 1101 further executes:

[0127] In response to a return operation triggered by the user, the layer is hidden, and the display of the image corresponding to the target area in the layer is stopped, and the display of the operation box is restored in the current virtual image to redefine the target area.

[0128] Optionally, after hiding the layer and starting to take a partial screenshot or partial screen recording of the image in the layer, the processor 1101 further executes:

[0129] If the number of frames of the saved partial virtual image meets the preset threshold, the dynamic screen capture function is automatically turned off; or

[0130] In response to the stop operation triggered by the user, a prompt box pops up in the current virtual screen. When the user confirms the content in the prompt box, the dynamic screen capture function is turned off.

[0131] Optionally, after the operation box is displayed, the processor 1101 further executes:

[0132] In response to a configuration operation triggered by the user, the initial parameters of the operation box are changed according to the target parameters selected by the user, and the parameters include at least color and shape.

[0133] Optionally, the position information includes direction and distance, the size of the operation box is negatively correlated with the distance from the user's viewpoint to the current virtual screen, and the moving direction of the operation box is the same as the moving direction of the user's viewpoint.

[0134] Optionally, the field of view adjustment operation is implemented through the joystick key of the virtual reality device itself or the joystick key of a handle connected to the virtual reality device, and the screenshot or screen recording operation is implemented through the function key of the virtual reality device itself or the function key of the handle connected to the virtual reality device.

[0135] Memory 1102 may be a volatile memory, such as random-access memory (RAM); a non-volatile memory, such as read-only memory, flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or any other medium capable of carrying or storing a desired computer program in the form of instructions or data structures and accessible by a computer, but is not limited thereto. Memory 1102 may be a combination of the aforementioned memories;

[0136] The processor 1101 may include one or more central processing units (CPUs) or a digital processing unit, etc.

[0137] It should be noted that Figure 11 This is merely an example of the hardware necessary for a virtual reality device to execute the steps of the method for capturing screenshots in a virtual world provided by the embodiments of this application. Not shown, the virtual reality device may also include conventional hardware such as a speaker, a microphone, a power supply, and a communication interface.

[0138] The embodiment of the present application provides a virtual reality device that displays an operation box in the current virtual screen by turning on the dynamic screenshot function. Since the operation box can change with the change of the user's viewpoint, the user can adjust the position information of the user's viewpoint relative to the current virtual screen by triggering the field of view adjustment operation, so that the user can flexibly select the target area to be screenshotted or recorded according to their own needs, and superimpose the image of the selected target area on the current virtual screen by creating a layer. In this way, the user can preview the effect of the partial screenshot or partial screen recording, ensuring the accuracy of the partial screenshot or partial screen recording. After the user triggers the screenshot or screen recording operation, the layer is hidden to avoid interference with the current virtual screen, thereby improving the user's viewing experience during the partial screenshot or partial screen recording process. Moreover, since the screenshot or screen recording operation is directly performed on the target area of ​​the current virtual screen, the original resolution of the partial screenshot image or partial screen recording image can be guaranteed, thereby improving the quality of the partial screenshot image or partial screen recording image.

[0139] The embodiment of the present application further provides a computer-readable storage medium for storing some instructions. When these instructions are executed, the method for capturing screenshots in the virtual world in the aforementioned embodiment can be completed.

[0140] An embodiment of the present application further provides a computer program product for storing a computer program, wherein the computer program is used to execute the method for capturing screenshots in a virtual world in the aforementioned embodiment.

[0141] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0142] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0143] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device that implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0144] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0145] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A method for capturing a screenshot in a virtual world, characterized in that: include: Enable the dynamic screenshot function to display an operation box in the current virtual screen, which changes with the user's viewpoint; In response to a field of view adjustment operation triggered by the user, adjusting position information of the user's viewpoint relative to the current virtual screen so that the operation box selects a target area in the current virtual screen; Creating a layer on the current virtual screen in a direction close to the viewpoint, and starting another rendering thread, rendering and displaying the image of the target area at a corresponding position in the current virtual screen in the layer, so that the image at the corresponding position of the target area is superimposed on the current virtual screen for display; In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from blocking the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

2. The method according to claim 1, wherein The displaying of the operation box in the current virtual screen includes: Obtaining an initial distance from the user's viewpoint to the current virtual screen, and determining an initial size of the operation box based on the initial distance, so that the user can quickly find the operation box for selecting an area for partial screenshot or partial recording in the current virtual screen; The operation frame of the initial size is displayed at a preset position on the current virtual screen.

3. The method according to claim 1, wherein After determining the target area selected by the operation box, the method further includes: The target area selected by the operation box is recorded, and the operation box is hidden.

4. The method according to claim 1, wherein After rendering and displaying the image of the target area at a corresponding position in the current virtual image in the layer so that the image of the target area at the corresponding position is superimposed on the current virtual image for display, the method further includes: Start the timer; If no screenshot or screen recording operation is received within the preset time, the dynamic screen recording function will be turned off.

5. The method according to claim 1, wherein After the picture at the position corresponding to the target area is superimposed on the current virtual picture for display, the method further includes: In response to the return operation triggered by the user, the layer is hidden, and the screen corresponding to the target area in the layer is stopped from being displayed, and the display of the operation box is restored in the current virtual screen to redefine the target area.

6. The method according to claim 1, wherein After hiding the layer and starting to take a partial screenshot or partial screen recording of the image in the layer, the method further includes: If the number of frames of the saved partial virtual image meets the preset threshold, the dynamic screen capture function is automatically turned off; or In response to the stop operation triggered by the user, a prompt box pops up in the current virtual screen, and when the user confirms the content in the prompt box, the dynamic screen capture function is turned off.

7. The method according to claim 1, wherein After displaying the operation box, the method further includes: In response to the configuration operation triggered by the user, the initial parameters of the operation box are changed according to the target parameters selected by the user, and the parameters include at least color and shape.

8. The method according to any one of claims 1 to 7, wherein The position information includes direction and distance. The size of the operation box is negatively correlated with the distance from the user viewpoint to the current virtual screen. The moving direction of the operation box is the same as the moving direction of the user viewpoint.

9. The method according to any one of claims 1 to 7, wherein The field of view adjustment operation is implemented through the joystick key of the virtual reality device itself or the joystick key of the handle connected to the virtual reality device, and the screenshot or screen recording operation is implemented through the function key of the virtual reality device itself or the function key of the handle connected to the virtual reality device.

10. A virtual reality device, characterized in that: The system comprises a processor, a memory and a display, wherein the display, the memory and the processor are connected via a bus: The memory stores a computer program, and the processor performs the following operations according to the computer program: Turning on the dynamic screenshot function to display an operation box in the current virtual screen displayed on the display, wherein the operation box changes as the user's viewpoint changes; In response to a field of view adjustment operation triggered by the user, adjusting position information of the user's viewpoint relative to the current virtual screen so that the operation box selects a target area in the current virtual screen; Creating a layer on the current virtual screen in a direction close to the viewpoint, and starting another rendering thread, rendering a picture of a corresponding position of the target area in the current virtual screen in the layer, and displaying the picture on the display so that the picture of the corresponding position of the target area is superimposed on the current virtual screen for display; In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from blocking the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

Images