Screen capturing and recording method in virtual world and virtual reality equipment

Abstract

The invention relates to the technical field of VR, and provides a screen capture and recording method in a virtual world and virtual reality equipment, which are used for realizing local screen capture and recording. According to the method, during screen capture and recording, an operation frame changing along with the change of a user viewpoint is displayed in a current virtual picture, so that a target area of screen capture or screen recording meeting requirements can be flexibly selected by adjusting the position information of the user viewpoint relative to the current virtual picture, and local screen capture and recording are realized; and the picture of the target area is displayed on the current virtual picture in an overlapping manner by creating the picture layer, so that the user can preview the effect of the local screen capture and recording, and the accuracy of the local screen capture and recording is ensured. The image layer is hidden after the screen capture and recording operation is received, so that interference to the current virtual picture is avoided, and since the screen capture or recording operation is directly performed on the target area of the current virtual picture, the original resolution of a local screen capture image or a local screen recording image can be ensured, and the quality of the local screen capture image or the local screen recording image is improved.

Description

Technical Field

[0001] The present application relates to the field of virtual reality (VR) technology and provides a method for capturing screen in a virtual world and a virtual reality device. Background Art

[0002] When using VR devices, the virtual world seen by the user is isolated from the real world, and there are obvious differences in the environmental content of the two. When the wearer wants to share the content of the three-dimensional virtual scene currently displayed by the VR device, he can share it by taking screenshots or recording the screen.

[0003] However, since the 3D scene is converted into a 2D image during the screenshot or screen recording process, existing VR / AR devices can only perform global operations on the entire display area of ​​the three-dimensional virtual scene in the wearer's field of view when taking screenshots or screen recordings. In this way, when the wearer wants to share some scene details that need to be highlighted in the field of view, he can only partially crop the global screenshot image or screen recording image, but this will cause the resolution of the shared local screenshot image or screen recording image to decrease, affecting the quality of the shared image, thereby reducing the user experience of the screenshot function. Summary of the invention

[0004] The embodiments of the present application provide a method for capturing screen in a virtual world and a virtual reality device, which are used to realize partial capture or recording of screen while ensuring image resolution.

[0005] On the one hand, an embodiment of the present application provides a method for capturing a screen in a virtual world, comprising:

[0006] Turn on the dynamic screenshot function to display an operation box in the current virtual screen, and the operation box changes with the user's viewpoint;

[0007] In response to a field of view adjustment operation triggered by a user, adjusting position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture;

[0008] A layer is created on the current virtual screen in a direction close to the viewpoint, and another rendering thread is started to render and display the image of the corresponding position of the target area in the current virtual screen in the layer, so that the image of the corresponding position of the target area is superimposed on the current virtual screen for display;

[0009] In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from obstructing the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

[0010] On the other hand, an embodiment of the present application provides a virtual reality device, including a processor, a memory, and a display, wherein the display, the memory, and the processor are connected via a bus:

[0011] The memory stores a computer program, and the processor performs the following operations according to the computer program:

[0012] Turning on the dynamic screenshot function, displaying an operation box in the current virtual screen displayed on the display, wherein the operation box changes as the user's viewpoint changes;

[0013] In response to a field of view adjustment operation triggered by a user, adjusting position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture;

[0014] Creating a layer on the current virtual screen in a direction close to the viewpoint, and starting another rendering thread, rendering a picture of a corresponding position of the target area in the current virtual screen in the layer, and displaying the picture through the display, so that the picture of the corresponding position of the target area is superimposed on the current virtual screen for display;

[0015] In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from obstructing the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

[0016] Optionally, the operation box is displayed in the current virtual screen displayed on the display, and the specific operation is:

[0017] Acquire an initial distance from the user's viewpoint to the current virtual screen, and determine an initial size of the operation box according to the initial distance, so that the user can quickly find the operation box for selecting an area for partial screenshot or partial screen recording in the current virtual screen;

[0018] The operation frame of the initial size is displayed at a preset position of the current virtual screen.

[0019] Optionally, after determining the target area selected by the operation box, the processor further executes:

[0020] The target area selected by the operation box is recorded, and the operation box is hidden.

[0021] Optionally, after the layer is used to overlay the image of the target area selected by the operation box on the current virtual image for display, the processor further executes:

[0022] Start the timer;

[0023] If no screenshot or screen recording operation is received within the preset time, the dynamic screenshot function will be turned off.

[0024] Optionally, after the picture at the position corresponding to the target area is superimposed on the current virtual picture for display, the processor further executes:

[0025] In response to the return operation triggered by the user, the layer is hidden, and the screen at the position corresponding to the target area in the layer is stopped from being displayed, and the display of the operation box is restored in the current virtual screen to redefine the target area.

[0026] Optionally, after hiding the layer and starting to take a partial screenshot or a partial screen recording of the image in the layer, the processor further executes:

[0027] If the number of frames of the saved partial virtual image meets the preset threshold, the dynamic screen capture function is automatically turned off; or

[0028] In response to the stop operation triggered by the user, a prompt box pops up in the current virtual screen, and when the user confirms the content in the prompt box, the dynamic screen capture function is turned off.

[0029] Optionally, after displaying the operation box, the processor further executes:

[0030] In response to the configuration operation triggered by the user, the initial parameters of the operation box are changed according to the target parameters selected by the user, and the reference includes at least color and shape.

[0031] Optionally, the position information includes direction and distance, the size of the operation box is negatively correlated with the distance from the user viewpoint to the current virtual picture, and the moving direction of the operation box is the same as the moving direction of the user viewpoint.

[0032] Optionally, the field of view adjustment operation is implemented through a joystick key of the virtual reality device itself or a joystick key of a handle connected to the virtual reality device, and the screenshot or screen recording operation is implemented through a function key of the virtual reality device itself or a function key of a handle connected to the virtual reality device.

[0033] On the other hand, an embodiment of the present application provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to enable a computer device to execute the steps of a method for capturing screenshots in a virtual world provided in an embodiment of the present application.

[0034] In a method for capturing a screen in a virtual world and a virtual reality device provided by an embodiment of the present application, an operation box is displayed in the current virtual screen by turning on a dynamic capturing function. Since the operation box can change with the change of the user's viewpoint, the user can adjust the position information of the user's viewpoint relative to the current virtual screen by triggering a field of view adjustment operation, so that the user can flexibly select the target area that needs to be captured or recorded according to his own needs, and overlay the image corresponding to the target area selected by the operation box on the current virtual screen by creating a layer. In this way, the user can preview the effect of partial capturing or partial recording, and ensure the accuracy of partial capturing or partial recording. After the user triggers the capturing or recording operation, the layer is hidden to avoid interference with the current virtual screen, and the user's viewing experience is improved during the partial capturing or partial recording process. In addition, since the capturing or recording operation is directly performed on the target area of ​​the current virtual screen, the original resolution of the partial capturing image or partial recording image can be guaranteed, and the quality of the partial capturing image or partial recording image is improved.

[0035] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0037] Figure 1 A schematic diagram of the process of taking a screenshot or recording a screen of the entire display area in a three-dimensional virtual scene;

[0038] Figure 2 This is the effect diagram of taking a screenshot of the entire display area;

[0039] Figure 3 A schematic diagram of the process of dynamically capturing or recording the progress of a local area in a three-dimensional virtual scene;

[0040] Figure 4 A flowchart of a method for capturing a screen shot in a virtual world;

[0041] Figure 5 It is a schematic diagram of the operation box for selecting the target area;

[0042] Figure 6 Adjust schematics for user viewpoint;

[0043] Figure 7 A schematic diagram of the target area for screenshot or screen recording;

[0044] Figure 8 It is a layered display effect diagram of the captured screen image and the current virtual image;

[0045] Fig. 9 This is a schematic diagram of a partial screen shot of a dynamic screenshot;

[0046] Fig.10 A flow chart of a method for taking screenshots of a local area;

[0047] Fig.11 The structure of the virtual reality device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the technical solution of the present application, rather than all of the embodiments. Based on the embodiments recorded in the application documents, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the technical solution of the present application.

[0049] Screen capture and screen recording are very important basic operations in VR / AR devices. Through screenshot or screen recording, the same virtual scene content can be shared with different users. At present, in actual products, VR / AR devices can only perform global screenshot or screen recording operations on the entire display area of ​​the virtual scene in the wearer's field of view.

[0050] like Figure 1 The figure shows a schematic diagram of the global screenshot process of a single field of view. During the rendering and display of the 3D virtual scene in the current field of view, an image of the size of the eye buffer on the screen is obtained, where the size of the eye buffer determines the resolution of the screenshot or screen recording image. When the screenshot or screen recording operation is triggered, a whole image with the same field of view resolution is generated according to the image size corresponding to the eye buffer and written to the file system for storage.

[0051] Take the screenshot operation as an example. Figure 2As shown, when a screenshot operation is triggered for a virtual scene within a monocular field of view, a whole screenshot image having the same resolution as the field of view (eg, 1832*1030 pixels) is generated.

[0052] Since existing VR / AR devices do not provide partial screenshot and partial screen recording functions, when the wearer wants to share some scene details that need to be highlighted in the field of view, he can only partially crop the global screenshot image or screen recording image, but this will cause the resolution of the shared partial screenshot image or screen recording image to decrease, affecting the quality of the shared image, thereby reducing the user experience of the screenshot function.

[0053] In view of this, an embodiment of the present application provides a method for capturing screenshots in a virtual world. For a three-dimensional scene in the virtual world, partial screenshot or partial screen recording operations are implemented through human-computer interaction, and the resolution of the partial screenshot image or screen recording image can be guaranteed.

[0054] The overall architecture of the method for capturing screen in a virtual world provided in the embodiment of the present application is as follows: Figure 3 As shown, in the process of rendering and displaying the three-dimensional virtual scene in the current field of view, an image of the size of the eye buffer on the screen is obtained. When it is necessary to take a screenshot or record a portion of the content of the three-dimensional virtual scene, the distance from the user's viewpoint to the portion of the content is adjusted through human-computer interaction to change the field of view, so that the current field of view can only see a local area in the three-dimensional virtual scene, and a new layer is added to the image corresponding to the local area. By rendering the new layer, a local screenshot image or a local screen recording image corresponding to the field of view angle is generated, and the resolution of the local screenshot image or the local screen recording image can be guaranteed to remain unchanged. Finally, the local screenshot image or the local screen recording image is written to the file system for storage.

[0055] See also Figure 4 , is a flow chart of a method for capturing screen in a virtual world provided in an embodiment of the present application. The process is executed by a virtual reality device and mainly includes the following steps:

[0056] S401: Enable the dynamic screenshot function and display an operation box in the current virtual screen.

[0057] Compared with global screenshot or global recording of the entire display area within the field of view, the dynamic screenshot function can support partial screenshot or partial recording of the three-dimensional virtual scene, and the screenshot or recording area is variable. In this way, the selected screenshot or recording area needs to be indicated.

[0058] In one example, the embodiment of the present application uses an operation box to select a screenshot or screen recording area in a three-dimensional virtual scene, and presents it to the user by displaying it in the current virtual screen. The operation box changes with the change of the user's viewpoint.

[0059] In specific implementation, the initial distance from the user's viewpoint to the current virtual screen is obtained, and based on the visual characteristics of small objects at a distance and large objects at a near distance, the initial size of the operation box is determined according to the initial distance obtained, wherein the operation box is used to select the area for partial screenshot or partial screen recording in the current virtual screen, and the initial size of the operation box is set according to the initial distance from the user's viewpoint to the current virtual screen, so that the operation box is not too large or too small, and the user can quickly find it. After determining the initial size of the operation box, the operation box of the initial size is displayed at a preset position on the current virtual screen.

[0060] Optionally, the initial size of the operation box may also be a preset default value.

[0061] It should be noted that the embodiment of the present application does not impose any restrictive requirements on the preset position of the operation box, which can be the center of the current virtual screen, the four corners of the current virtual screen, or the edge of the current virtual screen.

[0062] like Figure 5 , which is a schematic diagram of the initial display effect of the operation box in the current virtual screen. The rectangular operation box is displayed in the center of the current virtual screen.

[0063] After the operation box is displayed in the current virtual screen, at least one of the color and the shape of the operation box may be adjusted.

[0064] In one example, when the initial color of the operation box is the same as or similar to the color of the current virtual screen, it is not easy for the user to find the operation box. At this time, the user can personalize the operation box by clicking the configuration option of the operation box. The virtual reality device changes the initial color of the operation box according to the target color selected by the user to increase the color difference between the operation box and the current virtual screen, making it easier for the user to watch.

[0065] For example, assuming that the initial color of the operation box is blue, when the user wants to share the blue sky and white clouds in the current virtual screen with other users, since the blue sky is usually blue, it is not convenient for the user to observe the operation box. At this time, the color of the operation box can be changed to red.

[0066] It should be noted that the embodiment of the present application does not make specific requirements on the color of the operation box, including but not limited to blue, red, gray, green, etc.

[0067] In one example, considering that the shapes of objects in the virtual screen are diverse, when the shape of the object that the current user wants to share is quite different from the shape of the operation box, in order to ensure the physical integrity of the sharing, the area selected by the operation box may include some unnecessary pictures. At this time, the user can personalize the operation box by clicking the configuration option of the operation box. The virtual reality device changes the initial shape of the operation box according to the target shape selected by the user so that the shape of the operation box meets the sharing requirements.

[0068] For example, assuming that the initial shape of the operation box is a rectangle, when the user wants to share the triangular iron tower in the current virtual screen with other users, at this time, the shape of the operation box can be changed to a triangle.

[0069] It should be noted that the embodiment of the present application does not make specific requirements on the shape of the operation frame, including but not limited to rectangle, triangle, circle, square, trapezoid, star, and ellipse.

[0070] S402: In response to a field of view adjustment operation triggered by the user, adjust the position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture.

[0071] Based on the visual characteristics of VR devices where objects far away are small and objects near are large, the field of view can be affected by adjusting the position of the user's viewpoint. Figure 6 As shown, when the user's viewpoint is at position A, the current field of view (the area of ​​screenshot or screen recording in the embodiment of the present application) contains three five-pointed stars. Since the parameters of the human eye (such as the size of the field of view angle) are fixed, if the user only wants to share the middle five-pointed star, a feasible solution is to adjust the distance from the user's viewpoint to the five-pointed star, such as position B. At this time, only the local area containing the middle five-pointed star can be seen in the field of view.

[0072] Based on the above principle, the embodiment of the present application can adjust the position information of the user's viewpoint relative to the current virtual screen through user operation, thereby dynamically adjusting the area for screenshot or screen recording. Since the operation box changes with the change of the user's viewpoint, the operation box selects the target area in the current virtual screen that needs to be screenshot or screen recorded.

[0073] In an embodiment of the present application, the position information includes the direction of the user's viewpoint relative to the current virtual screen and the distance from the user's viewpoint to the current virtual screen, wherein the size of the operation box is negatively correlated with the distance from the user's viewpoint to the current virtual screen, that is, the closer the distance from the user's viewpoint to the current virtual screen, the larger the operation box, and the moving direction of the operation box is the same as the moving direction of the user's viewpoint. For example, if the user's viewpoint moves to the upper left relative to the current virtual screen, the operation box also moves to the upper left.

[0074] like Figure 7As shown, it is a rendering of the target area to be screenshot or recorded selected in the operation box in the current virtual screen, and the target area contains the three-dimensional scene content that the user wants to share with other users.

[0075] In an embodiment of the present application, the size of the operation box is less than or equal to the size of the current area screen, and when the two are equal, the effect is consistent with taking a screenshot or recording the entire display area of ​​the three-dimensional virtual scene.

[0076] In one example, the user may use a joystick key to adjust the position information of the user's viewpoint relative to the current virtual screen, wherein the joystick key may be a joystick key of the VR device itself or a joystick key of a handle connected to the VR device.

[0077] In an embodiment of the present application, an operation box that changes with the user's viewpoint is displayed in the current virtual screen. In this way, the position information of the user's viewpoint relative to the current virtual screen can be adjusted, so that the user can flexibly select the target area to be captured or recorded according to their own needs, thereby realizing the local capture or local recording function.

[0078] In one example, after the target area selected by the operation box is determined, the target area selected by the operation box is recorded, including but not limited to the position of the target area, the size of the target area, the aspect ratio of the target area, etc. At the same time, in order to ensure the user's viewing experience, after the target area selected by the operation box is determined, the operation box can also be hidden, and the target area can be directly screenshot or recorded based on the recorded operation box information, thereby preventing the operation box from interfering with the played virtual screen.

[0079] S403: creating a layer on the current virtual screen near the viewpoint direction, and starting another rendering thread, rendering and displaying the image of the corresponding position of the target area in the current virtual screen in the layer, so that the image of the corresponding position of the target area is superimposed on the current virtual screen for display.

[0080] When the target area to be screenshot or recorded is selected, a layer is created for rendering the corresponding position of the target area in the current virtual screen, wherein the layer is located above the current virtual screen close to the viewpoint direction, that is, the layer is located above the layer used to render the current virtual screen, thereby ensuring that the user can preview the screenshot or recording effect.

[0081] After the layer is created, another rendering thread is started to render the image of the corresponding position of the target area in the current virtual screen in this layer. Since this layer is located above the layer of the current virtual screen, the image of the corresponding position of the target area can be superimposed on the current virtual screen for display.

[0082] like Figure 8 As shown, the screen in the target area after screenshot or screen recording is superimposed and displayed in the center on the current virtual screen.

[0083] It should be noted that the embodiment of the present application does not impose any restrictive requirements on the position of the layer. For example, the layer may be located in the middle of the current virtual screen, at the edge of the current virtual screen, or at the four corners of the current virtual screen.

[0084] In an embodiment of the present application, a layer is created to overlay the image of the selected target area on the current virtual image for display, so that the user can preview the effect of the partial screenshot or partial screen recording, thereby ensuring the accuracy of the partial screenshot or partial screen recording.

[0085] In one example, the user can determine whether the screenshot or screen recording area meets the needs based on the display effect of the target area image superimposed on the current virtual screen, and if it does not meet the needs, trigger the return operation through the return key. At this time, the virtual reality device hides the created image and stops displaying the image at the corresponding position of the target area in the layer. At the same time, the display of the operation box is restored in the current virtual screen. In this way, the user can re-select the target area for screenshot or screen recording by re-adjusting the position information of the user's viewpoint relative to the current virtual screen until the user's needs are met.

[0086] S404: In response to a screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to prevent the partial screenshot or partial screen recording operation from blocking the current virtual picture.

[0087] When the user determines that the screenshot or screen recording area meets the needs based on the superimposed display effect, the screenshot or screen recording operation is triggered by pressing a function key (such as an "OK" key or a "Confirm" key).

[0088] Optionally, the function key may be a function key of the virtual reality device itself, or a function key of a handle connected to the virtual reality device.

[0089] After receiving the screenshot or screen recording operation instruction, the virtual reality device hides the created layer in the current virtual screen, and takes a partial screenshot or screen recording of the screen in the layer according to the information of the target area selected by the recorded operation box, obtains a partial virtual screen, and writes the partial virtual screen to the file system for storage. In the formation of partial screenshot or partial screen recording, the created layer can be hidden to avoid the partial screenshot or partial screen recording operation from blocking the current virtual screen, thereby ensuring the normal viewing of the user.

[0090] In the embodiment of the present application, since the current virtual picture and the local virtual picture are in two independent layers and are rendered based on the size of the eye buffer on the screen, respectively, the resolution of the local virtual picture is consistent with the resolution of the current virtual picture.

[0091] like Fig. 9 As shown, based on Figure 7 Schematic diagram of the partial virtual screen captured from the target area selected in the operation box.

[0092] In an embodiment of the present application, after a screenshot or screen recording operation is triggered by the user, the layer is hidden to avoid interference of the screenshot image or screen recording image with the current virtual screen, thereby improving the user's viewing experience. In addition, since the screenshot or screen recording operation is directly performed on the target area of ​​the current virtual screen, compared to cropping the screenshot image or screen recording image of the entire display area of ​​the three-dimensional virtual scene, the resolution of the local screenshot image or the local screen recording image can be ensured to be consistent with the resolution of the current virtual screen, thereby improving the quality of the local screenshot image or the local screen recording image.

[0093] In one example, after the image of the target area selected by the operation box is superimposed on the current virtual image for display, a timer can also be started to count whether a screenshot or screen recording operation triggered by the user is received within a preset time period. If no screenshot or screen recording operation is received, the dynamic screenshot function is turned off to prevent the dynamic screenshot function from being turned on by accident.

[0094] In some embodiments, after hiding the created layer and starting to take a partial screenshot or partial screen recording of the screen in the layer, you can also exit the partial screenshot or partial screen recording operation. Among them, the return method can be automatic exit or active exit. Specifically, before starting a partial screenshot or partial screen recording, the user can set the number of frames for the screenshot or screen recording, so that when the number of frames of the saved partial virtual screen meets the preset number of frames, the virtual reality device can automatically turn off the dynamic screenshot function; or, when the user wants to stop the partial screenshot or partial screen recording, click the stop option to trigger the stop operation. Based on the stop operation, the virtual reality device pops up a prompt box in the current virtual screen to prompt the user whether to exit the partial screenshot or partial screen recording operation. After the user confirms the content in the prompt box, the virtual reality device turns off the dynamic screenshot function.

[0095] In one embodiment, the user can click on the screenshot or screen recording icon in the current virtual screen, such as Figure 5 As shown, the screenshot or screen recording function is switched.

[0096] In the embodiment of the present application, since the layer occupies very few resources, it can be saved in the memory for backup after creation and destroyed when the virtual reality device is shut down.

[0097] The following takes the screenshot process as an example: Fig.10 As shown, it mainly includes the following steps:

[0098] S1001: Enable the screenshot function.

[0099] S1002: Determine whether the dynamic screen capture function is supported, if not, execute S1003, if yes, execute S1004.

[0100] S1003: Take a screenshot of the entire display area, obtain a global screenshot image, and save it.

[0101] S1004: In the current virtual picture, an operation box that changes with the user's viewpoint is displayed according to an initial size corresponding to an initial distance from the user's viewpoint to the current virtual picture.

[0102] S1005: Detect whether the joystick key is pressed, if so, execute S1006, if not, execute S1009.

[0103] S1006: adjusting the position information of the user's viewpoint relative to the current virtual picture according to the joystick key, so that the operation box selects the target area in the current virtual picture.

[0104] S1007: Record the target area selected by the adjusted operation box, and hide the operation box.

[0105] S1008: Create a layer, and use the layer to overlay the image of the target area selected by the operation box on the current virtual image for display.

[0106] S1009: Check whether the confirmation key is pressed, if so, execute S1010, if not, execute S1011.

[0107] S1010: Hide the layer, and take a partial screenshot or a partial screen recording of the target area in the current virtual screen to obtain and save the partial virtual screen.

[0108] S1011: Start the timer.

[0109] S1012: Determine whether the time without receiving the screenshot operation exceeds a preset time period, if so, execute S1013, if not, continue waiting.

[0110] A1013: Disable the dynamic screenshot function.

[0111] Based on the same technical concept, an embodiment of the present application provides a virtual reality device, which can implement the steps of the above-mentioned screenshot method in the virtual world and achieve the same technical effect.

[0112] See also Fig.11 The virtual reality device includes a processor 1101, a memory 1102, and a display 1103. The display 1103, the memory 1102, and the processor 1101 are connected via a bus 1104:

[0113] The memory 1102 stores a computer program, and the processor 1101 performs the following operations according to the computer program:

[0114] The dynamic capture screen function is turned on, and an operation box is displayed in the current virtual screen displayed by the display 1103, and the operation box changes with the change of the user's viewpoint;

[0115] In response to a field of view adjustment operation triggered by the user, adjusting the position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture;

[0116] A layer is created on the current virtual screen near the viewpoint direction, and another rendering thread is started to render the image of the corresponding position of the target area in the current virtual screen in the layer, and the image is displayed through the display 1103, so that the image of the corresponding position of the target area is superimposed on the current virtual screen for display;

[0117] In response to a screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid obstruction of the current virtual picture by the partial screenshot or partial screen recording operation. The resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

[0118] Optionally, an operation box is displayed in the current virtual screen displayed by the display 1103, and the specific operations are:

[0119] Obtaining an initial distance from the user's viewpoint to the current virtual screen, and determining an initial size of the operation box according to the initial distance, so that the user can quickly find the operation box for selecting an area for partial screenshot or partial screen recording in the current virtual screen;

[0120] An operation frame of an initial size is displayed at a preset position of the current virtual screen.

[0121] Optionally, after determining the target area selected by the operation box, the processor 1101 further executes:

[0122] The target area selected by the operation box is recorded and the operation box is hidden.

[0123] Optionally, after the image of the target area selected by the operation box is superimposed on the current virtual image by using a layer for display, the processor 1101 further executes:

[0124] Start the timer;

[0125] If no screenshot or screen recording operation is received within the preset time, the dynamic screenshot function will be turned off.

[0126] Optionally, after the picture at the position corresponding to the target area is superimposed on the current virtual picture for display, the processor 1101 further executes:

[0127] In response to the return operation triggered by the user, the layer is hidden, and the picture at the position corresponding to the target area in the layer is stopped from being displayed, and the display of the operation box is restored in the current virtual picture to redefine the target area.

[0128] Optionally, after hiding the layer and starting to take a partial screenshot or partial screen recording of the image in the layer, the processor 1101 further executes:

[0129] If the number of frames of the saved partial virtual image meets the preset threshold, the dynamic screen capture function is automatically turned off; or

[0130] In response to the stop operation triggered by the user, a prompt box pops up in the current virtual screen. When the user confirms the content in the prompt box, the dynamic screen capture function is turned off.

[0131] Optionally, after the operation box is displayed, the processor 1101 further executes:

[0132] In response to a configuration operation triggered by a user, the initial parameters of the operation box are changed according to the target parameters selected by the user, and the reference includes at least color and shape.

[0133] Optionally, the position information includes direction and distance, the size of the operation box is negatively correlated with the distance from the user's viewpoint to the current virtual screen, and the moving direction of the operation box is the same as the moving direction of the user's viewpoint.

[0134] Optionally, the field of view adjustment operation is implemented through a joystick key of the virtual reality device itself or a joystick key of a handle connected to the virtual reality device, and the screenshot or screen recording operation is implemented through a function key of the virtual reality device itself or a function key of a handle connected to the virtual reality device.

[0135] The memory 1102 may be a volatile memory, such as a random-access memory (RAM); the memory 1102 may also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD); or the memory 1102 may be any other medium that can be used to carry or store a desired computer program in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 1102 may be a combination of the above memories;

[0136] The processor 1101 may include one or more central processing units (CPU) or a digital processing unit, etc.

[0137] It should be noted that Fig.11 This is just an example, and provides the necessary hardware for the virtual reality device to execute the steps of the method for capturing a screenshot in a virtual world provided in the embodiment of the present application. If not shown, the virtual reality device may also include conventional hardware such as a speaker, a pickup, a power supply, and a communication interface.

[0138] A virtual reality device provided by an embodiment of the present application displays an operation box in the current virtual screen by turning on the dynamic screenshot function. Since the operation box can change with the change of the user's viewpoint, the user can adjust the position information of the user's viewpoint relative to the current virtual screen by triggering the field of view adjustment operation, so that the user can flexibly select the target area that needs to be screenshot or recorded according to his own needs, and superimpose the screen of the selected target area on the current virtual screen by creating a layer, so that the user can preview the effect of partial screenshot or partial screen recording to ensure the accuracy of partial screenshot or partial screen recording. After the user triggers the screenshot or screen recording operation, the layer is hidden to avoid interference with the current virtual screen, and the user's viewing experience is improved during the partial screenshot or partial screen recording process. In addition, since the screenshot or screen recording operation is directly performed on the target area of ​​the current virtual screen, the original resolution of the partial screenshot image or partial screen recording image can be guaranteed, and the quality of the partial screenshot image or partial screen recording image is improved.

[0139] The embodiment of the present application also provides a computer-readable storage medium for storing some instructions, which, when executed, can complete the method for capturing screenshots in the virtual world in the aforementioned embodiment.

[0140] The embodiment of the present application also provides a computer program product for storing a computer program, wherein the computer program is used to execute the method for capturing screenshots in a virtual world in the aforementioned embodiment.

[0141] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0142] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0143] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0144] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0145] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A method for capturing a screen in a virtual world, characterized in that: include: Turn on the dynamic screenshot function to display an operation box in the current virtual screen, and the operation box changes with the user's viewpoint; In response to a field of view adjustment operation triggered by a user, adjusting position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture; Creating a layer on the current virtual screen in a direction close to the viewpoint, and starting another rendering thread, rendering and displaying the image of the corresponding position of the target area in the current virtual screen in the layer, so that the image of the corresponding position of the target area is superimposed on the current virtual screen for display; In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from obstructing the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

2. The method according to claim 1, characterized in that The step of displaying the operation box in the current virtual screen includes: Acquire an initial distance from the user's viewpoint to the current virtual screen, and determine an initial size of the operation box according to the initial distance, so that the user can quickly find the operation box for selecting an area for partial screenshot or partial screen recording in the current virtual screen; The operation frame of the initial size is displayed at a preset position of the current virtual screen.

3. The method according to claim 1, characterized in that After determining the target area selected by the operation box, the method further includes: The target area selected by the operation box is recorded, and the operation box is hidden.

4. The method according to claim 1, characterized in that After the layer is used to overlay the image of the target area selected by the operation box on the current virtual image for display, the method further includes: Start the timer; If no screenshot or screen recording operation is received within the preset time, the dynamic screenshot function will be turned off.

5. The method according to claim 1, characterized in that After the picture at the position corresponding to the target area is superimposed on the current virtual picture for display, the method further includes: In response to the return operation triggered by the user, the layer is hidden, and the screen at the position corresponding to the target area in the layer is stopped from being displayed, and the display of the operation box is restored in the current virtual screen to redefine the target area.

6. The method according to claim 1, characterized in that After hiding the layer and starting to take a partial screenshot or a partial screen recording of the image in the layer, the method further includes: If the number of frames of the saved partial virtual image meets the preset threshold, the dynamic screen capture function is automatically turned off; or In response to the stop operation triggered by the user, a prompt box pops up in the current virtual screen, and when the user confirms the content in the prompt box, the dynamic screen capture function is turned off.

7. The method according to claim 1, characterized in that After displaying the operation box, the method further includes: In response to the configuration operation triggered by the user, the initial parameters of the operation box are changed according to the target parameters selected by the user, and the reference includes at least color and shape.

8. The method according to any one of claims 1 to 7, characterized in that The position information includes direction and distance. The size of the operation box is negatively correlated with the distance from the user's viewpoint to the current virtual screen. The moving direction of the operation box is the same as the moving direction of the user's viewpoint.

9. The method according to any one of claims 1 to 7, characterized in that The field of view adjustment operation is implemented through the joystick key of the virtual reality device itself or the joystick key of the handle connected to the virtual reality device, and the screenshot or screen recording operation is implemented through the function key of the virtual reality device itself or the function key of the handle connected to the virtual reality device.

10. A virtual reality device, characterized in that: The device comprises a processor, a memory and a display, wherein the display, the memory and the processor are connected via a bus: The memory stores a computer program, and the processor performs the following operations according to the computer program: Turning on the dynamic screenshot function, displaying an operation box in the current virtual screen displayed on the display, wherein the operation box changes as the user's viewpoint changes; In response to a field of view adjustment operation triggered by a user, adjusting position information of the user's viewpoint relative to the current virtual picture so that the operation box selects a target area in the current virtual picture; Creating a layer on the current virtual screen in a direction close to the viewpoint, and starting another rendering thread, rendering a picture of a corresponding position of the target area in the current virtual screen in the layer, and displaying the picture through the display, so that the picture of the corresponding position of the target area is superimposed on the current virtual screen for display; In response to the screenshot or screen recording operation triggered by the user, a partial screenshot or partial screen recording is performed according to the picture in the layer, a partial virtual picture is obtained and saved, and the layer is hidden to avoid the partial screenshot or partial screen recording operation from obstructing the current virtual picture, and the resolution of the partial virtual picture is consistent with the resolution of the current virtual picture.

Images