Picture screenshot method and device, head-mounted virtual reality device and storage medium

Abstract

The application discloses a picture screenshot method and device, a head-mounted virtual reality device and a storage medium, which are used for ensuring the accuracy of the screenshot and the non-deviation of the screenshot picture. The application determines a collection angle value based on a rotation angle value of the head-mounted virtual reality device in response to a screenshot operation triggered by a user, and adjusts the collection angle value. The first image and the second image are collected based on the adjusted collection angle value. Image recognition is performed on the first image and the second image to obtain a common view area. The first image and / or the second image is / are subjected to a trimming process based on the common view area. A screenshot picture is obtained based on the trimmed first image and / or the second image. The collection angle value is adjusted, so that the collected first image and second image will not deviate, the user operation is reduced, and the user experience is improved. Furthermore, the first image and the second image are subjected to trimming and splicing in the application, and then the screenshot picture is determined, so that the screenshot picture will not deviate to the left or the right.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of virtual reality, and in particular to a picture screenshot method and device, a head-mounted virtual reality device, and a storage medium. BACKGROUND

[0002] With the popularity of virtual reality devices, in social activities, experiencing and sharing new products have become a common topic among movie and game enthusiasts, and screenshot sharing is a common function. Screenshot is an indispensable function in existing virtual reality products. Virtual reality devices in related technologies are equipped with inertial measurement units (IMUs) so that virtual reality devices can have relatively accurate rotation and movement functions. The IMU itself has high precision, and virtual reality devices are mainly wearable devices. Therefore, when a user performs a screenshot operation through a screenshot key or a head-mounted combination key, it is difficult to keep the device completely tilted and trigger the screenshot at the same time, resulting in a certain degree of deviation of the screenshot picture.

[0003] Secondly, in order to simulate the imaging effect of human eyes, the head-mounted virtual reality device simulates the effect of human eyes through left and right virtual cameras. The left and right cameras respectively render two images that are not completely the same. In related technologies, a virtual display screen is created, and the left eye (or right eye) picture is transmitted to the display screen in real time. After the screenshot operation is triggered, the monocular picture in the display screen is intercepted as a screenshot picture. At this time, the screenshot picture has a left (or right) deviation problem. SUMMARY

[0004] The purpose of the present application is to provide a picture screenshot method, device, terminal device, and storage medium, which can ensure the accuracy of the head-mounted virtual reality device when taking a screenshot and ensure that the screenshot picture is not deviated.

[0005] In a first aspect, an embodiment of the present application provides a picture screenshot method applied to a head-mounted virtual reality device, and the method comprises the following steps:

[0006] In response to a screenshot operation triggered by a user, a collection angle value used for collecting an image is determined based on a rotation angle value of the head-mounted virtual reality device, and the collection angle value is adjusted.

[0007] A picture displayed on a display screen in a first line-of-sight range is collected based on the adjusted collection angle value to obtain a first image, and a picture displayed on the display screen in a second line-of-sight range is collected based on the adjusted collection angle value to obtain a second image. The first line-of-sight range and the second line-of-sight range overlap.

[0008] perform image recognition on the first image and the second image to obtain a common view area of the first image and the second image;

[0009] perform cropping processing on the first image and / or the second image based on the common view area to obtain a cropped first image and / or a cropped second image;

[0010] obtain a screenshot image based on the cropped first image and / or the cropped second image.

[0011] In the present application, by adjusting the acquisition angle value, the acquired first image and second image will not be offset, solving the problem of manually keeping the device from tilting by the user, and improving the user experience. Secondly, in the present application, the first image and the second image are cropped and spliced to determine the screenshot image, so that the cropped image will not be left or right biased.

[0012] In some possible embodiments, the acquisition angle value used for acquiring the image is determined based on the rotation angle value of the head-mounted virtual reality device, including:

[0013] If it is determined that the rotation angle value is greater than the preset angle threshold value, and it is determined that the user sets an angle value, the angle value set by the user is taken as the acquisition angle value;

[0014] If it is determined that the rotation angle value is greater than the preset angle value, and the user does not set an angle value, the initial angle value is taken as the acquisition angle value;

[0015] If it is determined that the rotation angle value is less than the preset angle threshold value, the initial angle value is taken as the acquisition angle value.

[0016] In the present application, the user can set an angle value according to his own needs, so that the head-mounted virtual reality device can capture the screen of any angle according to the user's needs; the user can also not set an angle value, and the initial angle value is taken as the acquisition angle value, so that the obtained screenshot image will not be offset.

[0017] In some possible embodiments, the image recognition on the first image and the second image to obtain the common view area of the first image and the second image includes:

[0018] obtain the interpupillary distance value and the field of view angle value of the user;

[0019] obtain the first line of sight range and the second line of sight range based on the distance between the user and the display screen, the field of view angle value, and the trigonometric function;

[0020] According to the difference between the first line-of-sight range and the pupillary distance value and the difference between the second line-of-sight range and the pupillary distance value, the common view area is determined.

[0021] In the present application, the common view area is determined according to the pupillary distance value and the field of view angle of the user, so that the obtained common view area is more accurate.

[0022] In some possible embodiments, the acquiring the screen displayed by the display screen in the first line-of-sight range based on the adjusted acquisition angle value to obtain a first image and acquiring the screen displayed by the display screen in the second line-of-sight range based on the adjusted acquisition angle value to obtain a second image comprises:

[0023] Acquiring first image data corresponding to the first line-of-sight range and second image data corresponding to the second line-of-sight range acquired by the head-mounted virtual reality device at the acquisition angle value;

[0024] Storing the first image data into a first bit array, saving the first bit array as a first portable network graphics file, and storing the second image data into a second bit array, saving the second bit array as a second portable network image file;

[0025] Generating the first image based on the first portable network graphics file and generating the second image based on the second portable network image file.

[0026] In the present application, the first image data and the second image data are acquired at the acquisition angle value, and the first image and the second image are respectively generated according to the first image data and the second image data, so that the obtained first image and second image are more accurate.

[0027] In some possible embodiments, after the screen capture image is obtained based on the cropped first image and / or second image, the method further comprises:

[0028] Determining the edge of the screen capture image according to an edge recognition algorithm;

[0029] Performing fine-tuning operation on the screen capture image based on the edge of the screen capture image by using an image recognition algorithm to obtain an adjusted screen capture image.

[0030] In the present application, the fine-tuning operation is performed on the edge of the screen capture image by using the image recognition algorithm, so that the adjusted screen capture image is more accurate.

[0031] In some possible embodiments, the obtaining the screen capture image based on the cropped first image and / or second image comprises:

[0032] If the first image is cropped, the cropped first image and the second image are spliced to obtain a screenshot image;

[0033] If the second image is cropped, the cropped second image and the first image are spliced to obtain a screenshot image;

[0034] If the first image and the second image are cropped, the cropped first image, the cropped second image and the common view area are spliced to obtain the screenshot image.

[0035] In the present application, the specific cropping and splicing methods are not limited, so that the present application is more universal.

[0036] In a second aspect, the present application also provides a picture screenshot device, the device comprising:

[0037] An angle adjustment module, configured to determine an acquisition angle value used for acquiring images based on a rotation angle value of the head-mounted virtual reality device in response to a screenshot operation triggered by a user, and adjust the acquisition angle value;

[0038] An image acquisition module, configured to acquire a picture displayed on a display screen within a first line-of-sight range based on the adjusted acquisition angle value to obtain a first image, and acquire a picture displayed on the display screen within a second line-of-sight range based on the adjusted acquisition angle value to obtain a second image; wherein the first line-of-sight range and the second line-of-sight range overlap;

[0039] An image recognition module, configured to perform image recognition on the first image and the second image to obtain a common view area of the first image and the second image;

[0040] An image cropping module, configured to crop the first image and / or the second image based on the common view area to obtain a cropped first image and / or a cropped second image;

[0041] A splicing module, configured to obtain a screenshot image based on the cropped first image and / or the cropped second image.

[0042] In some possible embodiments, the angle adjustment module performs the determination of the acquisition angle value based on the rotation angle value of the head-mounted virtual reality device, comprising:

[0043] If it is determined that the rotation angle value is greater than the preset angle threshold value and it is determined that a user has set an angle value, the angle value set by the user is taken as the acquisition angle value;

[0044] If it is determined that the rotation angle value is greater than the preset angle value, and the user does not set the angle value, the initial angle value is taken as the collection angle value;

[0045] If it is determined that the rotation angle value is less than the preset angle threshold value, the initial angle value is taken as the collection angle value.

[0046] In some possible embodiments, the image recognition module is configured to, when performing image recognition on the first image and the second image to obtain the common view area of the first image and the second image:

[0047] Obtain the interpupillary distance value and the field of view angle value of the user;

[0048] Based on the distance between the user and the display screen, the field of view angle value, and a trigonometric function, obtain a first line of sight range and a second line of sight range;

[0049] According to the difference between the first line of sight range and the interpupillary distance value, and the difference between the second line of sight range and the interpupillary distance value, determine the common view area.

[0050] In some possible embodiments, the image collection module is configured to, when performing image collection based on the adjusted collection angle value to obtain a first image of the screen displayed in the first line of sight range, and performing image collection based on the adjusted collection angle value to obtain a second image of the screen displayed in the second line of sight range, include:

[0051] Obtain first image data corresponding to the first line of sight range and second image data corresponding to the second line of sight range collected by the head-mounted virtual reality device at the collection angle value;

[0052] Store the first image data in a first bit array, save the first bit array as a first portable network graphics file, and store the second image data in a second bit array, save the second bit array as a second portable network image file;

[0053] Generate the first image based on the first portable network graphics file, and generate the second image based on the second portable network image file.

[0054] In some possible embodiments, after the splicing module performs the operation of obtaining the screenshot image based on the cropped first image and / or second image, the splicing module is further configured to:

[0055] Determine the edge of the screenshot image according to an edge recognition algorithm;

[0056] Based on the edge of the screenshot image, perform fine-tuning of the screenshot image using an image recognition algorithm to obtain an adjusted screenshot image.

[0057] In some possible embodiments, when the image cropping module performs the screenshot image based on the cropped first image and / or the second image, the image cropping module is configured to:

[0058] If the first image is cropped, the cropped first image and the second image are spliced to obtain a screenshot image.

[0059] If the second image is cropped, the cropped second image and the first image are spliced to obtain a screenshot image.

[0060] If the first image and the second image are cropped, the cropped first image, the cropped second image, and the common view area are spliced to obtain the screenshot image.

[0061] In a third aspect, another embodiment of the present application further provides a head-mounted virtual reality device, including at least one processor, and a memory connected with the at least one processor in communication; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute any method provided in the first aspect of the present application.

[0062] In a fourth aspect, another embodiment of the present application further provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is used to enable a computer to execute any method provided in the first aspect of the present application.

[0063] Other features and advantages of the present application will be described in the following description and other parts will be apparent from the description or will be learned by practice of the application. The purpose and other advantages of the present application will be achieved and obtained by the structure particularly pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF DRAWINGS

[0064] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments of the present application. Obviously, the drawings to be introduced below are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0065] Figure 1 An application scenario diagram of a picture screenshot method provided by the embodiments of the present application;

[0066] Figure 2Another application scenario diagram of a picture screenshot method provided by an embodiment of the present application;

[0067] Figure 3 A whole flow diagram of a picture screenshot method provided by an embodiment of the present application;

[0068] Figure 4 An angle adjustment prompt box diagram of a picture screenshot method provided by an embodiment of the present application;

[0069] Figure 5 An angle input interface diagram of a picture screenshot method provided by an embodiment of the present application;

[0070] Figure 6 An eye view range diagram of a picture screenshot method provided by an embodiment of the present application;

[0071] Figure 7 A first view range and a second view range diagram of a picture screenshot method provided by an embodiment of the present application;

[0072] Figure 8 A first image and a second image diagram of a picture screenshot method provided by an embodiment of the present application;

[0073] Figure 9 A first image acquisition flow diagram of a picture screenshot method provided by an embodiment of the present application;

[0074] Figure 10 A second image acquisition flow diagram of a picture screenshot method provided by an embodiment of the present application;

[0075] Figure 11 A fine adjustment operation flow diagram of a picture screenshot method provided by an embodiment of the present application;

[0076] Figure 12 A first image diagram of a picture screenshot method provided by an embodiment of the present application;

[0077] Figure 13 A common view area determination flow diagram of a picture screenshot method provided by an embodiment of the present application;

[0078] Figure 14 A common view area determination diagram of a picture screenshot method provided by an embodiment of the present application;

[0079] Figure 15 A left view area determination diagram of a picture screenshot method provided by an embodiment of the present application;

[0080] Figure 16A left view area of a picture screenshot method provided by an embodiment of the present application and a second image splicing schematic diagram;

[0081] Figure 17 A right view area of a picture screenshot method provided by an embodiment of the present application;

[0082] Figure 18 A right view area of a picture screenshot method provided by an embodiment of the present application and a first image splicing schematic diagram;

[0083] Figure 19 A left view area and a right view area of a picture screenshot method provided by an embodiment of the present application;

[0084] Figure 20 A left view area, a right view area and a co-view area of a picture screenshot method provided by an embodiment of the present application splicing schematic diagram;

[0085] Figure 21 A partial adjustment flowchart of a picture screenshot method provided by an embodiment of the present application;

[0086] Figure 22 A device schematic diagram of a picture screenshot method provided by an embodiment of the present application;

[0087] Figure 23 A head-mounted virtual reality device schematic diagram of a picture screenshot method provided by an embodiment of the present application. DETAILED DESCRIPTION

[0088] In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application. The embodiments in the present application and the features in the embodiments can be combined with each other arbitrarily without conflict. Moreover, although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.

[0089] The terms "first" and "second" in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any variations thereof are intended to cover non-exclusive protection. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in this application can mean at least two, for example, two, three or more, and the embodiments of this application are not limited thereto.

[0090] The inventors have found that with the popularization and application of virtual reality devices, the experience and sharing of new products have become a common topic among fans of movies, games, music and other functions in social activities. Taking screenshots and sharing the screenshots is a common function. Screenshots are an indispensable function in existing virtual reality products. Virtual reality devices in related technologies are equipped with IMUs so that the virtual reality devices can have relatively precise rotation and movement functions. The IMU itself has a relatively high accuracy, and virtual reality devices are mainly wearable devices. Therefore, when users use the screenshot button or the head-mounted combination key to perform a screenshot operation, it is difficult to keep the device completely straight and trigger the screenshot at the same time. As a result, the pictures captured by the user will have a certain degree of offset.

[0091] Secondly, in order to simulate the imaging effect of the human eye, the head-mounted virtual reality device simulates the human eye effect through two virtual cameras on the left and right. The left and right cameras respectively render two non-completely identical left and right images. Most related technologies create a virtual display screen and transmit the left eye (or right eye) picture to the display screen in real time, and after the screenshot operation is triggered, the monocular picture in the display screen is captured as the screenshot. At this time, the screenshot has the problem of being biased to the left (or right).

[0092] In view of this, the present application proposes a screen capture method, apparatus, terminal device and storage medium for solving the above problems. The inventive concept of the present application can be summarized as follows: in response to a screen capture operation triggered by a user, determining and adjusting the acquisition angle value used for capturing images based on the rotation angle value of the head-mounted virtual reality device; capturing the screen image displayed on the display screen within the first visual range based on the adjusted acquisition angle value to obtain a first image, and capturing the screen image displayed on the display screen within the second visual range based on the adjusted acquisition angle value to obtain a second image; wherein the first visual range and the second visual range overlap; performing image recognition on the first image and the second image to obtain a common viewing area of ​​the first image and the second image; cropping the first image and / or the second image based on the common viewing area to obtain a cropped first image and / or second image; and obtaining a screenshot image based on the cropped first image and / or second image.

[0093] For ease of understanding, a screenshot method provided by an embodiment of the present application is described in detail below with reference to the accompanying drawings, wherein:

[0094] like Figure 1 The figure shows an application scenario diagram of the screen capture method in the embodiment of the present application. The figure includes: a server 10, a storage 20, and a head-mounted virtual reality device 30; wherein:

[0095] In response to a screenshot operation triggered by the user based on the virtual reality device 30, the server 10 determines a capture angle value used for capturing an image based on a rotation angle value of the head-mounted virtual reality device 30, and adjusts the capture angle value; the server 10 controls the head-mounted virtual reality device 30 to capture a picture displayed on the display screen within a first visual range based on the adjusted capture angle value to obtain a first image, and to capture a picture displayed on the display screen within a second visual range based on the adjusted capture angle value to obtain a second image; and stores the first image and the second image in the memory 20, wherein the first visual range overlaps with the second visual range; performs image recognition on the first image and the second image to obtain a common visual area of ​​the first image and the second image; crops the first image and / or the second image based on the common visual area to obtain a cropped first image and / or second image; and obtains a screenshot image based on the cropped first image and / or second image.

[0096] In other embodiments, the operations performed by the server 10 may also be performed by the head mounted virtual reality device 30, such as Figure 2As shown, the figure includes: a memory 20, a head-mounted virtual reality device 30, wherein: the head-mounted virtual reality device 30, in response to a user-triggered screenshot operation, determines a collection angle value used for collecting an image based on a rotation angle value of the head-mounted virtual reality device 30, and adjusts the collection angle value; collects a picture displayed on the display screen within a first line-of-sight range based on the adjusted collection angle value to obtain a first image, and collects a picture displayed on the display screen within a second line-of-sight range based on the adjusted collection angle value to obtain a second image; and stores the first image and the second image in the memory 20, wherein the first line-of-sight range and the second line-of-sight range overlap; performs image recognition on the first image and the second image to obtain a common view area of the first image and the second image; performs cropping processing on the first image and / or the second image based on the common view area to obtain a cropped first image and / or a cropped second image; and obtains a screenshot image based on the cropped first image and / or the cropped second image.

[0097] In the description in the present application, only a single server, memory, head-mounted virtual reality device is described in detail, but those skilled in the art should understand that the server, memory, head-mounted virtual reality device shown is intended to represent the operation of the server, memory, head-mounted virtual reality device involved in the technical solution of the present application. There is no limitation on the number, type or location of the server, memory. It should be noted that if additional modules are added to the environment or individual modules are removed therefrom, the underlying concept of the example embodiments of the present application will not change. In addition, although bidirectional arrows from the memory 20 to the server 10 are shown in Figs. Figure 1 or Figure 2 Adding additional modules to the environment or removing individual modules therefrom does not change the underlying concept of the example embodiments of the present application. In addition, although bidirectional arrows from the memory 20 to the server 10 are shown in Figs. Figure 1 , and 2, those skilled in the art can understand that the reception and transmission of the above data also need to be implemented through a network.

[0098] It should be noted that the memory in the embodiments of the present application can be, for example, a cache system, a hard disk storage, a memory storage, etc. In addition, the picture screenshot method proposed in the present application is not only applicable to the application scenarios shown in Figs. Figure 1 , Figure 2 In addition, the picture screenshot method proposed in the present application is not only applicable to the application scenarios shown in Figs.

[0099] Secondly, the head-mounted virtual reality device in the present application includes but is not limited to: a virtual reality device (Virtual Reality, VR), an augmented reality device (Augmented Reality, AR), and a mixed reality device (Mixed Reality, MR).

[0100] As shown in Fig. Figure 3 , the overall flowchart of a picture screenshot method provided by the embodiments of the present application, wherein:

[0101] In step 301, in response to a user triggered screenshot operation, a collection angle value used for collecting an image is determined based on a rotation angle value of a head-mounted virtual reality device, and the collection angle value is adjusted.

[0102] In step 302, a picture displayed on a display screen in a first line-of-sight range is collected based on the adjusted collection angle value to obtain a first image, and a picture displayed on the display screen in a second line-of-sight range is collected based on the adjusted collection angle value to obtain a second image; wherein the first line-of-sight range and the second line-of-sight range overlap.

[0103] In step 303, the first image and the second image are subjected to image recognition to obtain a common viewing area of the first image and the second image.

[0104] In step 304, the first image and / or the second image are subjected to cropping processing based on the common viewing area to obtain a cropped first image and / or a cropped second image.

[0105] In step 305, a screenshot image is obtained based on the cropped first image and / or the cropped second image.

[0106] In the present application, the collection angle value is adjusted through the rotation angle value of the head-mounted virtual reality device, so that the collected first image and the second image do not deviate, solving the problem of manually keeping the device from tilting before taking a screenshot, simplifying the user's operation and improving the user experience. Secondly, in the present application, the first image and the second image are cropped and spliced to determine the screenshot image, so that the cropped picture does not deviate to the left or right, ensuring the user's visual experience.

[0107] For ease of understanding, the steps in the picture screenshot method proposed in the embodiments of the present application are described in detail in three parts as follows:

[0108] 1. Collecting an image

[0109] In the embodiments of the present application, in order to ensure that the collected image does not deviate, the collection angle value of the head-mounted virtual reality device needs to be adjusted before collecting the image. First, the process of adjusting the collection angle value of the virtual reality device is described in detail as follows:

[0110] In the embodiments of the present application, after the user triggers the screenshot operation, in order to ensure that the screenshot image is the angle expected by the user, three collection angle value adjustment methods are provided in the present application. They are described as follows:

[0111] In some embodiments, if the rotation angle value is determined to be less than the preset angle threshold, it indicates that the user has a slight deviation at this time, so it can be determined that the user does not have the need to collect the specified angle image, and therefore in this case, the initial angle value is directly taken as the collection angle value.

[0112] In other embodiments, if the rotation angle value is determined to be greater than the preset angle threshold, it cannot be determined whether the user wants to collect the specified angle image, so at this time the user can set the collection angle value by himself / herself, and if the user does not set the angle value, it indicates that the user does not have the need to collect the specified angle image, so the initial angle value can be taken as the collection angle value.

[0113] For example, after detecting that the user triggers the screenshot operation, it is determined that the rotation angle value of the head-mounted virtual reality device at this time is greater than the preset angle threshold, and an angle adjustment prompt box is popped up in the virtual reality screen, as shown in FIG. 6A, the user selects automatic correction or sets the angle in the prompt box, if the user selects to set the angle, jump to the interface as shown in FIG. 6B, prompt the user to input the collection angle value, and adjust the collection angle value to the angle value input by the user. If the user selects automatic correction in the prompt box, the collection angle value is adjusted to the initial angle value. Figure 4 Figure 5 It should be noted that,

[0114] It should be noted that, Figure 4 The prompt method of the prompt box shown is only one embodiment, and other prompt forms can be used in specific implementation, for example, a voice broadcast method. The specific prompt method is not limited in the present application, and the technical personnel can set it according to the needs.

[0115] In other possible embodiments, in order to ensure the experience of the user using the head-mounted virtual reality device, the collection angle value adjustment method can be directly set to automatic correction by the technical personnel before the user uses the head-mounted virtual reality device, so that when the user uses the head-mounted virtual reality device and triggers the screenshot operation, the collection angle value can be directly set to the initial angle value and then the image is collected.

[0116] It should be noted that, in addition to the above two adjustment times of the collection angle value, the collection angle value can be adjusted at any time before the image is collected, which is also applicable to the present application, and the present application does not limit the time of adjusting the collection angle value, and the technical personnel can set it according to the needs.

[0117] In summary, the interface screenshot method proposed in the embodiments of the present application does not require the user to ensure that the head-mounted virtual reality device is not tilted, and the non-tilt of the collected image is achieved by adjusting the collection angle value in the present application, which ensures the experience of the user and simplifies the operation of the user.

[0118] ​Since the head-mounted virtual reality device is a simulation of the imaging effect of human eyes, the line-of-sight range of the human eyes is as shown in Figure 6 Therefore, two virtual cameras, i.e., a left camera and a right camera, are arranged in the head-mounted virtual reality device to capture images. Therefore, the head-mounted virtual reality device captures two images when capturing images. As shown in Figure 7 Based on the adjusted capture angle value, a picture displayed on the display screen in the first line-of-sight range is captured to obtain a first image, and based on the adjusted capture angle value, a picture displayed on the display screen in the second line-of-sight range is captured to obtain a second image; wherein the first line-of-sight range and the second line-of-sight range overlap.

[0119] For example, as shown in Figure 8 The first image captured by the left camera and the second image captured by the right camera are shown in the schematic diagram, wherein the first image and the second image have the same part, and the first image and the second image also have their own visible parts.

[0120] The processes of capturing the first image and capturing the second image in the embodiments of the present application are described below, as shown in Figure 9 The process of capturing the first image corresponding to the first line-of-sight range based on the adjusted angle value in the embodiments of the present application is shown in the schematic diagram, wherein:

[0121] In step 901, first image data corresponding to the first line-of-sight range captured by the head-mounted virtual reality device at the capture angle value is obtained.

[0122] In some possible embodiments, after the user triggers the screenshot operation, the left camera obtains the network texture image information Texture1, i.e., the first image data, at the adjusted capture angle.

[0123] In step 902, the first image data is stored in a first bit array, and the first bit array is saved as a first portable network graphics file.

[0124] In some possible embodiments, the first image data Texture1 is saved in a first bit array Byte1, and Byte1 is saved as a first portable network graphics file (Portable Network Graphics, PNG), i.e., PNG1.

[0125] In step 903, the first image is generated based on the first portable network graphics file.

[0126] In the present application, after PNG1 is obtained, the first image is generated based on PNG1.

[0127] In other possible embodiments, as shown inFigure 10 FIG. 1 is a flow chart of capturing a second image corresponding to a second visual range based on the adjusted angle value, wherein:

[0128] In step 1001: obtaining second image data corresponding to a second visual range captured by the head-mounted virtual reality device at a capture angle value;

[0129] In some embodiments, after the user triggers a screenshot operation, the right camera will obtain the network texture image information Texture2 that needs to be rendered, that is, the second image data, at the adjusted acquisition angle.

[0130] In step 1002: storing the second image data in a second bit array, and saving the second bit array as a second portable network image file;

[0131] The second image data Texture2 is saved in a second bit array Byte2, and Byte2 is saved as a second portable network graphics file, ie, PNG2.

[0132] In step 1003 : a second image is generated based on the second portable network image file.

[0133] In the present application, after obtaining PNG2, a second image is generated based on PNG2.

[0134] In some possible embodiments, in order to ensure the integrity and clarity of the first image and the second image, in this application, after obtaining the first image and the second image, the first image and the second image can be fine-tuned. The following is an example of the fine-tuning operation on the first image, wherein the process of the fine-tuning operation is as follows: Figure 11 As shown:

[0135] In step 1101: determining the edge of the first image according to an edge recognition algorithm;

[0136] In step 1102 : an adjustment operation is performed on the first image using an image recognition algorithm based on the edge of the first image to obtain an adjusted first image.

[0137] For example: Figure 12 As shown, A is a schematic diagram of the first image of the first visual range captured by the left camera, B is the edge of the first image obtained by performing an edge recognition algorithm on the first image, and A is adjusted based on the edge of the first image.

[0138] 2. Image Recognition

[0139] In the embodiment of the present application, after the first image in the first line-of-sight range and the second image in the second line-of-sight range are collected, in order to ensure that the subsequent obtained screenshot image does not have the problem of left or right deviation, it is necessary to perform image recognition on the first image and the second image to obtain the common view area of the first image and the second image and the respective non-common view area. In the present application, in order to facilitate the distinction, the non-common view area in the first image is named as the left view area, and the non-common view area in the second image is named as the right view area.

[0140] In some possible embodiments, the flow of performing image recognition on the first image and the second image to obtain the common view area of the first image and the second image is as shown in Figure 13

[0141] In step 1301, the pupillary distance value and the field of view angle value of the user are obtained.

[0142] In step 1302, based on the distance between the user and the display screen, the field of view angle value and the trigonometric function, the first line-of-sight range and the second line-of-sight range are obtained.

[0143] In step 1303, the common view area is determined according to the difference between the first line-of-sight range and the pupillary distance value and the difference between the second line-of-sight range and the pupillary distance value.

[0144] As shown in Figure 14 , where the pupillary distance value of the user is T, the horizontal field of view angle value is a, the distance between the user and the display screen is h, and the distance h between the user and the display screen changes with the movement of the user. When the user moves towards the display screen, h decreases. When the user moves away from the display screen, h increases. Where the left view area is MD, the right view area is ND, and the common view area is ABCD. In the present application, the process of calculating BD and CD of the common view area is the same, and only the angle of the field of view angle used is different. Where the field of view angle used for calculating BD is the horizontal field of view angle, and the field of view angle value used for calculating CD is the vertical field of view angle. The process of calculating BD is taken as an example for detailed description below:

[0145] Where the common view area is a rectangular area, so AB = CD and AC = BD. As can be seen from the figure, BD = MD - MB, and since ML and BR are parallel, MB is consistent with the pupillary distance value of the user, and the pupillary distance value of the user is known as T, so MB = T, and according to the trigonometric function theorem, MD = 2 * (h * tan β), and β = 1 / 2 a. Therefore, BD = MD - MB = 2 * (h * tan (1 / 2 a)) - T; thus the common view area of the first image and the second image is obtained.

[0146] ​In an embodiment of the present application, in order to ensure the integrity and clarity of the obtained common viewing area, after obtaining the common viewing area, the common viewing area can be fine-tuned, and the method of the fine-tuning operation is the same as the process of fine-tuning the first image, which will not be repeated here.

[0147] It is important to note that this application provides Figure 14 The method for determining the common viewing area shown is only one embodiment. Other methods that can determine the common viewing area of ​​two images are also applicable to this application, for example: using a similarity recognition method to determine the common viewing area, which is not limited in this application.

[0148] 3. Image cropping and stitching

[0149] In the embodiment of the present application, after obtaining the first image, the second image, and the common viewing area, in order to ensure that the resulting screenshot image is not biased to the left or right, it is necessary to crop and splice the first image and / or the second image. The following three cases are explained:

[0150] 1) Crop the first image

[0151] In the present application, if the first image is cropped, it is necessary to crop the common viewing area from the first image according to the common viewing area to obtain the remaining part, that is, the left viewing area.

[0152] For example: Figure 15 As shown, the first image includes a left-viewing area and a common-viewing area. The common-viewing area is cropped from the first image to obtain the left-viewing area.

[0153] The left viewing area and the second image are stitched together to obtain a screenshot image, for example: Figure 16 As shown, Figure 15 The left viewing area obtained in the image is spliced ​​with the second image to obtain a screenshot image.

[0154] 2) Crop the second image

[0155] In the present application, if the second image is cropped, it is necessary to crop the common viewing area from the second image according to the common viewing area to obtain the remaining part, that is, the right viewing area.

[0156] For example: Figure 17 As shown, the second image includes a right-viewing area and a common-viewing area. The common-viewing area is cropped from the second image to obtain the right-viewing area.

[0157] The right viewing area and the first image are stitched together to obtain a screenshot image, for example: Figure 18 As shown, Figure 17 The right viewing area obtained in the image is spliced ​​with the first image to obtain a screenshot image.

[0158] 3) cropping the first image and the second image

[0159] In the present application, if the first image and the second image are cropped, the common view area is cropped from the first image to obtain the remaining part, i.e., the left view area; and the common view area is cropped from the second image to obtain the remaining part, i.e., the right view area, according to the common view area.

[0160] For example, as shown in FIG. 3A, the first image includes the left view area and the common view area, and the second image includes the right view area and the common view area. The common view area is cropped from the first image to obtain the left view area, and the common view area is cropped from the second image to obtain the right view area. Figure 19 The left view area, the right view area, and the common view area are spliced to obtain a screenshot image, for example, as shown in FIG. 3B.

[0161] Figure 20 The left view area, the right view area, and the common view area obtained in FIG. 3A are spliced to obtain a screenshot image. Figure 19

[0162] In the embodiment of the present application, in order to ensure the clarity and accuracy of the obtained screenshot image, the boundary between the common view area and the non-common view area (the left view area and / or the right view area) needs to be locally adjusted and slightly blurred according to the light and line trend in the virtual world.

[0163] The process of locally adjusting the common view area and the non-common view area is described below, as shown in FIG. 4. Figure 21

[0164] In step 2101, the edges of the common view area and the non-common view area are determined according to an edge recognition algorithm.

[0165] In step 2102, the common view area is adjusted based on the edges of the common view area using an image recognition algorithm to obtain an adjusted common view area; and the non-common view area is adjusted based on the edges of the non-common view area using an image recognition algorithm to obtain an adjusted non-common view area.

[0166] After obtaining the adjusted common view area and the adjusted non-common view area, the joint between the common view area and the non-common view area needs to be slightly blurred to obtain the final screenshot image.

[0167] ​​​To sum up, in the embodiment of the present application, by adjusting the collection angle value, the collected first image and second image will not be offset, solving the problem of user manually keeping the device from tilting, and improving user experience. Secondly, in the present application, the first image and second image are cropped and spliced to determine the screenshot image, so that the cropped image will not be left or right biased.

[0168] As shown in Figure 22 based on the same inventive concept, a picture screenshot device 2200 is provided, which comprises:

[0169] An angle adjustment module 22001 is configured to, in response to a screenshot operation triggered by a user, determine a collection angle value used for collecting an image based on a rotation angle value of a head-mounted virtual reality device, and adjust the collection angle value.

[0170] An image collection module 22002 is configured to collect a picture displayed on a display screen within a first line-of-sight range based on the adjusted collection angle value to obtain a first image, and collect a picture displayed on the display screen within a second line-of-sight range based on the adjusted collection angle value to obtain a second image; wherein the first line-of-sight range and the second line-of-sight range overlap.

[0171] An image recognition module 22003 is configured to perform image recognition on the first image and the second image to obtain a common viewing area of the first image and the second image.

[0172] An image cropping module 22004 is configured to perform cropping processing on the first image and / or the second image based on the common viewing area to obtain a cropped first image and / or a cropped second image.

[0173] A splicing module 22005 is configured to obtain a screenshot image based on the cropped first image and / or the cropped second image.

[0174] In some possible embodiments, the angle adjustment module performs the determination of the collection angle value based on the rotation angle value of the head-mounted virtual reality device, comprising:

[0175] If it is determined that the rotation angle value is greater than the preset angle threshold value, and it is determined that the user has set an angle value, the angle value set by the user is taken as the collection angle value.

[0176] If it is determined that the rotation angle value is greater than the preset angle value, and the user has not set an angle value, an initial angle value is taken as the collection angle value.

[0177] If it is determined that the rotation angle value is less than the preset angle threshold value, the initial angle value is taken as the collection angle value.

[0178] In some possible embodiments, the image recognition module, when performing image recognition on the first image and the second image to obtain the common view area of the first image and the second image, is configured to:

[0179] obtain a pupillary distance value and a field of view angle value of the user;

[0180] obtain a first line of sight range and a second line of sight range based on a distance between the user and a display screen, the field of view angle value, and a trigonometric function;

[0181] determine the common view area according to a difference between the first line of sight range and the pupillary distance value, and a difference between the second line of sight range and the pupillary distance value.

[0182] In some possible embodiments, the image acquisition module, when performing image acquisition based on the adjusted acquisition angle value to obtain a first image of a screen displayed by a display screen in the first line of sight range, and based on the adjusted acquisition angle value to obtain a second image of the screen displayed by the display screen in the second line of sight range, comprises:

[0183] obtain first image data corresponding to the first line of sight range and second image data corresponding to the second line of sight range acquired by the head-mounted virtual reality device at the acquisition angle value;

[0184] store the first image data in a first bit array, save the first bit array as a first portable network graphics file, and store the second image data in a second bit array, save the second bit array as a second portable network image file;

[0185] generate the first image based on the first portable network graphics file, and generate the second image based on the second portable network image file.

[0186] In some possible embodiments, the splicing module, after performing the operation of obtaining the screenshot image based on the cropped first image and / or second image, is further configured to:

[0187] determine an edge of the screenshot image according to an edge recognition algorithm;

[0188] perform fine-tuning on the screenshot image based on the edge of the screenshot image using an image recognition algorithm to obtain an adjusted screenshot image.

[0189] In some possible embodiments, the image cropping module, when performing the operation of obtaining the screenshot image based on the cropped first image and / or second image, is configured to:

[0190] If the first image is cropped, the cropped first image and the second image are stitched to obtain a screenshot image;

[0191] If the second image is cropped, the cropped second image and the first image are stitched to obtain a screenshot image.

[0192] If the first image and the second image are cropped, the cropped first image, the cropped second image and the common view area are stitched to obtain the screenshot image.

[0193] After introducing the screenshot method and device according to the exemplary embodiments of the present application, next, a head-mounted virtual reality device according to another exemplary embodiment of the present application is introduced.

[0194] Those skilled in the art can understand that various aspects of the present application can be implemented as a system, a method or a program product. Therefore, various aspects of the present application can be embodied as a complete hardware embodiment, a complete software embodiment (including firmware, microcode, etc.), or an embodiment combining hardware and software aspects, which can be collectively referred to as "circuitry", "module" or "system" herein.

[0195] In some possible embodiments, the head-mounted virtual reality device according to the present application can at least include at least one processor and at least one memory. The memory stores program code which, when executed by the processor, causes the processor to perform the steps of the screenshot method according to various exemplary embodiments of the present application described above in the specification.

[0196] The head-mounted virtual reality device 130 according to this embodiment of the present application is described below with reference to Figure 23 Figure 23 The displayed head-mounted virtual reality device 130 is only an example and should not bring any limitation to the functions and use range of the embodiments of the present application.

[0197] As Figure 23 shown, the head-mounted virtual reality device 130 is in the form of a general head-mounted virtual reality device. The components of the head-mounted virtual reality device 130 can include but are not limited to the above-mentioned at least one processor 131, the above-mentioned at least one memory 132, a bus 133 connecting different system components including the memory 132 and the processor 131.

[0198] The bus 133 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor or a local bus using any of a variety of bus structures. ​

[0199] Memory 132 can include a readable medium in the form of volatile memory, such as random access memory (RAM) 1321 and / or cache memory 1322, and can further include read only memory (ROM) 1323.

[0200] Memory 132 can also include a program / utility 1325 having a set of programs / modules 1324, including an operating system, one or more application programs, other program modules, and program data, each of which or a combination thereof, can include implementation of a network environment as in each of these examples or some combination thereof.

[0201] Head-mounted virtual reality device 130 can also communicate with one or more external devices 134 such as a keyboard, a pointing device, etc. and can communicate with one or more devices that enable a user to interact with head-mounted virtual reality device 130 and / or any devices (e.g., routers, modems, etc.) that enable head-mounted virtual reality device 130 to communicate with one or more other head-mounted virtual reality devices. Such communication can occur via input / output (I / O) interface 135. Still yet, head-mounted virtual reality device 130 can communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or the public network, such as the Internet) via network adapter 136. As depicted, network adapter 136 communicates with the other modules of head-mounted virtual reality device 130 via bus 133. It should be appreciated that although not shown, other hardware and / or software modules could be used in conjunction with head-mounted virtual reality device 130. Such as, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.

[0202] In some possible embodiments, each of the aspects of the method provided by the present application can also be implemented as a program product, which includes program codes for causing a computer device to execute the steps of the method described above according to various exemplary embodiments of the present application when the program product is run on the computer device, for example, the computer device can execute the transaction information processing method recorded in the embodiments of the present application. The program product can adopt any combination of one or more readable media.

[0203] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A screen capture method, characterized in that: Applied to a head-mounted virtual reality device, the method includes: In response to a screenshot operation triggered by a user, determining a capture angle value used for capturing an image based on a rotation angle value of the head-mounted virtual reality device, and adjusting the capture angle value; Capturing a picture displayed on a display screen within a first visual range based on the adjusted acquisition angle value to obtain a first image, and capturing a picture displayed on the display screen within a second visual range based on the adjusted acquisition angle value to obtain a second image; wherein the first visual range and the second visual range overlap; Obtaining a pupillary distance value and a field of view angle value of the user; obtaining a first sight range and a second sight range based on the distance between the user and the display screen, the field of view angle value, and a trigonometric function; and determining a common view area based on a difference between the first sight range and the pupillary distance value, and a difference between the second sight range and the pupillary distance value; performing cropping processing on the first image and the second image based on the common viewing area to obtain a cropped first image and a cropped second image; The cropped first image, the cropped second image, and the common viewing area are spliced ​​to obtain a screenshot image.

2. The method according to claim 1, characterized in that The determining of a capture angle value used for capturing an image based on a rotation angle value of the head-mounted virtual reality device includes: If it is determined that the rotation angle value is greater than the preset angle threshold, an angle adjustment prompt box will pop up on the virtual reality screen. If the user chooses to set the angle in the angle adjustment prompt box, the user will be prompted to enter the acquisition angle value, and the angle value entered by the user will be used as the acquisition angle value.

3. The method according to claim 1, characterized in that The step of acquiring a picture displayed on a display screen within a first sight range based on the adjusted acquisition angle value to obtain a first image, and acquiring a picture displayed on the display screen within a second sight range based on the adjusted acquisition angle value to obtain a second image, includes: Acquire first image data corresponding to a first visual range and second image data corresponding to a second visual range acquired by the head-mounted virtual reality device at the acquisition angle value; storing the first image data in a first bit array and saving the first bit array as a first portable network graphic file; and storing the second image data in a second bit array and saving the second bit array as a second portable network graphic file; The first image is generated based on the first portable network graphics file, and the second image is generated based on the second portable network graphics file.

4. The method according to claim 1, wherein After obtaining the screenshot image based on the cropped first image and / or second image, the method further includes: Determining the edge of the screenshot image according to an edge recognition algorithm; An image recognition algorithm is used to perform a fine-tuning operation on the screenshot image based on the edge of the screenshot image to obtain an adjusted screenshot image.

5. A screen capture device, characterized in that: Applied to a head-mounted virtual reality device, the device comprises: an angle adjustment module, configured to determine, in response to a screenshot operation triggered by a user, a capture angle value used for capturing an image based on a rotation angle value of the head-mounted virtual reality device, and adjust the capture angle value; an image acquisition module, configured to acquire a picture displayed on a display screen within a first visual range based on the adjusted acquisition angle value to obtain a first image, and to acquire a picture displayed on the display screen within a second visual range based on the adjusted acquisition angle value to obtain a second image; wherein the first visual range and the second visual range overlap; an image recognition module configured to obtain a pupil distance value and a field of view angle value of the user; obtain a first sight range and a second sight range based on the distance between the user and the display screen, the field of view angle value, and a trigonometric function; and determine a common view area based on a difference between the first sight range and the pupil distance value, and a difference between the second sight range and the pupil distance value; an image cropping module, configured to crop the first image and the second image based on the common viewing area to obtain a cropped first image and a cropped second image; The splicing module is used to splice the cropped first image, the cropped second image and the common viewing area to obtain a screenshot image.

6. The device according to claim 5, characterized in that When the angle adjustment module determines the acquisition angle value used for acquiring an image based on the rotation angle value of the head-mounted virtual reality device, the angle adjustment module is configured to: If it is determined that the rotation angle value is greater than the preset angle threshold, an angle adjustment prompt box will pop up on the virtual reality screen. If the user chooses to set the angle in the angle adjustment prompt box, the user will be prompted to enter the acquisition angle value, and the angle value entered by the user will be used as the acquisition angle value.

7. A head-mounted virtual reality device, characterized in that: The invention comprises at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to implement the method according to any one of claims 1 to 4.

8. A computer storage medium, characterized in that The computer storage medium stores a computer program, and the computer program is used to enable a computer to execute the method according to any one of claims 1 to 4.

Images