Depth Error Detection Method, Device, Computer Equipment and Storage Medium

Abstract

The present application discloses a depth error detection method, apparatus, computer device, and storage medium. The depth error detection method includes: controlling a near-eye display device to display virtual content based on a first position of a first physical object in a real scene; obtaining first depth information of the first physical object at the first position; obtaining feature information of the virtual content, and confirming second depth information of the virtual content according to the feature information; and determining a depth error of the display of the virtual content based on the first depth information and the second depth information. This method can accurately detect the depth error when the near-eye display device displays content.

Description

Technical Field

[0001] This application relates to the field of display technologies, and more particularly, to a depth error detection method, apparatus, computer device, and storage medium. Background Art

[0002] With the progress of technology, Augmented Reality (AR) technology has gradually become a research hotspot at home and abroad. There are more and more near-eye display devices based on augmented reality (such as AR glasses, AR head-up display devices, etc.). Through the near-eye display devices, virtual content can be superimposed and displayed in the real world for effective application, and can be perceived by human senses during this process, so that users can have a relatively real sensory experience. However, when a near-eye display device realizes augmented reality display, its display effect is related to the accuracy of superimposing virtual content onto the real scene. If the accuracy is insufficient, the display effect will be affected. Summary of the Invention

[0003] This application proposes a depth error detection method, apparatus, computer device, and storage medium, which can accurately detect the depth error when a near-eye display device displays content.

[0004] In a first aspect, an embodiment of this application provides a depth error detection method, the method includes: controlling a near-eye display device to display virtual content based on a first position of a first entity object in a real scene; obtaining first depth information of the first entity object at the first position; obtaining feature information of the virtual content, and confirming second depth information of the virtual content according to the feature information; determining a depth error of the virtual content display based on the first depth information and the second depth information.

[0005] In a second aspect, an embodiment of this application provides a depth error detection apparatus, the apparatus includes: a content display module, a first obtaining module, a second obtaining module, and an error determination module, where the content display module is configured to control a near-eye display device to display virtual content based on a first position of a first entity object in a real scene; the first obtaining module is configured to obtain first depth information of the first entity object at the first position; the second obtaining module is configured to obtain feature information of the virtual content, and confirm second depth information of the virtual content according to the feature information; the error determination module is configured to determine a depth error of the virtual content display based on the first depth information and the second depth information.

[0006] In a third aspect, an embodiment of the present application provides a depth error detection system, which includes: a computer device, a near-eye display device, and an image acquisition device. The computer device is connected to the near-eye display device and the image acquisition device. Among them, the computer device is configured to send a display instruction to the near-eye display device; the near-eye display device is configured to respond to the display instruction and display virtual content based on the first position of the first entity object in the real scene; the computer device is further configured to obtain the first entity object through the image acquisition device, detect the depth of the first entity object from the near-eye display device in the real scene, and obtain first depth information; the computer device is further configured to obtain the displayed virtual content through the image acquisition device, obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information; the computer device is further configured to determine the depth error of the displayed virtual content based on the first depth information and the second depth information.

[0007] In a fourth aspect, an embodiment of the present application provides a computer device, including: one or more processors; a memory; one or more application programs, where the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more application programs are configured to execute the depth error detection method provided in the first aspect above.

[0008] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, in which program code is stored, and the program code can be called by a processor to execute the depth error detection method provided in the first aspect above.

[0009] The solution provided by the present application controls the near-eye display device to display virtual content based on the first position of the first entity object in the real scene, and obtains the first depth information of the first entity object at the first position. Since the display position of the virtual content in the real scene matches the first position, this first depth information can be used as the display depth (i.e., the theoretical depth) of the near-eye display device to display the virtual content. In addition, the feature information of the virtual content is obtained, and the second depth information of the virtual content (i.e., the real depth of the displayed virtual content) is confirmed according to the feature information. Then, based on the first depth information and the second depth information, the depth error when the virtual content is displayed is determined. Thus, it is possible to accurately detect the depth error when the near-eye display device displays content, providing a discrimination basis for the accuracy of the near-eye display device to superimpose and display virtual content onto the real scene. Description of the Drawings

[0010] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those skilled in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0011] Figure 1 Fig. shows a schematic diagram of an application scenario provided by an embodiment of the present application.

[0012] Figure 2 Fig. shows a flowchart of a depth error detection method according to an embodiment of the present application.

[0013] Figure 3 Fig. shows a flowchart of a depth error detection method according to another embodiment of the present application.

[0014] Figure 4 Fig. shows a flowchart of a depth error detection method according to yet another embodiment of the present application.

[0015] Figure 5 Fig. shows a schematic diagram of the principle of the depth error detection method provided by an embodiment of the present application.

[0016] Figure 6 Fig. shows a flowchart of a depth error detection method according to still another embodiment of the present application.

[0017] Figure 7 Fig. shows a schematic diagram of an application scenario provided by an embodiment of the present application.

[0018] Figure 8 Fig. shows a flowchart of a depth error detection method according to yet another embodiment of the present application.

[0019] Figure 9 Fig. shows a block diagram of a depth error detection device according to an embodiment of the present application.

[0020] Figure 10 Fig. is a block diagram of a computer device for executing the depth error detection method according to an embodiment of the present application.

[0021] Figure 11 Fig. is a storage unit for storing or carrying program codes for implementing the depth error detection method according to an embodiment of the present application. Specific embodiments

[0022] To enable those skilled in the art to better understand the solutions of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings in the embodiments of the present application.

[0023] At present, augmented reality (AR) technology has begun to gradually enter people's lives. The near-eye display device based on AR is usually an optical transmissive display, which has a semi-transmissive and semi-reflective optical system. On the one hand, it can transmit external ambient light so that users can see the real world in front of them. On the other hand, it can reflect the images from the micro display and superimpose them into the human field of view, thus achieving the display effect of augmented reality. The optical transmissive near-eye display device can align virtual content with the real scene. It is necessary to collect the real scene through a camera and know the position relationship between the camera module and the content in the real world. Through the geometric transformation of the coordinate system, the rendering position of the virtual object in the display module is obtained, and then the virtual content is superimposed and displayed at the corresponding position in the real world.

[0024] In actual use, the near-eye display device needs to use a tracking camera to collect scene images or features, and project the scene-related coordinates onto the virtual phase plane of the display unit through the calibration parameters of the tracking camera and the display unit. At this time, the human eye completes the virtual-real registration through the virtual imaging of the near-eye display device and the real image of the scene transmitted through the near-eye display device. The near-eye display device that has completed the virtual-real registration can accurately superimpose and display the virtual content at the corresponding position in the real scene, thus ensuring the display effect. To ensure the virtual-real registration accuracy (i.e., the accuracy of the calibration parameters), usually a depth accuracy test needs to be completed at the factory to ensure that the depth difference between the virtual imaging and the actual scene is within a certain range. However, in the related technology, when detecting the depth difference between the virtual imaging and the actual scene, the user mainly subjectively observes the depth difference between the virtual phase plane and the actual plane in the real scene, resulting in poor measurement accuracy.

[0025] In view of the above problems, the inventors proposed the depth error detection method, device, computer device, and storage medium provided in the embodiments of the present application, which can accurately detect the depth error when the near-eye display device displays content, and provide a discrimination basis for the accuracy of the near-eye display device to superimpose and display virtual content into the real scene. Among them, the specific depth error detection method will be described in detail in the subsequent embodiments.

[0026] Next, the scenarios involved in the embodiments of the present application will be introduced first.

[0027] As Figure 1 shown, in Figure 1The described scenario includes a computer device 100, a near-eye display device 200, a device fixing device 300, a binocular camera 400, a first physical object 500, a first mobile device 600, and a guide rail 700. Among them, the near-eye display device 200 and the binocular camera 400 are arranged on the device fixing device 300, and the two cameras of the binocular camera 400 are respectively located at the viewing positions of the first display unit and the second display unit of the near-eye display device 200. For example, if the first display unit corresponds to the left eye of a human eye and the second display unit corresponds to the right eye of a human eye, then one of the cameras of the binocular camera 400 is located at the left-eye viewing position and the other camera is located at the right-eye viewing position; the first physical object 500 is arranged on the clamping device of the first mobile device 600, the first mobile device 600 is arranged on the guide rail 700, and the first physical object 500 is located in the projection direction of the near-eye display device 200. The guide rail 700 is parallel to the projection direction of the near-eye display device 200. Thus, when the first mobile device 600 moves on the guide rail 700, it can carry the first physical object 500 to move in a direction parallel to the projection direction of the near-eye display device 200, thereby changing the depth of the first physical object 500 from the near-eye display device 200.

[0028] Among them, the near-eye display device 200 can be an AR head-mounted display device (such as AR glasses, etc.), an AR head-up display, etc.; the first physical object 500 can be a physical plane, and a plurality of feature points are arranged on the physical plane. For example, the first physical object 500 can be a checkerboard target, and the first physical object 500 can be directly opposite to the near-eye display device 200.

[0029] The computer device 100 can be connected to the near-eye display device 200, the binocular camera 400, and the first mobile device 600. The computer device 100 can control the near-eye display device to superimpose and display virtual content matching the first physical object 500 in the real scene based on the above first physical object 500, and the display position of the virtual content in the real scene matches the position of the first physical object 500 in the real scene; and, the computer device 100 can use the binocular camera 400 to detect the depth of the first physical object 500 and detect the depth of the virtual content displayed by the near-eye display device 200 in the real scene. Since the binocular camera 400 is arranged at the viewing position of the display unit of the near-eye display device 200, it can be considered that the detected depth is the depth from the near-eye display device 200. Furthermore, the computer device 100 can determine the depth error when the near-eye display device 200 displays content based on the detected depth.

[0030] Next, the depth error detection method provided by the embodiments of the present application will be introduced in detail with reference to the accompanying drawings.

[0031] Please refer to Figure 2 ,Figure 2 The flowchart of the depth error detection method provided by an embodiment of the present application is shown. In a specific embodiment, the depth error detection method is applied to a depth error detection device 400 as shown in Figure 9 Figure 400 and a computer device 100 configured with the depth error detection device 400 ( Figure 10 ). Hereinafter, the computer device will be taken as an example to illustrate the specific process of this embodiment. Of course, it can be understood that the computer device applied in this embodiment can be a PC computer, a notebook computer, an industrial control computer, etc., which is not limited herein. The following will elaborate on the Figure 2 flow shown in Figure 400 in detail. The depth error detection method may specifically include the following steps:

[0032] Step S110: Control the near-eye display device to display virtual content based on the first position of the first entity object in the real scene.

[0033] In the embodiment of the present application, there is a first entity object within the field of view of the near-eye display device. The first entity object is used for the near-eye display device to perform tracking and recognition to superimpose and display virtual content in the real scene. When detecting the depth error of the virtual content display, the computer device can control the near-eye display device to superimpose and display virtual content at the first position where the first entity object is located in the real scene based on the first entity object in the real scene. That is to say, the display position of the first entity object in the real scene matches the position of the first entity object in the real scene. At this time, detecting the depth of the first entity object can be regarded as the theoretical display depth when the virtual content is displayed.

[0034] In some embodiments, the virtual content may match the first entity object. Optionally, the virtual content is the same as or partially the same as the first entity object. For example, if the first entity object is a solid plane with a pattern, the virtual content may only include a virtual pattern that matches the pattern, that is, the virtual content is partially the same as the first entity object; the virtual content may also be a virtual plane including a virtual pattern that matches the pattern, that is, the virtual content is exactly the same as the first entity object. Thus, using the depth of the first entity object as the theoretical display depth of the virtual content subsequently can be more accurate.

[0035] In some embodiments, the computer device may send a display instruction to the near-eye display device to instruct the near-eye display device to superimpose and display virtual content in the real scene based on the first position where the first entity object is located in the real scene. Correspondingly, after receiving the display instruction, the near-eye display device responds to the display instruction, performs tracking and recognition on the first entity object within the field of view, and then superimposes and displays virtual content in the real scene according to the tracking and recognition result.

[0036] In some embodiments, the first entity object may be a characteristic pattern of an entity or an object with a characteristic pattern pasted thereon. Thus, the near-eye display device can identify the characteristic pattern to determine the position of the first entity object in the real scene, and based on the identified position, superimpose and display virtual content at the position where the first entity object is located in the real scene.

[0037] In a possible embodiment, the characteristic pattern may be a pattern with a topological structure, where the topological structure is the connectivity relationship between sub-markers and feature points in the characteristic pattern; the characteristic pattern may also be a dot-type marker. Thus, the near-eye display device can identify the characteristic pattern, and further obtain the relative spatial position information between the near-eye display device and the first entity object, which reflects the position of the first entity object in the real scene. Therefore, based on the recognition result, it is possible to superimpose and display virtual content at the position where the first entity object is located in the real scene.

[0038] Optionally, the above characteristic pattern may include at least one sub-characteristic pattern, and the sub-characteristic pattern may be a pattern with a certain shape. In one embodiment, each sub-characteristic pattern may have one or more feature points, where the shape of the feature points is not limited and may be a dot, a ring, a triangle, or other shapes.

[0039] In a possible embodiment, for the near-eye display device to identify the above characteristic pattern, the near-eye display device may first collect an image containing the characteristic pattern through an image acquisition device (such as a tracking camera of the near-eye display device), and then identify the characteristic pattern in the image. Optionally, for the near-eye display device to collect an image containing the characteristic pattern, it may be by adjusting the spatial position of the near-eye display device in the real space or by adjusting the spatial position of the first entity object in the real space, so that the above characteristic pattern is within the visual range of the image acquisition device of the near-eye display device, thereby enabling the near-eye display device to perform image acquisition and image recognition on the characteristic pattern. Among them, the visual range of the image acquisition device may be determined by the size of the field of view angle.

[0040] In a possible embodiment, the content data of the virtual content displayed by the near-eye display device may be that after the near-eye display device identifies the above characteristic pattern, based on the identified characteristic pattern, it reads the content data that matches the characteristic pattern in the pre-stored display content data, and then obtains the content data of the virtual content to be displayed; the near-eye display device then determines the rendering position of the virtual content based on the identified relative spatial position information relative to the first entity object, and then renders and displays the content data based on the rendering position, thereby realizing the superimposed display of virtual content in the real scene.

[0041] Optionally, the distribution rules of the sub-feature patterns within different feature patterns are different. Therefore, each feature pattern can have different identity information. By recognizing the sub-feature patterns included in the feature pattern, the near-eye display device can obtain the identity information corresponding to the feature pattern. The identity information can be information such as coding that can be used to uniquely identify the feature pattern, but is not limited thereto.

[0042] In a possible implementation, after the near-eye display device captures an image including the first physical object through the image capture device, the captured image can be sent to the computer device. Correspondingly, the computer device can receive the image captured by the near-eye display device, perform recognition based on the captured image, and based on the recognition result, determine the content data of the virtual content that matches the recognition result as the content data of the virtual content to be displayed by the near-eye display device, and send the content data to the near-eye display device for display.

[0043] Step S120: Obtain the first depth information of the first physical object at the first position.

[0044] In the embodiments of the present application, after the computer device controls the near-eye display device to superimpose and display virtual content in the real scene, the depth error of the virtual content displayed by the near-eye display device can be detected. Among them, since the position where the virtual content displayed by the near-eye display device is superimposed and displayed in the real scene matches the position of the first physical object in the real scene, the computer device can obtain the first depth information of the first physical object, and this first depth information can be regarded as the theoretical display depth when the near-eye display device displays the above virtual content. On this basis, the computer device can determine the true depth information of the displayed virtual content to determine the depth error.

[0045] In some embodiments, the computer device can detect the distance between the first physical object and the near-eye display device visually and use this as the first depth information of the first physical object at the above first position. For example, through a binocular camera, a 3D camera, etc. disposed at the human eye viewing position of the near-eye display device. Of course, the specific method for detecting the first depth information of the first physical object at the first position can be not limited.

[0046] Step S130: Obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information.

[0047] In an embodiment of the present application, the computer device may further obtain the feature information of the displayed virtual content, and confirm the second depth information of the virtual content according to the feature information, that is, the actual depth of the displayed virtual content, so as to determine the depth error when the near-eye display device displays the content according to the above first depth information (the theoretical display depth of the virtual content) and the second depth (the actual depth of the displayed virtual content).

[0048] In some embodiments, the computer device may detect the feature information of the virtual content visually, and determine the depth of the displayed virtual content (i.e., the actual display position of the virtual content) from the near-eye display device according to the detected feature information of the virtual content. For example, image acquisition is performed by a binocular camera, a 3D camera, etc. disposed at the human eye viewing position of the near-eye display device, feature points are extracted from the acquired images, and the depth is calculated according to the extracted feature points. Of course, the specific method for detecting the depth of the displayed virtual content from the near-eye display device may not be limited.

[0049] Step S140: Determine the depth error of the virtual content display based on the first depth information and the second depth information.

[0050] In an embodiment of the present application, after the computer device obtains the above first depth information (i.e., the theoretical display depth when the near-eye display device displays the above virtual content) and the second depth information (i.e., the actual depth of the position of the displayed virtual content), it may determine the depth error of the virtual content display based on the difference between the first depth information and the second depth information.

[0051] In some embodiments, the computer device may obtain the difference between the first depth information and the second depth information, and use the obtained difference as the depth error when the virtual content is displayed. After the computer device determines the depth error, it may output the depth error for the user to know the corresponding depth error of the near-eye display device, and then further adjust the calibration parameters of the display unit, so as to ensure the accuracy when the near-eye display device displays the content.

[0052] The depth error detection method provided by the embodiments of the present application can control the near-eye display device to superimpose and display the virtual content at the position where the first physical object is located. Then, according to the position where the first physical object is located, the display depth when the virtual content is displayed can be determined. Then, the actual depth of the displayed virtual content is detected. Then, according to the difference between the two, the depth error when the virtual content is displayed can be accurately determined, providing a discrimination basis for the accuracy when the near-eye display device superimposes and displays the virtual content on the real scene.

[0053] Please refer to Figure 3 , Figure 3The flowchart of the depth error detection method provided by another embodiment of the present application is shown. The depth error detection method is applied to the above computer device, and the first entity object includes multiple entity feature points. The following will be directed to Figure 3 The shown process will be elaborated in detail. The depth error detection method may specifically include the following steps:

[0054] Step S210: Control the near-eye display device to superimpose and display virtual feature points matching each entity feature point based on the position corresponding to each entity feature point of the first entity object.

[0055] In an embodiment of the present application, the computer device controls the near-eye display device to display virtual content based on the first entity object, which may be to control the near-eye display device to superimpose and display virtual feature points matching each entity feature point in the real scene based on the position corresponding to each entity feature point of the first entity object.

[0056] In some embodiments, as Figure 1 shown, the first entity object 500 may be located in the projection direction directly opposite to the near-eye display device 200, that is, the first entity object 500 is within the field of view of the image acquisition device (such as a tracking camera) of the near-eye display device 200, and the first entity object 500 includes multiple entity feature points located in the same plane. Since the multiple entity feature points are in the same plane and the multiple entity feature points are located in the projection direction directly opposite to the near-eye display device, the depth of the multiple feature points from the near-eye display device can accurately reflect the depth of the first entity object from the near-eye display device.

[0057] In a possible embodiment, the first entity object may be an entity plane, and multiple entity feature points are arranged on the entity plane. The shape of the entity feature points may not be limited, for example, it may be a dot, a ring, a triangle, etc.; the color of the entity feature points may also not be limited, for example, it may be black, red, etc. Exemplarily, as Figure 1 shown, the first entity object 500 is a checkerboard target, the entity feature points are black dots, and the multiple entity feature points include dots of different sizes.

[0058] After receiving a display instruction sent by a computer device, a near-eye display device can, in response to the display instruction, track and identify entity feature points on a first entity object to identify the spatial positions of the respective entity feature points relative to the near-eye display device (i.e., positions in the real scene), and the content to be displayed that matches each feature point. Then, based on the calibration parameters of the display unit (the conversion relationship between the virtual space and the real space), the content to be displayed is displayed, so that the content to be displayed is superimposed and displayed at the position where the entity feature points are located. Among them, the content to be displayed can be virtual feature points that are the same as the entity feature points. Thus, the virtual content displayed by the near-eye display device includes virtual feature points that match the respective entity feature points.

[0059] Step S220: Obtain the depth of each of the entity feature points from the near-eye display device in the real scene to obtain the depth corresponding to each entity feature point.

[0060] In an embodiment of the present application, when determining the depth of a first entity object from a near-eye display device, a computer device can obtain the depth of each entity feature point from the near-eye display device in the real scene. Thus, the depth corresponding to each entity feature point can be obtained, that is, the theoretical display depth of each virtual feature point displayed by the near-eye display device.

[0061] In some embodiments, the computer device can collect an image of the first entity object through a camera disposed on the near-eye display device, and based on the collected image, identify each entity feature point, and then determine the depth of each entity feature point from the near-eye display device.

[0062] Step S230: Based on the depth corresponding to each entity feature point, determine the depth of the first entity object from the near-eye display device in the real scene as first depth information.

[0063] In an embodiment of the present application, after the computer device obtains the depth of each entity feature point from the near-eye display device, it can determine the first depth information of the first entity object based on the depth corresponding to each entity feature point.

[0064] In a possible embodiment, the computer device can obtain the average value of the depths corresponding to multiple entity feature points and use this average value as the first depth information of the first entity object. It can be understood that since multiple entity feature points are on the same plane and multiple entity feature points are in the projection direction directly facing the near-eye display device, the average value of the depths of multiple entity feature points from the near-eye display device can be regarded as the first depth information of the position of the first entity object in its real scene.

[0065] Optionally, after obtaining the average value of the depths corresponding to multiple entity feature points, the computer device may also screen the depths corresponding to the multiple entity feature points to filter out the depths corresponding to the entity feature points whose difference from the average value is greater than a specified threshold, and then obtain the average value of the depths corresponding to the screened entity feature points, and use this average value as the first depth information of the first entity object.

[0066] Step S240: Obtain each virtual feature point of the virtual content, and obtain the depth corresponding to each virtual feature point according to the depth of each virtual feature point.

[0067] In the embodiment of the present application, similar to obtaining the first depth information of the first entity object, the computer device may obtain each virtual feature point in the displayed virtual content, and determine the depth of each virtual feature point according to each obtained virtual feature point, that is, the real depth of each virtual feature point displayed by the near-eye display device.

[0068] In some embodiments, the computer device may collect images of the displayed virtual content through a camera disposed at the human eye viewing position of the near-eye display device, identify each virtual feature point based on the collected images, and then determine the depths of the virtual feature points in the virtual content based on the identified virtual feature points.

[0069] Step S250: Based on the depth corresponding to each virtual feature point, determine the depth of the displayed virtual content from the near-eye display device in the real scene as the second depth information.

[0070] In the embodiment of the present application, after the computer device obtains the depth of each displayed virtual feature point, it may determine the depth of the virtual content from the near-eye display device in the real scene based on the depth corresponding to each virtual feature point, so as to obtain the second depth information of the virtual content.

[0071] In a possible implementation manner, the computer device may obtain the average value of the depths corresponding to multiple virtual feature points, and use this average value as the depth of the displayed virtual content from the near-eye display device in the real scene. It can be understood that since each virtual feature point matches each entity feature point, and the display position of the virtual feature point matches the position where the entity feature point is located, the multiple virtual feature points are also in the same plane, and the virtual feature points are located in the projection direction directly opposite to the near-eye display device. Therefore, the average value of the depths of the multiple virtual feature points from the near-eye display device can be regarded as the second depth information of the displayed virtual content.

[0072] Optionally, after obtaining the average value of the depths corresponding to multiple virtual feature points, the computer device also filters the depths corresponding to the multiple virtual feature points to filter out the depths corresponding to the virtual feature points whose difference from the average value is greater than a specified threshold, and then obtains the average value of the depths corresponding to the filtered virtual feature points, and uses this average value as the second depth information of the virtual content.

[0073] Step S260: Determine the depth error of the virtual content display based on the first depth information and the second depth information.

[0074] In the embodiment of the present application, the content of step S260 can refer to the content of other embodiments and will not be elaborated here.

[0075] The depth error detection method provided by the embodiment of the present application can realize superimposing and displaying virtual feature points matching the entity feature points at the positions where each entity feature point is located by controlling the near-eye display device. Thus, the depth information of the first entity object can be determined based on the depths corresponding to each entity feature point, and the depth information of the virtual content can be determined based on the depths corresponding to each virtual feature point, so as to improve the accuracy of the theoretical display depth and the true depth of the determined virtual content, and further improve the accuracy of detecting the depth error when the near-eye display device displays content.

[0076] Please refer to Figure 4 , Figure 4 shows a schematic flowchart of a depth error detection method provided by another embodiment of the present application. This depth error detection method is applied to the above computer device, and the near-eye display device includes a first display unit and a second display unit. The following will elaborate on the Figure 4 shown process in detail. The depth error detection method may specifically include the following steps:

[0077] Step S310: Control the near-eye display device to display virtual content based on the first position of the first entity object in the real scene.

[0078] In the embodiment of the present application, the content of step S310 can refer to the content of the foregoing embodiments and will not be elaborated here.

[0079] Step S320: Obtain the first entity object through the first display unit and the second display unit by the first camera, and detect the depth of the first entity object from the near-eye display device in the real scene to obtain the first depth information.

[0080] In an embodiment of the present application, a near-eye display device may include a first display unit and a second display unit. The first display unit and the second display unit of the near-eye display device may respectively correspond to the two eyes of a human eye. For example, the first display unit corresponds to the left eye of the human eye, and the second display unit corresponds to the right eye of the human eye, or the first display unit corresponds to the right eye of the human eye, and the second display unit corresponds to the left eye of the human eye. Among them, the near-eye display device may be an AR glasses, an AR display helmet, etc. Thus, when the near-eye display device displays virtual content, it can respectively generate the display content corresponding to the first display unit and the second display unit, and the display content corresponding to the first display unit and the display content corresponding to the second display unit have parallax, so as to achieve a three-dimensional display effect.

[0081] In this embodiment, when detecting the depth error of the display content of the near-eye display device, a first camera may be set at the viewing positions of the first display unit and the second display unit. The first camera may be a binocular camera, and the first camera may collect images of a first physical object through the optical lenses of the first display unit and the second display unit. Thus, the first physical object in the real scene can be obtained through the first display unit and the second display unit by the first camera, and the depth of the first physical object from the near-eye display device in the real scene can be detected. For example, please refer to Figure 1 , the two cameras of the binocular camera 400 are respectively located at the viewing positions of the first display unit and the second display unit of the near-eye display device 200. Thus, the binocular camera can simulate the human eyes of the user, detect the depth information of the first physical object and the depth information of the displayed virtual content, and further detect the depth error of the display content of the near-eye display device more accurately.

[0082] In some embodiments, binocular stereo calibration may be performed on the binocular camera in advance. Binocular stereo calibration refers to the calibration of the relative positions between two cameras. Among them, the binocular camera calibration parameters may include: the camera internal parameter matrix, the distortion coefficient matrix, the essential matrix, the fundamental matrix, the rotation matrix, and the translation matrix. The binocular camera that has completed binocular stereo calibration can be connected to a computer device, and the computer device can implement the above-mentioned depth detection through the binocular camera.

[0083] Step S330: Obtain the virtual content displayed by the first display unit and the second display unit through the second camera, obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information.

[0084] In the embodiments of the present application, similar to obtaining the above-mentioned second depth information, the second camera can obtain the virtual content displayed by the first display unit and the second display unit through the first display unit and the second display unit, obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information of the virtual content. Thus, the actual display depth of the virtual content can be accurately determined. It can be understood that the second camera can be the same camera as the first camera.

[0085] Step S340: Based on the first depth information and the second depth information, determine the depth error of the virtual content display.

[0086] In the embodiments of the present application, the content of step S340 can refer to the content of other embodiments and will not be elaborated here.

[0087] Next, in combination with Figure 1 the depth error detection system 10 shown below, the depth error detection method provided by the embodiments of the present application will be described.

[0088] In Figure 1 the depth error detection system 10 shown below, after binocular stereo calibration, the binocular cameras 400 are respectively located at the viewing positions of the first display unit and the second display unit of the near-eye display device 200; the binocular cameras 400 (including the left industrial camera and the right industrial camera) collect images of the first physical object 500, extract feature points and perform stereo matching, calculate the depth, so as to obtain the depth corresponding to each physical feature point, and obtain the average value of the depths corresponding to each physical feature point to obtain the first depth information of the first physical object 500. This depth can be regarded as the display depth when the near-eye display device 200 displays virtual content; please refer to Figure 5 , by controlling the tracking camera of the near-eye display device 200 to track and identify each physical feature point in the first physical object 500, the physical feature point and the tracking camera projection are recorded as The physical feature points tracked and identified by this tracking camera are projected onto the virtual phase plane 1 of the left optical engine (the first display unit) (projection relationship ) through the internal and external calibration parameters between the tracking camera and the virtual optical engine (display unit), and onto the virtual phase plane 2 of the right optical engine (the second display unit) (projection relationship ). At this time, the virtual feature points projected by the near-eye display device 200 are obtained through the binocular cameras 400, and the depth of each virtual feature point from the near-eye display device 200 is obtained through binocular ranging, and the average value of the depths corresponding to each virtual feature point is obtained to obtain the second depth information of the displayed virtual content; then the difference between the first depth information of the detected first physical object 500 and the second depth information of the displayed virtual content is calculated to obtain the depth error when the near-eye display device 200 displays content.

[0089] In addition, in some ways, the first entity object 500 is disposed on the first mobile device 600, which can be a robotic arm or the like. The computer device 100 can control the first mobile device 600 to move the first entity object 500 to a first position, which is one or more different positions, so that the depth of the first entity object 500 from the near-eye display device 200 changes, and the process of the above depth error detection method is repeated to complete the depth error detection at different display depths, and multiple determined depth errors are obtained.

[0090] In this way, after the computer device obtains multiple determined depth errors, when determining whether the near-eye display device is qualified based on the multiple determined depth errors, it can compare each determined depth error with an error threshold; if each determined depth error is not greater than the error threshold, it can be determined that the near-eye display device is qualified; if any one of the multiple determined depth errors is greater than the error threshold, it is determined that the near-eye display device is unqualified.

[0091] The depth error detection method provided by the embodiments of the present application can realize controlling the near-eye display device to superimpose and display virtual content at the position where the first entity object is located. By detecting the first entity object at the viewing positions of the first display unit and the second display unit, the theoretical display depth when displaying the virtual content can be determined, and then the actual depth of the displayed virtual content is detected by the binocular camera, and then according to the difference between the two, the depth error when the near-eye display device displays content can be automatically tested, and errors will not be generated due to human intervention, improving the detection accuracy and the detection efficiency.

[0092] Please refer to Figure 6 , Figure 6 which shows a schematic flowchart of the depth error detection method provided by another embodiment of the present application. This depth error detection method is applied to the above computer device. The following will elaborate in detail on the Figure 6 shown process. The depth error detection method may specifically include the following steps:

[0093] Step S410: Control the near-eye display device to display virtual content based on the first position of the first entity object in the real scene.

[0094] Step S420: Obtain the first depth information of the first entity object at the first position.

[0095] Step S430: Obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information.

[0096] Step S440: Determine the depth error of the virtual content display based on the first depth information and the second depth information.

[0097] In the embodiments of the present application, steps S410 to S440 may refer to the content of other embodiments and will not be elaborated herein.

[0098] Step S450: Control the near-eye display device to project a first virtual plane along the projection direction facing the near-eye display device at a first projection distance, where the first virtual plane matches the first physical plane, and the first physical plane is disposed on the second mobile device.

[0099] In the embodiments of the present application, the depth error may also be obtained by combining the user's eye perception. Among them, the computer device may control the near-eye display device to project a first virtual plane along the projection direction facing the near-eye display device at a first projection distance. The first virtual plane may be generated based on the first physical plane so that the user can compare whether the first physical plane coincides with the first virtual plane, and the first physical plane is disposed on the second mobile device. Thus, when the first physical plane is moved by controlling the first mobile device to carry the first physical plane, and when the human eye perceives that the first physical plane coincides with the first virtual plane, the distance between the first physical plane and the near-eye display device may be used as the distance between the first virtual plane displayed in the real scene and the near-eye display device.

[0100] Step S460: Control the second mobile device to carry the first physical plane to move in the real scene along the projection direction facing the near-eye display device until a target indication information is received, where the target indication information is used to indicate that the first physical plane coincides with the first virtual plane.

[0101] In some embodiments, the second mobile device is located on a guide rail parallel to the projection direction facing the near-eye display device. The computer device may control the second mobile device to move along the guide rail so that when the user observes through the near-eye display device that the first physical plane coincides with the first virtual plane, the user inputs the target indication information to the computer device.

[0102] Step S470: Obtain the distance between the first physical plane and the near-eye display device as the first actual distance.

[0103] In an embodiment of the present application, when the computer device obtains the target indication information, it indicates that the user observes through the near-eye display device that the first physical plane coincides with the first virtual plane. At this time, the distance between the first physical plane and the near-eye display device in the real scene can be regarded as the actual distance between the first virtual screen displayed by the near-eye display device and the near-eye display device in the real scene. Moreover, since the first virtual plane is projected along the projection direction facing the near-eye display device, this distance can be regarded as the actual depth of the displayed first virtual plane from the near-eye display device.

[0104] In some embodiments, before controlling the near-eye display device to display the first virtual plane, the first mobile device can be controlled to move the first physical plane to a position where the distance from the near-eye display device is 0, and then the near-eye display device is controlled to display the first virtual plane; then the first mobile device is controlled to move the first physical plane until the input target indication information is received. At this time, the computer device can obtain the distance that the second mobile device moves along the guide rail, and this distance can be regarded as the distance between the first physical plane and the near-eye display device. Of course, the distance between the first physical plane and the near-eye display device can also be detected by means of a distance sensor or visual detection.

[0105] Step S480: Determine the depth error when the near-eye display device displays the content based on the difference between the first projection distance and the first actual distance, and the depth error of the virtual content display.

[0106] In an embodiment of the present application, after obtaining the above first actual distance, the difference between the first projection distance (i.e., the theoretical display depth of the first virtual plane) and the second actual distance (i.e., the actual depth of the displayed first virtual plane from the near-eye display device in the real scene) can be obtained. This difference is the depth error obtained by the way of human eye perception of the user. Then, based on this difference and the depth error of the virtual content display obtained above, the depth error when the near-eye display device displays the content is determined.

[0107] In some embodiments, the average value of the above difference and the depth error of the virtual content display obtained is obtained and used as the depth error when the near-eye display device displays the content. Since the above difference and the depth error of the virtual content display obtained can be understood as the depth errors detected by different detection methods, therefore, determining the depth error based on the above difference and the depth error of the virtual content display obtained can improve the accuracy of detecting the depth error of the near-eye display device.

[0108] In some embodiments, it is also possible to control the first mobile device to carry the first physical object and move it to different positions relative to the displayed device in the real scene. And each time the first mobile device is controlled to carry the first physical object and move to a different position, steps S410 to S440 are repeated to obtain the depth errors when the virtual content is determined multiple times. Additionally, the above-mentioned first projection distance can be updated, and steps S450 to S470 are repeated to obtain the differences between the first projection distance and the first actual distance determined multiple times, as Figure 7 shown, it is possible to control the near-eye display device to change the projection distance of the first virtual plane, and when the first virtual plane coincides with the first physical plane through the user's eye perception, the depth error is detected to obtain the differences determined multiple times ( Figure 7 in this case, it is n times, where n is a positive integer); based on the differences determined multiple times and the depth errors when the virtual content is displayed determined multiple times, when determining the depth error when the near-eye display device displays content, the average value of the differences determined multiple times and the depth errors when the virtual content is displayed determined multiple times can be obtained and used as the depth error when the near-eye display device displays content. Optionally, the standard deviation of the differences determined multiple times and the depth errors when the virtual content is displayed determined multiple times can also be obtained to provide a reference for the user.

[0109] The depth error detection method provided by the embodiments of the present application detects the depth error when the near-eye display device displays content by automatically detecting the depth error and combining the method of detecting the depth error through human eye perception, and then determines the final depth error based on the depth errors determined by the two methods, thereby improving the accuracy of detecting the depth error when the near-eye display device displays content.

[0110] Please refer to Figure 8 , Figure 8 which shows a schematic flowchart of a depth error detection method provided by another embodiment of the present application. This depth error detection method is applied to the above-mentioned computer device, and the following will elaborate in detail on the Figure 8 shown process. The depth error detection method may specifically include the following steps:

[0111] Step S510: Control the near-eye display device to display virtual content based on the first position of the first physical object in the real scene.

[0112] Step S520: Obtain the first depth information of the first physical object at the first position.

[0113] Step S530: Obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information.

[0114] Step S540: Determine the depth error of the virtual content display based on the first depth information and the second depth information.

[0115] In the embodiments of the present application, the contents of steps S510 to S540 can refer to the content of the foregoing embodiments and will not be elaborated herein.

[0116] Step S550: Control the near-eye display device to project a second virtual plane along the projection direction facing the near-eye display device at a second projection distance, where the second virtual plane matches the second physical plane.

[0117] In the embodiments of the present application, the depth error can also be obtained in combination with the way of human eye perception of the user. Among them, the computer device can control the near-eye display device to project a second virtual plane along the projection direction facing the near-eye display device at a second projection distance. The second virtual plane can be generated based on the second physical plane so that the user can compare the depth deviation between the second physical plane and the second virtual plane.

[0118] Step S560: Receive the input measurement deviation, where the measurement deviation is the distance deviation between the second physical plane and the displayed second virtual plane in the projection direction.

[0119] In the embodiments of the present application, after controlling the near-eye display device to display the second virtual plane, the tester can, based on the displayed second virtual plane, test the distance deviation between the second physical plane and the displayed second virtual plane in the projection direction and input the tested distance deviation as the measurement deviation into the computer device. Correspondingly, the computer device can receive the input measurement deviation. Exemplarily, the first tester can view the displayed second virtual plane through the near-eye display device, and the second tester can carry the second physical plane in the projection direction of the near-eye display device and, based on the description of the first tester, use a measuring tool (such as a ruler, etc.) to measure the distance deviation between the second physical plane and the second virtual plane in the above projection direction; then, the tester inputs the measurement deviation through the input interface of the computer device, and further the computer device can receive the input measurement deviation.

[0120] Step S570: Determine the depth error when the near-eye display device displays content based on the depth error of the virtual content display and the measurement deviation.

[0121] In an embodiment of the present application, a computer device may obtain an average value of the depth error and measurement deviation of virtual content display, and use this average value as the depth error when the near-eye display device displays content. Since the depth error and measurement deviation of virtual content display can be understood as depth errors detected by different detection methods, determining the depth error based on the depth error and measurement deviation of virtual content display can improve the accuracy of the detected depth error of the near-eye display device.

[0122] In some embodiments, it is also possible to control the first mobile device to carry the first physical object to move to different positions relative to the displayed device in the real scene, and each time the first mobile device is controlled to carry the first physical object to move to a different position, steps S510 to S540 are repeated to obtain the depth errors of virtual content display determined multiple times; in addition, the above second projection distance can be updated, and the above steps S550 to S560 are repeated to obtain the measurement deviations determined multiple times; when determining the depth error when the near-eye display device displays content based on the depth error of virtual content display and the distance deviation, the average value of the depth errors of virtual content display determined multiple times and the distance deviations determined multiple times can be obtained and used as the depth error when the near-eye display device displays content. Optionally, the standard deviation of the depth errors of virtual content display determined multiple times and the distance deviations determined multiple times can also be obtained to provide a reference for the user.

[0123] It should be noted that the depth error detection method provided in the embodiment of the present application can also be combined with the depth error detection method provided in the previous embodiment. For example, through the implementation method in the previous embodiment, the depth error of the above virtual content display and the difference between the first projection distance and the first actual distance can be obtained, and through the implementation method in the embodiment of the present application, the above measurement deviation can be obtained, and then the average value of the depth error of virtual content display, the above difference, and the distance deviation is obtained as the finally determined depth error.

[0124] The depth error detection method provided in the embodiment of the present application respectively detects the depth error when the near-eye display device displays content by automatically detecting the depth error and combining the method of detecting the depth error by human eye perception, and then determines the final depth error based on the depth errors determined by the two methods, thereby improving the accuracy of detecting the depth error when the near-eye display device displays content.

[0125] Please refer to Figure 9, which shows a structural block diagram of a depth error detection device 400 provided by an embodiment of the present application. The depth error detection device 400 applies the above computer device. The depth error detection device 400 includes: a content display module 410, a first acquisition module 420, a second acquisition module 430, and an error determination module 440. Among them, the content display module 410 is used to control the near-eye display device to display virtual content based on the first position of the first physical object in the real scene; the first acquisition module 420 is used to acquire the first depth information of the first physical object at the first position; the second acquisition module 430 is used to acquire the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information; the error determination module 440 is used to determine the depth error of the virtual content display based on the first depth information and the second depth information.

[0126] In some embodiments, the first physical object includes a plurality of physical feature points. The first acquisition module 420 may specifically be used to: acquire the depth of each physical feature point from the near-eye display device in the real scene, and obtain the depth corresponding to each physical feature point; based on the depth corresponding to each physical feature point, determine the depth of the first physical object from the near-eye display device in the real scene as the first depth information.

[0127] In this embodiment, the content display module 410 may specifically be used to: control the near-eye display device to superimpose and display virtual feature points matching each physical feature point based on the position corresponding to each physical feature point of the first physical object. The second acquisition module 430 may specifically be used to: acquire each virtual feature point of the virtual content, and obtain the depth corresponding to each virtual feature point according to the depth of each virtual feature point; based on the depth corresponding to each virtual feature point, determine the depth of the displayed virtual content from the near-eye display device in the real scene as the second depth information.

[0128] In some embodiments, the near-eye display device includes a first display unit and a second display unit. The first acquisition module 420 may specifically be used to: acquire the first physical object through the first display unit and the second display unit by a first camera, and detect the depth of the first physical object from the near-eye display device in the real scene to obtain the first depth information.

[0129] In some other embodiments, the near-eye display device includes a first display unit and a second display unit. The second acquisition module 430 may be specifically configured to: acquire the virtual content displayed by the first display unit and the second display unit through the second camera through the first display unit and the second display unit, acquire the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information.

[0130] In some embodiments, the first physical object is disposed on the first mobile device. The depth error detection device 400 may further include: a position adjustment module. The position adjustment is configured to: control the first mobile device to move the first physical object to a first position, where the first position is one or more different positions, and the different positions have different depths from the near-eye display device.

[0131] In a possible embodiment, the depth error detection device 400 may further include: a result determination module. The result determination module is configured to: if any of the depth errors determined multiple times is greater than an error threshold, determine that the near-eye display device is unqualified.

[0132] In some embodiments, the depth error detection device 400 may further include: a movement control module and a third acquisition module. The content display module 410 may further be configured to control the near-eye display device to project a first virtual plane along a projection direction facing the near-eye display device at a first projection distance, where the first virtual plane matches a first physical plane, and the first physical plane is disposed on the first mobile device; the movement control module may be configured to control the first mobile device to carry the first physical plane to move in the real scene along the projection direction facing the near-eye display device until a target indication information is received, where the target indication information is used to indicate that the first physical plane coincides with the first virtual plane; the third acquisition module is configured to acquire the distance between the first physical plane and the near-eye display device as a first actual distance.

[0133] In this embodiment, the error determination module 440 may be specifically configured to: determine the depth error when the near-eye display device displays content based on the difference between the first projection distance and the first actual distance, and the depth error of the virtual content display.

[0134] In some embodiments, the depth error detection device 400 may further include: a deviation receiving module. The content display module 410 may further be configured to control the near-eye display device to project a second virtual plane along the projection direction facing the near-eye display device at a second projection distance, and the second virtual plane matches the second physical plane; the deviation receiving module may be configured to receive an input measurement deviation, where the measurement deviation is the distance deviation between the second physical plane and the displayed second virtual plane in the projection direction.

[0135] In this embodiment, the error determination module 440 may specifically be configured to: determine the depth error when the near-eye display device displays content based on the depth error of the virtual content display and the measurement deviation.

[0136] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the foregoing method embodiments, and will not be elaborated herein.

[0137] In several embodiments provided by the present application, the coupling between modules may be electrical, mechanical, or other forms of coupling.

[0138] In addition, in each embodiment of the present application, each functional module may be integrated in a processing module, or each module may exist physically alone, or two or more modules may be integrated in one module. The above integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0139] The embodiments of the present application further provide a depth error detection system, which includes: a computer device, a near-eye display device, and an image acquisition device, and the computer device is connected to the near-eye display device and the image acquisition device. Among them, the computer device is configured to send a display instruction to the near-eye display device; the near-eye display device is configured to respond to the display instruction and display virtual content based on the first position of the first physical object in the real scene; the computer device is further configured to obtain the first physical object through the image acquisition device, detect the depth of the first physical object from the near-eye display device in the real scene, and obtain first depth information; the computer device is further configured to obtain the displayed virtual content through the image acquisition device, obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information; the computer device is further configured to determine the depth error of the virtual content display based on the first depth information and the second depth information

[0140] In summary, for the solution provided in this application, by controlling the near-eye display device to display virtual content based on the first position of the first physical object in the real scene and obtaining the first depth information of the first physical object at the first position, since the display position of the virtual content in the real scene matches the first position, this first depth information can be used as the display depth (i.e., the theoretical depth) of the virtual content displayed by the near-eye display device. Additionally, the feature information of the virtual content is obtained, and the second depth information of the virtual content (i.e., the real depth of the displayed virtual content) is confirmed according to the feature information. Then, based on the first depth information and the second depth information, the depth error when the virtual content is displayed is determined. Thus, it is possible to accurately detect the depth error when the near-eye display device displays content, providing a discrimination basis for the accuracy of the near-eye display device to superimpose and display virtual content onto the real scene.

[0141] Please refer to Figure 10 , which shows a structural block diagram of a computer device provided in an embodiment of this application. The computer device 100 can be a computer device such as a PC, a laptop, or an industrial control computer that can run application programs. The computer device 100 in this application may include one or more of the following components: a processor 110, a memory 120, and one or more application programs, where one or more application programs can be stored in the memory 120 and configured to be executed by one or more processors 110, and one or more application programs are configured to execute the methods described in the foregoing method embodiments.

[0142] The processor 110 may include one or more processing cores. The processor 110 connects various parts within the entire computer device 100 through various interfaces and circuits. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and by invoking the data stored in the memory 120, it performs various functions of the computer device 100 and processes data. Optionally, the processor 110 may be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), or programmable logic array (PLA). The processor 110 may integrate a combination of one or more of a central processing unit (CPU), a graphics processing unit (GPU), and a modem, etc. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing display content; the modem is used to process wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 110 and may be implemented separately through a communication chip.

[0143] The memory 120 may include random access memory (RAM) and may also include read-only memory. The memory 120 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area. Among them, the program storage area can store instructions for implementing the operating system, instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing each of the following method embodiments, etc. The data storage area can also store data created during the use of the computer device 100 (such as phone book, audio and video data, chat record data, etc.).

[0144] Please refer to Figure 11 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. Program code is stored in the computer-readable medium 800, and the program code can be called by the processor to execute the methods described in the above method embodiments.

[0145] The computer-readable storage medium 800 can be an electronic memory such as a flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 800 has a storage space for program code 810 that executes any of the method steps in the above-described methods. These program codes can be read from or written to one or more computer program products. The program code 810 can be compressed in a suitable form, for example.

[0146] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments or equivalently replace some of the technical features. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the various embodiments of the present application.

Claims

1. A depth error detection method, characterized in that, The method includes: Controlling a near-eye display device to display virtual content based on a first position of a first physical object in a real scene; Obtaining first depth information of the first physical object at the first position; Obtaining feature information of the virtual content, and confirming second depth information of the virtual content according to the feature information; Determining a depth error of the virtual content display based on the first depth information and the second depth information; Controlling the near-eye display device to project a second virtual plane along a projection direction facing the near-eye display device at a second projection distance, where the second virtual plane matches a second physical plane; Receiving an input measurement deviation, where the measurement deviation is a distance deviation between the second physical plane and the displayed second virtual plane in the projection direction; Determining a depth error when the near-eye display device displays content based on the depth error of the virtual content display and the measurement deviation.

2. The method according to claim 1, characterized in that, The first physical object includes a plurality of physical feature points. The obtaining first depth information of the first physical object at the first position includes: Obtaining the depth of each physical feature point from the near-eye display device in the real scene, to obtain the depth corresponding to each physical feature point; Based on the depth corresponding to each physical feature point, determining the depth of the first physical object from the near-eye display device in the real scene as the first depth information.

3. The method according to claim 2, characterized in that, The controlling the near-eye display device to display virtual content based on a first position of a first physical object in a real scene includes: Controlling the near-eye display device to superimpose and display virtual feature points matching each physical feature point based on the position corresponding to each physical feature point of the first physical object.

4. The method according to claim 3, where the obtaining feature information of the virtual content and confirming second depth information of the virtual content according to the feature information includes: Obtaining each virtual feature point of the virtual content, and obtaining the depth corresponding to each virtual feature point according to the depth of each virtual feature point; Based on the depth corresponding to each virtual feature point, determining the depth of the displayed virtual content from the near-eye display device in the real scene as the second depth information.

5. The method according to claim 1, wherein The near-eye display device includes a first display unit and a second display unit. The obtaining first depth information of the first physical object at the first position includes: Obtaining the first physical object through the first display unit and the second display unit by a first camera, and detecting the depth of the first physical object from the near-eye display device in the real scene to obtain the first depth information.

6. The method according to claim 1, wherein The near-eye display device includes a first display unit and a second display unit. The obtaining feature information of the virtual content and confirming second depth information of the virtual content according to the feature information includes: The second camera obtains the virtual content displayed by the first display unit and the second display unit through the first display unit and the second display unit, obtains the feature information of the virtual content, and confirms the second depth information of the virtual content according to the feature information.

7. The method according to any one of claims 1-6, characterized in that, Before the first physical object is disposed on the first mobile device and the near-eye display device is controlled to display virtual content based on the first position of the first physical object in the real scene, the method further includes: Controlling the first mobile device to move the first physical object to the first position, where the first position is one or more different positions, and the depths of the different positions from the near-eye display device are different.

8. The method according to claim 7, wherein The method further includes: If any of the depth errors determined multiple times is greater than the error threshold, it is determined that the near-eye display device is unqualified.

9. The method according to any one of claims 1-6, characterized in that The method further includes: Controlling the near-eye display device to project a first virtual plane along the projection direction facing the near-eye display device according to a first projection distance, where the first virtual plane matches a first physical plane, and the first physical plane is disposed on the second mobile device; Controlling the second mobile device to move the first physical plane in the real scene along the projection direction facing the near-eye display device until target indication information is received, where the target indication information is used to indicate that the first physical plane coincides with the first virtual plane; Obtaining the distance between the first physical plane and the near-eye display device as the first actual distance; After determining the depth error of the virtual content display based on the first depth information and the second depth information, the method further includes: Determining the depth error when the near-eye display device displays content based on the difference between the first projection distance and the first actual distance, and the depth error of the virtual content display.

10. A depth error detection device, characterized in that, The device includes: a content display module, a first acquisition module, a second acquisition module, an error determination module, and a deviation reception module, where The content display module is configured to control a near-eye display device to display virtual content based on a first position of a first physical object in a real scene; The first acquisition module is configured to acquire first depth information of the first physical object at the first position; The second acquisition module is configured to acquire feature information of the virtual content, and confirm second depth information of the virtual content according to the feature information; The error determination module is configured to determine a depth error of the virtual content display based on the first depth information and the second depth information; The content display module is further configured to control the near-eye display device to project a second virtual plane along the projection direction facing the near-eye display device according to a second projection distance, where the second virtual plane matches a second physical plane; The deviation reception module is configured to receive an input measurement deviation, where the measurement deviation is a distance deviation between the second physical plane and the displayed second virtual plane in the projection direction; The error determination module is further configured to determine the depth error when the near-eye display device displays content, based on the depth error of the virtual content display and the measurement deviation.

11. A depth error detection system, characterized in that, The system includes: a computer device, a near-eye display device, and an image acquisition device. The computer device is connected to the near-eye display device and the image acquisition device. Among them, The computer device is configured to send a display instruction to the near-eye display device; The near-eye display device is configured to, in response to the display instruction, display virtual content based on the first position of the first physical object in the real scene; The computer device is further configured to obtain the first physical object through the image acquisition device, detect the depth of the first physical object from the near-eye display device in the real scene, and obtain first depth information; The computer device is further configured to obtain the displayed virtual content through the image acquisition device, obtain the feature information of the virtual content, and confirm the second depth information of the virtual content according to the feature information; The computer device is further configured to determine the depth error of the virtual content display based on the first depth information and the second depth information; The near-eye display device is further configured to project a second virtual plane along the projection direction facing the near-eye display device according to a second projection distance, and the second virtual plane matches the second physical plane; The computer device is further configured to receive the input measurement deviation, where the measurement deviation is the distance deviation between the second physical plane and the displayed second virtual plane in the projection direction; and determine the depth error when the near-eye display device displays content based on the depth error of the virtual content display and the measurement deviation.

12. A computer device, characterized in that, including: One or more processors; A memory; One or more programs, where the one or more programs are stored in the memory and are configured to be executed by the one or more processors. The one or more programs are configured to execute the method according to any one of claims 1-9.

13. A computer-readable storage medium, characterized in that, Program code is stored in the computer-readable storage medium, and the program code can be called by the processor to execute the method according to any one of claims 1-9.

Images