Distortion image acquisition method, calibration method, acquisition device and augmented reality device

Abstract

The invention relates to a distorted image acquisition method, a distorted image calibration method, a distorted image acquisition device and an augmented reality device, and relates to the technical field of virtual reality, and the distorted image acquisition method comprises the steps of obtaining an initial image; adjusting the shooting orientation of a shooting lens, and obtaining local images in different shooting orientations; according to the initial image, the local image and the overlapped part of the initial image and the local image, splicing the initial image and the local image to obtain a target image; and obtaining first distortion data according to the target image. According to the distorted image acquisition method, the calibration method, the acquisition equipment and the augmented reality equipment, distorted image data can be accurately acquired, so that the definition of a picture passing through a lens is improved.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a distorted image acquisition method, a calibration method, an acquisition device, and an extended reality device. Background Art

[0002] At present, the lens components in VR / AR devices all have distortion. The distorted images produced by the lens components will affect the actual experience of users. In order to improve the clarity of the images on the display screen, it is necessary to improve the impact caused by the distortion phenomenon. In the prior art, for VR / AR devices with a large field of view, it is impossible to accurately collect distorted image data, and it is also impossible to effectively improve the clarity of the images through the lens. Summary of the invention

[0003] In order to solve the above technical problems, the embodiments of the present application provide a distorted image acquisition method, a calibration method, an acquisition device and an extended reality device, which can accurately acquire distorted image data, thereby improving the clarity of the picture through the lens.

[0004] According to one aspect of the present application, a distorted image acquisition method is provided, comprising:

[0005] Acquire an initial image; wherein the initial image represents a portion of an original distorted image; and the original distorted image represents an image displayed on a display screen of an extended reality device;

[0006] Adjusting the shooting orientation of the shooting lens to obtain partial images at different shooting orientations; wherein the shooting lens is configured to shoot the original distorted image on the display screen through the lens of the extended reality device; the partial image represents a portion of the original distorted image; and the partial image overlaps a portion of the initial image;

[0007] splicing the initial image and the partial image according to the initial image, the partial image, and an overlapping portion between the initial image and the partial image to obtain a target image;

[0008] According to the target image, first distortion data is obtained; wherein the first distortion data represents the distortion characteristics of the original distorted image.

[0009] The distorted image acquisition method provided in the embodiment of the present application first obtains an initial image, then adjusts the shooting orientation of the shooting lens to obtain local images at different shooting orientations, and then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain a target image, and then obtains first distortion data according to the target image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, some of the original distorted images can be obtained from different orientations, and then the obtained partial images are spliced ​​to obtain original distorted image data with a larger coverage range, which is convenient for subsequently improving the clarity of the image on the display screen according to the first distortion data.

[0010] According to one aspect of the present application, before acquiring the initial image, the distorted image acquisition method further includes:

[0011] The position of the shooting lens is adjusted so that the optical axis of the shooting lens coincides with the optical axis of the lens of the extended reality device.

[0012] According to one aspect of the present application, before adjusting the position of the shooting lens, the distorted image acquisition method further includes:

[0013] Controlling the display screen to display a logo image;

[0014] The adjusting the position of the shooting lens comprises:

[0015] The shooting lens is adjusted so that the center of the logo image coincides with the center of the shooting lens.

[0016] According to one aspect of the present application, the partial image includes a first partial image and a second partial image;

[0017] The step of adjusting the shooting orientation of the shooting lens to obtain local images at different shooting orientations includes:

[0018] Adjusting the shooting orientation of the shooting lens to a first position;

[0019] Acquire the first partial image captured by the shooting lens at the first position; wherein the first partial image partially overlaps with the initial image;

[0020] Adjusting the shooting position of the shooting lens to a second position;

[0021] Acquire the second partial image captured by the shooting lens at the second position; wherein the second partial image partially overlaps with the initial image;

[0022] The step of splicing the initial image and the partial image according to the initial image, the partial image, and the overlapping portion of the initial image and the partial image to obtain a target image comprises:

[0023] The initial image, the first partial image, the second partial image, the overlapping portion of the first partial image and the initial image, and the overlapping portion of the second partial image and the initial image are spliced ​​to form the target image.

[0024] According to another aspect of the present application, a distorted image acquisition device is also provided, including:

[0025] An adjustment device configured to carry an extended reality device;

[0026] An aperture, movably disposed on the adjusting device;

[0027] A shooting lens connected to the aperture;

[0028] An electronic device is communicatively connected to the adjustment device and the shooting lens, and the electronic device is configured to run executable instructions to implement the distorted image acquisition method as described above.

[0029] The distorted image acquisition device provided in the embodiment of the present application first obtains an initial image, then adjusts the shooting orientation of the shooting lens to obtain local images at different shooting orientations, and then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain a target image, and then obtains first distortion data according to the target image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, some of the original distorted images can be obtained from different orientations, and then the obtained partial images are spliced ​​to obtain original distorted image data with a larger coverage range, which is convenient for subsequently improving the clarity of the image on the display screen according to the first distortion data.

[0030] According to another aspect of the present application, the adjusting device comprises:

[0031] A support base, configured to carry the extended reality device;

[0032] The flip bracket is rotatably connected to the support seat, the flip bracket is connected to the diaphragm, and the flip bracket is configured to drive the diaphragm to rotate around a horizontal axis.

[0033] According to another aspect of the present application, the adjusting device further comprises:

[0034] A horizontal angle adjustment disk is rotatably connected to the support seat, the horizontal angle adjustment disk is connected to the diaphragm, and the horizontal angle adjustment disk is configured to drive the diaphragm to rotate around a vertical axis.

[0035] According to another aspect of the present application, the adjusting device further comprises:

[0036] A first movable seat, movably connected to the support seat, the first movable seat is connected to the horizontal angle adjustment plate, and the first movable seat is configured to drive the horizontal angle adjustment plate and the aperture to move along a first horizontal direction;

[0037] The second movable seat is movably connected to the support seat, and the second movable seat is connected to the horizontal angle adjustment disk. The second movable seat is configured to drive the horizontal angle adjustment disk and the aperture to move along a second horizontal direction; wherein the second horizontal direction is perpendicular to the first horizontal direction.

[0038] According to another aspect of the present application, a distortion image calibration method is also provided, comprising:

[0039] Acquire second distortion data of the shooting lens; wherein the second distortion data represents the distortion characteristics of the shooting lens;

[0040] Distorted image acquisition method as described above;

[0041] calibrating the original distorted image according to the first distortion data and the second distortion data; and

[0042] The display screen is controlled to display the calibrated image.

[0043] The distortion image calibration method provided in the embodiment of the present application obtains the second distortion data of the shooting lens, then obtains the initial image, then adjusts the shooting orientation of the shooting lens, obtains local images at different shooting orientations, then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain the target image, then obtains the first distortion data according to the target image, then calibrates the original distorted image according to the first distortion data and the second distortion data, and then controls the display screen to display the calibrated image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, some of the original distorted images can be obtained from different orientations, and then the obtained partial images are spliced ​​to obtain original distorted image data with a larger coverage range. Then, according to the first distortion data and the second distortion data, the image to be displayed can be calibrated, so that the calibrated image presented on the display screen eliminates the distortion effect and has higher clarity.

[0044] According to another aspect of the present application, an extended reality device is also provided, including:

[0045] case;

[0046] A display screen, arranged on the housing;

[0047] A controller is disposed in the housing, the controller is in communication connection with the display screen, and the controller runs executable instructions to implement the distortion image calibration method as described above.

[0048] The extended reality device provided in the embodiment of the present application obtains the second distortion data of the shooting lens, then obtains the initial image, then adjusts the shooting orientation of the shooting lens, obtains local images at different shooting orientations, then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain the target image, then obtains the first distortion data according to the target image, then calibrates the original distorted image according to the first distortion data and the second distortion data, and then controls the display screen to display the calibrated image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, part of the original distorted image can be obtained from different orientations, and then the obtained part of the image can be spliced ​​to obtain original distorted image data with a larger coverage range. Then, according to the first distortion data and the second distortion data, the image to be displayed can be calibrated, so that the calibrated image presented on the display screen eliminates the distortion effect and has higher clarity. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0050] Figure 1 A flowchart of a distorted image acquisition method provided by an exemplary embodiment of the present application.

[0051] Figure 2 A schematic flowchart of a distorted image acquisition method provided by another exemplary embodiment of the present application.

[0052] Figure 3 A flowchart of a distorted image acquisition method provided by an exemplary embodiment of the present application.

[0053] Figure 4 A schematic flowchart of a distorted image acquisition method provided by another exemplary embodiment of the present application.

[0054] Figure 5 A schematic structural diagram of a distorted image acquisition device provided as an exemplary embodiment of the present application.

[0055] Figure 6 A schematic flowchart of a distorted image calibration method provided by an exemplary embodiment of the present application.

[0056] Figure 7 A structural block diagram of an extended reality device provided for an exemplary embodiment of the present application.

[0057] Figure 8 A structural block diagram of a controller provided for an exemplary embodiment of the present application.

[0058] Figure numerals: 100 - distortion image acquisition device; 110 - adjustment device; 111 - support seat; 112 - flip bracket; 113 - horizontal angle adjustment plate; 114 - first movable seat; 115 - second movable seat; 120 - aperture; 130 - shooting lens. DETAILED DESCRIPTION

[0059] Below, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.

[0060] Figure 1 The following is a flow chart of a method for acquiring distorted images provided by an exemplary embodiment of the present application. Figure 1 As shown, the distorted image acquisition method provided in the embodiment of the present application may include:

[0061] S210: Acquire an initial image.

[0062] Specifically, the initial image can be understood as a portion of the original distorted image, and the original distorted image can be understood as an image displayed on the display screen of the extended reality device, which is distorted by the lens to form a distorted image on the display screen. For an extended reality device with a large field of view, the coverage of its original distorted image is large, and it is difficult to obtain the original distorted image of all contents through the shooting lens. Therefore, the shooting lens can usually obtain a portion of the original distorted image, that is, the initial image.

[0063] In one embodiment, the extended reality device may include a VR device, an AR device, an MR device, etc.

[0064] S220: Adjust the shooting orientation of the shooting lens to obtain local images at different shooting orientations.

[0065] S230: splicing the initial image and the partial image according to the initial image, the partial image, and the overlapping portion between the initial image and the partial image to obtain a target image.

[0066] Specifically, the shooting lens can be used to shoot the original distorted image on the display screen through the lens of the augmented reality device. When the shooting lens is in the initial position, it can shoot part of the original distorted image to obtain the aforementioned initial image. Then, the shooting orientation of the shooting lens is adjusted, and the shooting lens can shoot the original distorted image in different orientations, so that the partial images in different shooting orientations can be obtained.

[0067] It should be understood that, similar to the initial image, the local image can also be understood as a partial image of the original distorted image. That is to say, by adjusting the shooting orientation of the shooting lens, images at different positions of the original distorted image can be obtained, and then after subsequent stitching operations, a complete original distorted image can be formed. In this way, even for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, partial images of the original distorted image can be obtained from different orientations, and then the obtained partial images are stitched together, so that data of the original distorted image with a larger coverage range can be obtained, which is convenient for improving the clarity of the image on the display screen according to the distortion data.

[0068] In one embodiment, after adjusting the shooting orientation of the shooting lens, the captured partial image overlaps with a portion of the initial image, which can facilitate the subsequent confirmation of the positional relationship between the multiple partial images and the initial image based on the overlapping portion, which is conducive to the subsequent collection of more accurate distortion data. In other words, based on the initial image, the partial image, and the overlapping portion of the initial image and the partial image, the initial image and the partial image can be spliced ​​to obtain the final target image, that is, the image corresponding to the original distorted image displayed on the display screen.

[0069] In one embodiment, the shooting lens can be a mobile phone lens, a camera lens, etc.

[0070] S240: Obtain first distortion data according to the target image.

[0071] Specifically, the first distortion data can characterize the distortion characteristics of the original distorted image, and the first distortion data can be obtained by performing distortion analysis on the target image. In the subsequent use process, the output data of the image can be adjusted according to the first distortion data to eliminate the distortion effect and improve the clarity of the image on the display screen.

[0072] The distorted image acquisition method provided in the embodiment of the present application first obtains an initial image, then adjusts the shooting orientation of the shooting lens to obtain local images at different shooting orientations, and then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain a target image, and then obtains first distortion data according to the target image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, some of the original distorted images can be obtained from different orientations, and then the obtained partial images are spliced ​​to obtain original distorted image data with a larger coverage range, which is convenient for subsequently improving the clarity of the image on the display screen according to the first distortion data.

[0073] Figure 2 FIG. 1 is a flow chart of a distorted image acquisition method provided by another exemplary embodiment of the present application. Figure 2 As shown, before step S210, the distorted image acquisition method may further include:

[0074] S250: Adjust the position of the shooting lens so that the optical axis of the shooting lens coincides with the optical axis of the lens of the extended reality device.

[0075] Specifically, before acquiring the initial image, the position of the shooting lens can be adjusted so that the optical axis of the shooting lens coincides with the optical axis of the lens of the extended reality device. In this way, it can be ensured that the shooting lens obtains a clearer image through the lens, and the accuracy of the first distortion data collected subsequently can be effectively guaranteed.

[0076] Figure 3 The following is a flow chart of a method for acquiring distorted images provided by an exemplary embodiment of the present application. Figure 3 As shown, before step S250, the distorted image acquisition method further includes:

[0077] S260: The control display screen displays the logo image.

[0078] Specifically, the identification image may include a cross arrow, a horizontal line, a vertical line, a coordinate point, a circle, a rectangle, and the like.

[0079] Correspondingly, step S250 may include:

[0080] S251: Adjust the shooting lens so that the center of the logo image coincides with the center of the shooting lens.

[0081] Specifically, the shooting lens is adjusted so that the center of the identification image coincides with the center of the shooting lens, so that it can be considered that the optical axis of the shooting lens coincides with the optical axis of the lens.

[0082] It should be understood that by observing whether the center of the identification image coincides with the center of the shooting lens, it is possible to quickly determine whether the shooting lens coincides with the optical axis of the lens, which can effectively improve the debugging efficiency of the shooting lens.

[0083] Figure 4 FIG. 1 is a flow chart of a distorted image acquisition method provided by another exemplary embodiment of the present application. Figure 4 As shown, the partial image may include a first partial image and a second partial image; step S220 may include:

[0084] S221: Adjusting the shooting direction of the shooting lens to a first position.

[0085] S222: Acquire a first partial image captured by the capturing lens at a first position.

[0086] Specifically, the first position can be pre-set according to actual conditions. If the field of view angle of the extended reality device is different, the corresponding first position will also be different.

[0087] It should be noted that the first partial image partially overlaps with the initial image, which facilitates determination of the relative position relationship between the first partial image and the initial image.

[0088] In one embodiment, the half-angle of the shooting angle of the shooting lens is 35 degrees, the left and right field of view angles of the extended reality device are 200 degrees in full angle and 100 degrees in half angle. The position of the shooting lens is adjusted and rotated 65 degrees around the vertical axis from the initial position. In this way, the shooting lens can be adjusted to the first position, which not only can capture the first partial image, but also can ensure that the first partial image and the initial image have an overlapping area of ​​5 degrees.

[0089] S223: Adjust the shooting direction of the shooting lens to a second position.

[0090] S224: Acquire a second partial image captured by the capturing lens at a second position.

[0091] Specifically, the second position can be pre-set according to actual conditions. If the field of view angle of the extended reality device is different, the corresponding second position will also be different.

[0092] It should be noted that the second partial image partially overlaps with the initial image, which facilitates determination of the relative positional relationship between the second partial image and the initial image.

[0093] In one embodiment, the half angle of the shooting angle of the shooting lens is 35 degrees, the upper and lower viewing angles of the extended reality device are 110 degrees, and the half angle is 55 degrees. The position of the shooting lens is adjusted and rotated 20 degrees around the horizontal axis from the initial position. In this way, the shooting lens can be adjusted to the second position, which can not only capture the second partial image, but also ensure that the second partial image has a 5-degree overlapping area with the initial image.

[0094] In one embodiment, after executing step S221 and step S222, in order to facilitate the subsequent determination of the relationship between the second partial image and the initial image, the shooting lens is generally restored from the first position to the initial position, and then adjusted from the initial position to the second position.

[0095] Correspondingly, step S230 includes:

[0096] S231: splicing the initial image, the first partial image, the second partial image, the overlapping portion of the first partial image and the initial image, and the overlapping portion of the second partial image and the initial image to form a target image.

[0097] Specifically, before stitching, the field of view angle of the area where the overlapping part is located can be obtained according to the aforementioned rotation angle, and then the highlighted origin can be displayed in the corresponding field of view angle area. The system can identify the area as the overlapping part based on the highlighted origin, and then use the stitching algorithm to stitch the initial image, the first local image and the second local image into a complete image, that is, to form a target image, so as to facilitate the subsequent acquisition of the first distortion data based on the target image.

[0098] In one embodiment, the number of highlight origins in each overlapping area may be one, two, three, etc.

[0099] Figure 5 A schematic diagram of the structure of a distorted image acquisition device provided for an exemplary embodiment of the present application. The distorted image acquisition device 100 provided in the embodiment of the present application may include an adjustment device 110, an aperture 120, a shooting lens 130 and an electronic device, wherein the adjustment device 110 may be used to carry an extended reality device, so as to facilitate the shooting lens 130 to capture the original distorted image on the display screen of the extended reality device, the aperture 120 may be movably arranged on the adjustment device 110, the shooting lens 130 is connected to the aperture 120, and the shooting angle of the shooting lens 130 may be adjusted during the movement of the aperture 120 relative to the adjustment device 110, the electronic device is communicatively connected to the adjustment device 110 and the shooting lens 130, and the electronic device may run executable instructions to implement the aforementioned distorted image acquisition method.

[0100] The distorted image acquisition device 100 provided in the embodiment of the present application first obtains an initial image, then adjusts the shooting orientation of the shooting lens 130 to obtain local images at different shooting orientations, and then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain a target image, and then obtains first distortion data according to the target image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens 130 multiple times, some of the original distorted images can be obtained from different orientations, and then the obtained partial images are spliced ​​to obtain original distorted image data with a larger coverage range, which is convenient for subsequently improving the clarity of the image on the display screen according to the first distortion data.

[0101] like Figure 5 As shown, the adjustment device 110 may include a support base 111 and a flip bracket 112 . The support base 111 may be used to carry the aforementioned extended reality device. The flip bracket 112 is rotatably connected to the support base 111 , and the flip bracket 112 is connected to the aperture 120 .

[0102] Specifically, in actual application, the flip bracket 112 rotates around the horizontal axis, driving the diaphragm 120 to rotate around the horizontal axis, and the shooting lens 130 follows the diaphragm 120 to rotate around the horizontal axis, so that the shooting lens 130 can be adjusted to obtain a partial image under different up and down viewing angles. For example, during the execution of the aforementioned steps S223 and S224, the flip bracket 112 can be operated to rotate the diaphragm 120 and the shooting lens 130 along the horizontal axis to reach the second position.

[0103] like Figure 5 As shown, the adjustment device 110 may further include a horizontal angle adjustment disk 113 , the horizontal angle adjustment disk 113 is rotatably connected to the support seat 111 , and the horizontal angle adjustment disk 113 is connected to the diaphragm 120 .

[0104] Specifically, in actual application, the horizontal angle adjustment disk 113 rotates around the vertical axis, driving the diaphragm 120 to rotate around the vertical axis, and the shooting lens 130 follows the diaphragm 120 to rotate around the vertical axis, so that the shooting lens 130 can be adjusted to obtain a partial image under different left and right viewing angles. For example, during the execution of the aforementioned steps S221 and S222, the horizontal angle adjustment disk 113 can be operated to rotate the diaphragm 120 and the shooting lens 130 along the vertical axis to reach the first position.

[0105] like Figure 5As shown, the adjustment device 110 may further include a first movable seat 114 and a second movable seat 115, both of which are movably connected to the support seat 111, and both of which are connected to the horizontal angle adjustment disk 113, and the first movable seat 114 can drive the horizontal angle adjustment disk 113 and the aperture 120 to move along the first horizontal direction ( Figure 5 The second movable seat 115 can move the horizontal angle adjustment plate 113 and the aperture 120 along the second horizontal direction (in the direction indicated by the arrows A and C). Figure 5 The first horizontal direction and the second horizontal direction are arranged vertically.

[0106] Specifically, when it is necessary to adjust the position of the shooting lens 130 on the horizontal plane, the relative position between the shooting lens 130 and the extended reality device can be adjusted by adjusting the first movable seat 114 and the second movable seat 115. For example, when executing step S250, if there is a deviation between the optical axis of the shooting lens 130 and the optical axis of the lens of the extended reality device, the position of the shooting lens 130 can be adjusted by adjusting the first movable seat 114 and the second movable seat 115 so that the optical axis of the shooting lens 130 coincides with the optical axis of the lens of the extended reality device. For example, when executing steps S221 and S223, the position of the shooting lens 130 can also be adjusted by adjusting the first movable seat 114 and the second movable seat 115 so that the shooting lens 130 reaches the first position or the second position more accurately.

[0107] Figure 6 The flowchart of the distortion image calibration method provided by an exemplary embodiment of the present application is shown in FIG. Figure 6 As shown, the distortion image calibration method provided in the embodiment of the present application may include:

[0108] S510: Acquire second distortion data of the shooting lens.

[0109] Specifically, the second distortion data can be understood as the distortion characteristics of the shooting lens. During the production process of the shooting lens, its distortion characteristics can be obtained through pre-production testing, that is, the second distortion data of the shooting lens can be obtained according to the production parameters of the shooting lens.

[0110] S210: Acquire an initial image.

[0111] S220: Adjust the shooting orientation of the shooting lens to obtain local images at different shooting orientations.

[0112] S230: splicing the initial image and the partial image according to the initial image, the partial image, and the overlapping portion between the initial image and the partial image to obtain a target image.

[0113] S240: Obtain first distortion data according to the target image.

[0114] Specifically, for the relevant introduction of step S210, step S220, step S230 and step S240, reference can be made to the content of the aforementioned distorted image acquisition method. The distorted image calibration method provided in the embodiment of the present application includes the aforementioned distorted image acquisition method and has all the beneficial effects of the distorted image acquisition method.

[0115] S520: Calibrate the original distorted image according to the first distortion data and the second distortion data.

[0116] S530: Control the display screen to display the calibrated image.

[0117] Specifically, when the extended display device needs to control the display screen to display an image, the first distortion data and the second distortion data can be called to determine the combined impact of the first distortion data and the second distortion data on the image, and then the image is compensated accordingly based on the combined impact of the two, that is, the original distorted image is calibrated, so that the calibrated image presented on the display screen eliminates the distortion effect and has higher clarity.

[0118] The distortion image calibration method provided in the embodiment of the present application obtains the second distortion data of the shooting lens, then obtains the initial image, then adjusts the shooting orientation of the shooting lens, obtains local images at different shooting orientations, then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain the target image, then obtains the first distortion data according to the target image, then calibrates the original distorted image according to the first distortion data and the second distortion data, and then controls the display screen to display the calibrated image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, some of the original distorted images can be obtained from different orientations, and then the obtained partial images are spliced ​​to obtain original distorted image data with a larger coverage range. Then, according to the first distortion data and the second distortion data, the image to be displayed can be calibrated, so that the calibrated image presented on the display screen eliminates the distortion effect and has higher clarity.

[0119] Figure 7 This is a structural block diagram of an extended reality device provided by an exemplary embodiment of the present application. Figure 7 As shown, the extended reality device 600 provided in the embodiment of the present application may include a shell 610, a display screen 620 and a controller 630. The display screen 620 is disposed on the shell 610, and the controller 630 is disposed in the shell 610. The controller 630 is communicatively connected with the display screen 620, and the controller 630 runs executable instructions to implement the aforementioned distorted image calibration method.

[0120] The extended reality device provided in the embodiment of the present application obtains the second distortion data of the shooting lens, then obtains the initial image, then adjusts the shooting orientation of the shooting lens, obtains local images at different shooting orientations, then splices the initial image and the local image according to the initial image, the local image and the overlapping part of the initial image and the local image to obtain the target image, then obtains the first distortion data according to the target image, then calibrates the original distorted image according to the first distortion data and the second distortion data, and then controls the display screen to display the calibrated image. In this way, for an extended reality device with a large field of view, by adjusting the orientation of the shooting lens multiple times, part of the original distorted image can be obtained from different orientations, and then the obtained part of the image can be spliced ​​to obtain original distorted image data with a larger coverage range. Then, according to the first distortion data and the second distortion data, the image to be displayed can be calibrated, so that the calibrated image presented on the display screen eliminates the distortion effect and has higher clarity.

[0121] It should be noted that the controller involved in the embodiments of the present application is similar to the structure of the electronic device, and here the controller is taken as an example to introduce its structure in detail.

[0122] Figure 8 This is a block diagram of a controller provided by an exemplary embodiment of the present application. Figure 8 As shown, the controller 630 may be any one or both of the first device and the second device, or a stand-alone device independent of them. The stand-alone device may communicate with the first device and the second device to receive the collected input signals from them.

[0123] like Figure 8 As shown, the controller 630 includes one or more processors 631 and a memory 632 .

[0124] The processor 631 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the controller 630 to perform desired functions.

[0125] The memory 632 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 631 may run the program instructions to implement the control methods of the various embodiments of the present application described above and / or other desired functions. Various contents such as input signals, signal components, noise components, etc. may also be stored in the computer-readable storage medium.

[0126] In one example, the controller 630 may further include: an input device 633 and an output device 634 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0127] When the controller is a stand-alone device, the input device 633 may be a communication network connector for receiving collected input signals from the first device and the second device.

[0128] In addition, the input device 633 may also include, for example, a keyboard, a mouse, etc.

[0129] The output device 634 can output various information to the outside, including the determined distance information, direction information, etc. The output device 634 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0130] Of course, to simplify, Figure 8 Only some of the components in the controller 630 related to the present application are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, the controller 630 may also include any other appropriate components according to specific application conditions.

[0131] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0132] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0133] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0134] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0135] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0136] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0137] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A method for acquiring distorted images, characterized in that: include: Acquire an initial image; wherein the initial image represents a portion of an original distorted image; and the original distorted image represents an image displayed on a display screen of an extended reality device; Adjusting the shooting orientation of the shooting lens to obtain partial images at different shooting orientations; wherein the shooting lens is configured to shoot the original distorted image on the display screen through the lens of the extended reality device; the partial image represents a portion of the original distorted image; and the partial image overlaps a portion of the initial image; splicing the initial image and the partial image according to the initial image, the partial image, and an overlapping portion between the initial image and the partial image to obtain a target image; According to the target image, first distortion data is obtained; wherein the first distortion data represents the distortion characteristics of the original distorted image.

2. The distorted image acquisition method according to claim 1, characterized in that: Before acquiring the initial image, the distorted image acquisition method further includes: The position of the shooting lens is adjusted so that the optical axis of the shooting lens coincides with the optical axis of the lens of the extended reality device.

3. The distorted image acquisition method according to claim 2, characterized in that: Before adjusting the position of the shooting lens, the distorted image acquisition method further includes: Controlling the display screen to display a logo image; The adjusting the position of the shooting lens comprises: The shooting lens is adjusted so that the center of the logo image coincides with the center of the shooting lens.

4. The distorted image acquisition method according to claim 1, characterized in that: The partial image includes a first partial image and a second partial image; The step of adjusting the shooting orientation of the shooting lens to obtain local images at different shooting orientations includes: Adjusting the shooting orientation of the shooting lens to a first position; Acquire the first partial image captured by the shooting lens at the first position; wherein the first partial image partially overlaps with the initial image; Adjusting the shooting position of the shooting lens to a second position; Acquire the second partial image captured by the shooting lens at the second position; wherein the second partial image partially overlaps with the initial image; The step of splicing the initial image and the partial image according to the initial image, the partial image, and the overlapping portion of the initial image and the partial image to obtain a target image comprises: The initial image, the first partial image, the second partial image, the overlapping portion of the first partial image and the initial image, and the overlapping portion of the second partial image and the initial image are spliced ​​to form the target image.

5. A distorted image acquisition device, characterized in that: include: An adjustment device configured to carry an extended reality device; An aperture, movably disposed on the adjusting device; A shooting lens connected to the aperture; An electronic device is communicatively connected to the adjustment device and the shooting lens, and the electronic device is configured to run executable instructions to implement the distorted image acquisition method according to any one of claims 1 to 4.

6. The distorted image acquisition device according to claim 5, characterized in that: The regulating device comprises: A support base, configured to carry the extended reality device; The flip bracket is rotatably connected to the support seat, the flip bracket is connected to the diaphragm, and the flip bracket is configured to drive the diaphragm to rotate around a horizontal axis.

7. The distorted image acquisition device according to claim 6, characterized in that: The adjusting device also includes: A horizontal angle adjustment disk is rotatably connected to the support seat, the horizontal angle adjustment disk is connected to the diaphragm, and the horizontal angle adjustment disk is configured to drive the diaphragm to rotate around a vertical axis.

8. The distorted image acquisition device according to claim 7, characterized in that: The adjusting device also includes: A first movable seat, movably connected to the support seat, the first movable seat is connected to the horizontal angle adjustment plate, and the first movable seat is configured to drive the horizontal angle adjustment plate and the aperture to move along a first horizontal direction; The second movable seat is movably connected to the support seat, and the second movable seat is connected to the horizontal angle adjustment disk. The second movable seat is configured to drive the horizontal angle adjustment disk and the aperture to move along a second horizontal direction; wherein the second horizontal direction is perpendicular to the first horizontal direction.

9. A method for calibrating a distorted image, characterized in that: include: Acquire second distortion data of the shooting lens; wherein the second distortion data represents the distortion characteristics of the shooting lens; The distorted image acquisition method according to any one of claims 1 to 4; calibrating the original distorted image according to the first distortion data and the second distortion data; and The display screen is controlled to display the calibrated image.

10. An extended reality device, characterized in that: include: case; A display screen, arranged on the housing; A controller is disposed in the housing, the controller is communicatively connected with the display screen, and the controller runs executable instructions to implement the distorted image calibration method according to claim 9.

Images