A 3D Image Processing Method and Device Based on Cloud Service

Abstract

The present invention is applicable to the technical field of 3D avatar processing, and provides a 3D image processing method and device based on cloud services. The method includes: through Step 1: obtaining multiple pictures of a target object generated by taking 360-degree omnidirectional shots of the target object; Step 2: sending all the multiple pictures of the target object to a cloud storage space; Step 3: performing composition on the multiple pictures of the target object to generate a composite image; Step 4: performing overlap removal on the composite image and converting it into a three-dimensional space stereogram; Step 5: sequentially repeating Step 1, Step 2, Step 3, and Step 4 to obtain a secondary three-dimensional space stereogram, and composing the three-dimensional space stereogram with the secondary three-dimensional space stereogram; and through Step 6, outputting the composed three-dimensional space stereogram; so that the image effect is smoother and closer to the real scene, thereby improving the user experience.

Description

Technical Field

[0001] This invention belongs to the field of 3D avatar processing technology, and particularly relates to a 3D image processing method and apparatus based on cloud services. Background Technology

[0002] Panoramic images have a wide range of applications, such as tourist attractions, hotels, real estate buildings, and interior design displays. The generation of 3D panoramic images involves taking multiple photos of a scene using a wide-angle lens, and then stitching these photos together into a continuous image using relevant software. The stitched image can then be viewed in a panoramic view to achieve a panoramic image effect. However, existing panoramic images suffer from severe blurring and image distortion after being enlarged, which no longer meets people's needs. Summary of the Invention

[0003] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a 3D image processing method and apparatus based on cloud services, which aims to solve the problem of poor 3D image quality and poor user experience caused by the inability of the prior art to provide an effective 3D image processing method based on cloud services.

[0004] On one hand, the present invention provides a 3D image processing method based on cloud services, the method comprising the following steps:

[0005] Step 1: Take 360-degree panoramic photos of the target object to generate multiple images of the target object;

[0006] Step 2: Send all images of the target object to the cloud storage space;

[0007] Step 3: Combine multiple images of the target object to generate a composite image;

[0008] Step 4: Remove overlap from the composite image and convert it into a 3D spatial stereo image;

[0009] Step 5: Repeat steps 1, 2, 3 and 4 in sequence to obtain the second three-dimensional spatial stereoscopic image, and then combine or compare the three-dimensional spatial stereoscopic image with the second three-dimensional spatial stereoscopic image;

[0010] Step 6: Output the composite 3D spatial image or comparison results.

[0011] More preferably, in step one: taking 360-degree panoramic photos of the target object to generate multiple images of the target object, a wide-angle lens is used to photograph the target object and the objects surrounding the target object.

[0012] More preferably, when repeating steps one, two, three, and four in sequence, a magnifying lens is used to photograph the target object in step one.

[0013] Preferably, in step one: taking 360-degree panoramic photos of the target object to generate multiple images of the target object, the photos are taken with the target object as the shooting center and at a preset resolution and pixel count.

[0014] Preferably, before step three: the cloud storage space combines multiple images of the target object to generate a composite image, the multiple images of the target object are rectangularly stitched together with the complete target object as the center;

[0015] A composite image is generated by combining the edges of images of adjacent target objects;

[0016] The image of the target object contains local features of the target object.

[0017] More preferably, when performing overlap removal on the composite image, the edges of the image of the target object with fewer overlapping edges are removed;

[0018] The conversion to a three-dimensional spatial image includes: converting a three-dimensional spatial image into an equidistant, deformation-free three-dimensional sphere centered on the axis of the cylinder.

[0019] Preferably, the method further includes: adaptively reducing the size of the secondary three-dimensional spatial stereoscopic image and then combining or comparing it with the three-dimensional spatial stereoscopic image.

[0020] On the other hand, the present invention provides a cloud-based 3D image processing apparatus, the apparatus comprising:

[0021] The shooting unit captures multiple images of the target object from a 360-degree perspective.

[0022] The uploading unit sends multiple images of the target object to the cloud storage space;

[0023] The acquisition unit acquires multiple images of the target object by taking 360-degree panoramic photos of the target object from cloud storage space.

[0024] A planar composite unit combines multiple images of the target object to generate a composite image;

[0025] The 3D conversion unit removes overlap from composite images and converts them into 3D spatial stereo images.

[0026] A three-dimensional composite unit combines the three-dimensional spatial stereoscopic image with a secondary three-dimensional spatial stereoscopic image;

[0027] The output unit outputs the composite 3D spatial image.

[0028] On the other hand, the present invention also provides a non-volatile computer-readable storage medium storing computer-executable instructions, which, when executed by one or more processors, cause the one or more processors to perform the above-described cloud-based 3D image processing method.

[0029] On the other hand, the present invention also provides a computer program product, the computer program product comprising a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions that, when executed by a processor, cause the processor to perform the above-described cloud service-based 3D image processing method.

[0030] The beneficial effects of this invention are as follows: Step 1: Acquire multiple images of the target object by taking 360-degree panoramic photos; Step 2: Send all images of the target object to cloud storage; Step 3: Composite the multiple images of the target object to generate a composite image; Step 4: Remove overlap from the composite image and convert it into a three-dimensional spatial stereoscopic image; Step 5: Repeat steps 1, 2, 3, and 4 in sequence to obtain a secondary three-dimensional spatial stereoscopic image, and composite the three-dimensional spatial stereoscopic image with the secondary three-dimensional spatial stereoscopic image; and Step 6: Output the composite three-dimensional spatial stereoscopic image; thus making the image effect smoother, closer to the real scene, and improving the user experience. Attached Figure Description

[0031] Figure 1 This is a flowchart illustrating the implementation of the cloud-based 3D image processing method provided in Embodiment 1 of the present invention.

[0032] Figure 2 This is a schematic diagram of the structure of the cloud-based 3D image processing device provided in Embodiment 2 of the present invention. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0034] The specific implementation of the present invention will be described in detail below with reference to specific embodiments:

[0035] Example 1:

[0036] Figure 1The implementation flow of the cloud service-based 3D image processing method provided in Embodiment 1 of the present invention is illustrated. For ease of explanation, only the parts related to the embodiments of the present invention are shown, and are described in detail below:

[0037] In step S101: Multiple images of the target object are generated by taking 360-degree panoramic photos of the target object;

[0038] In an embodiment of the present invention, in step one: when taking 360-degree all-round shots of the target object to generate multiple images of the target object, a wide-angle lens is used to shoot the target object and the objects around the target object.

[0039] When taking 360-degree panoramic photos of a target object to generate multiple images of the target object, the photos are taken with the target object as the shooting center and according to the preset resolution and pixels.

[0040] In step S102: multiple images of the target object are sent to the cloud storage space;

[0041] In embodiments of the present invention, cloud computing is used to reduce the workload of local devices.

[0042] In step S103: Multiple images of the target object are combined to generate a composite image;

[0043] In an embodiment of the present invention, before the cloud storage space combines multiple images of target objects to generate a composite image, the multiple images of target objects are rectangularly stitched together with the complete target object as the center; so as to combine and stitch the images of multiple target objects according to the positions corresponding to the real objects;

[0044] Composite images are generated by combining the edges of images of adjacent target objects.

[0045] The image of the target object must contain local features of the target object; that is, it must be taken from a 360-degree perspective around the target object and must contain local features of the target object in order to facilitate stitching and combination.

[0046] In step S104: the composite image is overlapped and converted into a three-dimensional spatial stereo image;

[0047] In an embodiment of the present invention, when removing overlap from a composite image, the edges of the image of the target object with fewer overlapping edges are removed;

[0048] The conversion to a three-dimensional spatial image includes: converting a three-dimensional spatial image into an equidistant, deformation-free three-dimensional sphere centered on the axis of the cylinder.

[0049] In step S105: Steps one, two, three and four are repeated in sequence to obtain a secondary three-dimensional spatial stereoscopic image, and the three-dimensional spatial stereoscopic image is combined or compared with the secondary three-dimensional spatial stereoscopic image.

[0050] In an embodiment of the present invention, the secondary three-dimensional spatial stereoscopic image is adaptively reduced and then composited or compared with the three-dimensional spatial stereoscopic image; the adaptive reduction is consistent with the ratio of the primary three-dimensional spatial stereoscopic image.

[0051] Furthermore, in step five, when repeating steps one, two, three, and four in sequence, a magnifying lens is used to photograph the target object in step one; this results in different resolutions for the two photographs, making the composite effect clearer.

[0052] In step S106, the composite three-dimensional spatial stereoscopic image or comparison result is output;

[0053] In embodiments of the present invention, a three-dimensional comparison can also be performed between the target object and the previous one after local feature changes are made, in order to meet different usage requirements.

[0054] In an embodiment of the present invention, the process involves: Step 1: acquiring multiple images of the target object by taking 360-degree panoramic photos; Step 2: sending all the images of the target object to cloud storage; Step 3: compositing the multiple images of the target object to generate a composite image; Step 4: removing overlap from the composite image and converting it into a three-dimensional spatial stereoscopic image; Step 5: repeating Step 1, Step 2, Step 3, and Step 4 sequentially to obtain a secondary three-dimensional spatial stereoscopic image, and compositing the three-dimensional spatial stereoscopic image with the secondary three-dimensional spatial stereoscopic image; and Step 6: outputting the composite three-dimensional spatial stereoscopic image. This process results in a smoother image effect, closely resembling a real scene, thereby improving the user experience.

[0055] Example 2:

[0056] Figure 2 The structure of the cloud-based 3D image processing device provided in Embodiment 2 of the present invention is shown. For ease of explanation, only the parts related to the embodiments of the present invention are shown, including:

[0057] The shooting unit 200 captures multiple images of the target object from a 360-degree perspective.

[0058] Upload unit 201 sends multiple images of the target object to cloud storage space 301;

[0059] The acquisition unit 302 acquires multiple images of the target object from the cloud storage space 301, which are generated by taking 360-degree panoramic photos of the target object; wherein, the cloud storage space 301 is the storage space in the cloud server.

[0060] The planar composite unit 303 combines multiple images of a target object to generate a composite image;

[0061] The 3D conversion unit 304 performs overlap removal on the composite image and converts it into a 3D spatial stereo image.

[0062] The three-dimensional composite unit 305 combines a three-dimensional spatial stereoscopic image with a secondary three-dimensional spatial stereoscopic image;

[0063] Output unit 306 outputs the composite three-dimensional spatial image; for example, it outputs it to a query terminal device via a cloud server.

[0064] In this embodiment of the invention, each unit of the cloud-based 3D image processing device can be implemented by corresponding hardware or software units. Each unit can be an independent hardware or software unit, or it can be integrated into a hardware or software unit. This is not intended to limit the invention.

[0065] Example 3:

[0066] Embodiment 3 of the present invention provides a non-volatile computer-readable storage medium storing computer-executable instructions that are executed by one or more processors, for example, executing the instructions described above. Figure 1 The method steps S101 to S106.

[0067] As an example, non-volatile storage media can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) as an external cache memory. By way of explanation, RAM can be obtained in many forms such as synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct Rambus RAM (DRRAM). The memory components or memories disclosed in the operating environment described herein are intended to include one or more of these and / or any other suitable types of memory.

[0068] Example 4:

[0069] Embodiment 4 of the present invention provides a computer program product, which includes a computer program stored on a non-volatile computer-readable storage medium. The computer program includes program instructions, which, when executed by a processor, cause the processor to perform the cloud-based 3D image processing method described in the above embodiment. For example, performing the above-described... Figure 1 The method steps S101 to S106.

[0070] The embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0071] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general-purpose hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can exist in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., including several instructions to cause a computer electronic device (which may be a personal computer, server, or network electronic device, etc.) to execute the methods of each embodiment or some parts of the embodiments.

[0072] Among other things, conditional language such as “can,” “may,” “may,” or “may,” unless otherwise specifically stated or otherwise understood as in the context in which they are used, is generally intended to convey that a particular implementation may include (but not others) certain features, elements, and / or operations. Therefore, such conditional language is generally not intended to imply that features, elements, and / or operations are necessary for one or more implementations in any way, or that one or more implementations must include logic for determining whether such features, elements, and / or operations are included or will be performed in any particular implementation, with or without student input or prompts.

[0073] The contents already described herein in this specification and accompanying drawings include examples of 3D image processing methods and apparatuses capable of providing cloud-based services. Of course, it is not possible to describe every conceivable combination of elements and / or methods for the purpose of describing the various features of this disclosure, but it will be appreciated that many other combinations and substitutions of the disclosed features are possible. Therefore, it will be apparent that various modifications can be made to this disclosure without departing from the scope or spirit of this disclosure. Furthermore, or in alternatives, other embodiments of this disclosure may become apparent from consideration of this specification and accompanying drawings and from practice of this disclosure as presented herein. It is intended that the examples presented in this specification and accompanying drawings be considered illustrative rather than restrictive in all respects. Although specific terminology is used herein, it is used in a general and descriptive sense and is not intended for limiting purposes.

Claims

1. A 3D image processing method based on cloud services, characterized in that, The method includes the following steps: Step 1: Take 360-degree panoramic photos of the target object to generate multiple images of the target object; Step 2: Send all images of the target object to the cloud storage space; Step 3: Combine multiple images of the target object to generate a composite image; Step 4: Remove overlap from the composite image and convert it into a 3D spatial stereo image; Step 5: Repeat steps 1, 2, 3 and 4 in sequence to obtain the second three-dimensional spatial stereoscopic image, and then combine or compare the three-dimensional spatial stereoscopic image with the second three-dimensional spatial stereoscopic image; Step 6: Output the composite 3D spatial image or comparison results.

2. The method as described in claim 1, characterized in that, In step one, when taking 360-degree panoramic photos of the target object to generate multiple images of the target object, a wide-angle lens is used to photograph the target object and the objects surrounding the target object.

3. The method as described in claim 1, characterized in that, In step five, when repeating steps one, two, three, and four in sequence, the target object is photographed using a magnifying lens in step one.

4. The method as described in claim 2 or 3, characterized in that, In step one, when taking 360-degree panoramic photos of the target object to generate multiple images of the target object, the photos are taken with the target object as the shooting center and according to a preset resolution and pixel count.

5. The method as described in claim 1, characterized in that, Before step three: the cloud storage space combines multiple images of the target object to generate a composite image, the multiple images of the target object are rectangularly stitched together with the complete target object as the center. A composite image is generated by combining the edges of images of adjacent target objects; The image of the target object contains local features of the target object.

6. The method as described in claim 1, characterized in that, When performing overlap removal on the composite image, the edges of the target object image with fewer overlapping edges are removed; The conversion to a three-dimensional spatial image includes: converting a three-dimensional spatial image into an equidistant, deformation-free three-dimensional sphere centered on the axis of the cylinder.

7. The method as described in claim 3, characterized in that, The method further includes: The two-dimensional spatial stereoscopic images are adaptively reduced in size and then combined or compared with the three-dimensional spatial stereoscopic images.

8. A cloud-based 3D image processing device, characterized in that, The device includes: The shooting unit captures multiple images of the target object from a 360-degree perspective. The uploading unit sends multiple images of the target object to the cloud storage space; The acquisition unit acquires multiple images of the target object by taking 360-degree panoramic photos of the target object from cloud storage space. A planar composite unit combines multiple images of the target object to generate a composite image; The 3D conversion unit removes overlap from composite images and converts them into 3D spatial stereo images. A three-dimensional composite unit combines the three-dimensional spatial stereoscopic image with a secondary three-dimensional spatial stereoscopic image; The output unit outputs the composite 3D spatial image.

9. A non-volatile computer-readable storage medium, characterized in that, The non-volatile computer-readable storage medium stores computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the cloud-based 3D image processing method according to any one of claims 1-7.

10. A computer program product, characterized in that, The computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program including program instructions that, when executed by a processor, cause the processor to perform the cloud-based 3D image processing method according to any one of claims 1-7.

Images