A 3D Image Processing Method and Device Based on Cloud Service

Abstract

The present invention is applicable to the technical field of 3D avatar processing, and provides a 3D image processing method and device based on cloud services. The method includes: through Step 1: obtaining multiple pictures of a target object generated by taking a 360-degree omnidirectional photograph of the target object; Step 2: sending all the multiple pictures of the target object to a cloud storage space; Step 3: performing composition on the multiple pictures of the target object to generate a composite image; Step 4: performing overlapping removal on the composite image and converting it into a three-dimensional space stereogram; Step 5: sequentially repeating Step 1, Step 2, Step 3, and Step 4 to obtain a secondary three-dimensional space stereogram, and composing the three-dimensional space stereogram with the secondary three-dimensional space stereogram; and through Step 6, outputting the composed three-dimensional space stereogram; so that the image effect is smoother and closer to the real scene, thereby improving the user experience.

Description

Technical Field

[0001] The present invention belongs to the technical field of 3D avatar processing, and particularly relates to a 3D image processing method and device based on cloud services. Background Art

[0002] Panoramic images have a wide range of application fields, such as tourist attractions, hotels, building real estate, decoration displays, etc.; the generation of three-dimensional panoramic images is to use a wide-angle lens to take multiple photos of a scene, and then use relevant software to stitch the multiple photos into a coherent picture, and the stitched picture can be panoramically browsed to achieve the panoramic image effect; however, existing panoramic images are severely blurred and distorted after being enlarged, and can no longer meet people's usage requirements. Summary of the Invention

[0003] In view of the deficiencies of the above-mentioned prior art, the purpose of the present invention is to provide a 3D image processing method and device based on cloud services, aiming to solve the problems of poor 3D image effects and poor user experience caused by the inability of the prior art to provide an effective 3D image processing method based on cloud services.

[0004] On the one hand, the present invention provides a 3D image processing method based on cloud services, and the method includes the following steps:

[0005] Step 1: Obtain multiple pictures of the target object taken 360 degrees omnidirectionally.

[0006] Step 2: Send all the multiple pictures of the target object to the cloud storage space.

[0007] Step 3: Composite the multiple pictures of the target object to generate a composite image.

[0008] Step 4: Remove the overlaps from the composite image and convert it into a three-dimensional space stereogram.

[0009] Step 5: Repeat Step 1, Step 2, Step 3, and Step 4 in sequence to obtain two three-dimensional space stereograms, and composite or compare the three-dimensional space stereogram with the two three-dimensional space stereograms.

[0010] Step 6: Output the composite three-dimensional space stereogram or the comparison result.

[0011] Further preferably, when taking multiple pictures of the target object taken 360 degrees omnidirectionally in Step 1, use a wide-angle lens to take pictures of the target object and the objects around the target object.

[0012] Further preferably, when successively repeating Step One, Step Two, Step Three, and Step Four, a magnifying lens is used to photograph the target object in Step One.

[0013] Preferably, in Step One: when performing a 360-degree omnidirectional photographing of the target object to generate multiple pictures of the target object, the photographing is performed at a preset resolution and pixel count with the target object as the photographing center.

[0014] Preferably, before Step Three: the cloud storage space composites multiple pictures of the target object to generate a composite image, the multiple pictures of the target object are rectangularly stitched with the complete target object as the center;

[0015] The edges of adjacent images of the target object are composited to generate a composite image;

[0016] The pictures of the target object contain local features of the target object.

[0017] Further preferably, when removing the overlap from the composite image, the edges of the pictures of the target object with fewer overlapping edges are removed;

[0018] The conversion to a three-dimensional space stereogram includes: performing a conversion to an isometric non-deformed three-dimensional spherical three-dimensional space stereogram with the cylinder axis as the center.

[0019] Preferably, the method further includes: adaptively reducing the secondary three-dimensional space stereogram and then compositing or comparing it with the three-dimensional space stereogram.

[0020] On the other hand, the present invention provides a 3D image processing device based on cloud services, the device includes:

[0021] A photographing unit that performs a 360-degree omnidirectional photographing of the target object to generate multiple pictures of the target object;

[0022] An uploading unit that sends all the multiple pictures of the target object to the cloud storage space;

[0023] An obtaining unit that obtains multiple pictures of the target object generated by performing a 360-degree omnidirectional photographing of the target object from the cloud storage space;

[0024] A planar composite unit that composites multiple pictures of the target object to generate a composite image;

[0025] A three-dimensional conversion unit that removes the overlap from the composite image and converts it into a three-dimensional space stereogram;

[0026] A three-dimensional composite unit that composites the three-dimensional space stereogram with the secondary three-dimensional space stereogram;

[0027] An output unit that outputs the composite three-dimensional stereogram.

[0028] On the other hand, the present invention also provides a non-volatile computer-readable storage medium storing computer-executable instructions, which when executed by one or more processors, enable the one or more processors to execute the above-described cloud service-based 3D image processing method.

[0029] On the other hand, the present invention also provides a computer program product, which includes a computer program stored on a non-volatile computer-readable storage medium. The computer program includes program instructions that, when executed by a processor, cause the processor to execute the above-described cloud service-based 3D image processing method.

[0030] The beneficial effects of the present invention are as follows: Through Step 1: Obtain multiple pictures of the target object taken 360 degrees omnidirectionally; Step 2: Send all the multiple pictures of the target object to the cloud storage space; Step 3: Composite the multiple pictures of the target object to generate a composite image; Step 4: Remove the overlap of the composite image and convert it into a three-dimensional stereogram; Step 5: Repeat Step 1, Step 2, Step 3, and Step 4 in sequence to obtain a secondary three-dimensional stereogram, and composite the three-dimensional stereogram with the secondary three-dimensional stereogram; and through Step 6, output the composite three-dimensional stereogram; so as to make the image effect smoother and closer to the real scene, thereby improving the user experience. Description of the Drawings

[0031] Figure 1 is a flowchart of the implementation of the cloud service-based 3D image processing method provided by Embodiment 1 of the present invention;

[0032] Figure 2 is a schematic structural diagram of the cloud service-based 3D image processing device provided by Embodiment 2 of the present invention. Detailed Embodiments

[0033] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0034] The following describes the specific implementation of the present invention in detail with reference to specific embodiments:

[0035] Example 1:

[0036] Figure 1The implementation process of the 3D image processing method based on cloud services provided in the first embodiment of the present invention is shown. For the sake of convenience of description, only the parts related to the embodiments of the present invention are shown and are described in detail as follows:

[0037] In step S101: Obtain multiple pictures of the target object generated by taking a 360-degree omnidirectional photograph of the target object;

[0038] In the embodiment of the present invention, in step one: When taking a 360-degree omnidirectional photograph of the target object to generate multiple pictures of the target object, use a wide-angle lens to photograph the target object and the objects around the target object;

[0039] Among them, when taking a 360-degree omnidirectional photograph of the target object to generate multiple pictures of the target object, take the photograph with the target object as the center of the photographing according to the preset resolution and pixels.

[0040] In step S102: Send all the multiple pictures of the target object to the cloud storage space;

[0041] In the embodiment of the present invention, for cloud computing to reduce the workload of local devices.

[0042] In step S103: Composite the multiple pictures of the target object to generate a composite image;

[0043] In the embodiment of the present invention, before the cloud storage space composites the multiple pictures of the target object to generate a composite image, splice the multiple pictures of the target object in a rectangle with the complete target object as the center; so as to combine and splice the pictures of multiple target objects according to the positions corresponding to the physical objects;

[0044] Composite the edges of the adjacent target object images to generate a composite image;

[0045] The pictures of the target object contain the local features of the target object; that is, it is necessary to take a 360-degree omnidirectional photograph around the target object and must contain the local features of the target object for easy splicing and combination.

[0046] In step S104: Remove the overlaps from the composite image and convert it into a three-dimensional space stereogram;

[0047] In the embodiment of the present invention, when removing the overlaps from the composite image, remove the edges of the pictures of the target objects with fewer overlapping edges;

[0048] Converting into a three-dimensional space stereogram includes: Converting into a three-dimensional space stereogram of an equidistant non-deformed three-dimensional sphere with the cylinder axis as the center.

[0049] In step S105: Repeat step one, step two, step three, and step four in sequence to obtain a secondary three-dimensional solid figure, and composite or compare the three-dimensional solid figure with the secondary three-dimensional solid figure;

[0050] In an embodiment of the present invention, the secondary three-dimensional solid figure is adaptively reduced and then composite or compared with the three-dimensional solid figure; the ratio of the adaptive reduction is the same as that of the primary three-dimensional solid image;

[0051] Further, in step five: When repeating step one, step two, step three, and step four in sequence, use a magnifying lens to photograph the target object in step one; so that the resolutions of the two photographs are different and the effect after composite is clearer;

[0052] In step S106, output the composite three-dimensional solid figure or the comparison result;

[0053] In an embodiment of the present invention, three-dimensional comparison can also be performed before and after local feature changes of the target object to meet different usage requirements.

[0054] In an embodiment of the present invention, through step one: Obtain multiple pictures of the target object generated by taking 360-degree omnidirectional photographs of the target object; step two: Send all the multiple pictures of the target object to the cloud storage space; step three: Composite the multiple pictures of the target object to generate a composite image; step four: Remove the overlap of the composite image and convert it into a three-dimensional solid figure; step five: Repeat step one, step two, step three, and step four in sequence to obtain a secondary three-dimensional solid figure, and composite the three-dimensional solid figure with the secondary three-dimensional solid figure; and through step six, output the composite three-dimensional solid figure; so that the image effect is smoother and closer to the real scene, thereby improving the user experience.

[0055] Example 2:

[0056] Figure 2 The structure of the 3D image processing device based on cloud service provided in the second embodiment of the present invention is shown. For the sake of convenience of description, only the parts related to the embodiment of the present invention are shown, including:

[0057] A photographing unit 200, which takes 360-degree omnidirectional photographs of the target object to generate multiple pictures of the target object;

[0058] An uploading unit 201, which sends all the multiple pictures of the target object to the cloud storage space 301;

[0059] An acquisition unit 302 acquires multiple pictures of a target object generated by taking 360-degree omnidirectional shots of the target object from a cloud storage space 301, where the cloud storage space 301 is a storage space in a cloud server.

[0060] A planar composite unit 303 composites the multiple pictures of the target object to generate a composite image.

[0061] A three-dimensional conversion unit 304 removes overlaps from the composite image and converts it into a three-dimensional space stereogram.

[0062] A three-dimensional composite unit 305 composites the three-dimensional space stereogram with a secondary three-dimensional space stereogram.

[0063] An output unit 306 outputs the composite three-dimensional space stereogram, for example, outputs it to a query terminal device through a cloud server.

[0064] In an embodiment of the present invention, each unit of the 3D image processing device based on cloud services can be implemented by corresponding hardware or software units. Each unit can be an independent software or hardware unit, or can be integrated into a software or hardware unit, which is not used to limit the present invention here.

[0065] Example 3:

[0066] Embodiment 3 of the present invention provides a non-volatile computer-readable storage medium. The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors. For example, the method steps S101 to S106 described above are executed. Figure 1 in the above.

[0067] As an example, the non-volatile storage medium can include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable ROM (EEPROM), or a flash memory. The volatile memory can include a random access memory (RAM) as an external cache memory. By way of illustration and not limitation, the RAM can be obtained in many forms such as synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct Rambus RAM (DRRAM). The memory components or memories of the operating environment disclosed herein are intended to include one or more of these and / or any other suitable types of memories.

[0068] Example 4:

[0069] Embodiment 4 of the present invention provides a computer program product. The computer program product includes a computer program stored on a non-volatile computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a processor, the processor is caused to execute the 3D image processing method based on cloud services in the above method embodiments. For example, execute the method steps S101 to S106 described above. Figure 1 in the above.

[0070] The embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0071] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform. Of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution, in essence, or the part that contributes to the related technology can be embodied in the form of a software product. The computer software product can exist in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer electronic device (which can be a personal computer, a server, or a network electronic device, etc.) to execute the methods of each embodiment or some parts of the embodiments.

[0072] Among other things, conditional language such as "can", "be able to", "may", or "could", unless specifically stated otherwise or otherwise understood within the context in which it is used, generally is intended to convey that a particular embodiment can include (while other embodiments do not include) a particular feature, element, and / or operation. Thus, such conditional language generally is not intended to imply that a feature, element, and / or operation is in any way required for one or more embodiments or that one or more embodiments must include logic for determining whether such feature, element, and / or operation is included or will be performed in any particular embodiment with or without student input or prompting.

[0073] What has been described herein in this specification and the drawings includes examples of a 3D image processing method and apparatus capable of providing cloud service-based. Of course, it is not possible to describe every conceivable combination of elements and / or methods for the purpose of describing the various features of the present disclosure, but it will be recognized that many additional combinations and permutations of the disclosed features are possible. Thus, it is evident that various modifications can be made to the present disclosure without departing from the scope or spirit thereof. Additionally, or in the alternative, other embodiments of the present disclosure may be apparent from consideration of the specification and drawings and practice of the present disclosure as presented herein. It is intended that the examples presented in this specification and the drawings be considered illustrative in all respects and not restrictive. Although specific terms are employed herein, they are used in a generic and descriptive sense and not for purposes of limitation.

Claims

1. A 3D image processing method based on cloud services, characterized in that, The method includes the following steps: Step 1: Obtain multiple pictures of the target object generated by taking 360-degree omnidirectional pictures of the target object; Step 2: Send all the multiple pictures of the target object to the cloud storage space; Step 3: Composite the multiple pictures of the target object in the cloud storage space to generate a composite image; The composite of the multiple pictures of the target object in the cloud storage space to generate a composite image includes: Composite the edges of adjacent pictures of the target object to generate a composite image; Wherein, the picture of the target object contains local features of the target object; Step 4: Remove the overlap of the composite image and convert it into a three-dimensional space stereogram; When removing the overlap of the composite image, remove the edges of the pictures of the target object with less overlapping edges; The conversion into a three-dimensional space stereogram includes: Performing an isometric non-deformed three-dimensional spherical three-dimensional space stereogram conversion with the cylinder axis as the center; Step 5: Repeat Step 1, Step 2, Step 3, and Step 4 in sequence to obtain two three-dimensional space stereograms; Adaptively reduce the two three-dimensional space stereograms and then composite or compare them with the three-dimensional space stereogram; Step 6: Output the composite three-dimensional space stereogram or the comparison result; In Step 5: When repeating Step 1, Step 2, Step 3, and Step 4 in sequence, use a magnifying lens to take pictures of the target object in Step 1.

2. The method according to claim 1, characterized in that In Step 1: When taking 360-degree omnidirectional pictures of the target object to generate multiple pictures of the target object, use a wide-angle lens to take pictures of the target object and the objects around the target object.

3. The method according to claim 1 or 2, characterized in that, In Step 1: When taking 360-degree omnidirectional pictures of the target object to generate multiple pictures of the target object, take pictures with the target object as the shooting center according to a preset resolution.

4. An apparatus for implementing the 3D image processing method based on cloud services according to claim 1, characterized in that, The device includes: A shooting unit that takes 360-degree omnidirectional pictures of the target object to generate multiple pictures of the target object; An uploading unit that sends all the multiple pictures of the target object to the cloud storage space; An obtaining unit that obtains multiple pictures of the target object generated by taking 360-degree omnidirectional pictures of the target object from the cloud storage space; A planar composite unit that composites the multiple pictures of the target object to generate a composite image; A three-dimensional conversion unit that removes the overlap of the composite image and converts it into a three-dimensional space stereogram; A three-dimensional composite unit that composites the three-dimensional space stereogram with the two three-dimensional space stereograms; An output unit that outputs the composite three-dimensional space stereogram.

5. A non-volatile computer-readable storage medium, characterized in that, The non-volatile computer-readable storage medium stores computer-executable instructions, which when executed by one or more processors, can cause the one or more processors to execute the cloud service-based 3D image processing method according to any one of claims 1-3.

6. A computer program product, characterized in that, The computer program product includes a computer program stored on a non-volatile computer-readable storage medium. The computer program includes program instructions, which when executed by a processor, cause the processor to execute the cloud service-based 3D image processing method according to any one of claims 1-3.

Images