A digital positioning shooting system and method based on panoramic imaging
By determining the shooting requirements, acquiring scenes and targets, determining the imaging range and coding targets in panoramic imaging technology, the problem of inaccurate positioning and recognition of shooting scenes is solved, and high intelligence and accuracy of panoramic shooting is achieved.
Patent Information
- Application Number
- CN202211697325.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-28
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2042-12-28
AI Technical Summary
The existing panoramic imaging technology has inaccurate problems in the positioning and recognition of shooting scenes, resulting in inaccurate shooting images.
By determining the shooting requirements, acquiring the shooting scene and target, determining the panoramic imaging range, and digitally encode the shooting target to generate positioning factors to achieve accurate positioning of the shooting target and stitching of the panoramic images.
Improves the intelligence and accuracy of shooting, ensuring the reliability and clarity of panoramic images.
Smart Images

Figure CN116074630B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of panoramic imaging, and in particular to a digital positioning shooting system and method based on panoramic imaging. Background Art
[0002] At present, panoramic imaging is to stitch one or more groups of photos taken by a camera at multiple angles into a panoramic image. Panoramic imaging brings people a new sense of real scene and interactive feeling. Therefore, it is widely used in today's life.
[0003] With the development of science and technology, the development of panoramic imaging technology is also constantly improving. For example, the patent with application number CN201210145996.6 discloses a traffic accident scene mapping instrument based on an active panoramic vision sensor, and the steps are as follows: an omnidirectional vision sensor, an omnidirectional laser light source, a GPS sensor for locating the traffic accident scene and automatically generating a road plan, a compass for determining the measurement direction, and a microprocessor for three-dimensional stereoscopic camera measurement of the panoramic image of the omnidirectional vision sensor, visual restoration of the accident scene and digital stereoscopic reproduction, the system application software automatically captures the panoramic image of the traffic accident scene, automatically measures the spatial geometric data of the vehicles, objects, traces, etc. at the scene, automatically outputs the scene record map, the scene scale map, the scene cross-section map, the scene elevation map and the scene analysis map, and provides a method for mapping the scene of a traffic accident. The invention has the following defects: no positioning and identification of the captured scene is performed, so that the captured picture is inaccurate;
[0004] Therefore, the present invention provides a digital positioning shooting system and method based on panoramic imaging. Summary of the invention
[0005] The present invention provides a digital positioning shooting system and method based on panoramic imaging, which are used to determine shooting requirements, thereby obtaining shooting scenes and shooting targets, and determine the panoramic imaging range through the shooting scene, and digitally position the shooting targets to determine positioning factors, so as to position the shooting targets according to the panoramic imaging range and the positioning factors, thereby realizing digital positioning shooting of the shooting scenes, which is beneficial to ensuring the intelligence and accuracy of shooting.
[0006] The present invention provides a digital positioning shooting system based on panoramic imaging, comprising:
[0007] A shooting requirement acquisition module is used to acquire shooting requirements and determine shooting scenes and shooting targets according to the shooting requirements;
[0008] The shooting preparation module is used to read the shooting scene, determine the panoramic imaging range corresponding to the shooting scene, and digitally position the shooting target to generate a positioning factor;
[0009] The positioning shooting module is used to digitally position and shoot the target scene based on the panoramic imaging range and the positioning factor to obtain a panoramic image.
[0010] Preferably, a digital positioning shooting system based on panoramic imaging, a shooting demand acquisition module, includes:
[0011] A demand reading unit, used to obtain the user's shooting demand, read the shooting demand, and determine the first target keyword and the second target keyword of the shooting demand;
[0012] A shooting scene acquisition unit, used to determine a target shooting location corresponding to the shooting requirement based on the first target keyword, and retrieve a shooting scene corresponding to the shooting location in a target map;
[0013] The shooting target acquisition unit is used to read the second target keyword to determine the shooting target.
[0014] Preferably, a digital positioning shooting system based on panoramic imaging, a shooting target acquisition unit, comprises:
[0015] Keyword reading subunit, used for:
[0016] Reading the second target keyword, determining a visual expression corresponding to the second target keyword, and determining a label identifier of the second target keyword according to the visual expression;
[0017] The label identifier is input into a preset label image repository for matching, and at the same time, a target label image consistent with the visual expression is retrieved from the preset label image repository according to the matching result;
[0018] The shooting target determination subunit is used to learn the target label image to determine the two-dimensional depth map of the second target keyword, and to call the three-dimensional transformation model. At the same time, the two-dimensional depth map is input into the three-dimensional transformation model for three-dimensional conversion, and the shooting target is generated based on the conversion result.
[0019] Preferably, a digital positioning shooting system based on panoramic imaging, a shooting preparation module, comprises:
[0020] A first reading unit is used to read the shooting scene, determine the scene distribution characteristics of the shooting scene, and determine the shooting area of the shooting scene according to the scene distribution characteristics;
[0021] A panoramic imaging range confirmation unit, used to determine the panoramic imaging range corresponding to the shooting scene according to the shooting area of the shooting scene;
[0022] The second reading unit is used to read the photographed target, determine the attribute information of the photographed target, and at the same time, retrieve the target coding template;
[0023] The positioning factor determination unit is used to perform digital positioning coding on the photographed target based on the coding template and according to the attribute information of the photographed target, and generate the positioning factor based on the coding result.
[0024] Preferably, a digital positioning shooting system based on panoramic imaging, in which the first reading unit comprises:
[0025] The reading subunit is used to read the scene distribution characteristics of the shooting scene and determine the scene background distribution characteristics and the scene foreground distribution characteristics of the shooting scene;
[0026] The shooting area determination subunit is used to:
[0027] Determine the area outline according to the distribution characteristics of the scene background;
[0028] Determine the internal space of the region based on the distribution characteristics of the scene foreground;
[0029] The shooting area is determined based on the area outline and the internal space of the area.
[0030] Preferably, a digital positioning shooting system based on panoramic imaging, a positioning shooting module, comprises:
[0031] A shooting map determining unit, used to generate a shooting map based on the panoramic imaging range;
[0032] A labeling unit is used to identify the photographed target, determine the target identifier of the photographed target, match the target identifier of the photographed target in the photographed map, label the photographed target in the photographed map based on the matching result, and at the same time, obtain the map scale of the photographed map, and proportionally enlarge the photographed target in the photographed map according to the map scale to determine the target area of the photographed target;
[0033] An instruction generating unit, used for acquiring the viewing angle range of the shooting device, and generating a dynamic positioning shooting instruction based on the viewing angle range, the target area of the shooting target, the identification factor and the shooting map;
[0034] The panoramic image acquisition unit is used to control the shooting device to perform digital positioning shooting on the target scene according to the dynamic positioning shooting instruction to obtain a panoramic image.
[0035] Preferably, a digital positioning shooting system based on panoramic imaging, the instruction generating unit comprises:
[0036] A first shooting instruction generating sub-unit is used to perform shooting division in the panoramic imaging range based on the viewing angle range of the shooting device and the target area of the shooting target to obtain multiple sub-shooting ranges, and at the same time, determine the shooting order corresponding to the multiple sub-shooting ranges based on the panoramic imaging range, and generate a first shooting instruction according to the multiple sub-shooting ranges and the shooting order corresponding to the multiple sub-shooting ranges;
[0037] A second shooting instruction generating subunit, used for generating a second shooting instruction based on the identification factor and the shooting map;
[0038] The dynamic positioning shooting instruction generating subunit is used to comprehensively determine the dynamic positioning shooting instruction by combining the first shooting instruction and the second shooting instruction.
[0039] Preferably, a digital positioning shooting system based on panoramic imaging, a panoramic image acquisition unit, comprises:
[0040] The instruction calling subunit is used to call the dynamic positioning shooting instruction based on the shooting device, determine the dynamic execution order of the shooting device, and at the same time, determine the range sizes of multiple sub-shooting ranges in the panoramic imaging range, and determine the single rotation angle of the shooting device based on the range sizes;
[0041] The shooting sub-unit is used to dynamically position and shoot each sub-shooting range according to the single rotation angle and positioning factor of the shooting device to obtain multiple sub-shooting scene images. At the same time, the multiple sub-shooting scene images are panoramically stitched and a panoramic image is obtained based on the stitching result.
[0042] Preferably, a digital positioning shooting system based on panoramic imaging, the shooting subunit includes: a shooting device, a rotating device, a reference clock and a controller:
[0043] The reference clock is electrically connected to the controller, the controller is electrically connected to the rotating device, the photographing device is connected to the rotating device, and the photographing device is above the rotating device;
[0044] A reference clock is configured in the rotating device, and parameter modulation is performed on the reference clock based on a preset shooting time for each sub-shooting range;
[0045] A periodic pulse signal is generated based on the modulation result. At the same time, the periodic pulse signal is transmitted to the controller to generate a control instruction, and based on the control instruction, the rotating device is controlled to drive the shooting device to perform dynamic shooting.
[0046] Preferably, a digital positioning shooting method based on panoramic imaging includes:
[0047] Step 1: Obtain shooting requirements and determine the shooting scene and shooting target based on the shooting requirements;
[0048] Step 2: Read the shooting scene to determine the panoramic imaging range corresponding to the shooting scene. At the same time, digitally position and encode the shooting target to generate a positioning factor.
[0049] Step 3: Digitally position and shoot the target scene based on the panoramic imaging range and positioning factors to obtain a panoramic image.
[0050] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.
[0051] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
[0053] Figure 1 A structural diagram of a digital positioning shooting system based on panoramic imaging in an embodiment of the present invention;
[0054] Figure 2 This is a structural diagram of a shooting requirement acquisition module in a digital positioning shooting system based on panoramic imaging in an embodiment of the present invention;
[0055] Figure 3 A connection diagram of components in a digital positioning shooting system based on panoramic imaging in an embodiment of the present invention;
[0056] Figure 4 The present invention is a flowchart of a digital positioning shooting method based on panoramic imaging in an embodiment of the present invention. DETAILED DESCRIPTION
[0057] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.
[0058] Embodiment 1:
[0059] This embodiment provides a digital positioning shooting system based on panoramic imaging, such as Figure 1 As shown, including:
[0060] A shooting requirement acquisition module is used to acquire shooting requirements and determine shooting scenes and shooting targets according to the shooting requirements;
[0061] The shooting preparation module is used to read the shooting scene, determine the panoramic imaging range corresponding to the shooting scene, and digitally position the shooting target to generate a positioning factor;
[0062] The positioning shooting module is used to digitally position and shoot the target scene based on the panoramic imaging range and the positioning factor to obtain a panoramic image.
[0063] In this embodiment, the shooting requirements can be determined based on the requirements provided by the user, including the shooting scene and the shooting target. The shooting scene generally refers to the shooting environment and the shooting location, etc. For example, the shooting environment includes: indoors or outdoors, etc. The shooting location can be specified by the user himself; the shooting target can be the central content of the shooting, such as: buildings, objects, etc.
[0064] In this embodiment, the shooting requirements can be determined based on the requirements provided by the user, including shooting scenes and shooting targets. The shooting scene generally refers to the shooting environment and the shooting location, etc. For example, the shooting environment includes: indoors or outdoors, etc. The shooting location can be specified by the user himself; the shooting target can be the central content of the shooting, and the number of shooting targets is equal to or greater than 1, such as: buildings, objects, etc.
[0065] In this embodiment, the panoramic imaging range may be a spatial area that needs to be photographed and is determined based on a shooting scene, such as a panoramic view of an office.
[0066] In this embodiment, the digital positioning code may be a form of encoding the analog information of the photographed object into digital information.
[0067] In this embodiment, the positioning factor can be an execution program for locating the shooting target determined based on the digital positioning code of the shooting target. For example, if the shooting target is safflower, the safflower is digitally positioned and encoded to determine the identification factor of the safflower, and the identification factor of the safflower (positioning execution program) is input into the shooting device. The shooting device can directly locate and identify the safflower based on the identification factor.
[0068] In this embodiment, the panoramic image may be a panoramic image determined by combining a shooting scene and a shooting target.
[0069] The beneficial effects of the above technical solution are: by determining the shooting requirements, the shooting scene and the shooting target are obtained, and the panoramic imaging range is determined by the shooting scene, and the shooting target is digitally positioned and encoded to determine the positioning factor, so that the shooting target is positioned according to the panoramic imaging range and the positioning factor, and digital positioning shooting of the shooting scene is achieved, which is conducive to ensuring the intelligence and accuracy of the shooting.
[0070] Embodiment 2:
[0071] Based on Example 1, this embodiment provides a digital positioning shooting system based on panoramic imaging, such as Figure 2 As shown, the shooting requirement acquisition module includes:
[0072] A demand reading unit, used to obtain the user's shooting demand, read the shooting demand, and determine the first target keyword and the second target keyword of the shooting demand;
[0073] A shooting scene acquisition unit, used to determine a target shooting location corresponding to the shooting requirement based on the first target keyword, and retrieve a shooting scene corresponding to the shooting location in a target map;
[0074] The shooting target acquisition unit is used to read the second target keyword to determine the shooting target.
[0075] In this embodiment, the first target keyword may be a shooting location keyword (eg, community location, etc.) of the shooting requirement.
[0076] In this embodiment, the second target keyword may be a keyword describing the photographing target.
[0077] The beneficial effect of the above technical solution is that by determining the first target keyword and the second target keyword, the user's shooting requirements can be effectively read, ensuring the accuracy of the reading of the user's shooting requirements.
[0078] Embodiment 3:
[0079] Based on Example 2, this embodiment provides a digital positioning shooting system based on panoramic imaging, and the shooting target acquisition unit includes:
[0080] Keyword reading subunit, used for:
[0081] Reading the second target keyword, determining a visual expression corresponding to the second target keyword, and determining a label identifier of the second target keyword according to the visual expression;
[0082] The label identifier is input into a preset label image repository for matching, and at the same time, a target label image consistent with the visual expression is retrieved from the preset label image repository according to the matching result;
[0083] The shooting target determination subunit is used to learn the target label image to determine the two-dimensional depth map of the second target keyword, and to call the three-dimensional transformation model. At the same time, the two-dimensional depth map is input into the three-dimensional transformation model for three-dimensional conversion, and the shooting target is generated based on the conversion result.
[0084] In this embodiment, the visual expression may be an explanation of the photographed target in the form of text, for example, the shape, color, etc. of the photographed target may be expressed.
[0085] In this embodiment, the label representation may be a marking label used to mark the second target keyword, through which the type of the second target keyword can be quickly and accurately determined.
[0086] In this embodiment, the preset label image storage library is set in advance and is used to store label images.
[0087] In this embodiment, the target label image may be a label image in a preset label image repository that matches the label identifier.
[0088] In this embodiment, the two-dimensional depth map may be used to represent the distance of the photographed target relative to the photographing device, and is a necessary step for converting into a three-dimensional model.
[0089] The beneficial effects of the above technical solution are: by reading the second target keyword, the visual expression of the shooting target can be accurately and effectively determined; secondly, the target label image of the object is obtained from the preset label image repository through the visual expression, and the target label image is three-dimensionally converted, finally realizing the determination of the shooting target, ensuring the reliability of the determined shooting target, providing convenience for the digital positioning shooting of the shooting scene, and ensuring the intelligence and accuracy of the shooting.
[0090] Embodiment 4:
[0091] Based on Example 1, this embodiment provides a digital positioning shooting system based on panoramic images, and a shooting preparation module, including:
[0092] A first reading unit is used to read the shooting scene, determine the scene distribution characteristics of the shooting scene, and determine the shooting area of the shooting scene according to the scene distribution characteristics;
[0093] A panoramic imaging range confirmation unit, used to determine the panoramic imaging range corresponding to the shooting scene according to the shooting area of the shooting scene;
[0094] The second reading unit is used to read the photographed target, determine the attribute information of the photographed target, and at the same time, retrieve the target coding template;
[0095] The positioning factor determination unit is used to perform digital positioning coding on the photographed target based on the coding template and according to the attribute information of the photographed target, and generate the positioning factor based on the coding result.
[0096] In this embodiment, the scene distribution features may include background distribution features of the shooting scene (i.e., features such as the size of the edge background of the shooting scene) and foreground distribution features of the shooting scene (i.e., features such as the volume occupied by objects in the shooting scene, such as buildings, flowers, etc., and their locations in the shooting scene).
[0097] In this embodiment, the attribute information of the photographed object may be the type of the photographed object, such as building type, landscape type, etc.
[0098] In this embodiment, the target coding template may be pre-set to ensure uniformity of the format when encoding the photographed target, thereby facilitating the recognition of the photographed target by the positioning factor.
[0099] The beneficial effects of the above technical solution are: by determining the scene distribution characteristics of the shooting scene, the shooting area of the shooting scene is locked, and then the panoramic imaging range is accurately obtained through the shooting area, and by calling the target coding template, the uniform format when encoding the shooting target is guaranteed, which is conducive to the positioning factor to identify the shooting target, and by determining the target coding template and the attribute information of the shooting target, the generated positioning factor is made more comprehensive and objective, which is conducive to ensuring the accuracy of identifying the shooting target.
[0100] Embodiment 5:
[0101] On the basis of Embodiment 4, this embodiment provides a digital positioning shooting system based on panoramic images, wherein the first reading unit includes:
[0102] The reading subunit is used to read the scene distribution characteristics of the shooting scene and determine the scene background distribution characteristics and the scene foreground distribution characteristics of the shooting scene;
[0103] The shooting area determination subunit is used to:
[0104] Determine the area outline according to the distribution characteristics of the scene background;
[0105] Determine the internal space of the region based on the distribution characteristics of the scene foreground;
[0106] The shooting area is determined based on the area outline and the internal space of the area.
[0107] The beneficial effect of the above technical solution is: by determining the scene background distribution characteristics and the scene foreground distribution characteristics of the shooting scene, the shooting area is effectively obtained.
[0108] Embodiment 6:
[0109] Based on Example 1, this embodiment provides a digital positioning shooting system based on panoramic imaging, and the positioning shooting module includes:
[0110] A shooting map determining unit, used to generate a shooting map based on the panoramic imaging range;
[0111] A labeling unit is used to identify the photographed target, determine the target identifier of the photographed target, match the target identifier of the photographed target in the photographed map, label the photographed target in the photographed map based on the matching result, and at the same time, obtain the map scale of the photographed map, and proportionally enlarge the photographed target in the photographed map according to the map scale to determine the target area of the photographed target;
[0112] An instruction generating unit, used for acquiring the viewing angle range of the shooting device, and generating a dynamic positioning shooting instruction based on the viewing angle range, the target area of the shooting target, the identification factor and the shooting map;
[0113] The panoramic image acquisition unit is used to control the shooting device to perform digital positioning shooting on the target scene according to the dynamic positioning shooting instruction to obtain a panoramic image.
[0114] In this embodiment, the shooting map may be used to record specific locations of different objects to be shot in the panoramic imaging range, so as to provide a reference for achieving panoramic shooting.
[0115] In this embodiment, the target identification is a marking label used to mark different shooting targets, and the type and position of the shooting target can be quickly determined through the target identification.
[0116] In this embodiment, the target area may be an image area representing the area occupied by the photographed target in the photographed map.
[0117] In this embodiment, the viewing angle range may be a maximum range angle that represents the shooting device can perform.
[0118] In this embodiment, the dynamic positioning shooting instruction may be used to dynamically control the shooting device to shoot a target within the viewing angle.
[0119] In this embodiment, the photographing device may be a camera or the like.
[0120] The beneficial effect of the above technical solution is: by generating a shooting map according to the panoramic imaging range, the shooting target is identified and matched with the shooting map, so as to generate dynamic positioning shooting instructions for the shooting target according to the shooting map, and finally control the shooting device to perform digital positioning shooting of the target field through the dynamic positioning shooting instructions, thereby ensuring the reliability of the final panoramic image, which is conducive to ensuring the intelligence and accuracy of the shooting.
[0121] Embodiment 7:
[0122] Based on Example 6, this embodiment provides a digital positioning shooting system based on panoramic imaging, and the instruction generating unit includes:
[0123] A first shooting instruction generating sub-unit is used to perform shooting division in the panoramic imaging range based on the viewing angle range of the shooting device and the target area of the shooting target to obtain multiple sub-shooting ranges, and at the same time, determine the shooting order corresponding to the multiple sub-shooting ranges based on the panoramic imaging range, and generate a first shooting instruction according to the multiple sub-shooting ranges and the shooting order corresponding to the multiple sub-shooting ranges;
[0124] A second shooting instruction generating subunit, used for generating a second shooting instruction based on the identification factor and the shooting map;
[0125] The dynamic positioning shooting instruction generating subunit is used to comprehensively determine the dynamic positioning shooting instruction by combining the first shooting instruction and the second shooting instruction.
[0126] In this embodiment, performing shooting segmentation in the panoramic imaging range based on the viewing angle range of the shooting device and the target area of the shooting target may be as follows: overlapping the viewing angle range of the shooting device in the panoramic imaging range, and performing a first shooting segmentation in the panoramic imaging range according to the overlapping result (segmenting the panoramic imaging range according to the viewing angle range of the shooting device), determining the target area of the shooting target to determine whether the first shooting segmentation affects the shooting target, and when the shooting target is affected, performing a second shooting segmentation in the panoramic imaging range (i.e., adjusting the first shooting segmentation) based on the viewing angle range of the shooting device.
[0127] In this embodiment, the shooting sequence may be based on the sub-shooting range corresponding to the starting end of the panoramic imaging range as the initial shooting direction, thereby sequentially determining the shooting sequence corresponding to the multiple sub-shooting ranges.
[0128] In this embodiment, the sub-shooting range may be based on shooting segmentation performed in the panoramic imaging range, and the sub-shooting range is determined according to the segmentation result.
[0129] In this embodiment, the first shooting instruction may be determined based on the shooting order corresponding to the multiple shooting ranges, which is helpful to ensure the shooting direction of the shooting device.
[0130] In this embodiment, the second shooting instruction may be determined based on the recognition factor and the shooting map, which is conducive to realizing intelligent positioning of the shooting target in the shooting scene.
[0131] In this embodiment, the dynamic positioning shooting instruction may be an instruction determined based on the first shooting instruction and the second shooting instruction, and is used to dynamically shoot the shooting scene.
[0132] The beneficial effects of the above technical solution are: by determining the dynamic positioning shooting instructions, it is helpful to ensure the shooting direction of the shooting device, thereby improving the accuracy and stability of the shooting device, and positioning the shooting target, thereby ensuring that the shooting device can automatically identify the shooting target and focus, thereby improving the intelligence of the shooting and making the panoramic image clearer.
[0133] Embodiment 8:
[0134] On the basis of Example 6, this embodiment provides a digital positioning shooting system based on panoramic images, and a panoramic image acquisition unit includes:
[0135] The instruction calling subunit is used to call the dynamic positioning shooting instruction based on the shooting device, determine the dynamic execution order of the shooting device, and at the same time, determine the range sizes of multiple sub-shooting ranges in the panoramic imaging range, and determine the single rotation angle of the shooting device based on the range sizes;
[0136] The shooting sub-unit is used to dynamically position and shoot each sub-shooting range according to the single rotation angle and positioning factor of the shooting device to obtain multiple sub-shooting scene images. At the same time, the multiple sub-shooting scene images are panoramically stitched and a panoramic image is obtained based on the stitching result.
[0137] In this embodiment, the dynamic execution order may be a sequence of capturing the target by the capturing device.
[0138] In this embodiment, the single rotation angle is used to represent the angle required to rotate when shooting different sub-shooting ranges through the shooting device, for example, it can be rotated 10 degrees each time, so as to achieve shooting of shooting targets in different sub-shooting ranges.
[0139] In this embodiment, the sub-shooting scene images may be images corresponding to each sub-shooting range obtained after a shooting device shoots a shooting target within each sub-shooting range.
[0140] The beneficial effects of the above technical solution are: by calling the dynamic positioning shooting instruction, the dynamic execution order of the shooting device can be accurately and effectively determined; secondly, by determining the range sizes of multiple sub-shooting ranges in the panoramic imaging range, the single rotation angle of the shooting device can be accurately and effectively determined; finally, different sub-shooting ranges are shot at a single rotation angle, and the sub-shooting scene images obtained after shooting are spliced, so as to realize accurate and effective acquisition of panoramic images, thereby ensuring the accuracy and intelligence of digital positioning shooting, and also ensuring the reliability of the final panoramic image.
[0141] Embodiment 9:
[0142] Based on Example 8, this embodiment provides a digital positioning shooting system based on panoramic images, such as Figure 3 As shown, the shooting subunit includes: a shooting device 1, a rotating device 2, a reference clock 3 and a controller 4:
[0143] The reference clock 3 is electrically connected to the controller 4, the controller 4 is electrically connected to the rotating device 2, the photographing device 1 is connected to the rotating device 2, and the photographing device is above the rotating device;
[0144] A reference clock 3 is configured in the rotating device 2, and parameters of the reference clock 3 are modulated based on a preset shooting time for each sub-shooting range;
[0145] A periodic pulse signal is generated based on the modulation result. At the same time, the periodic pulse signal is transmitted to the controller 4 to generate a control instruction, and based on the control instruction, the rotating device 2 is controlled to drive the shooting device 1 to perform dynamic shooting.
[0146] In this embodiment, the rotating device is fixed in advance, and the shooting device is fixedly connected to the rotating device. During the shooting process, the rotating device cannot move forward, backward, left or right, and can only rotate within a certain angle range. When the shooting requirements change, the position of the rotating device can be changed, thereby realizing the change of the position of the shooting device.
[0147] In this embodiment, the reference clock may be a tool for generating a periodic pulse signal in order to generate a periodic control instruction.
[0148] In this embodiment, the preset shooting time is set in advance and is used to represent the shooting time for each sub-shooting range, for example, it may be 5 seconds.
[0149] In this embodiment, the parameter modulation may be to configure the clock period of the reference clock, so as to generate a periodic pulse signal according to a preset shooting time.
[0150] In this embodiment, the periodic pulse signal may be a sending control instruction signal, so that the controller can generate corresponding control instructions in time after receiving the periodic pulse signal.
[0151] The beneficial effect of the above technical solution is: by connecting the shooting device with the rotating device, configuring a reference clock for the rotating device, and modulating the reference clock parameters according to the preset shooting time of each sub-shooting range, it is convenient to generate periodic control instructions, thereby realizing the periodic rotation of the rotating device, ensuring the effect of dynamic shooting through the shooting device, and improving the intelligence and accuracy of shooting.
[0152] Embodiment 10:
[0153] On the basis of Embodiment 8, the shooting subunit further includes:
[0154] A stitching feature point acquisition subunit is used to set a scale space factor when performing panoramic stitching on multiple sub-shooting scene images, determine an image sequence of each sub-shooting scene image based on the scale space factor, and determine a stitching feature point of each sub-shooting scene image according to the image sequence of each sub-shooting scene image;
[0155] The first calculation subunit is used to calculate the gradient modulus of the pixels in the splicing feature point area according to the following formula;
[0156]
[0157] Among them, φ(a,b) represents the gradient modulus of the pixels in the area of the splicing feature point; m(a+1,b) represents the right adjacent point of the splicing feature point; m(a-1,b) represents the left adjacent point of the splicing feature point; m(a,b+1) represents the upper adjacent point of the splicing feature point; m(a,b-1) represents the lower adjacent point of the splicing feature point; a represents the horizontal coordinate value of the splicing feature point; b represents the total coordinate value of the splicing feature point;
[0158] The second calculation subunit is used to calculate the direction of the pixels in the splicing feature point area according to the following formula;
[0159]
[0160] Among them, θ(a,b) represents the direction of the pixels in the area of the spliced feature points; arctan(·) represents the inverse tangent function;
[0161] A stitching direction determination subunit, used to determine the stitching direction of the stitching feature points of each sub-shooting scene according to the gradient modulus of the pixels in the stitching feature point area and the direction of the pixels in the stitching feature point area;
[0162] The stitching subunit is used to perform panoramic stitching on multiple sub-shooting scene images based on the stitching direction of the stitching feature points of each sub-shooting scene, and obtain a panoramic image based on the stitching result.
[0163] In this embodiment, the scale space factor may be σ, which represents the degree of smoothing of the sub-captured scene image, wherein the smaller the degree of smoothing of the sub-captured scene image is, the smaller the corresponding scale is.
[0164] In this embodiment, the stitching feature points may be connection points between sub-shooting scene images.
[0165] The beneficial effect of the above technical solution is: by determining the scale space factor, the image sequence corresponding to the sub-capture scene image is determined by determining the smoothness of the sub-capture scene image, and then the stitching feature points are determined through the image sequence, and by respectively calculating the gradient modulus value of the pixels in the stitching feature point field and the direction of the pixels in the stitching feature point field, the stitching direction of the stitching feature points of each sub-capture scene is accurately determined, thereby realizing panoramic stitching of multiple sub-capture scene images and improving the image quality of the panoramic image.
[0166] Embodiment 11:
[0167] This embodiment provides a digital positioning shooting method based on panoramic imaging, such as Figure 4 As shown, including:
[0168] Step 1: Obtain shooting requirements and determine the shooting scene and shooting target based on the shooting requirements;
[0169] Step 2: Read the shooting scene to determine the panoramic imaging range corresponding to the shooting scene. At the same time, digitally position and encode the shooting target to generate a positioning factor.
[0170] Step 3: Digitally position and shoot the target scene based on the panoramic imaging range and positioning factors to obtain a panoramic image.
[0171] The beneficial effects of the above technical solution are: by determining the shooting requirements, the shooting scene and the shooting target are obtained, and the panoramic imaging range is determined by the shooting scene, and the shooting target is digitally positioned and encoded to determine the positioning factor, so that the shooting target is positioned according to the panoramic imaging range and the positioning factor, and digital positioning shooting of the shooting scene is achieved, which is conducive to ensuring the intelligence and accuracy of the shooting.
[0172] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A digital positioning shooting system based on panoramic imaging, characterized in that: include: A shooting requirement acquisition module is used to acquire shooting requirements and determine shooting scenes and shooting targets according to the shooting requirements; The shooting preparation module is used to read the shooting scene, determine the panoramic imaging range corresponding to the shooting scene, and digitally position the shooting target to generate a positioning factor; A positioning shooting module is used to digitally position and shoot the target scene based on the panoramic imaging range and the positioning factor to obtain a panoramic image; Positioning shooting module, including: A shooting map determining unit, used to generate a shooting map based on the panoramic imaging range; A labeling unit is used to identify the photographed target, determine the target identifier of the photographed target, match the target identifier of the photographed target in the photographed map, label the photographed target in the photographed map based on the matching result, and at the same time, obtain the map scale of the photographed map, and proportionally enlarge the photographed target in the photographed map according to the map scale to determine the target area of the photographed target; An instruction generating unit, used for acquiring the viewing angle range of the shooting device, and generating a dynamic positioning shooting instruction based on the viewing angle range, the target area of the shooting target, the identification factor and the shooting map; The panoramic image acquisition unit is used to control the shooting device to perform digital positioning shooting on the target scene according to the dynamic positioning shooting instruction to obtain a panoramic image.
2. The digital positioning shooting system based on panoramic imaging according to claim 1, characterized in that: Shooting requirements acquisition module, including: A demand reading unit, used to obtain the user's shooting demand, read the shooting demand, and determine the first target keyword and the second target keyword of the shooting demand; A shooting scene acquisition unit, used to determine a target shooting location corresponding to the shooting requirement based on the first target keyword, and retrieve a shooting scene corresponding to the shooting location in a target map; The shooting target acquisition unit is used to read the second target keyword to determine the shooting target.
3. The digital positioning shooting system based on panoramic imaging according to claim 2, characterized in that: The shooting target acquisition unit includes: Keyword reading subunit, used for: Reading the second target keyword, determining a visual expression corresponding to the second target keyword, and determining a label identifier of the second target keyword according to the visual expression; The label identifier is input into a preset label image repository for matching, and at the same time, a target label image consistent with the visual expression is retrieved from the preset label image repository according to the matching result; The shooting target determination subunit is used to learn the target label image to determine the two-dimensional depth map of the second target keyword, and to call the three-dimensional transformation model. At the same time, the two-dimensional depth map is input into the three-dimensional transformation model for three-dimensional conversion, and the shooting target is generated based on the conversion result.
4. The digital positioning shooting system based on panoramic imaging according to claim 1, characterized in that: Shooting preparation module, including: A first reading unit is used to read the shooting scene, determine the scene distribution characteristics of the shooting scene, and determine the shooting area of the shooting scene according to the scene distribution characteristics; A panoramic imaging range confirmation unit, used to determine the panoramic imaging range corresponding to the shooting scene according to the shooting area of the shooting scene; The second reading unit is used to read the photographed target, determine the attribute information of the photographed target, and at the same time, retrieve the target coding template; The positioning factor determination unit is used to perform digital positioning coding on the photographed target based on the coding template and according to the attribute information of the photographed target, and generate the positioning factor based on the coding result.
5. The digital positioning shooting system based on panoramic imaging according to claim 4, characterized in that: The first reading unit includes: The reading subunit is used to read the scene distribution characteristics of the shooting scene and determine the scene background distribution characteristics and the scene foreground distribution characteristics of the shooting scene; The shooting area determination subunit is used to: Determine the area outline according to the distribution characteristics of the scene background; Determine the internal space of the region based on the distribution characteristics of the scene foreground; The shooting area is determined based on the area outline and the internal space of the area.
6. The digital positioning shooting system based on panoramic imaging according to claim 1, characterized in that: Instruction generation unit, including: A first shooting instruction generating sub-unit is used to perform shooting division in the panoramic imaging range based on the viewing angle range of the shooting device and the target area of the shooting target to obtain multiple sub-shooting ranges, and at the same time, determine the shooting order corresponding to the multiple sub-shooting ranges based on the panoramic imaging range, and generate a first shooting instruction according to the multiple sub-shooting ranges and the shooting order corresponding to the multiple sub-shooting ranges; A second shooting instruction generating subunit, used for generating a second shooting instruction based on the identification factor and the shooting map; The dynamic positioning shooting instruction generating subunit is used to comprehensively determine the dynamic positioning shooting instruction by combining the first shooting instruction and the second shooting instruction.
7. The digital positioning shooting system based on panoramic imaging according to claim 1, characterized in that: A panoramic image acquisition unit, comprising: The instruction calling subunit is used to call the dynamic positioning shooting instruction based on the shooting device, determine the dynamic execution order of the shooting device, and at the same time, determine the range sizes of multiple sub-shooting ranges in the panoramic imaging range, and determine the single rotation angle of the shooting device based on the range sizes; The shooting sub-unit is used to dynamically position and shoot each sub-shooting range according to the single rotation angle and positioning factor of the shooting device to obtain multiple sub-shooting scene images. At the same time, the multiple sub-shooting scene images are panoramically stitched and a panoramic image is obtained based on the stitching result.
8. The digital positioning shooting system based on panoramic imaging according to claim 7, characterized in that: The shooting subunit includes: a shooting device, a rotating device, a reference clock and a controller: The reference clock is electrically connected to the controller, the controller is electrically connected to the rotating device, the photographing device is connected to the rotating device, and the photographing device is above the rotating device; A reference clock is configured in the rotating device, and parameter modulation is performed on the reference clock based on a preset shooting time for each sub-shooting range; A periodic pulse signal is generated based on the modulation result. At the same time, the periodic pulse signal is transmitted to the controller to generate a control instruction, and based on the control instruction, the rotating device is controlled to drive the shooting device to perform dynamic shooting.
9. A digital positioning shooting method based on panoramic imaging, characterized in that: include: Step 1: Obtain shooting requirements and determine the shooting scene and shooting target based on the shooting requirements; Step 2: Read the shooting scene to determine the panoramic imaging range corresponding to the shooting scene. At the same time, digitally position and encode the shooting target to generate a positioning factor. Step 3: Digitally position and shoot the target scene based on the panoramic imaging range and positioning factors to obtain a panoramic image; The method of performing digital positioning shooting on the target scene based on the panoramic imaging range and the positioning factor to obtain a panoramic image includes: Generate a shooting map based on the panoramic imaging range; Identify the photographed target, determine the target identifier of the photographed target, match it in the photographed map according to the target identifier of the photographed target, mark the photographed target in the photographed map based on the matching result, and at the same time, obtain the map scale of the photographed map, and proportionally enlarge the photographed target in the photographed map according to the map scale to determine the target area of the photographed target; Acquire the viewing angle range of the shooting device, and generate a dynamic positioning shooting instruction based on the viewing angle range, the target area of the shooting target, the identification factor and the shooting map; According to the dynamic positioning shooting instruction, the shooting device is controlled to perform digital positioning shooting of the target scene to obtain a panoramic image.
Citation Information
Patent Citations
Traffic accident field surveying instrument based on active omnidirectional visual sensor
CN102692213B
Shooting control method and device and shooting system
CN111212218A