Image processing system for precise correction and synthesis of image
The image processing system addresses the challenge of accurately correcting and synthesizing 2D images for 3D video production by using a vehicle-mounted CCD camera and position indicator, enabling precise image alignment and recovery of deleted features, resulting in accurate 3D video images.
Patent Information
- Application Number
- KR1020260129120
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2026-07-14
- Publication Date
- 2026-10-30
- Estimated Expiration
- 2046-07-14
AI Technical Summary
Existing image processing systems fail to accurately correct and synthesize 2D object images for 3D video production, and cannot recover deleted non-security object images from edited video images, leading to unclear digital maps and limited accuracy in video image production.
An image processing system comprising a collection information DB, security information DB, MMS information DB, and modules for coordinate-based search, image processing, stereoscopic conversion, video inspection, correction, and video editing, which utilize a movable vehicle-mounted CCD camera and position indicator to align and correct images, generate 2D and 3D feature images, and recover obscured features.
The system accurately corrects and synthesizes 2D images for 3D video production, recovering deleted non-security object images, thereby producing precise and complete video images.
Smart Images

Figure 112026085536379-PAT00002_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to an image processing system, and more specifically, to an image processing system that precisely performs image correction and synthesis. Background Technology
[0003] Orthophotos are obtained by correcting the deviation of centrally projected aerial photographs to transform them into an orthophoto-like form, similar to a map. Here, deviation correction is the process of adjusting for factors such as tilt and scale that occurred during camera capture.
[0004] These orthophotos are constructed through a series of processes that involve obtaining ground images via orthophoto aerial projection, extracting error-free orthophotos by utilizing a Digital Elevation Model (DEM) on the obtained orthophoto images, correcting and aggregating the colors of the orthophotos, and organizing them through error correction and final quality inspection.
[0005] Orthophoto aerial projection for securing image images (orthophoto images) secures a projected photographic image that overlaps by more than 60% in the vertical direction and more than 30% in the horizontal direction by the aircraft route.
[0006] Digital elevation models are essential in the process of producing orthophotos to correct geometric distortions in aerially projected images. The extracted orthophotos undergo a color correction process to adjust colors and brightness, and an image aggregation process to combine individual images with neighboring images.
[0007] The final orthophoto map image is completed through image processing that includes color correction and image aggregation of orthophoto images obtained from orthophoto aerial projection, and it is common practice to synthesize coordinate information (location information) precisely surveyed at each ground location corresponding to each point on the orthophoto map.
[0008] Images collected through aerial photography and the like are immediately and preferentially delivered to security-related agencies, which then provide the final edited images—after removing images of security targets—to digital map production companies.
[0009] However, during this process, security agencies do not perform detailed editing, so they edit by removing part or all of the surrounding landmark images. This type of editing makes accurate image processing impossible and causes a problem in that reliable digital maps cannot be produced because the shape and size of the landmark images, which have been partially or completely removed, become unclear.
[0010] Furthermore, differences in the position and shape of the object image within the captured image may occur depending on the condition of the object at the time of shooting, the shooting angle, the resolution, etc. Consequently, video images produced based on the captured image exhibit differences in the position and shape of the object image, which limits the ability to produce accurate video images.
[0011] Furthermore, since the accuracy of the planar view of the object image must be guaranteed for the production of 3D video images, the production of the object image, which is a reliable planar image of the object, must be done beforehand. Consequently, there was an urgent need for image processing technology capable of clearly correcting and processing unclear video images generated during the editing process.
[0012] The matters described above as background technology are intended solely to enhance understanding of the background of the present invention and should not be construed as an acknowledgment that they constitute prior art already known to those skilled in the art. The problem to be solved
[0014] The present invention aims to solve the problems of the aforementioned prior art and provides an image processing system that precisely performs image correction and synthesis, which can more accurately inspect and correct 2D object images that are primarily visualized for the production of 3D images.
[0015] In addition, another objective of the present invention is to provide an image processing system that precisely performs image correction and synthesis, capable of recovering the removed portion of a non-security object image from a video image in which a security object image has been deleted and edited, through synthesis processing, and completing it into an accurate video image.
[0016] The technical problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description of the present invention. means of solving the problem
[0018] The configuration of the present invention for achieving the above purpose comprises: a collection information DB that receives and stores a captured image and feature data, area data, and topographic data belonging to the captured image from an information collection device; a security information DB that stores and manages security information consisting of a first editing section edited in the captured image, a second editing section processed in image, and location information of a replacement image synthesized in the second editing section; an MMS information DB that stores and manages MMS information regarding the location and height of features through field collection by the information collection device; and a coordinate-based search module that searches for feature data, area data, and topographic data by coordinate in the collection information DB according to input search conditions, designates a feature image within a designated range based on the boundary of the first editing section as a damaged feature image, and searches for image information of the corresponding damaged feature image through a target feature search device. An image processing module that images the outer lines of features and zones by aligning the feature data, zone data, and terrain data searched by the coordinate-based search module with the corresponding coordinate lines within a 2D-based coordinate plane, generates 2D planar feature images and zone images respectively, synthesizes image information searched by the target feature search device onto the corresponding damaged feature image, divides the second editing section corresponding to security information into parts, and performs image processing by synthesizing replacement images for each part;A stereoscopic conversion module that compares the outline of a feature image, which has been processed by the image processing module and corrected by the correction module below, with a first reference line and a coordinate line specified in a 2D-based coordinate plane to confirm the relative position and placement angle with respect to the first reference line and the position and placement angle according to the coordinate line, respectively, and processes the outline corresponding to the relative position and placement angle based on the second reference line specified in the 3D-based coordinate plane along the coordinate line set in the 3D-based coordinate plane to generate a stereoscopic image composed of a 3D-format planar feature image and a zone image and a 3D-format replacement image in the 3D-based coordinate plane, and confirms the feature data corresponding to the 3D-format planar feature image to generate a stereoscopic feature image of the height according to the collection information of the corresponding feature image stored in the collection information DB based on the 3D-format planar feature image;The positional coordinate values of the 2D feature images and area images generated by the image processing module are compared with the corresponding feature data and area data to verify for errors; the position and shape of the planar 3D feature images and area images generated by the stereoscopic conversion module and the position and shape of the stereoscopic 3D replacement image are compared with the respective positions and shapes of the 2D feature images, area images, and replacement images to verify for errors; the replacement images processed by the image processing module and the stereoscopic conversion module are verified to identify the endpoints of the exposed sections within the outer lines of the feature image from which only a portion of the stereoscopic feature image was deleted as a blind spot by the replacement image during the stereoscopic conversion module's stereoscopic conversion process as the boundary points of the blind spots; the stereoscopic feature image having the corresponding boundary points in the stereoscopic feature image generated by conversion by the stereoscopic conversion module and the 3D planar feature image containing the corresponding boundary points in the 3D-based coordinate plane are identified; and the blind spots of the stereoscopic feature image caused by the replacement image A video inspection module that defines the range as a range formed starting from a boundary point on a 3D-based coordinate plane, modifies the corresponding collected information stored in the collected information DB according to the MMS information stored in the MMS information DB, and modifies the height of the three-dimensional feature image; a correction module that checks the vertex coordinates and centroid coordinates of the feature image confirmed by the video inspection module through 2D-format video image scanning by aligning it with coordinate lines configured on a 2D-based coordinate plane, compares the vertex coordinates and centroid coordinates of the previous version of the corresponding 2D-format feature image stored in the collected information DB, and corrects the corresponding 2D-format feature image to match the vertex coordinates and centroid coordinates of the previous version if an error exceeding a reference value is confirmed; and a proximity location information collection module that searches the MMS information of a three-dimensional feature image located partially or entirely within the blind spot range confirmed by the video inspection module in the MMS information DB.and a video editing module that generates a three-dimensional feature image having a corresponding height according to MMS information based on a planar 3D feature image within the blind spot range confirmed by the video inspection module in a 3D-based coordinate plane, and edits the three-dimensional feature image obscured by the replacement image so that a part or the whole of the replacement image can be visually seen; characterized by including.;
[0019] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, the information collection device preferably comprises: a movable vehicle; a support body disposed on the upper part of the vehicle; a support post connected to the support body in a height-adjustable manner and equipped with a height indicator; a CCD camera rotatably installed on the support post; a position indicator installed on the CCD camera and rotating together with the CCD camera, which repeatedly flashes and irradiates light of different colors; a lifting support part connected to the support body and supporting the support body in a way that allows it to be raised and lowered; a main body connecting part connected to the support body; and a battery installed on the support body.
[0020] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, the support body preferably comprises: a support base arranged parallel to the upper part of a vehicle; and a support block provided on the upper surface of the support base and rotatably supporting a support post.
[0021] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, the post unit preferably comprises: a first post rotatably installed on a support block and having a height indicator formed thereon; a second post connected to the first post so as to be vertically and rotatable and having a height indicator formed thereon; and a third post connected to the second post so as to be vertically and rotatable and having a height indicator formed thereon, on which a CCD camera is installed.
[0022] In an image processing system that precisely performs correction and synthesis of image images according to an embodiment of the present invention, the CCD camera preferably comprises: a camera connection block installed on a third post and having an angle indicator formed on its outer surface; a camera connection post rotatably connected to the camera connection block; a camera head connected to the camera connection post; a camera member installed on the camera head; and a rotation fixing part that penetrates the camera connection block and contacts the camera connection post, and limits the rotation of the camera connection post.
[0023] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, the position indicator unit preferably comprises: a connecting plate installed on the outer surface of a camera head and rotating together with the camera head; a position block installed on the connecting plate; and a plurality of position lights installed on the position block and repeatedly flashing and irradiating light of different colors.
[0024] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, the lifting support unit preferably comprises: a connecting block installed on a support base; a lifting drive unit installed on the connecting block; a lifting unit connected to the lifting drive unit and lifting in the direction of the upper part of the vehicle; and a support flange installed at the end of the lifting unit and contact-coupled to the upper part of the vehicle.
[0025] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, the main body connecting part preferably comprises: a first connecting bar coupled to a support base; a second connecting bar connected to the first connecting bar so as to be vertical and rotatable; a third connecting bar connected to the second connecting bar so as to be vertical and rotatable and formed at an angle to the second connecting bar; and a display installed on the third connecting bar.
[0026] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, it is preferable that the angle display unit be arranged in a direction intersecting the extension direction of the height display unit.
[0027] In an image processing system that precisely performs image correction and synthesis according to an embodiment of the present invention, it is preferable that the CCD camera and the position display unit rotate within an angle range displayed on the angle display unit. Effects of the invention
[0029] The present invention, having the above configuration, can more accurately inspect and correct 2D object images that are primarily visualized for the production of 3D video images, and has the effect of recovering the removed portion of non-security object images from a video image in which security object images have been deleted and edited through synthesis processing, thereby completing an accurate video image. Brief explanation of the drawing
[0031] It is noted that the attached drawings are provided as examples for reference to understand the technical concept of the present invention, and the scope of the rights of the present invention is not limited by them. Fig. 1 is a block diagram illustrating the configuration of each component of a conventional general image processing system. Fig. 2 is a flowchart sequentially illustrating the operation process of a conventional general image processing system. Fig. 3 is an image showing an edited state in which an image of a security target object has been removed from a conventional general captured image. Fig. 4 is an image conceptually illustrating the conventional general image processing system synthesizing a collected 2D composite image onto the image to recover the deleted and edited image. Fig. 5 is an image showing the image finally processed by a conventional general image processing system. Fig. 6 is a drawing of an image in 2D format, each processed from the images of Fig. 3 and Fig. 5. Fig. 7 is a drawing illustrating the conventional general image processing system inspecting the 2D image of the object. Fig. 8 is a drawing illustrating the conventional general image processing system correcting errors on the 2D image of the object. Fig. 9 is a conventional general A drawing illustrating the conversion of the drawing shown in Fig. 6 into a 3D format image and the synthesis of a supplementary image onto an image of a security target object. Fig. 10 is a drawing illustrating the conversion of the conventional general drawing shown in Fig. 9 into a three-dimensional image. Fig. 11 is a drawing illustrating the overall appearance of an information collection device according to an embodiment of the present invention. Fig. 12 is a perspective view illustrating the specific configuration of a support body and a support post, etc., according to an embodiment of the present invention. Fig. 13 is a perspective view illustrating the state in which a support post is raised and rotated according to an embodiment of the present invention. Fig. 14 is a perspective view illustrating the state in which a CCD camera is rotated according to an embodiment of the present invention. Specific details for implementing the invention
[0032] Hereinafter, the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily implement it. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein.
[0033] To clearly explain the present invention, parts unrelated to the explanation have been omitted, and the same reference numerals are used for identical or similar components throughout the specification.
[0034] In addition, terms or words used in this specification and claims should not be interpreted as being limited to their ordinary or dictionary meanings, but should be interpreted in a meaning and concept consistent with the technical spirit of the invention, based on the principle that the inventor can appropriately define the concept of the terms to best describe his invention.
[0036] Figure 1 is a block diagram illustrating the configuration of a conventional general image processing system.
[0037] A conventional general image processing system is composed of a management device (100) that generates and inspects image images, and a target object search device (30) that collects image information about a damaged object image in a first editing section (DS1; see FIG. 3) online.
[0038] A conventional general management device (100) comprises: a collection information DB (110) that collects and stores information collected from an information collection device (200); a security information DB (120) that stores and manages coordinates for an editing section (DS1), etc., within a captured image as security information; an MMS information DB (130) that stores and manages MMS information by feature; a coordinate-specific search module (140) that searches for feature data, area data, terrain data, and image information (CB1 to CB4; see FIG. 4) of damaged feature images by coordinate, respectively; an image processing module (150) that processes and edits video images; a stereoscopic conversion module (160) that stereoscopically converts a feature image into a stereoscopic video image; an image inspection module (170) that scans 2D and 3D images, feature images, and area images; and a device that corrects a 2D format feature image confirmed in the inspection of the image inspection module (170) by comparing it with a previous version of the feature image. It includes a correction module (175), a proximity location information collection module (180) that searches for MMS information in the MMS information DB, and an image editing module (190) that generates and edits three-dimensional images of objects in blind spots.
[0039] Additionally, the target object search device (30) communicates online with the coordinate-based search module (140) of the management device (100) and a plurality of clients (40, 40', 40"; hereinafter '40'), and searches for and collects image information (CB1 to CB4) of planar image corresponding to the search conditions of the coordinate-based search module (140). Here, the search conditions may be the GNSS (Global Navigation Satellite System) coordinates, business name, building name, address, contact information, etc. of the object, and among the information corresponding to the search conditions, only the planar image is extracted and stored as image information (CB1 to CB4).
[0040] The client (40) may be a general user terminal or a data server, and the target object search device (30) searches the client (40) according to the coordinate value, which is one of the search conditions received from the coordinate-based search module (140), and the name and business name of the object, and searches for a planar image such as an image of an object located at the corresponding coordinate value. Generally, real estate brokerage servers and map guidance service servers, etc., store the planar image of an object corresponding to the search conditions as data, so the target object search device (30) searches the client (40) of the corresponding server, etc., and collects image information (CB1 to CB4).
[0041] The above components are explained in more detail.
[0042] The collected information DB (110) receives and stores / manages feature data, area data, and topographic data collected through geodetic surveying and aerial photography from the information collection device (200). The information collection device (200) can collect relevant information by geodetic surveying and photographing the area, and stores and manages the collected information.
[0043] The security information DB (120) stores and manages information as security information in the coordinates of the first editing section edited within the captured image, the coordinates of the second editing section processed in the image, and the range of the replacement image synthesized within the second editing section.
[0044] The MMS information DB (130) stores and manages MMS information regarding the location and height of features through field collection by the information collection device (200). As is well known, MMS stands for 'Mobile Mapping System' and means a mobile mapmaking system.
[0045] MMS information is acquired by using an information collection device (200) mounted on a movable vehicle (C) that integrates various sensors such as a CCD camera (300) implemented with photogrammetry technology and a position measuring device (GNSS), and is implemented to acquire position measuring and visual information of terrain features around the road along with the operation of the vehicle (C).
[0046] The MMS information collected by the information collection device (200) includes data regarding the spacing, height, and size between the relevant features at the site, and can be used to produce a three-dimensional image with higher accuracy and a three-dimensional image map containing the same.
[0047] The coordinate-based search module (140) searches for feature data, area data, and terrain data by coordinate in the collected information DB (110) according to the input search conditions. Additionally, based on the boundary of the first editing section (DS1), the feature image within the designated range is designated as the damaged feature image, and the image information (CB1 to CB4) of the corresponding damaged feature image is searched through the target feature search device (30). The coordinate-based search module (140) outputs the planar image of the damaged feature image received from the target feature search device (30) to the operator, and designates the corresponding planar image as a replacement image for the damaged feature image according to the operator's selection value.
[0048] The image processing module (150) images the outer lines of the features and zones by aligning the feature data, zone data, and terrain data searched by the coordinate-based search module (140) with the corresponding coordinate lines within a 2D-based coordinate plane, generates 2D-format planar feature images and zone images respectively, synthesizes image information (CB1 to CB4) searched by the target feature search device (30), divides the second editing section (DS2) corresponding to security information into parts (DZ; see FIG. 9), and performs image processing by synthesizing a replacement image (IM; see FIG. 9) for each part (DZ). For reference, the replacement image (IM) may be a tree image, etc. Additionally, although a single replacement image (IM) is synthesized for all parts (DZ), the replacement image (IM) may not be synthesized for some parts (DZ) as needed. The division of the second editing section (DS2) by part (DZ) and the synthesis of the replacement image (IM) are performed after 3D conversion.
[0049] The coordinate-based search module (140) aligns the searched feature data, area data, and terrain data with the corresponding coordinate lines within a 2D-based coordinate plane, classifies them into 2D-format feature images and area images according to the feature data, area data, and terrain data, and generates an image as shown in FIG. 6. The image processing module (150) executes an image processing process based on data input according to collected information on a 2D-based coordinate plane in which coordinate values are set for each location, thereby completing 2D-format feature images and area images. Here, the feature image is a planar view of a building or structure, and the area image is a planar view of a block-based section.
[0050] The stereoscopic conversion module (160) converts the 2D format image generated by the image processing module (150) into a planar 3D format aligned with coordinate lines within a 3D-based coordinate plane, and generates a stereoscopic image of the object by making the object image three-dimensional according to the height of each object included in the object data. Since the 2D format image only visualizes the object and the planar appearance as shown in FIG. 6, the range of the area in question can be easily identified, but there are practical limitations in understanding the shape of the object and the appearance of the site. After converting the 2D format image into a 3D format image, a stereoscopic image is generated based on the collected information for each object.
[0051] The image inspection module (170) checks the object data corresponding to the coordinate range for each zone data in the image generated by the image processing module (150), scans the image processing status of the object image located within the zone image to check and correct for errors, checks the boundary point of the exposed section within the outer line of the three-dimensional object image in which only a part of the three-dimensional object image deleted as a blind spot by a replacement image during the three-dimensional conversion process of the three-dimensional conversion module (160) for the zone confirmed in the security information DB (120), and checks the object image of the object having the boundary point on the outer line and the object image of the object corresponding to the blind spot in the planar 3D format generated by conversion by the three-dimensional conversion module (160). The image inspection module (170) scans the location and shape of the 2D format and 3D format image and the three-dimensional image to identify the image processing status for each object and check for errors, and the method for doing this is explained in more detail below.
[0052] The correction module (175) checks the vertex coordinates and center coordinates of the object image confirmed by the image inspection module (170) through 2D format image scanning by aligning them with the coordinate lines configured on the 2D-based coordinate plane, and compares the vertex coordinates and center coordinates of the object image in the previous version of the 2D format stored in the collection information DB (110), and if an error greater than a reference value is confirmed, corrects the 2D format object image to match the vertex coordinates and center coordinates of the previous version.
[0053] The proximity location information collection module (180) searches the MMS information of an image of a feature located in part or in whole within a blind spot confirmed by the image inspection module (170) in the MMS information DB (130).
[0054] The video editing module (190) reinforces deletion lines within the blind spot based on the boundary points in accordance with the corresponding planar 3D format confirmed by the video inspection module (170) in the object image having the boundary points, generates a three-dimensional object image according to the MMS information regarding the object in the object image, and generates a planar 3D format object image based on the coordinates and height of the deleted three-dimensional object image located within the blind spot. At this time, the coordinates and height of the object are based on the MMS information.
[0056] FIG. 2 is a flowchart sequentially illustrating the operation process of a conventional general image processing system; FIG. 3 is an image showing an edited state in which an image of a security target object is removed from a conventional general captured image; FIG. 4 is a conceptually illustrated image showing a conventional general image processing system synthesizing a collected 2D composite image onto the image to recover the deleted and edited image; FIG. 5 is an image showing the final image processed by a conventional general image processing system; FIG. 6 is a drawing of an image in 2D format created by processing the images of FIG. 3 and FIG. 5, respectively; FIG. 7 is a drawing showing a conventional general image processing system inspecting a 2D image of a security target object; FIG. 8 is a drawing showing an error correction of a 2D image of a security target object by a conventional general image processing system; FIG. 9 is a drawing showing the conventional general drawing shown in FIG. 6 being converted into a 3D image and a supplementary image being synthesized onto the image of the security target object; FIG. 10 is a conventional general drawing This is a drawing that converts the drawing shown in 9 into a three-dimensional image.
[0057] S10; Image processing target area verification step
[0058] The coordinate-based search module (140) searches for corresponding feature data, zone data, and terrain data in the collected information DB (110) according to the information of the image processing target area entered by the operator. The information of the image processing target area entered by the operator may be GNSS-based coordinate values or unique codes such as feature data, zone data, and terrain data.
[0059] The collected information may include a captured image as shown in Figure 3 (b), and the coordinate-based search module (140) may search for and output the captured image together when searching the collected information DB (110).
[0060] In addition, the coordinate-based search module (140) sets the object image within the designated range based on the boundary of the first editing section (DS1) as the damaged object image, and searches for the corresponding damaged object images (CB1 to CB4) through the target object search device (30).
[0061] S20; Image processing step
[0062] The image processing module (150) generates image data classified into 2D-format feature images (B1, B2) and area images (Z1 to Z7; hereinafter 'Z') as shown in FIG. 6, by aligning the feature data, area data, and terrain data searched by the coordinate-based search module (140) with the corresponding coordinate line (L) within a 2D-based coordinate plane.
[0063] To this end, the image processing module (150) constructs the 2D-based coordinate plane, which is a base with unique coordinate values set differently from GNSS, and displays feature data, zone data, and terrain data by inputting them according to the coordinate values specified on the 2D-based coordinate plane. For example, the feature data includes information regarding the location coordinates and range of the corresponding feature, and the image processing module (150) processes the location coordinates and range into feature images (B1, B2) according to the coordinate values of the 2D-based coordinate plane. In this way, zones (Z1 to Z7) are also visualized on the 2D-based coordinate plane by verifying their range and location.
[0064] According to the method described above, the image processing module (150) completes a 2D image as illustrated in Figure 6 (b), and the operator can check for errors by comparing it with the captured image shown in Figure 5.
[0065] For reference, if a new feature that was not present in the recent version is created and captured in the image shown in Fig. 5, the operator can directly produce feature images (B1, B2) based on the image shown in Fig. 5 through the image processing process of the image processing module (150). To this end, the image processing module (150) displays a line at a designated location on a 2D-based coordinate plane according to a command value input by the operator, and automatically adjusts the position of the line when an error is confirmed by comparing the coordinate value on the 2D-based coordinate plane where the line is located with the collected information about the actual feature.
[0066] The image processing module (150) checks the previously searched damaged object images (CB1 to CB4) and composites the object images (CB1 to CB4) to the corresponding positions of the image to determine the final second editing section (DS2).
[0067] For reference, the damaged object images (CB1 to CB4) shown in FIG. 5 are a collection of multiple object images shown as a single image, but the damaged object images (CB1 to CB4) shown in FIG. 5 are merely simplified for the convenience of explanation and to aid understanding. Therefore, each of the damaged object images (CB1 to CB4) forms a complete shape for each object, is composited at the corresponding location as in FIG. 4, and completes the second editing section (DS2), which is the actual section to be edited as in Figure 6 (b). Thus, there can be dozens or more of damaged object images (CB1 to CB4).
[0068] Once the second editing section (DS2) is completed, the second editing section (DS2) corresponding to security information is divided into parts (DZ), and image processing is performed by synthesizing a replacement image (IM) for each part (DZ). For reference, the replacement image (IM) may be a tree image, etc. Additionally, although a single replacement image (IM) was synthesized for all parts (DZ), the replacement image (IM) may not be synthesized for some parts (DZ) if necessary.
[0069] For reference, since the actual synthesis of alternative images (IM) is performed only after converting a 2D image into a 3D image as explained below, the alternative image (IM) synthesis details explained in this step should be understood for reference only.
[0070] Meanwhile, the image inspection module (170) checks the feature data corresponding to the coordinate range for each zone data in the image generated by the image processing module (150), and scans the image processing status of the feature images (B1, B1', B1", B2, B2', B2") located within the zone image (Z) to check for and correct errors. More specifically, the image inspection module (170) searches for zone data and feature data in the collected information DB (110) and identifies the features located in each zone. Accordingly, the image inspection module (170) identifies the feature images (B1, B1', B1", B2, B2', B2") that must be located within the zone image (Z), and if part or all of the corresponding feature images (B1, B1', B1", B2, B2', B2") are outside the zone image (Z), or if part or all of the feature images not designated within any zone image (Z) are located, it identifies this and notifies the operator. Of course, the operator can identify whether the corresponding image is defective and correct it, thereby completing the final image.
[0071] S30; Image correction step
[0072] The correction module (175) checks the vertex coordinate values (CP1 to CP10) and center coordinate values (CP0) of the object image (B3) confirmed by the image inspection module (170) through 2D format image scanning, in alignment with the coordinate line (L) configured on a 2D-based coordinate plane as shown in drawing (b) of FIG. 7, and compares the vertex coordinate values and center coordinate values of the previous version of the object image (B3') in the collection information DB (110), and if an error greater than the reference value is confirmed, corrects the object image (B3) in the 2D format to the vertex coordinate values and center coordinate values of the previous version as shown in FIG. 8.
[0073] To explain this more specifically, the vertex coordinate values (CP1 to CP10) and the center point coordinate values (CP0) are based on the coordinate line (L) of the coordinate plane, and the correction module (175) calculates the center point coordinate values (CP0) of the object image (B3) according to [Equation 1].
[0074]
[0075] As noted, since the 2D coordinate value for the coordinate line (L) is (x, y), the 'x' value of the center point coordinate value (CP0) is the sum of the 'x' values of each of the vertex coordinate values (CP1 to CP10), and the sum is divided by 10 to perform the calculation. Of course, the 'y' value of the center point coordinate value (CP0) is also the same as the calculation of the 'x' value.
[0076] The 2D-formatted feature image (B3) verified in this way is compared with the previous version of the feature image (B3') as shown in FIG. 8. The comparison between the newly generated feature image (B3) and the previous version of the feature image (B3') is performed by comparing the average values by dividing the difference between each vertex coordinate value (CP1 to CP10) and the center coordinate value (CP0) by the corresponding number, 11. At this time, if the average is found to be greater than or equal to the reference value, the newly generated feature image (B3) is considered an error, and the 2D-formatted feature image (B3) visualized on the coordinate plane is corrected to the previous version of the feature image (B3').
[0077] S40; 3D conversion step
[0078] The stereoscopic conversion module (160) compares the outline of the 2D format image generated by the image processing module (150) with a reference line of a 2D-based coordinate plane to determine the position and placement angle, and the stereoscopic conversion module (160) generates an outline corresponding to the position and placement angle relative to the reference line of a 3D-based coordinate plane and converts it into a planar 3D format by image processing on a 3D-format coordinate plane.
[0079] Since 2D imagery is a simple flat image as shown in Fig. 6, in actual field use, users can only utilize it to understand the location of relatively large features and road structures.
[0080] However, a three-dimensional map in 3D format is advantageous for understanding because it is identical or similar to the structural conditions of the site, such as the location and size of the features. Therefore, the three-dimensional conversion module (160) first converts and generates a planar 3D format feature image (B1', B2') that can form the basis for generating a three-dimensional feature image (B1", B2") as shown in FIG. 9.
[0081] In order to convert a 2D format image into a planar 3D format, the stereoscopic conversion module (160) designates a first reference line (S1, S2) and rotates the first reference line (S1, S2) as shown in FIG. 9 to create a new second reference line (S1', S2') on a 3D-based coordinate plane. Subsequently, the stereoscopic conversion module (160) determines the relative value of the position and placement angle of the outer line of the object image (B1, B2) relative to the first reference line (S1, S2), and adjusts the position and placement angle of the outer line of the object image (B1', B2') so that the relative value is the same as the second reference line (S1', S2').
[0082] For example, the horizontal and vertical lines constituting the first reference line (S1, S2) on a 2D-based coordinate plane do not have the same rotation angle as the horizontal and vertical lines constituting the second reference line (S1', S2') on a 3D-based coordinate plane. That is, even if the angle difference between the horizontal line of the first reference line (S1, S2) and the horizontal line of the second reference line (S1', S2') is 30 degrees, the angle difference between the vertical line of the first reference line (S1, S2) and the vertical line of the second reference line (S1', S2') is not 30 degrees.
[0083] Accordingly, the three-dimensional transformation module (160) forms a coordinate line based on the horizontal and vertical lines of the second reference line (S1', S2'), and generates the outer lines of the object image (B1', B2') and the zone image (Z) according to the coordinate line.
[0084] Through this outline adjustment, the stereoscopic conversion module (160) converts a 2D format image into a flat 3D format.
[0085] When the video image is converted into a planar 3D format, the image processing module (150) divides the second editing section (DS2) corresponding to security information into parts (DZ) as shown in Figure 9 (a), and synthesizes a replacement image (IM) for each part (DZ) as shown in Figure 9 (b). For reference, the replacement image (IM) may be a tree image, etc. Additionally, although one replacement image (IM) is synthesized for all parts (DZ), the replacement image (IM) may not be synthesized for some parts (DZ) as necessary.
[0086] S50; Stereoscopic image generation step
[0087] The three-dimensional conversion module (160) converts the object images (B1', B2') into three-dimensional object images (B1", B2") by adjusting the height of each object included in the object data.
[0088] Since the above-mentioned feature data includes height information as well as the location of the feature, the three-dimensional conversion module (160) converts the feature image (B1', B2') into a three-dimensional form based on a planar 3D format image as shown in figure (a) of Fig. 10, according to the height of the feature image.
[0089] In the process of generating such a three-dimensional image, a blind spot is formed as shown in figure (a) of Fig. 10, and the three-dimensional conversion module (160) deletes the generated line belonging to the blind spot so that it is visually advantageous to identify the object images (B1", B2") of the three-dimensional image.
[0090] S60; Replacement image section verification step
[0091] The image inspection module (170) searches the security target DB (120) to verify security information and verifies the replacement image (IM) synthesized at the location corresponding to the security information in the three-dimensional object image (B1", B2") within the three-dimensional image.
[0092] For reference, the three-dimensional feature images (B1", B2") and zone images (Z) configured in the above three-dimensional image are linked to the corresponding feature data and zone data, respectively, so based on this, the location scanning module (170) can verify the replacement image (IM) and the second editing section (DS2) based on the security information.
[0093] S70; Confirmation step for features to be edited
[0094] The image inspection module (170) checks the object image (B1) having the corresponding boundary points (P1 to P5; hereinafter P) in the three-dimensional object image (B1) and generated by the three-dimensional conversion module (160), and the object image (B1', B2') in a planar 3D format on a 3D-based coordinate plane corresponding to the size of the replacement image (IM) with the boundary points (P) as the starting point, and considers the object image (B1', B2') to be within the blind spot.
[0095] Here, the boundary point (P) is a reference point for searching for and restoring the feature images (B1", B2") deleted in the blind spot. The boundary point (P) is located on the outer line of the feature image (B1"), which has a section where only a part is obscured and deleted in the blind spot, and is an intersection point that touches the outer line of the replacement image (IM).
[0096] As described above, the security information DB (120) stores and manages security information regarding the replacement image (IM) and the editing section (DS1, DS2). Therefore, the image inspection module (170) determines whether the replacement image (IM) exists within the corresponding stereoscopic image during the security target verification step (S50), and if the replacement image (IM) exists, checks the size of the replacement image (IM). The range of the blind spot formed by the replacement image (IM) can be inferred based on the size of the replacement image (IM), and the image inspection module (170) can identify the 3D-format object images (B1', B2') belonging to the blind spot range on a 3D-based coordinate plane based on the size of the replacement image (IM).
[0097] For reference, if the width and height of the replacement image (IM) are '3' and '4' respectively, based on the spacing of the coordinate lines set on the 3D-based coordinate plane, the range of the blind spot formed by the replacement image (IM) will be a range of '3' or '4' starting from the boundary point (P).
[0098] The image inspection module (170) checks the range of the blind spot by the replacement image (IM) using the method described above, and searches the collected information DB (110) through the coordinate-based search module (140) to search for images of objects (B1", B2") belonging to the blind spot in a 3D coordinate plane.
[0099] As shown in Fig. 10, approximately 9 feature images (B1", B2"; including some deleted feature images) are configured within the blind spot.
[0100] Meanwhile, the proximity location information collection module (180) searches for MMS information of object images (B1', B2') in the MMS information DB (130) in a planar 3D coordinate plane in which part or all is located within the blind spot previously identified by the image inspection module (170), and the image inspection module (170) verifies the location of object images (B1', B2') located within the blind spot in a 3D-based coordinate plane and the spacing between neighboring object images (B1', B2') based on the MMS information.
[0101] In addition, the height of the object images (B1', B2') located within the above blind spot is checked in the MMS information, and the height of the object checked in the collected information DB (110) is compared to verify the height value for generating the three-dimensional object images (B1", B2").
[0102] If there is a difference between the collected information in the collected information DB (110) and the MMS information in the MMS information DB (130), the image inspection module (170) modifies the collected information DB (110) through the coordinate-based search module (140).
[0103] S80; Video image editing step
[0104] The video editing module (190) outputs a three-dimensional object image (B1", B2") having a corresponding height according to MMS information based on a planar 3D object image (B1', B2') within a blind spot confirmed by the video inspection module (170) in a 3D coordinate plane, and edits the image so that parts covered by the replacement image (IM) can also be visually visible.
[0105] Ultimately, the stereoscopic image displays stereoscopic feature images (B1", B2") in the blind spots obscured by the replacement image (IM), so that the user can clearly identify the shape and location of the feature images (B1", B2") in the parts obscured by the replacement image (IM).
[0107] FIG. 11 is a drawing showing the overall appearance of an information collection device according to an embodiment of the present invention, FIG. 12 is a perspective view showing the specific configuration of a support body and a support post, etc., according to an embodiment of the present invention, FIG. 13 is a perspective view showing the state in which a support post is raised and rotated according to an embodiment of the present invention, and FIG. 14 is a perspective view showing the state in which a CCD camera is rotated according to an embodiment of the present invention.
[0108] As described above, the information collection device (200) comprises a movable vehicle (C), a support body (400) positioned on the upper part of the vehicle (C), a support post (420) that is height-adjustably connected to the support body (400) and is equipped with a height indicator (424), a CCD camera (300) rotatably installed on the support post (420), a position indicator (430) installed on the CCD camera (300) and rotating together with the CCD camera (300) and repeatedly flashing and emitting light of different colors, a lifting support part (440) connected to the support body (400) and supporting the support body (400) so as to be raised and lowered, a main body connection part (450) connected to the support body (400), and a battery (412) installed on the support body (400).
[0109] The above support body (400) is positioned on the upper part of the vehicle (C) and is a foundation structure on which each component of the information collection device (200) is installed. A support post (420), a lifting support part (440), a main body connection part (450), and a battery (412) are installed on the support body (400), and the support body (400) is installed on the upper part of the vehicle (C) while stably supporting these components. The support body (400) includes a support base (410) and a support block (411).
[0110] The support base (410) is positioned parallel to the upper part of the vehicle (C). The support base (410) may be formed in the shape of a square plate, but is not limited thereto and may be modified into various shapes such as a circular plate.
[0111] The above support base (410) may be made of a metal material having rigidity to stably support the load of the support post (420), the lifting support part (440), the main body connection part (450), and the battery (412).
[0112] A support block (411) is provided in the center of the upper surface of the support base (410). Since the support base (410) is positioned parallel to the upper part of the vehicle (C), the support post (420) supported by the support base (410) can be erected vertically with respect to the upper part of the vehicle (C).
[0113] The support block (411) is provided on the upper surface of the support base (410) and rotatably supports the support post (420). An insertion hole may be formed inside the support block (411) into which the lower end of the support post (420), i.e., the lower end of the first post (421), is inserted, and a bearing member may be interposed between the support block (411) and the first post (421) to allow the first post (421) to rotate smoothly.
[0114] Since the support post (420) is rotatably installed on the support block (411), the support post (420) can be rotated in place while the support body (400) is fixed to the vehicle (C).
[0115] The above support post (420) is height-adjustable connected to the support body (400) and is equipped with a height indicator (424). The support post (420) includes a first post (421), a second post (422), and a third post (423).
[0116] The first post (421) is rotatably installed on the support block (411), and a height indicator (424) is formed on its outer surface. The first post (421) may be formed in a hollow cylindrical shape, and a second post (422) may be movably accommodated inside.
[0117] The lower part of the first post (421) is inserted into the support block (411) and rotatably supported, so that the entire support post (420) can be rotated together by the rotation of the first post (421).
[0118] The second post (422) is connected to the first post (421) so as to be vertical and rotatable, and a height indicator (424) is formed on its outer surface. The second post (422) is formed in the shape of a hollow cylinder with a smaller diameter than the first post (421) and can be inserted into the interior of the first post (421) so as to be slidably movable, and the total height of the support post (420) varies depending on the degree to which it is withdrawn from the first post (421).
[0119] The third post (423) is connected to the second post (422) so as to be vertical and rotatable, has a height indicator (424) formed on its outer surface, and has a CCD camera (300) installed on its upper end. The third post (423) is formed with a smaller diameter than the second post (422) and can be inserted into the interior of the second post (422) so as to be slidably movable.
[0120] In this way, since the first post (421), second post (422), and third post (423) are connected in a multi-stage retractable manner, the total height of the support post (420) can be freely adjusted according to working conditions, and the height of the support post (420) can be minimized during storage and movement to improve handling.
[0121] Meanwhile, the connecting portion between the first post (421) and the second post (422) and the connecting portion between the second post (422) and the third post (423) may be provided with a fixing means, such as a clamp, for fixing the adjusted height.
[0122] The height indicator (424) is formed on the outer surface of each of the first post (421), the second post (422), and the third post (423), and is arranged to extend along the length direction of the support post (420).
[0123] The height indicator (424) is displayed at regular intervals, and the user can intuitively recognize the height of the support post (420) simply by reading the display of the height indicator (424). The height indicator (424) may be formed in a color that contrasts with the outer surface of the support post (420) so that visibility from a distance can be ensured.
[0124] The above CCD camera (300) is rotatably installed on a support post (420) and can acquire visual information around the vehicle. The CCD camera (300) includes a camera connection block (310), a camera connection post (320), a camera head (330), a camera member (340), and a rotation fixing part (350).
[0125] The above camera connection block (310) is installed on the third post (423), and an angle indicator (311) is formed on the outer surface. The camera connection block (310) can be coupled to the upper part of the third post (423), and a hollow portion can be formed inside into which the camera connection post (320) is rotatably inserted.
[0126] The angle indicator (311) is formed on the outer surface of the camera connection block (310) and is positioned in a direction that intersects with the extension direction of the height indicator (424). That is, while the height indicator (424) extends along the length direction (up and down direction) of the support post (420), the angle indicator (311) is positioned along the circumference direction of the camera connection block (310).
[0127] Angle scales at regular intervals may be displayed on the angle display unit (311), and the operator can precisely adjust the rotation angle of the CCD camera (300) by quantitatively checking the angle displayed on the angle display unit (311).
[0128] The above camera connection post (320) is rotatably connected to the camera connection block (310). The camera connection post (320) can be rotated relative to the camera connection block (310) while inserted into the hollow portion of the camera connection block (310), and the camera head (330), camera member (340), and position indicator (430) are rotated together by the rotation of the camera connection post (320).
[0129] The above camera head (330) is connected to the upper part of the camera connection post (320). The camera head (330) may have a space formed inside to accommodate a camera member (340), and an opening is formed on one side so that the camera member (340) can acquire information.
[0130] An opening rim portion (331) is formed protrudingly on the outer surface of the camera head (330) to surround the perimeter of the camera member (340). The opening rim portion (331) protects the camera member (340) from external impact and enables the camera member (340) to obtain visual information more clearly.
[0131] The rotation fixing part (350) penetrates the camera connection block (310) and contacts the camera connection post (320), thereby restricting the rotation of the camera connection post (320). The rotation fixing part (350) may be exemplified by a bolt member that is screw-coupled to the camera connection block (310), and may be provided with a handle or knob at the end to facilitate gripping.
[0132] When the operator rotates the rotation fixing part (350) in one direction to tighten it, the end of the rotation fixing part (350) comes into pressurized contact with the outer surface of the camera connection post (320), thereby restricting the rotation of the camera connection post (320). When the operator rotates the rotation fixing part (350) in the other direction to loosen it, the pressure on the camera connection post (320) is released, and the camera connection post (320) becomes rotatable again. Accordingly, the angle of the CCD camera (300) set based on the angle display part (311) can be stably maintained without being arbitrarily changed during operation.
[0133] The above-mentioned position indicator (430) is installed on the CCD camera (300) and rotates together with the CCD camera (300), and repeatedly flashes and emits light of different colors. The position indicator (430) is configured to enable rapid identification of the location of the information collection device (200) and includes a connecting plate (431), a position block (432), and a position light (433).
[0134] The above connecting plate (431) is installed on the outer surface of the camera head (330) and rotates together with the camera head (330). The connecting plate (431) may be formed to extend laterally from the outer surface of the camera head (330) and serves as a medium for connecting the position block (432) to the camera head (330).
[0135] The above position block (432) is installed on the connecting plate (431) and forms a body on which a plurality of position lights (433) are installed.
[0136] The above position lights (433) are installed in multiple locations on the position block (432) and repeatedly flash and irradiate light of different colors. The position lights (433) can be exemplified by multiple LED modules that irradiate light of different colors, for example, by flashing red light and green light alternately.
[0137] Since the above-mentioned location lighting (433) repeatedly flashes and irradiates light of different colors, the location of the information collection device (200) can be identified immediately during the day as well as at night, and accordingly, the location of the CCD camera (300) can be quickly confirmed.
[0138] In addition, since the flashing light has higher visibility than the continuously lit light, the location of the information collection device (200) can be clearly distinguished even in an environment where there are similar structures nearby.
[0139] Since the position indicator (430) is installed on the camera head (330) via the connecting plate (431), it rotates together with the CCD camera (300) when the camera connecting post (320) rotates. That is, regardless of whether the position indicator (430) rotates or the camera head (330) rotates, the position indicator (430) and the CCD camera (300) rotate simultaneously while organically connected.
[0140] Accordingly, the CCD camera (300) and the position display unit (430) rotate as a single unit while sharing the angle range displayed on one angle display unit (311) to display the position.
[0141] Since the shooting direction of the CCD camera (300) and the display direction of the position display unit (430) can be aligned simultaneously, scale reading and position identification can be performed with a single rotation operation without separate operation.
[0142] The lifting support member (440) is connected to the support body (400) and supports the support body (400) so that it can be lifted. The lifting support member (440) is configured to fix the support body (400) to the upper part of the vehicle (C) and includes a connecting block (441), a lifting drive member (442), a lifting member (443), and a support flange (444).
[0143] The above connecting block (441) is installed on the support base (410). Multiple connecting blocks (441) may be provided, each installed at a corner of the support base (410), and a mounting portion is provided on which a lifting drive unit (442) is mounted.
[0144] The above lifting drive unit (442) is installed on the connecting block (441) and provides a driving force to move the lifting unit (443) up and down. The lifting drive unit (442) may be exemplified as an electric actuator that operates by receiving power from the battery (412), but is not limited thereto and may be modified to a screw jack method that raises the lifting unit (443) by manual operation.
[0145] The lifting unit (443) is connected to the lifting drive unit (442) and is raised in the upward direction of the vehicle (C). The lifting unit (443) is lowered by the operation of the lifting drive unit (442) to raise the support base (410), or raised to lower the support base (410).
[0146] The support flange (444) is installed at the end of the lifting section (443) and is connected to the upper part of the vehicle (C). The support flange (444) is formed in a plate shape that extends from the end of the lifting section (443) to secure a contact area with the upper part of the vehicle (C).
[0147] The above main body connecting part (450) is connected to the supporting main body (400) and includes a first connecting bar (451), a second connecting bar (452), a third connecting bar (453), and a display (454).
[0148] The first connecting bar (451) is coupled to the support base (410). The first connecting bar (451) can be installed to extend upward from the upper surface of the support base (410) and serves to support the entire main body connecting part (450) on the support base (410).
[0149] The second connecting bar (452) is connected to the first connecting bar (451) so as to be able to move up and down and rotate. The second connecting bar (452) can be connected to the first connecting bar (451) so as to be able to slide and rotate relative to it while inserted into the first connecting bar (451).
[0150] The third connecting bar (453) is connected to the second connecting bar (452) so as to be vertical and rotatable, and is formed at an angle to the second connecting bar (452). Since the third connecting bar (453) is formed at an angle to the second connecting bar (452), interference between the support post (420) and the display (454) can be prevented.
[0151] In this way, since the second connecting bar (452) is connected to the first connecting bar (451) and the third connecting bar (453) is connected to the second connecting bar (452) so as to be vertically and rotatable, the height and angle of the main body connecting part (450) can be adjusted in multiple stages.
[0152] The above display (454) is installed on the third connecting bar (453). The display (454) may display the operating status of the camera member (340), the lighting status of the position light (433), the operating status of the lifting support member (440), the remaining amount of the battery (412), etc. The display (454) may be equipped with a touch panel capable of touch operation and may also serve as an operating unit that controls the operation of the camera member (340), the position light (433), and the lifting drive unit (442).
[0153] The battery (412) is installed on the support body (400) and supplies power to the electrical configuration of the information collection device (200). The battery (412) may be installed on the upper surface of the support base (410) and supplies power to the camera member (340), position lighting (433), lifting drive unit (442), and display (454).
[0154] The above battery (412) can be exemplified as a rechargeable and reusable secondary battery, and thus can be used for a long time even in outdoor sites where power supply is difficult. Since the battery (412) is installed on the support base (410), the center of gravity of the device is located at the bottom, so the device can be prevented from tipping over even when the support post (420) is extended high.
[0155] It will be obvious to those skilled in the art that the invention described above is not limited by the aforementioned embodiments and attached drawings, and that various substitutions, modifications, and changes can be made within the scope of the technical concept of the invention. Explanation of the symbols
[0157] 100 : Management device 200 : Information collection device 300 : CCD camera 310 : Camera connection block 311: Angle display section 320: Camera connection post 330 : Camera head 331 : Aperture rim 340 : Camera component 350 : Rotating fixing part 400 : Support body 410 : Support base 411 : Support block 412 : Battery 420 : Jiji Post 421 : 1st Post 422 : Post 2 423 : Post 3 424 : Height indicator 430 : Position indicator 431 : Connection plate 432 : Position block 433 : Position lighting 440 : Elevator support 441 : Connecting block 442 : Lifting drive unit 443 : Lifting section 444 : Support flange 450 : Main body connection part 451 : First connecting bar 452 : 2nd connecting bar 453 : 3rd connecting bar 454 : Display
Claims
Claim 1 A collection information DB that receives and stores captured images, feature data, area data, and terrain data belonging to the captured images from an information collection device; a security information DB that stores and manages security information consisting of a first edited section edited in the captured image, a second edited section processed in image, and location information of a replacement image synthesized in the second edited section; and an MMS information DB that stores and manages MMS information regarding the location and height of features through field collection by the information collection device. A coordinate-based search module that searches for feature data, zone data, and topographic data by coordinate in the collected information DB according to input search conditions, designates a feature image within a designated range based on the boundary of the first editing section as a damaged feature image, and searches for image information of the corresponding damaged feature image through a target feature search device; and an image processing module that images the outer lines of features and zones by aligning the feature data, zone data, and topographic data searched by the coordinate-based search module with the corresponding coordinate lines within a 2D-based coordinate plane, generates 2D planar feature images and zone images respectively, composites image information searched by the target feature search device onto the corresponding damaged feature image, divides the second editing section corresponding to security information into parts, and processes images by compositing replacement images for each part.A stereoscopic conversion module that compares the outline of a feature image, which has been processed by the image processing module and corrected by the correction module below, with a first reference line and a coordinate line specified in a 2D-based coordinate plane to confirm the relative position and placement angle with respect to the first reference line and the position and placement angle according to the coordinate line, respectively, and processes the outline corresponding to the relative position and placement angle based on the second reference line specified in the 3D-based coordinate plane along the coordinate line set in the 3D-based coordinate plane to generate a stereoscopic image composed of a 3D-format planar feature image and a zone image and a 3D-format replacement image in the 3D-based coordinate plane, and confirms the feature data corresponding to the 3D-format planar feature image to generate a stereoscopic feature image of the height according to the collection information of the corresponding feature image stored in the collection information DB based on the 3D-format planar feature image;The positional coordinate values of the 2D feature images and area images generated by the image processing module are compared with the corresponding feature data and area data to verify for errors; the position and shape of the planar 3D feature images and area images generated by the stereoscopic conversion module and the position and shape of the stereoscopic 3D replacement image are compared with the respective positions and shapes of the 2D feature images, area images, and replacement images to verify for errors; the replacement images processed by the image processing module and the stereoscopic conversion module are verified to identify the endpoints of the exposed sections within the outer lines of the feature image from which only a portion of the stereoscopic feature image was deleted as a blind spot by the replacement image during the stereoscopic conversion module's stereoscopic conversion process as the boundary points of the blind spots; the stereoscopic feature image having the corresponding boundary points in the stereoscopic feature image generated by conversion by the stereoscopic conversion module and the 3D planar feature image containing the corresponding boundary points in the 3D-based coordinate plane are identified; and the blind spots of the stereoscopic feature image caused by the replacement image A video inspection module that defines the range as a range formed starting from a boundary point on a 3D-based coordinate plane, modifies the corresponding collected information stored in the collected information DB according to the MMS information stored in the MMS information DB, and modifies the height of the three-dimensional feature image; a correction module that checks the vertex coordinates and centroid coordinates of the feature image confirmed by the video inspection module through 2D-format video image scanning by aligning it with coordinate lines configured on a 2D-based coordinate plane, compares the vertex coordinates and centroid coordinates of the previous version of the corresponding 2D-format feature image stored in the collected information DB, and corrects the corresponding 2D-format feature image to match the vertex coordinates and centroid coordinates of the previous version if an error exceeding a reference value is confirmed; and a proximity location information collection module that searches the MMS information of a three-dimensional feature image located partially or entirely within the blind spot range confirmed by the video inspection module in the MMS information DB.An image processing system comprising: an image editing module that generates a three-dimensional feature image having a corresponding height according to MMS information based on a planar 3D feature image within the blind spot range confirmed by the image inspection module in a 3D-based coordinate plane, and edits the three-dimensional feature image obscured by the replacement image so that a part or the whole can be visually seen; wherein the information collection device comprises: a movable vehicle; a support body positioned on the upper part of the vehicle; a support post connected to the support body in a height-adjustable manner and equipped with a height indicator; a CCD camera rotatably installed on the support post; a position indicator installed on the CCD camera, rotating together with the CCD camera, and repeatedly flashing and emitting light of different colors; a lifting support part connected to the support body to support the support body so as to be raised and lowered; a body connection part connected to the support body; and a battery installed on the support body; wherein the support body comprises: a support base positioned parallel to the upper part of the vehicle; and a support block provided on the upper surface of the support base and rotatably supporting the support post. The apparatus comprises: a first post rotatably installed on a support block and having a height indicator formed thereon; a second post connected to the first post so as to be vertically and rotatably, having a height indicator formed thereon; and a third post connected to the second post so as to be vertically and rotatably, having a height indicator formed thereon, and having a CCD camera installed thereon; wherein the CCD camera comprises: a camera connection block installed on the third post and having an angle indicator formed on its outer surface; a camera connection post rotatably connected to the camera connection block; a camera head connected to the camera connection post; a camera member installed on the camera head; and a rotation fixing part that penetrates the camera connection block and contacts the camera connection post, and limits the rotation of the camera connection post; wherein the position indicator comprises: a connection plate installed on the outer surface of the camera head and rotating together with the camera head; and a position block installed on the connection plate.and a plurality of position lights are installed in the position block and repeatedly flash and irradiate light of different colors; wherein the height indicator extends along the longitudinal direction of the support post and the angle indicator is arranged along the circumferential direction of the camera connection block, and the camera head, camera member, and position indicator rotate together by the rotation of the camera connection post, and when the position indicator rotates, or when the camera head rotates, or when the position indicator and the CCD camera rotate simultaneously while connected, and an opening rim is formed protrudingly on the outer surface of the camera head to wrap around the circumference of the camera member, and the lifting support includes a connecting block installed on the support base; a lifting drive unit installed on the connecting block; a lifting unit connected to the lifting drive unit and lifting in the upward direction of the vehicle; and a support flange installed at the end of the lifting unit and contact-coupled to the upper part of the vehicle; and the main body connection includes a first connecting bar coupled to the support base; and a second connecting bar connected to the first connecting bar so as to be able to lift and rotate. An image processing system for precisely performing image correction and synthesis, comprising: a third connecting bar connected to a second connecting bar so as to be vertical and rotatable and formed at an angle to the second connecting bar; and a display installed on the third connecting bar; wherein the angle display unit is arranged in a direction intersecting the extension direction of the height display unit, and the CCD camera and position display unit rotate within an angle range indicated by the angle display unit.
Citation Information
Patent Citations
Integrated safety accident monitoring system based on aerial video using fixed unmanned aerial vehicles
KR1020250061778A
Image processing system for editing shooting image for making 3D image
KR102486283B1
Image processing system for improving precision by error correction
KR102924729B1
Image processing system for improving precision of image by correcting error
KR102642145B1
