Graphic Registration System

Abstract

To provide a graphic registration system which can solve a conventional problem, and can turn a noticed object into a graphic while utilizing each characteristic of a there-dimensional model and a single photograph.SOLUTION: A graphic registration system includes three-dimensional model storage means and single photograph storage means, graphic input means, graphic position calculation means, graphic storage means, and single photograph extraction means. The graphic input means is means for enabling an operator to input a graphic to a three-dimensional model displayed on the display means, and the graphic storage means is means for storing the input graphic together with the position. The single photograph is stored together with a photographic position and a photographic attitude, and the single photograph extraction means extracts a single photograph including a graphic among the plurality of single photographs stored in the single photograph storage means.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a technology for managing objects that users should pay attention to, such as cracks, signs, and illegal road occupancies (hereinafter referred to simply as "objects of interest"). More specifically, the present invention relates to a graphic registration system that uses 3D models and single photographs to create graphics of objects of interest. [Background technology]

[0002] Those who manage specific facilities, such as road and river administrators, regularly inspect those facilities to see if there are any abnormalities and record the results of the inspection. For example, road administrators inspect concrete structures such as road pavement and retaining walls to see if there are any abnormalities such as cracks, conduct facility surveys of road signs and lighting, and monitor whether illegal objects have been installed on roads they manage, and keep records of each inspection.

[0003] When managing roads, rivers, etc., the target area is generally vast (long). For this reason, in addition to the results of inspections (such as the presence or absence of abnormalities), what is important is the location of the "objects of interest" such as cracks, signs, and illegal road occupancies. Furthermore, along with the location, the shape of the object of interest is often useful information. In other words, more effective management work can be carried out by recording the attribute information of the object of interest (such as the inspection results) together with information such as its location and shape.

[0004] On the other hand, because the areas to be managed for roads and rivers are vast, it is not realistic to frequently inspect or investigate the entire area. On the other hand, it is easier to carry out quality management work by inspecting more frequently. For this reason, instead of direct visual inspections on-site, it is possible to carry out inspections using photographs. In other words, first take photographs of the area to be managed, and then visually inspect the photographs to obtain the necessary information. This allows inspections to be carried out in an office, etc., without having to go to the site, and investigation results to be obtained more frequently.

[0005] In addition, photogrammetry technology can be used to determine the position of a target object, and the shape of the target object can be extracted by tracing a photograph. Management methods using photogrammetry technology have been proposed in the past. For example, Patent Document 1 proposes a technology for determining the coordinates of a target object by photogrammetry and managing various types of photogrammetry data in general. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent Publication No. 10-246630 Summary of the Invention [Problem to be solved by the invention]

[0007] By the way, when extracting cracks in road pavement, etc., while visually inspecting photos, it is necessary to check a large number of photos. This requires a considerable amount of effort and time, and human error such as overlooking something is inevitable. This is mainly due to checking each photo one by one. For example, if there were wide-area photos that could be used to get a bird's-eye view of the target area, the effort required for checking and human error could be reduced.

[0008] Therefore, the inventors of the present application focused on using a 3D model of the managed object. By using a 3D model, it is possible to check the road as a series of flows, and by manipulating the 3D model, it is possible to view from a desired viewpoint, which significantly reduces the work effort and makes it easier to avoid human error.

[0009] However, even when visually inspecting a 3D model equipped with color information (e.g., RGB, etc.), it may be difficult to clearly extract the shape of a crack, etc. This is because a 3D model equipped with color information generally has a lower resolution than a single photograph. Therefore, when extracting the shape of a crack, etc., it is desirable to use a single photograph. However, a single photograph alone cannot grasp the position of the crack, etc. (in this case, the position in the managed object). In other words, when a 3D model is used, the position of the crack, etc. can be grasped, but the shape is difficult to grasp, while when a single photograph is used, it is easy to extract the shape of the crack, etc., but the position cannot be grasped.

[0010] The object of the present invention is to solve the problems of the conventional technology, that is, to provide a graphic registration system that can graphically represent an object of interest while taking advantage of the respective advantages of a 3D model and a single photograph. [Means for solving the problem]

[0011] The present invention focuses on the point that a diagram of an object of interest having information on its position and shape is generated by determining the position of the object of interest using a 3D model and tracing the shape of the object of interest using a single photograph, and is an invention based on an idea that has not been seen before.

[0012] The graphic registration system of the present invention comprises a 3D model storage means, a single photograph storage means, a graphic input means, a graphic position calculation means, a graphic storage means, and a single photograph extraction means. Among these, the 3D model storage means is a means for storing a 3D model of a target terrain, the single photograph storage means is a means for storing a plurality of single photographs of the target terrain, and the graphic input means is a means for an operator to input a graphic to a 3D model displayed on a display means. The graphic position calculation means is a means for calculating the position of a graphic in a 3D space, the graphic storage means is a means for storing an input graphic together with the position calculated by the graphic position calculation means, and the single photograph extraction means is a means for extracting a specific single photograph based on a graphic. The single photograph is stored together with the photographing position and the photographing attitude, and the single photograph extraction means extracts a single photograph including a graphic from the plurality of single photographs stored in the single photograph storage means.

[0013] The figure registration system of the present invention may further include a photographing location display means for displaying the photographing location of a single photograph with a frame line (or surface). This photographing location display means displays the frame line, etc. on the 3D model at a position corresponding to the photographing position, and also displays the frame line, etc. on the 3D model at an inclination corresponding to the photographing posture.

[0014] The graphic registration system of the present invention can also calculate the position of the graphic in the single photograph. In this case, the single photograph extracted by the single photograph extracting means is displayed on the output means together with the graphic.

[0015] The graphic registration system of the present invention may further include a single-photo selection means and a graphic adjustment means. The single-photo selection means is a means for an operator to select a desired single photo from the single photos extracted by the single-photo extraction means, and the graphic adjustment means is a means for the operator to adjust the graphic. In this case, the single photo selected by the single-photo selection means is displayed together with the graphic in a separate window, and when the operator adjusts the graphic of the single photo displayed in the separate window, the graphic on the 3D model and the graphic in the other single photos are also adjusted.

[0016] The shape registration system of the present invention can also display two single photographs selected by the operator side by side in a separate window, allowing the operator to adjust the shape while viewing the two single photographs in a stereoscopic view in the separate window.

[0017] The graphic registration system of the present invention may further comprise an attribute information input means for an operator to input attribute information for the graphic, in which case the graphic storage means stores the graphic together with the input attribute information.

[0018] The graphic registration system of the present invention may be configured such that a server is provided with a 3D model storage means, a single photo storage means, a graphic position calculation means, a graphic storage means, and a single photo extraction means, and a graphic input means is provided in a terminal device connected to the server via a network. In this case, an operator can input a graphic while visually checking the 3D model displayed on the display means of the terminal device. Effect of the Invention

[0019] The graphic registration system of the present invention has the following advantages. (1) By using a 3D model, for example, it is possible to check a road as a series of steps, and by manipulating the 3D model, it is possible to view it from any desired viewpoint. As a result, the work effort is significantly reduced and human error is easily avoided. (2) By inputting a shape into the 3D model, its position information is obtained, and candidates for single photos to be confirmed are presented, so in this respect too, the work effort is significantly reduced and human error is made easier to avoid. (3) Since it is possible to trace the shape of an object of interest (such as a crack) while visually observing a high-resolution single photograph, it is possible to generate a more accurate diagram of the object of interest. [Brief description of the drawings]

[0020] [Figure 1]1 is a block diagram showing the main configuration of a graphic registration system according to the present invention; [Diagram 2] FIG. 13 is a model diagram showing a shooting parameter frame corresponding to the shooting parameters. [Diagram 3] FIG. 1 is a block diagram showing a diagram registration system of the present invention which is composed of a server and a terminal. [Figure 4] FIG. 2 is a flowchart showing a main process flow of the graphic registration system of the present invention. [Diagram 5] 11 is a screen diagram showing a state in which a 3D model, an inputted figure, candidate single photos, and a shooting specification frame are displayed on a display means. [Figure 6] A screenshot showing the two selected single photos displayed as a stereo image in a separate window. [Figure 7] A screen shot showing a situation in which adjusting the shape of one selected single photograph causes the shape of the other selected single photograph to be similarly adjusted. [Figure 8] A screen shot showing a situation where adjusting the shape of one selected single photograph does not adjust the shape of the other selected single photograph. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] An example of a graphic registration system according to the present invention will be described with reference to the drawings.

[0022] 1 is a block diagram showing the main components of a graphic registration system 100 according to the present invention. As shown in the figure, the graphic registration system 100 includes a graphic input means 101, a graphic position calculation means 102, a single photo extraction means 103, a 3D model storage means 109, a single photo storage means 110, and a graphic storage means 111, and may further include a photography location display means 104, a single photo selection means 105, a graphic adjustment means 106, an attribute information input means 107, and a display means 108.

[0023] The graphic input means 101, graphic position calculation means 102, single photo extraction means 103, photography location display means 104, single photo selection means 105, graphic adjustment means 106, and attribute information input means 107 that constitute the graphic registration system 100 can be manufactured as dedicated devices, or general-purpose computer devices can be used. This computer device is equipped with a processor such as a CPU, memories such as ROM and RAM, and some also include input means such as a mouse and keyboard, and a display, and can be configured, for example, by a personal computer (PC) or a server.

[0024] The 3D model storage means 109, the single photo storage means 110, and the graphic storage means 111 can use a storage device of a general-purpose computer (for example, a personal computer) or can be constructed in a database server. When constructed in a database server, they can be placed in a local network (LAN: Local Area Network) or can be a cloud server that stores data via the Internet (i.e., wireless communication).

[0025] Below, each of the main elements constituting the graphic registration system 100 of the present invention will be described in detail.

[0026] (3D model storage means) The 3D model storage means 109 stores a three-dimensional model (hereinafter referred to as a "3D model") of the terrain targeted by the user (hereinafter simply referred to as the "target terrain"). Here, the 3D model is a representation of the target terrain in three-dimensional coordinates, and is, for example, a terrain model such as a DSM (Digital Surface Model) or a DEM (Digital Elevation Model).

[0027] A 3D model is usually composed of a plurality of meshes. A mesh is formed by dividing the mesh into orthogonal grids, for example, and each mesh has a representative point. Since a point cloud obtained by measurement (for example, laser measurement) is often random data, geometric calculation is often performed to assign height to the representative point of the mesh. This calculation method can be a method using a triangulated irregular network (TIN) that obtains height using an irregular triangulation network formed from random data, a nearest neighbor method that uses the nearest laser measurement point 4, or other conventional methods such as an inverse distance weighting method (IDW), a Kriging method, or an average method. Note that the 3D model is not limited to laser measurement, and can be constructed by various methods including photogrammetry, and it is particularly preferable to use a 3D model that has color information such as RGB obtained from a photograph or the like. The 3D model used here may be constructed for the present invention, or of course, an existing one can be used.

[0028] (Single photo storage means) The single photograph storage means 110 stores individual single photographs obtained by photographing various parts of the target terrain. Usually, the range of the target terrain is vast, and therefore the number of single photographs is large, that is, the single photograph storage means 110 stores a large number of single photographs. In the graphic registration system 100 of the present invention, it is preferable to use adjacent single photographs that partially overlap (overlap or side lap). The single photograph storage means 110 also stores the single photograph together with the photographing position (three-dimensional coordinates: X, Y, Z) and photographing attitude (yaw ω, pitch φ, roll κ) when the single photograph was taken, that is, by associating (linking) the photographing position and the photographing attitude. In other words, each single photograph stored in the single photograph storage means 110 has information on the photographing position and the photographing attitude.

[0029] (Graphic input means) The graphic input means 101 is a means by which an operator inputs a graphic onto a 3D model, and is a means by which an operator can input a graphic in a desired position and shape using a pointing device (mouse, touch panel, pen tablet, touch pad, track pad, track ball, etc.), a keyboard, etc. while visually viewing the 3D model displayed on a display means 108 such as a liquid crystal display. For example, when an operator finds a crack (target object) in the asphalt road surface on the displayed 3D model, the operator uses a pointing device to trace the crack, that is, input the graphic. Note that the graphic here includes various shapes such as points, lines, and surfaces (polygons).

[0030] (Graphic position calculation means) The figure position calculation means 102 is a means for calculating the position (three-dimensional coordinates) of figure data (hereinafter simply referred to as "figure data") input by an operator, and performs coordinate calculation processing when the operator inputs the figure or when the operator's instruction operation is used as a trigger. Of course, if the figure is a point, it calculates the coordinates of the point, if the figure is a line, it calculates the coordinates of the line segments, and if the figure is a polygon, it calculates the coordinates of the faces. The coordinates calculated by the figure position calculation means 102 are coordinates in a three-dimensional coordinate system (three-dimensional space) set in the 3D model, and therefore it reads necessary information from the 3D model storage means 109 and then performs coordinate calculation processing (Fig. 1). The coordinates calculated here (hereinafter referred to as "figure position" for convenience) are associated (linked) with the inputted figure data and then stored in the figure storage means 111 (Fig. 1).

[0031] (Means for inputting attribute information) The attribute information input means 107 is a means by which an operator inputs attribute information related to the input graphic data, and can utilize a pointing device, keyboard, etc., as with the graphic input means 101. For example, attribute information can be input, such as the fact that the graphic data is a crack, the date and time when the crack was discovered, the crack dimensions, and the person who inputted it. The attribute information input here is associated (linked) with the input graphic data and stored in the graphic storage means 111 (FIG. 1).

[0032] (Single photo extraction method) The single photograph extraction means 103 is a means for extracting a single photograph including graphic data input by an operator from among a large number of single photographs stored in the single photograph storage means 110. As already explained, since a single photograph has a photographing position and a photographing attitude (hereinafter referred to as "photographing specifications"), the position (photographing range) of the single photograph can be calculated by using a 3D model. In other words, if a photograph is taken with those photographing specifications, it is possible to grasp which range of the target terrain (i.e., the 3D model) is the target. Specifically, the photographing range of the single photograph in the three-dimensional coordinate system of the 3D model is calculated based on the 3D model and the photographing specifications of the single photograph.

[0033] The single photo extraction means 103 uses the graphic data input by the operator as a "clue," so to speak, to extract the target single photo. Specifically, it compares the graphic position calculated by the graphic position calculation means with the shooting range of the single photo (FIG. 1), and extracts single photos that include graphic data within that shooting range. Therefore, the number of single photos extracted here (hereinafter, for convenience, referred to as "candidate single photos") may be one or more.

[0034] The candidate single photographs extracted by the single photograph extraction means 103 are displayed on the display means 108 together with the 3D model. At this time, since the graphic position and the shooting range of the single photograph are respectively expressed in the same three-dimensional coordinate system, the position of the graphic data in the candidate single photograph can also be obtained. Therefore, it is preferable that the candidate single photographs displayed on the display means 108 include the graphic data input by the operator.

[0035] (Means for displaying shooting location) The photographing location display means 104 is a means for showing the photographing parameters of the candidate single photograph extracted by the single photograph extraction means 103, and displays a shape (hereinafter referred to as a "photographing parameter frame") set according to the photographing position and the photographing posture on the display means 108 together with the 3D model. More specifically, as shown in FIG. 2, the photographing parameter frame is displayed on the 3D model (that is, in the three-dimensional coordinate system of the 3D model) at a position according to the photographing position and at an inclination according to the photographing posture. FIG. 2 shows an example in which a single photograph is taken at five points (points A to E), and the photographing parameters at point A are displayed on the display means 108 as photographing parameter frame A, and similarly, the photographing parameters at point B are displayed as photographing parameter frame B, the photographing parameters at point C are displayed as photographing parameter frame C, the photographing parameters at point D are displayed as photographing parameter frame D, and the photographing parameters at point E are displayed as photographing parameter frame E. The shooting parameter frame can be configured as a frame line (that is, a line) or as a surface (that is, a polygon).

[0036] (Method of selecting single photos) The single photo selection means 105 is a means by which an operator selects a desired candidate single photo from among the candidate single photos extracted by the single photo extraction means 103, and can utilize a pointing device, a keyboard, or the like, as with the graphic input means 101 and the attribute information input means 107. When selecting a candidate single photo from among the candidate single photos, the desired candidate single photo can be designated from among the candidate single photos displayed on the display means 108 together with the 3D model, or in addition (or instead) from among the shooting specification frames displayed on the display means 108 together with the 3D model. Furthermore, when a candidate single photo is designated, the position (shooting range) of the single photo can be displayed on the 3D model using coloring, etc.

[0037] Candidate single photos selected by the operator (hereinafter, for convenience, referred to as "selected single photos") are displayed on the display means 108, and are displayed in a separate window from the 3D model. At this time, when two selected single photos are selected from the candidate single photos, these two selected single photos are displayed side-by-side in a separate window. Therefore, when the two selected single photos partially overlap each other (overlap or side lap), these selected single photos are displayed as stereo images, which is convenient because the operator can actually see the target object (e.g., a crack) in the selected single photos.

[0038] (Graphic adjustment means) The graphic adjustment means 106 is a means for an operator to adjust the graphic data in the selected single photo as necessary while visually checking the selected single photo displayed in a separate window from the 3D model, and can utilize a pointing device, keyboard, etc., like the graphic input means 101, attribute information input means 107, and single photo selection means 105. Adjustment of graphic data here refers to an operation to change its position, shape, etc.

[0039] When the operator adjusts the graphic data in the selected single photograph using the graphic adjustment means 106, the graphic position calculation means 102 calculates (i.e., recalculates) the graphic position in accordance with the adjustment. The adjusted graphic data including the recalculated graphic position is stored in the graphic storage means 111. At this time, the original (pre-adjustment) graphic data (including the graphic position) can be left as history and new (adjusted) graphic data can be stored separately, or the original graphic data can be left as is and only the new graphic data can be stored (so-called overwriting). The adjusted graphic data is then reflected in the graphic data displayed on the 3D model and in the candidate single photograph, i.e., the adjusted graphic data is displayed in the 3D model and the candidate single photograph.

[0040] (System Configuration) The graphic registration system 100 of the present invention can also be configured with a server (e.g., a cloud server) and a terminal device, as shown in Fig. 3. In this case, the server may be provided with a graphic position calculation means 102, a single photo extraction means 103, a photography location display means 104, a 3D model storage means 109, a single photo storage means 110, and a graphic storage means 111, while the terminal device may be provided with a graphic input means 101, a single photo selection means 105, a graphic adjustment means 106, an attribute information input means 107, and a display means 108. The terminal device here refers to a device such as a personal computer (PC), a tablet computer (iPad (registered trademark), etc.), or a smartphone, and is connected to the server via a network.

[0041] In addition, the graphic registration system 100 can also connect multiple terminal devices (terminals A to C in the figure) to one server as shown in Fig. 3. Furthermore, it can be configured so that each terminal device transmits a single photograph to the server, and the server that receives the photograph stores the single photograph in single photograph storage means 110, or it can be configured so that a 3D model is created on the server side from a large number of single photographs transmitted from each terminal device, and this is stored in 3D model storage means 109. In this case, it is preferable to associate (link) the information on the terminal device with the single photograph or 3D model before storing them, so that it is possible to distinguish which terminal device the single photograph or 3D model belongs to.

[0042] (Processing flow) The main processing of the graphic registration system 100 will be described in detail below with reference to Fig. 4. Fig. 4 is a flow diagram showing the flow of the main processing of the graphic registration system 100 of the present invention. In this flow diagram, the action to be performed is shown in the center column, the things necessary for the action are shown in the left column, and the things resulting from the action are shown in the right column.

[0043] As shown in Fig. 4, first, a 3D model is read from the 3D model storage means 109, and the 3D model is displayed on the display means 108 such as a liquid crystal display (Step 201). When an operator finds a crack or the like (target object) in the 3D model, the operator inputs graphic data using the graphic input means 101 so as to trace the crack on the 3D model (Step 202). Fig. 5 shows the state in which the input graphic data is displayed on the 3D model. At this time, the operator can also input attribute information related to the graphic data using the attribute information input means 107. The attribute information input here is associated (linked) with the graphic data and stored in the graphic storage means 111.

[0044] When the graphic data is input, the graphic position is calculated by the graphic position calculation means 102 (Step 203). The graphic position calculated here is associated (linked) with the graphic data and stored in the graphic storage means 111. When the graphic position is calculated, a candidate single photograph that includes the input graphic data in its image is extracted by the single photograph extraction means 103 (Step 204), the position of the graphic data in the candidate single photograph is found (Step 205), and the candidate single photograph including the graphic data is displayed on the display means 108 (Step 206). Figure 5 shows the state in which the candidate single photograph including the graphic data is displayed together with the 3D model.

[0045] When a candidate single photograph is extracted, the shooting specification frame of the extracted candidate single photograph is displayed on the display means 108 by the shooting location display means 104 (Step 207). FIG. 5 shows a state in which the shooting specification frame is displayed together with the 3D model. Then, the operator selects a desired selected single photograph from among the candidate single photographs using the single photograph extraction means 103 (Step 208). At this time, the desired selected single photograph may be specified from among the candidate single photographs displayed on the display means 108, and in addition (or instead) the desired candidate single photograph may be specified from among the shooting specification frames displayed on the display means 108.

[0046] When the selected single photos are selected, they are displayed in a separate window from the 3D model (Step 209). At this time, if two selected single photos are selected from the candidate single photos, these two selected single photos are displayed side by side in a separate window, that is, these selected single photos are displayed as stereo images, and the operator can see the target object (e.g., a crack) in the selected single photos in real life. Figure 6 shows the selected single photos, each containing graphic data, displayed side by side in a separate window.

[0047] When the selected single photograph is displayed in a window separate from the 3D model, the operator adjusts the graphic data in the selected single photograph as necessary while visually checking the selected single photograph using the graphic adjustment means 106 (Step 210). The result of the adjustment is reflected in the graphic data displayed on the 3D model and the graphic data displayed in the candidate single photograph, that is, the adjusted graphic data is displayed in the 3D model and the candidate single photograph. FIG. 7 shows a situation in which, when the graphic data of one selected single photograph (e.g., the left side) in a separate window is adjusted, the graphic data of the other selected single photograph (e.g., the right side) is also adjusted accordingly. As shown in FIG. 7, a mode in which the graphic data of both selected single photographs in separate windows are adjusted in conjunction (a so-called linked mode) can be prepared, and a mode in which the result of adjusting the graphic data of one selected single photograph in a separate window is not reflected in the graphic data of the other selected single photograph (a so-called independent mode) can also be prepared. FIG. 8 shows a situation in which, when the graphic data of one selected single photograph (e.g., the left side) in a separate window is adjusted, the graphic data of the other selected single photograph (e.g., the right side) remains in that state (i.e., is not adjusted).

[0048] After adjusting the graphic data in the selected single photograph, the operator performs a registration operation, and the adjusted graphic data is stored in the graphic storage means 111 (Step 211). [Industrial Applicability]

[0049] The graphic registration system of the present invention is particularly useful for road and river administrators, including national and local governments. Since the present invention contributes to the optimal maintenance and management of roads and rivers, it not only allows users to use these facilities comfortably, but also leads to a longer life and reduced life cycle costs for so-called infrastructure such as roads and rivers. Considering this, the present invention can be said to be an invention that can be expected to not only be used industrially, but also to make a great contribution to society. [Explanation of symbols]

[0050] 100 Graphic registration system of the present invention 101 Graphic input means (for graphic registration systems) 102 (Graphic registration system) graphic position calculation means 103 (Graphic Registration System) Single Photo Extraction Method 104 (Graphic registration system) Shooting location display means 105 Single Photo Selection Method (for Graphic Registration System) 106 (Graphic registration system) graphic adjustment means 107 Attribute information input means (for graphic registration system) 108 Display means (of graphic registration system) 109 3D model storage means (of the graphic registration system) 110 (Graphic registration system) Single-photo storage means 111 (Graphic storage means for graphic registration systems)

Claims

1. a three-dimensional model storage means for storing a three-dimensional model of a target terrain; A single photograph storage means for storing a plurality of single photographs of a target terrain; a graphic input means for allowing an operator to input a graphic to the three-dimensional model displayed on the display means; a figure position calculation means for calculating a position of the figure in a three-dimensional space; a figure storage means for storing the input figure together with the position calculated by the figure position calculation means; A single photograph extraction means for extracting a specific single photograph based on the graphic, The single photograph is stored together with the photographing position and the photographing posture, the single photograph extraction means extracts the single photograph including the graphic from the plurality of single photographs stored in the single photograph storage means; A pattern registration system comprising:

2. The apparatus further includes a photographing location display means for displaying the photographing location of the single photograph by a frame line or a surface, the photographing location display means displays a frame line or a surface on the three-dimensional model at a position corresponding to the photographing position, and displays the frame line or the surface on the three-dimensional model at an inclination corresponding to the photographing attitude.

2. The system according to claim 1, wherein the image registration system includes:

3. The figure position calculation means calculates the position of the figure in the single photograph, the single photograph extracted by the single photograph extracting means is displayed on an output means together with the figure; 3. The system according to claim 1, wherein the number of pixels is 1 or 2.

4. a single photograph selection means for allowing an operator to select a desired single photograph from the single photographs extracted by the single photograph extraction means; and a graphic adjustment means for allowing an operator to adjust the graphic, the single photograph selected by the single photograph selection means is displayed together with the figure in a separate window; When an operator adjusts the figure of the single photograph displayed in a separate window, the figure on the three-dimensional model is also adjusted, and the figures in the other single photographs are also adjusted.

4. The system according to claim 3, wherein the image registration system includes:

5. When the operator selects two of the single photographs using the single photograph selection means, the two are displayed side by side in a separate window, The operator can adjust the figure while viewing the two single photographs in a stereoscopic view in a separate window.

5. The system according to claim 4, wherein the image registration system includes:

6. The method further includes an attribute information input unit for allowing an operator to input attribute information for the graphic, the graphic storage means stores the graphic together with the input attribute information; 6. The system according to claim 1, wherein the number of pixels is 1 or more.

7. the three-dimensional model storage means, the single photograph storage means, the figure position calculation means, the figure storage means, and the single photograph extraction means are provided in a server; the graphic input means is provided in a terminal device connected to the server via a network, The operator can input the figure while visually checking the three-dimensional model displayed on the display means of the terminal device.

7. A graphic registration system according to claim 1.

Images