Information processing device, information processing method, and program

Abstract

To facilitate the analysis of an image containing a boundary line that indicate connection portions of a plurality of images.SOLUTION: An information processing device includes an input receiving unit that receives a display request for connected image data representing a connected image obtained by connecting a plurality of images captured by dividing spatially continuous regions, and an output unit that receives a display request and outputs boundary line information including boundary line position information indicating connecting portions of a plurality of images, and the connected image data.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] It has been known in the past to measure the width of linear defects such as cracks that occur on wall surfaces or road surfaces to investigate the urgency of rebuilding or repairing tunnels, roads, etc. In addition, in such investigations, a technology has been disclosed that uses images obtained by linking photographic images taken by multiple cameras mounted on a vehicle (see Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0003] However, with conventional techniques, if there is a positional shift or the like at the boundary between connected images, there is a problem in that the state of a crack or the like across the boundary may be erroneously recognized.

[0004] In view of the above-mentioned problems, an object of the present invention is to facilitate the analysis of an image that includes a boundary line indicating a connection point between a plurality of photographic images. [Means for solving the problem]

[0005] The information processing device of the present invention includes an input receiving unit that receives a display request for concatenated image data representing a concatenated image obtained by concatenating a plurality of images captured by dividing a spatially continuous area, and an output unit that receives the display request and outputs boundary information including position information of a boundary line indicating a connection point of the plurality of images, and the concatenated image data. a display image generating unit that generates boundary line superimposed image data by superimposing the boundary line on the connected image data based on the connected image data and the boundary line information; Have the boundary information includes information for measuring a width of misalignment when the multiple images are connected by detecting a linear object from the concatenated image, and for displaying the boundary line if the measured width of misalignment is greater than a predetermined width, and for hiding the boundary line if the measured width of misalignment is smaller than a predetermined width; when the boundary information includes information for displaying the boundary line, a display image generation unit generates boundary line superimposed image data in which the boundary line is superimposed on the concatenated image data, and the output unit outputs the boundary line superimposed image data; when the boundary information includes information for hiding the boundary line, the display image generation unit does not superimpose the boundary line on the concatenated image data, and the output unit outputs the concatenated image data. Effect of the Invention

[0006] The present invention can facilitate the analysis of images that include borders that indicate where multiple photographic images join. [Brief description of the drawings]

[0007] [Figure 1] 1 is a diagram showing an outline of an image display system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram showing an example of a connected image created in an embodiment of the present invention. [Diagram 3] 1 is a diagram illustrating an example of a hardware configuration of an information processing device and a terminal device according to an embodiment of the present invention. [Figure 4] 1 is a diagram illustrating an example of a functional configuration of an information processing device according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram illustrating an example of a functional configuration of a terminal device according to an embodiment of the present invention. [Figure 6] 5 is a flowchart illustrating an example of a process of the information processing device according to the embodiment of the present invention. [Figure 7] FIG. 11 is a diagram illustrating a connection of captured images. [Figure 8] FIG. 13 is a diagram illustrating a boundary line position. [Figure 9] 13A and 13B are diagrams illustrating a case where a connection position deviation occurs. [Figure 10] FIG. 13 is a diagram illustrating a connection position deviation width. [Figure 11] 6 is a flowchart illustrating an example of a process of a terminal device according to an embodiment of the present invention. [Figure 12] FIG. 13 is a diagram illustrating functions of another information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, as an example of an embodiment of the present invention, a processing execution method performed by an information processing device will be described with reference to the drawings.

[0009] 1 is a diagram showing an outline of an image display system according to the present embodiment. The image display system 10 of the present embodiment includes a camera 1, an information processing device 3, and a terminal device 4. In the image display system 10, the information processing device 3 and the terminal device 4 are connected to each other via a network 2. The camera 1 may be connected to the information processing device 3 and the terminal device 4 via the network 2, or may be connected to the terminal device 4 by any communication method.

[0010] The camera 1 is mounted on a tunnel inspection vehicle or the like, or an inspector takes a photograph of a subject. The subject of the photograph taken is the wall or ground of a structure such as a tunnel, bridge, road, or building made of concrete or asphalt. The tunnel inspection vehicle or inspector moves the camera 1 to take multiple photographs of a wide range of areas in order to detect abnormalities such as cracks on the surface of the subject. In this embodiment, it is also possible to take multiple photographs simultaneously by setting multiple cameras 1 with the angle of shooting adjusted.

[0011] Image data of the multiple photographs taken is transmitted to the information processing device 3 together with location information that can identify the photographing location, such as the photographing time, the photographing place, and the camera position. The camera 1 may transmit the photographed image data to the information processing device 3 via the network 2, or may transmit the photographed image data to the information processing device 3 via the terminal device 4.

[0012] The information processing device 3 uses the received image data and position information to create a concatenated image by concatenating multiple image data, and stores the concatenated image together with boundary information indicating the boundary of the concatenated image. The boundary information includes information indicating the position in the concatenated image where the image of the boundary line is to be superimposed and displayed. In other words, the boundary information includes position information of the boundary line to be superimposed and displayed on the concatenated image.

[0013] The terminal device 4 receives the image data and boundary information stored in the information processing device 3, and displays an image in which the boundary is superimposed on the concatenated image. Here, the terminal device 4 may be connected to the information processing device 3 via the network 2, or may be directly connected to the information processing device 3.

[0014] Fig. 2 shows an example of a concatenated image created by the information processing device 3. The concatenated image 21 shown in Fig. 2 is a concatenated image in which a plurality of images having adjacent photographed areas are concatenated. By referring to the concatenated image 21, the examiner can efficiently check photographed images covering a wide range. In addition, in the example of Fig. 2, no boundary line is superimposed on the concatenated image, but in this embodiment, a boundary line indicating the connection points of the plurality of images is displayed on the concatenated image 21.

[0015] 2, for example, a boundary line 22 is displayed at a connecting point between images A and B, which have adjacent shooting areas and are included in a connected image 21. Hereinafter, a process of displaying the boundary line superimposed on the connected image will be described in detail.

[0016] First, a description will be given of the hardware configuration of the information processing device 3 and the terminal device 4 of this embodiment. Fig. 3 shows an example of the hardware configuration of the information processing device 3 according to the embodiment of the present invention.

[0017] The information processing device 3 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a network interface 104, an I / O controller (input / output controller) 105, and an auxiliary memory means 109, all of which are connected via a bus 110.

[0018] The CPU 101 reads out a program for causing the information processing device 3 to execute the processing of the present invention from the ROM 102 or the auxiliary storage means 109, and executes the program.

[0019] The RAM 103 is a memory (work memory) used for the operation of the CPU 101, and is also used to temporarily store image data.

[0020] The network interface 104 is an interface for performing data communication using a communication network, and is also used for sending and receiving image data.

[0021] The auxiliary storage means 109 is a storage means (external storage means) external to the information processing device 3, and may be, for example, an HDD (Hard Disk Drive), a CD-ROM, or a USB memory.

[0022] The information processing device 3 further includes a VRAM (Video RAM) 106 connected to the I / O controller 105, an image display means 107, and a pointing device 108.

[0023] Image display means 107 is controlled by I / O controller 105, and is configured to include a monitor screen such as a liquid crystal display or a CRT (Cathode Ray Tube). Image display means 107 displays an original image (digital photograph image) and an image being calculated, and also displays the outline of a predetermined area superimposed on the image, as well as lines and arrows indicating directions and pixels.

[0024] The pointing device 108 is a means controlled by the I / O controller 105 for indicating the position of an image displayed on the image display means 107, such as a mouse, a mouse pointer of a keyboard, or a contact position of a finger on a touch panel.

[0025] The VRAM 106 is controlled by the I / O controller 105 and serves as a means for temporarily storing an object to be displayed on the image display means 107 .

[0026] The terminal device 4 of the present embodiment is an example of an information processing device, and the hardware configuration is similar to that of the information processing device 3, and therefore a description thereof will be omitted. If the terminal device 4 is, for example, a tablet terminal or a smartphone, in addition to the above-described configuration, the terminal device 4 may have a touch panel instead of the pointing device 108. The terminal device 4 may also have a camera and a GPS receiving means for receiving GPS signals from a GPS (Global Positioning System) satellite. The terminal device 4 acquires location information by having the GPS receiving means.

[0027] Next, the functional configuration of the information processing device 3 according to this embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the functional configuration of the information processing device 3 according to this embodiment.

[0028] The information processing device 3 has an image data transmission / reception unit 31, an image correction unit 32, an image boundary determination unit 33, a connected image generation unit 34, and an image data storage unit 35. Each functional unit other than the image data storage unit 35 is a function or means realized by the CPU 101 executing instructions included in one or more programs installed in the information processing device 3. The image data storage unit 35 is realized by a storage unit such as an auxiliary storage unit 109, for example.

[0029] The image data transmission / reception unit 31 has a function of transmitting and receiving image data to and from the camera 1, the terminal device 4, and the like.

[0030] The image correction unit 32 has a function of correcting the received image data so as to properly link the image data.

[0031] The image boundary determination unit 33 has a function of determining the position of a boundary line when connecting image data. In other words, the image boundary determination unit 33 generates boundary information including position information of the boundary line.

[0032] The connected image generating unit 34 has a function of generating a connected image by connecting a plurality of images based on a plurality of image data and boundary information.

[0033] The image data storage unit 35 has a function of storing image data, boundary line information, and the like.

[0034] Next, the functional configuration of the terminal device 4 according to this embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the functional configuration of the terminal device 4 according to this embodiment. The terminal device 4 has an image data receiving unit 41, a display image generating unit 42, an output unit 43, and an input accepting unit 44. Each functional unit is a function or means realized by the CPU of the terminal device 4 executing instructions included in one or more programs installed in the terminal device 4.

[0035] The image data receiving unit 41 requests the information processing device 3 for connected image data indicating the connected image and boundary information, and transmits (passes) the received connected image data and boundary information to the display image generating unit .

[0036] Based on operational input from the input receiving unit 44 (specification of the type of border, whether to show / hide the border, enlarge / reduce the image, etc.), the display image generation unit 42 uses the received concatenated image data and border information to create a border superimposed image in which the border is superimposed on the concatenated image, and transmits border superimposed image data showing the generated border superimposed image to the output unit 43.

[0037] When the input receiving unit 44 receives an operation to hide the boundary line, the display image generating unit 42 passes only the connected image data to the output unit 43 without superimposing the boundary line on the connected image.

[0038] The output unit 43 displays the image data received from the display image generating unit 42 on the image display means 107. Note that the output unit 43 may output the connected image data and the boundary information separately.

[0039] The input receiving unit 44 receives an operation input input by an operator operating the pointing device 108, etc. The input receiving unit 44 may also receive an operation by recognizing an input from a keyboard or a voice input.

[0040] Next, a process performed by the information processing device 3 according to this embodiment will be described with reference to Fig. 6. Fig. 6 is a flow chart showing an example of a process performed by the information processing device 3.

[0041] S20: The image data transmission / reception unit 31 receives image data of a plurality of photographs taken by dividing a spatially continuous area. In other words, the image data transmission / reception unit 31 captures image information. The image data may be received from the external storage medium 5 via the auxiliary storage means 109, or may be received from the camera 1 connected to the network 2 via the network interface 104.

[0042] Then, the image data transmission / reception unit 31 may store the received image data in the image data storage unit 35.

[0043] The image data holds a luminance value indicating the brightness of each pixel, for example, 8 bits per pixel. Alternatively, in order to reduce the data size, the data may be compressed and held in a format based on a standard such as JPEG. The image data may also include information necessary for linking images, such as the time of shooting and the position of the camera 1.

[0044] Furthermore, the image data transmission / reception unit 31 may transmit image data stored in the image data storage unit 35 in response to a request from the terminal device 4 or the like.

[0045] S21: The image correction unit 32 performs a correction process on the image data received by the image data transmission / reception unit 31 so that the images can be linked correctly. Near the boundary between adjacent captured images, there are differences in conditions such as the distance from the camera and the angle, even if the images were taken of the same area. The correction process of this embodiment is a process for correcting such differences.

[0046] S22: The image boundary determination unit 33 determines the boundary line position when connecting the image data corrected by the image correction unit 32, and transmits the corrected image data and boundary line information including position information of the determined boundary line to the connected image generation unit 34.

[0047] Here, the process of determining the position of the boundary line will be described in detail with reference to Fig. 7 and Fig. 8. Fig. 7 is a diagram for explaining the connection of captured images.

[0048] In FIG. 7, when an image capturing area 60 is captured by cameras 1A and 1B, the position of the boundary line between an image 63 captured by camera 1A and an image 64 captured by camera 1B is determined.

[0049] First, the image boundary determination unit 33 uses information indicating the shooting time, the camera position, etc., contained in the received image data to identify an overlapping area 65 (the hatched portion of the photographed area 60) where the photographed images A and B overlap. Next, within the identified overlapping area 65, the position of a boundary line 62 between the photographed images 63 and 64 is determined.

[0050] FIG. 8 is a diagram for explaining the position of the boundary line, and shows the vicinity of the overlapping region 65 enlarged in pixel units.

[0051] As shown in FIG. 8, the image boundary determination unit 33 assigns pixel row numbers to pixels in the horizontal direction in order from the top of the image data, for example. The first pixel row number may be the pixel row at the top of the photographed image 64, or may be the pixel row at the top of the entire concatenated image. Using this pixel row number, the position of the boundary line between the photographed images 63 and 64 is specified. The position of the boundary line may be within the overlapping area 65, and if the pixel row number of the boundary line is L, then L may be determined as a value that satisfies L=N+K (0≦K≦M-1, where L, N, and K are integers equal to or greater than 0, and M is a natural number). Here, M indicates the number of pixel rows in the overlapping area, pixel row number N is the top of photographed image B, and pixel row number N+M-1 is the bottom of photographed image A.

[0052] S23: The connected image generating unit 34 generates connected image data indicating the connected image using the received image data and boundary information, and stores the generated connected image data in the image data storage unit 35 in association with the boundary information.

[0053] 7 or 8, the concatenated image of the photographed image 63 and the photographed image 64 is an image obtained by concatenating an image from the top of the photographed image 63 to the boundary line 62 and an image from the pixel row one pixel below the boundary line 62 to the bottom of the photographed image 64. Alternatively, the concatenated image of the photographed image 63 and the photographed image 64 may be an image obtained by concatenating an image from the top of the photographed image 63 to the pixel row one pixel above the boundary line 62 and an image from the boundary line 62 to the bottom of the photographed image 64. Alternatively, the photographed images 63 and 64 may be handled separately (made into separate files).

[0054] Furthermore, in this embodiment, the information included in the boundary information may include information indicating whether to display or hide the boundary. Whether to display or hide the boundary is determined based on the deviation of the connection positions of the connected images. The reason for using this information and the method for determining it will be described below.

[0055] Normally, it is very difficult to accurately link adjacent images pixel by pixel at every point, so the linking position may shift from the correct position (called linking position misalignment). If linking position misalignment occurs, for example, when inspecting the condition of cracks on a tunnel wall, it may be erroneously analyzed as if there are multiple cracks near the boundary line.

[0056] 9 is a diagram for explaining the case where a misalignment in connection occurs, and shows a combined image 70 of photographed images 63 and 64 and a boundary line superimposed image 71, both with and without the display (hidden) of a boundary line 73. As shown in the diagram, when the boundary line 73 is not displayed (left), it is difficult to determine whether the discontinuity of object 72 is due to a misalignment in connection, and there is a possibility that it will be mistakenly recognized as being originally divided into two.

[0057] In contrast, in the case of boundary line superimposed image 71 (right) in which boundary line 73 is displayed, it is clear that the break in object 72 coincides with boundary line 73, making it easy to determine that a connection misalignment has occurred. On the other hand, if no connection misalignment has occurred, there is no interruption in object 72, and there is no risk of misjudgment, so there is no need to display boundary line 73. Therefore, it is effective to switch between displaying and not displaying boundary line 73 depending on whether or not there is a connection misalignment.

[0058] Next, a method for determining whether or not there is a connection position deviation will be described. Fig. 10 is a diagram for explaining the connection position deviation width.

[0059] 10, the image boundary determination unit 33 regards the object 72 as a crack in the tunnel wall surface and measures the positional deviation width 81 shown in Fig. 10. Next, the image boundary determination unit 33 compares the positional deviation width 81 with a predetermined distance d, and if the former is larger, decides to display the boundary line 73, and if not, decides not to display the boundary line 83.

[0060] That is, the image boundary determination unit 33 of the present embodiment includes, in the boundary information, information indicating that the boundary line is to be displayed when the position shift width 81 is greater than the predetermined distance d. Also, the image boundary determination unit 33 includes, in the boundary information, information indicating that the boundary line is to be hidden when the position shift width 81 is less than the predetermined distance d.

[0061] Here, an example of a method for measuring the positional deviation width 81 is to detect a linear object captured in a digital photograph and measure the line width of the object. In this embodiment, this method is used to analyze the vicinity of the boundary between the captured image 63 and the captured image B 64, and calculate the positional deviation width 81 by finding the difference between the positions of the object 72 detected in both images.

[0062] In this embodiment, the above-described steps from S20 to S23 are the processes performed by the information processing device 3, but when there are adjacent images not only in the horizontal direction but also in the vertical direction as shown in Fig. 2, the processes described here are performed on the captured images adjacent in all directions. That is, when focusing on one captured image, up to eight adjacent images in the upper, lower, left, right and diagonal directions are linked.

[0063] Next, a process performed by the terminal device 4 according to this embodiment will be described with reference to Fig. 11. Fig. 11 is a flow chart showing an example of a process performed by the terminal device 4.

[0064] S24: When the terminal device 4 receives an operation requesting the display of the concatenated image data via the input receiving unit 44, the terminal device 4 requests the concatenated image data and border information from the information processing device 3 via the image data receiving unit 41, and receives (acquires) the received concatenated image data and border information.

[0065] S25: Based on the connected image data and boundary information received by the image data receiving unit 41, the display image generating unit 42 generates boundary line superimposed image data showing a boundary line superimposed image in which the boundary line is superimposed on the connected image.

[0066] As an example of a method for superimposing a boundary line, there is a method for setting all the pixels of the boundary line to a constant luminance value. For example, when the luminance value ranges from 0 to 255, the luminance values ​​of all the pixels of the boundary line are set to the same value such as 0 or 255. The difference in luminance value results in a difference in brightness or darkness of the displayed boundary line. If the image display means 107 is capable of displaying in color, the display image generating unit 42 may generate boundary line superimposition data in which the boundary line is colored. In addition, the display image generating unit 42 may generate boundary line superimposition data in which the luminance of the boundary line is not all set to a constant value but is changed every period so that the boundary line becomes a dotted line, a dashed line, or the like. In addition, the display image generating unit 42 may generate boundary line superimposition data in which the thickness of the boundary line is thickened by setting the pixel value of the pixels adjacent to the boundary line to the same value as the boundary line.

[0067] Furthermore, in order to improve the visibility of the boundary line, the display image generating unit 42 may change the luminance (thickness) of the line according to the luminance of the pixel near the connection boundary so that the contrast with the pixel near the connection boundary is maximized. Specifically, the display image generating unit 42 adjusts the difference between the average luminance near the connection boundary and the luminance of the boundary line so that it is maximized. At this time, the range for calculating the average may be an area with a certain degree of spread (for example, an area with an appropriate width on both sides of the boundary line). Then, for example, if the average luminance value near the boundary line is 100, the display image generating unit 42 sets the luminance value of the boundary line to 255, and if the average luminance value near the boundary line is 150, the luminance value of the boundary line to 0.

[0068] The input receiving unit 44 receives input operations for settings such as the brightness value (thickness), color, thickness, and line type of the boundary line, switching on and off of displaying the boundary line, and enlarging or reducing the concatenated image, and transmits the settings to the display image generating unit 42. The input operations may be received by a pointing device 108 such as a mouse or a touch panel, or a keyboard, or may be received by voice recognition of voice input from a microphone. When the image is displayed in a reduced size, if pixels on the boundary line are thinned out, pixels near the boundary line may be displayed as the boundary line.

[0069] S25: The output unit 43 receives the image generated by the display image generating unit 42 and displays it on the image display means 107.

[0070] As described above, according to the embodiment of the present invention, it is possible to display a boundary line superimposed image in which a boundary line indicating a connection point between a plurality of photographic images is superimposed on a concatenated image, and it is possible to easily analyze an image including a boundary line indicating a connection point between a plurality of photographic images. Furthermore, according to the embodiment, it is possible to switch between displaying and not displaying the boundary line in the concatenated image according to a user's decision.

[0071] Furthermore, in this embodiment, when the positional deviation width of the connection point is smaller than a predetermined distance d, the boundary line is not displayed, thereby improving visibility for the user.

[0072] In the present embodiment, the display image generating unit 42 that generates the boundary line superimposition data is provided in the terminal device 4, but is not limited to this. The functions of the terminal device 4 may be provided in the information processing device 3.

[0073] An information processing device 3A including the functions of the terminal device 4 will be described below with reference to Fig. 12. Fig. 12 is a diagram for explaining the functions of another information processing device.

[0074] The information processing device 3A shown in FIG. 12 has an image data transmitting / receiving unit 31, an image correcting unit 32, an image boundary determining unit 33, a connected image generating unit , an image data storage unit 35, a display image generating unit , an output unit 43, and an input receiving unit .

[0075] 12 receives a display request for the connected image data from the terminal device 4 via the input receiving unit 44, the information processing device 3A generates boundary line superimposed image data via the display image generating unit 42 based on the connected image data and boundary line information stored in the image data storage unit 35. The information processing device 3A then outputs (transmits) the generated boundary line superimposed image data to the terminal device 4, and causes the terminal device 4 to display the boundary line superimposed image data.

[0076] In this way, if the information processing device 3A is provided with a function for generating linked image data, the terminal device 4 only needs to display the boundary line superimposed image data, and the configuration of the terminal device 4 can be simplified.

[0077] In this embodiment, the camera 1 may be a general digital camera or an imaging device attached to a vehicle, etc. An imaging device attached to a vehicle may include, for example, a plurality of cameras arranged along the front-rear or up-down direction of the vehicle.

[0078] Although several forms for carrying out the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0079] Additionally, the described apparatuses are merely one of several computing environments for implementing the embodiments disclosed herein. In one embodiment, an information processing system includes a plurality of computing devices, such as a server cluster, configured to communicate with each other via any type of communication link, including a network, shared memory, etc., and to implement the processes disclosed herein.

[0080] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or a conventional circuit module designed to execute each function described above.

[0081] The information processing device 3 may be, for example, a PJ (Projector), an IWB (Interactive White Board: an electronic whiteboard functioning as a blackboard that allows intercommunication), an output device such as digital signage, a HUD (Head Up Display) device, industrial machinery, an imaging device, a sound collection device, medical equipment, a network home appliance, an automobile (Connected Car), a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a digital camera, a wearable PC or a desktop PC. [Explanation of symbols]

[0082] 1 Camera 2 Network 3. Information processing equipment 4 Terminal Equipment 31 Image data transmission / reception unit 32 Image correction section 33 Image Boundary Determination Unit 34 Connected image generation unit 35 Image data storage unit 41 Image data receiving unit 42 Display image generation unit 43 Output section 44 Input reception section [Prior art documents] [Patent documents]

[0083] [Patent Document 1] Patent No. 6456239

Claims

1. an input receiving unit that receives a display request for concatenated image data representing a concatenated image obtained by concatenating a plurality of images captured by dividing a spatially continuous area; an output unit that receives the display request and outputs boundary line information including position information of a boundary line indicating a connecting point of the plurality of images and the connected image data; a display image generating unit that generates boundary line superimposed image data by superimposing the boundary line on the connected image data based on the connected image data and the boundary line information; having the boundary information includes information for measuring a width of misalignment when the plurality of images are connected by detecting a linear object from the connected image, and displaying the boundary if the measured width of misalignment is greater than a predetermined width, and for not displaying the boundary if the measured width of misalignment is smaller than a predetermined width, When the boundary information includes information for displaying the boundary line, the display image generation unit generates boundary line superimposed image data by superimposing the boundary line on the linked image data, and the output unit outputs the boundary line superimposed image data; When the boundary information includes information for hiding the boundary line, the display image generation unit does not superimpose the boundary line on the linked image data, and the output unit outputs the linked image data.

2. The display image generating unit is The information processing apparatus according to claim 1 , wherein the color of the border line is changed in response to an operation received by the input receiving unit.

3. The display image generating unit is The information processing apparatus according to claim 2 , further comprising: a processor configured to change a line type of the boundary line in response to an operation received by the input receiving unit.

4. The display image generating unit is The information processing apparatus according to claim 2 , further comprising: a processor configured to change a density of the boundary line in response to an operation received by the input receiving unit.

5. The display image generating unit is The information processing apparatus according to claim 4 , wherein a difference in luminance of the boundary line in the connected image is maximized with respect to an average display luminance of images in the vicinity of the boundary line.

6. The display image generating unit is The information processing apparatus according to claim 2 , wherein the boundary line is switched between being displayed and not displayed in response to an operation received by the input receiving unit.

7. The information processing apparatus according to claim 2 , wherein the input receiving unit receives at least one of an input from a keyboard, a pointing device, a touch panel, and a voice input from a microphone.

8. A display method using an information processing device, comprising: receiving a display request for concatenated image data representing a concatenated image obtained by concatenating a plurality of images captured by dividing a spatially continuous area; a step of outputting, in response to the display request, boundary information including position information of a boundary line indicating a connecting point of the plurality of images, and the connected image data; generating boundary line superimposed image data by superimposing the boundary line on the connected image data based on the connected image data and the boundary line information; having the boundary information includes information for measuring a width of misalignment when the plurality of images are connected by detecting a linear object from the connected image, and displaying the boundary if the measured width of misalignment is greater than a predetermined width, and for not displaying the boundary if the measured width of misalignment is smaller than a predetermined width, generating boundary line superimposed image data by superimposing the boundary line on the linked image data when the boundary line information includes information for displaying the boundary line; A step of outputting the boundary line superimposed image data; a step of outputting the connected image data without superimposing the boundary line on the connected image data when the boundary line information includes information for hiding the boundary line; A display method comprising:

9. A display request for concatenated image data showing a concatenated image obtained by concatenating a plurality of images captured by dividing a spatially continuous area is received; In response to the display request, outputting boundary information including position information of a boundary line indicating a connecting point of the plurality of images and the connected image data; generating boundary line superimposed image data by superimposing the boundary line on the connected image data based on the connected image data and the boundary line information; the boundary information includes information for measuring a width of misalignment when the plurality of images are connected by detecting a linear object from the connected image, and displaying the boundary if the measured width of misalignment is greater than a predetermined width, and for not displaying the boundary if the measured width of misalignment is smaller than a predetermined width, A program that causes a computer of an information processing device to execute a process to generate boundary line superimposed image data in which the boundary line is superimposed on the linked image data when the boundary line information includes information for displaying the boundary line, and output the boundary line superimposed image data, and to output the linked image data without superimposing the boundary line on the linked image data when the boundary line information includes information for hiding the boundary line.

Images