Method, information processing device, and program

Abstract

To enable necessary information to be accurately read from an image utilizing an omission line.SOLUTION: A method executed by an information processing device 10 comprises the steps of: acquiring an image including object information; determining whether an omission line shown in a manner of being superimposed on the object information is included in the image; acquiring first information about the omission line when determining that the omission line is included in the image; acquiring second information about an axis shown along the object information; calculating a positional relation between the omission line and the axis on the basis of the acquired first information and second information; and setting a numeric value related to the axis for the axis on the basis of the acquired second information.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to a method, an information processing device, and a program. [Background technology]

[0002] Conventionally, there is known a technology in which an information processing device creates a database by reading an image including a graph or a map, etc. For example, Patent Document 1 discloses a data reading device that uses a lattice to extract a graph from graph information input as an image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 5-233785 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional techniques do not fully consider images that include ellipsis lines, making it difficult to read necessary information from images that use ellipsis lines.

[0005] The present disclosure provides a technique that makes it possible to accurately read necessary information from an image in which ellipsis lines are used. [Means for solving the problem]

[0006] According to one embodiment of the present disclosure, the method comprises: A method executed by an information processing device, comprising: Obtaining an image containing target information; determining whether the image includes an omission line superimposed on the target information; When it is determined that the ellipsis line is included in the image, first information regarding the ellipsis line is obtained; obtaining second information relating to an axis indicated along the object information; Calculating a positional relationship between the omitted line and the axis based on the acquired first information and second information; and setting a value for the axis associated with the axis based on the second information obtained; Includes.

[0007] An information processing device according to an embodiment of the present disclosure includes: An information processing device including a control unit, Acquire an image containing the target information; determining whether the image includes an ellipsis line superimposed on the target information; When it is determined that the ellipsis line is included in the image, first information regarding the ellipsis line is obtained; obtaining second information about an axis indicated along the object information; Calculating a positional relationship between the omitted line and the axis based on the acquired first information and second information; A numerical value associated with the axis is set for the axis based on the obtained second information.

[0008] A program according to an embodiment of the present disclosure includes: In the information processing device, Obtaining an image containing target information; determining whether the image includes an omission line superimposed on the target information; When it is determined that the ellipsis line is included in the image, first information regarding the ellipsis line is obtained; obtaining second information relating to an axis indicated along the object information; Calculating a positional relationship between the omitted line and the axis based on the acquired first information and second information; and setting a value for the axis associated with the axis based on the second information obtained; The method executes an operation including: Effect of the Invention

[0009] According to a method, an information processing device, and a program according to an embodiment of the present disclosure, it becomes possible to accurately read necessary information from an image in which ellipsis lines are used. [Brief description of the drawings]

[0010] [Figure 1] 1 is a functional block diagram showing a schematic configuration of an information processing device according to an embodiment of the present disclosure. [Diagram 2] 4 is a flowchart for explaining a first embodiment of an information processing method executed by the information processing device of FIG. [Diagram 3] FIG. 3 is a first diagram for specifically explaining each step of the information processing method shown in FIG. 2. [Figure 4] FIG. 2 is a second diagram for specifically explaining each step of the information processing method shown in FIG. [Diagram 5] FIG. 3 is a third diagram for specifically explaining each step of the information processing method shown in FIG. [Figure 6] FIG. 4 is a fourth diagram for specifically explaining each step of the information processing method shown in FIG. [Figure 7] FIG. 5 is a fifth diagram for specifically explaining each step of the information processing method shown in FIG. [Figure 8] 13 is a flowchart illustrating a second embodiment of an information processing method executed by the information processing device of FIG. [Figure 9] 1. FIG. 4 is a schematic diagram showing another example of the information processing method executed by the information processing device of FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0012] 1 is a functional block diagram showing a schematic configuration of an information processing device 10 according to an embodiment of the present disclosure. An example of the configuration of the information processing device 10 will be mainly described with reference to FIG.

[0013] The information processing device 10 is any general-purpose electronic device such as a PC (Personal Computer) or a smartphone. The information processing device 10 is an electronic device used by a specific user. The information processing device 10 is not limited to these, and may be one or multiple server devices that can communicate with each other.

[0014] As an overview of one embodiment, the information processing device 10 acquires an image including target information. In this specification, "image" includes, for example, any image in which target information is shown. "Target information" includes, for example, a graph. A graph includes any graph that is drawn in two dimensions, i.e., along two X-axis and Y-axis.

[0015] The information processing device 10 determines whether or not an omission line superimposed on the target information is included in the image. In this specification, the "omission line" includes any line superimposed on the target information in the image, for example, which indicates the omission of the target information. The omission line includes, for example, two parallel wavy lines drawn to overlap a graph in the image. When the information processing device 10 determines that the image includes an omission line, it acquires first information related to the omission line. In this specification, the "first information" includes, for example, the position, shape, and number of the omission lines in the image. The first information includes these pieces of information as numerical values.

[0016] The information processing device 10 acquires second information on an axis shown along the target information. In this specification, the "second information" includes, for example, the position of the X-axis of a graph in an image and the numerical range of the X-axis scale, and the position of the Y-axis of a graph in an image and the numerical range of the Y-axis scale. In addition, the second information includes, for example, the numerical interval of the X-axis scale and the numerical interval of the Y-axis scale of a graph. The information processing device 10 calculates the positional relationship between the ellipsis line and the axis based on the acquired first information and second information. The information processing device 10 sets a numerical value related to the axis for the axis based on the acquired second information. In this specification, the "numerical value related to the axis" includes, for example, the numerical value of the scale given along the X-axis of the graph, and the numerical value of the scale given along the Y-axis of the graph.

[0017] As shown in FIG. 1, the information processing device 10 includes a communication unit 11, a storage unit 12, an input unit 13, an output unit 14, and a control unit 15.

[0018] The communication unit 11 includes a communication module that connects to a network including, for example, a mobile communication network and the Internet. For example, the communication unit 11 includes a communication module that supports mobile communication standards or Internet standards such as 4G (4th Generation) and 5G (5th Generation). In one embodiment, the information processing device 10 is connected to the network via the communication unit 11. The communication unit 11 transmits and receives various information via the network.

[0019] The storage unit 12 is, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like, but is not limited to these. The storage unit 12 functions, for example, as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores any information used in the operation of the information processing device 10. For example, the storage unit 12 stores system programs, application programs, and various information received or transmitted by the communication unit 11. The information stored in the storage unit 12 can be updated, for example, with information received from a network via the communication unit 11.

[0020] The input unit 13 includes one or more input interfaces that detect a user input and acquire input information based on a user operation. For example, the input unit 13 includes a physical key, a capacitive key, a mouse, a touch screen that is integral with the display of the output unit 14, a touch pen that functions together with the touch screen, and a microphone that accepts voice input.

[0021] The output unit 14 includes one or more output interfaces that output information to notify a user. For example, the output unit 14 may be, but is not limited to, a display that outputs information as a video or a speaker that outputs information as an audio.

[0022] The control unit 15 includes one or more processors. In one embodiment, the "processor" is a general-purpose processor or a dedicated processor specialized for a specific process, but is not limited thereto. The control unit 15 is communicably connected to each component of the information processing device 10 and controls the operation of the information processing device 10 as a whole.

[0023] (First embodiment) Fig. 2 is a flowchart for explaining a first embodiment of an information processing method executed by the information processing device 10 of Fig. 1. The first embodiment of the information processing method executed by the information processing device 10 of Fig. 1 will be explained with reference to Fig. 2. The flowchart shown in Fig. 2 shows an example of a basic process flow of the information processing method executed by the information processing device 10.

[0024] In step S100, the control unit 15 of the information processing device 10 acquires an image including target information.

[0025] In step S101, the control unit 15 determines whether the image acquired in step S100 includes an ellipsis line superimposed on the target information. If the control unit 15 determines that the image includes an ellipsis line, it executes the process of step S102. If the control unit 15 determines that the image does not include an ellipsis line, it ends the process.

[0026] In step S102, if the control unit 15 determines in step S101 that the image includes an ellipsis line, it acquires first information regarding the ellipsis line.

[0027] In step S103, the control unit 15 acquires second information related to axes shown along the target information included in the image acquired in step S100. For example, the control unit 15 acquires the position of the X-axis of the graph and the numerical range of the scale of the X-axis, and the position of the Y-axis of the graph and the numerical range of the scale of the Y-axis, as the second information.

[0028] In step S104, the control unit 15 calculates the positional relationship between the omitted line and the axis based on the first information and the second information acquired in steps S102 and S103, respectively.

[0029] In step S105, the control unit 15 divides the image into two areas, a first area and a second area, with the ellipsis line as a boundary, based on the positional relationship calculated in step S104, and identifies the divided areas.

[0030] In step S106, the control unit 15 acquires second information related to an axis indicated along the target information included in the image acquired in step S100. For example, the control unit 15 acquires, as the second information, a numerical interval of the scale of the axis in each of the first and second regions identified in step S105.

[0031] In step S107, the control unit 15 sets a numerical value related to the axis for the axis based on the second information acquired in steps S103 and S106.

[0032] Fig. 3 is a first diagram for specifically explaining each step of the information processing method shown in Fig. 2. With reference to Fig. 3, the processing contents of the control unit 15 in step S100 in Fig. 2 will be explained in more detail.

[0033] The control unit 15 refers to an electronic file of any file format stored in the storage unit 12 based on a user's operation using the input unit 13. For example, the control unit 15 refers to a PDF file. Next, the control unit 15 acquires any image included in the referenced PDF file. At this time, the control unit 15 accepts a user input via the input unit 13 that specifies an image area IM for an image that includes target information and is included in the PDF file. The control unit 15 acquires the image that includes the target information by extracting the image area IM specified by the user using the input unit 13.

[0034] Fig. 4 is a second diagram for specifically explaining each step of the information processing method shown in Fig. 2. Fig. 4 shows an example of an image acquired by control unit 15 in step S100 in Fig. 2. The processing contents of control unit 15 in step S101 in Fig. 2 will be explained in more detail with reference to Fig. 4.

[0035] The image acquired by the control unit 15 includes a two-dimensional graph G as target information. In addition to the graph G, the image shows the X-axis and Y-axis of the graph G, as well as the X-axis scale M1 and the Y-axis scale M2. Furthermore, the image shows two parallel wavy lines as omission lines L that overlap the graph G. The omission lines L include an upper wavy line L1 and a lower wavy line L2 that are parallel to each other in the vertical direction. The omission lines L indicate that a portion of the graph G along the Y-axis has been omitted. The graph G can be divided into two regions in the vertical direction along the Y-axis.

[0036] The control unit 15 executes the determination process of step S101 in Fig. 2 by applying a technique such as image recognition to the image acquired in step S100 in Fig. 2. That is, the control unit 15 determines whether or not the image acquired in step S100 includes an omitted line L that overlaps with the graph G.

[0037] Fig. 5 is a third diagram for specifically explaining each step of the information processing method shown in Fig. 2. The processing contents of the control unit 15 in step S102 in Fig. 2 will be explained in more detail with reference to Fig. 5.

[0038] The control unit 15 receives a user input specifying a range R0 surrounding the omitted line L through the input unit 13. The range R0 surrounds the periphery of the omitted line L in a rectangular shape, for example. The control unit 15 reads the omitted line L within such a rectangular range R0 by using a technique such as image recognition. That is, the control unit 15 acquires numerical information such as the position, shape, and number of the omitted line L in the image as first information for each of the upper wavy line L1 and the lower wavy line L2.

[0039] Fig. 6 is a fourth diagram for specifically explaining each step of the information processing method shown in Fig. 2. The process contents of the control unit 15 in step S103 in Fig. 2 will be explained in more detail with reference to Fig. 6.

[0040] The control unit 15 receives a user input specifying, as numerical information, a minimum value 0 and a maximum value 5 in the numerical range of the X-axis scale M1 via the input unit 13. The control unit 15 receives, as numerical information, a user input specifying, as numerical information, a minimum value 0 and a maximum value 2000 in the numerical range of the Y-axis scale M2 via the input unit 13. The control unit 15 acquires, as second information, the numerical range of the scale of each axis, based on the minimum and maximum values ​​in the numerical range of the scale of each axis specified by the user.

[0041] The control unit 15 receives a user input specifying the X-axis through the input unit 13. For example, the user specifies the X-axis in the image by clicking the mouse on a part of the X-axis in the image displayed on the output unit 14. For example, the user specifies the X-axis in the image by moving the pointer along the X-axis in the image while clicking the mouse. For example, the user specifies the X-axis in the image by moving the touch pen along the X-axis in the image.

[0042] The control unit 15 receives a user input specifying the Y-axis through the input unit 13. For example, the user specifies the Y-axis in the image by clicking the mouse on a part of the Y-axis in the image displayed on the output unit 14. For example, the user specifies the Y-axis in the image by moving the pointer along the Y-axis in the image while clicking the mouse. For example, the user specifies the Y-axis in the image by moving the touch pen along the Y-axis in the image.

[0043] The control unit 15 acquires, as the second information, the position of the X-axis of the graph G in the image based on the user's designation of the X-axis. Similarly, the control unit 15 acquires, as the second information, the position of the Y-axis of the graph G in the image based on the user's designation of the Y-axis.

[0044] Fig. 7 is a fifth diagram for specifically explaining each step of the information processing method shown in Fig. 2. The processing contents of the control unit 15 in steps S104 to S107 in Fig. 2 will be explained in more detail with reference to Fig. 7.

[0045] The control unit 15 calculates the positional relationship between the omitted line L and the axis based on the acquired first information and second information. The control unit 15 calculates the positional relationship between the omitted line L and the X-axis and Y-axis, more specifically, the position of the omitted line L on the Y-axis. As a result, the control unit 15 identifies that the omitted line L is located in the center of the Y-axis along the up-down direction and between the scale 200 and the scale 1000 of the Y-axis.

[0046] Based on the positional relationship calculated in this manner, the control unit 15 divides and identifies the image into two regions, a first region R1 and a second region R2, with the omission line L as the boundary. In the image shown in Fig. 7, the first region R1 includes the region above the upper wavy line L1 of the omission line L, and the second region R2 includes the region below the lower wavy line L2 of the omission line L.

[0047] Here, in the first region R1, the numerical interval of the Y-axis scale M2 is 1000, whereas in the second region R2, the numerical interval of the Y-axis scale M2 is 100. The numerical intervals of the Y-axis scale M2 are different from each other in the first region R1 and the second region R2. The control unit 15 identifies the numerical interval of the scale M2 along the Y-axis for each of the first region R1 and the second region R2 by using a technique such as image recognition, and acquires it as the second information. The control unit 15 identifies that the numerical interval of the Y-axis scale M2 is 1000 in the first region R1, and that the numerical interval of the Y-axis scale M2 is 100 in the second region R2.

[0048] The control unit 15 sets, for the axis, numerical values ​​related to the axis based on the second information. For example, the control unit 15 sets, for the X-axis, the numerical value of the scale M1 to be applied along the X-axis using the X-axis position and the numerical range of the X-axis scale M1. The control unit 15 sets, for the Y-axis, the numerical value of the scale M2 to be applied along the Y-axis using the Y-axis position and the numerical range of the Y-axis scale M2 together with the numerical interval of the Y-axis scale M2 of each of the identified first region R1 and second region R2.

[0049] In this way, the control unit 15 accurately reads the graph G, which has been captured as an image in an electronic file as shown in FIG.

[0050] According to the embodiment described above, it is possible to accurately read necessary information from an image in which ellipsis lines are used. When reading a graph included in an image, even if the ellipsis lines, which indicate the omission of values, are included in the image so as to overlap with the graph and the consistency of the scale values ​​on the axes is lost, the information processing device 10 can accurately read the graph, each axis, the scales of each axis, and the ellipsis lines.

[0051] The information processing device 10 can complement the information by acquiring the first information through a technique such as a user input and image recognition, etc. This allows the information processing device 10 to read the first information related to the ellipsis line with high accuracy.

[0052] The information processing device 10 can complement the information by acquiring the second information through a technique such as a user input or image recognition. This allows the information processing device 10 to accurately read the second information on the axis in both the first region R1 and the second region R2 that are bounded by the ellipsis line. For example, in FIG. 7, the numerical interval 100 of the scale M2 in the second region R2 is also continuously applied to the first region R1, suppressing erroneous recognition such as reading a portion of the scale M2 that should be read as a numerical value of 2000 as 1100.

[0053] The information processing device 10 divides an image into two regions, a first region and a second region, with the ellipsis line as a boundary, and identifies the regions, so that even if the numerical intervals of the axis scale differ from each other in the first region and the second region, the information processing device 10 can individually identify the numerical intervals of the axis scale for each region. This allows the information processing device 10 to accurately read the second information on the axis near the ellipsis line from an image in which the ellipsis line is used.

[0054] The information processing device 10 receives a user input specifying an area surrounding the ellipsis line and reads the ellipsis line within that area, thereby making it possible to read the first information related to the ellipsis line from the image with high accuracy.

[0055] Second embodiment Fig. 8 is a flowchart for explaining a second embodiment of the information processing method executed by the information processing device 10 of Fig. 1. The second embodiment of the information processing method executed by the information processing device 10 of Fig. 1 will be explained with reference to Fig. 8. The flowchart shown in Fig. 8 shows an example of a basic process flow of the information processing method executed by the information processing device 10.

[0056] In the following description, the same description as the specific processing contents described above with reference to Figures 3 to 7 in the first embodiment applies to the processing contents common to the first embodiment of the information processing method shown in Figure 2. In the following, only an overview of the processing contents common to the first embodiment will be given, and processing contents different from the first embodiment will be described in detail.

[0057] In step S200, the control unit 15 of the information processing device 10 acquires an image including target information.

[0058] In step S201, the control unit 15 determines whether the image acquired in step S200 includes an ellipsis line superimposed on the target information. If the control unit 15 determines that the image includes an ellipsis line, it executes the process of step S202. If the control unit 15 determines that the image does not include an ellipsis line, it ends the process.

[0059] In step S202, when the control unit 15 determines in step S201 that the image includes an ellipsis line, the control unit 15 accepts a user input that designates a first region R1 and a second region R2 in the image, each of which has the ellipsis line as its boundary, as shown in Fig. 7. The control unit 15 identifies the first region R1 and the second region R2 in the image based on the user input.

[0060] In step S203, the control unit 15 acquires first information regarding the omitted line. The control unit 15 identifies the upper wavy line L1 shown along the edge adjacent to the second region R2 in the first region R1 identified in step S202 as the omitted line L. Similarly, the control unit 15 identifies the lower wavy line L2 shown along the edge adjacent to the first region R1 in the second region R2 identified in step S202 as the omitted line L. The control unit 15 acquires first information regarding the omitted line L including the upper wavy line L1 and the lower wavy line L2.

[0061] In step S204, the control unit 15 acquires second information related to axes shown along the target information included in the image acquired in step S200. For example, similar to the first embodiment, the control unit 15 acquires the position of the X-axis of the graph and the numerical range of the X-axis scale, and the position of the Y-axis of the graph and the numerical range of the Y-axis scale as the second information by user input.

[0062] In the second embodiment, in addition to this, the control unit 15 accepts a user input specifying a numerical interval along the axis for each of the first region R1 and the second region R2 for numerical values ​​related to the axis. The control unit 15 identifies a numerical interval of the scale M2 along the Y-axis by the user input for each of the first region R1 and the second region R2, and acquires it as the second information. The control unit 15 identifies that the numerical interval of the scale M2 of the Y-axis in the first region R1 is 1000, and that the numerical interval of the scale M2 of the Y-axis in the second region R2 is 100.

[0063] In step S205, the control unit 15 calculates the positional relationship between the omitted line and the axis based on the first information and the second information acquired in steps S203 and S204, respectively.

[0064] In step S206, the control unit 15 sets a numerical value related to the axis for the axis based on the second information acquired in step S204.

[0065] According to the second embodiment as described above, the same effects as those of the first embodiment are achieved.

[0066] In addition, the information processing device 10 can read the first and second regions from the image with high accuracy by accepting a user input that specifies the first and second regions in the image, each of which has an ellipsis line as a boundary. Similarly, the information processing device 10 can read the numerical interval of the scale along the axis with high accuracy as second information in each of the first and second regions from the image by accepting a user input that specifies the numerical interval along the axis, each of which is related to the axis, for the first and second regions.

[0067] Although the present disclosure has been described based on the drawings and examples, it should be noted that those skilled in the art can make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each configuration or each step can be rearranged so as not to be logically inconsistent, and multiple configurations or steps can be combined or divided into one.

[0068] For example, a general-purpose electronic device such as a smartphone or a computer can be configured to function as the information processing device 10 according to the above-described embodiment. Specifically, a program describing the processing contents for realizing each function of the information processing device 10 according to the embodiment is stored in the memory of the electronic device, and the program is read and executed by a processor of the electronic device. Therefore, the disclosure according to one embodiment can also be realized as a program executable by a processor.

[0069] Alternatively, the disclosure according to an embodiment may be realized as a non-transitory computer-readable medium storing a program executable by one or more processors to cause the information processing device 10 according to the embodiment to execute each function. It should be understood that these are also included in the scope of the present disclosure.

[0070] In the above embodiment, the object information included in the image is described as a two-dimensional graph, but is not limited thereto. The object information may include any graph drawn in three dimensions, i.e., along three X-axis, Y-axis, and Z-axis. The object information may include any two-dimensional or three-dimensional map. The object information may include any two-dimensional or three-dimensional drawing based on CAD (Computer-Aided Design).

[0071] In the above embodiment, the omitted lines are described as including two parallel wavy lines that divide the graph into two regions in the Y-axis direction, but are not limited thereto. The omitted lines may divide the graph into two regions in the X-axis direction instead of the Y-axis direction. The omitted lines may include lines of any other shape different from wavy lines. The omitted lines may include one or three or more lines instead of two. The omitted lines may include any lines drawn to overlap a map instead of a graph. The omitted lines may include any lines drawn to overlap a CAD drawing instead of a graph and a map.

[0072] In the above embodiment, the axes shown along the object information are described as the X-axis and Y-axis of the graph, but are not limited thereto. The axes shown along the object information may be the X-axis, Y-axis, and Z-axis of the graph. The axes shown along the object information may be any coordinate axis indicating a position on a map. The axes shown along the object information may be any coordinate axis indicating a position on a CAD drawing.

[0073] In the above first embodiment, the information processing device 10 divides an image into two regions, a first region and a second region, with an ellipsis line as a boundary, based on the calculated positional relationship, and identifies the regions, but this is not limited to the above. Instead of or in addition to such an identification process, the information processing device 10 may accept a user input that specifies the first region and the second region in the image, as in the second embodiment. The information processing device 10 may not execute these processes when, for example, the numerical intervals of the scales of the regions along the Y axis are the same. That is, the information processing device 10 may not divide an image into a plurality of regions.

[0074] In the above first embodiment, the information processing device 10 identifies the numerical intervals of the scale for each of the first and second regions by using a technique such as image recognition, and acquires the second information, but is not limited to this. Instead of or in addition to such processing, the information processing device 10 may accept a user input that specifies the numerical intervals along the axis for each of the first and second regions for the numerical values ​​related to the axis, as in the second embodiment.

[0075] In the above first embodiment, the information processing device 10 receives a user input specifying a range surrounding the ellipsis line and obtains the first information by reading the ellipsis line within the range, but is not limited thereto. Instead of or in addition to such processing, the information processing device 10 may read the ellipsis line from within the first and second regions in a state in which the first and second regions are specified by the user in advance, as in the second embodiment. Instead of these processes, the information processing device 10 may obtain the first information by reading the ellipsis line included in the image only by image recognition. This eliminates the need for the user to perform any input operation using the input unit 13 in order for the information processing device 10 to read the ellipsis line. This improves the user's convenience when using the information processing device 10.

[0076] Instead of or in addition to the above processes, the information processing device 10 may acquire the first information by accepting a user input that specifies at least a portion of the omitted line. For example, the user may specify at least a portion of the omitted line by moving a pointer along at least a portion of the omitted line in the image displayed on the output unit 14 while clicking the mouse. For example, the user may specify at least a portion of the omitted line by moving a touch pen along at least a portion of the omitted line in the image. When the user specifies only a portion of the omitted line, the information processing device 10 may identify the remaining portion of the omitted line by using a technique such as image recognition.

[0077] In the above embodiment, the information processing device 10 has been described as acquiring the X-axis position and the numerical range of the X-axis scale of the graph, and the Y-axis position and the numerical range of the Y-axis scale of the graph as the second information by user input, but is not limited thereto. The information processing device 10 may acquire at least one of the X-axis position and the numerical range of the X-axis scale of the graph, and the Y-axis position and the numerical range of the Y-axis scale of the graph as the second information by identifying them using a technology such as image recognition. The information processing device 10 may acquire the numerical range of the scale in each region individually as the second information by user input that individually specifies the minimum and maximum values ​​of the scale in the first region and the minimum and maximum values ​​of the scale in the second region, instead of the numerical range of the scale of the entire Y-axis of the graph.

[0078] In the above first embodiment, the information processing device 10 divides the image into two areas, a first area and a second area, with the ellipsis line as a boundary, based on the calculated positional relationship, and then identifies the numerical intervals of the scale for each of the first area and the second area by using a technique such as image recognition, and acquires them as the second information. However, the present invention is not limited to this. The information processing device 10 may identify each numerical value of the scale of the entire axis by using a technique such as image recognition, without dividing the image into two areas, the first area and the second area, and acquire them collectively as the second information in step S103 of FIG. 2.

[0079] In the above embodiment, the information processing device 10 acquires an image including target information by extracting an image area IM specified by a user using the input unit 13. However, the information processing device 10 may acquire an image including target information by using a technique such as image recognition.

[0080] FIG. 9 is a schematic diagram showing another example of the information processing method executed by the information processing device 10 of FIG. 1. In the above embodiment, the information processing device 10 sets the numerical values ​​of the scale marks to be added along the axis within the numerical range of the scale marks specified by the user, but the present invention is not limited to this. As shown in FIG. 9, in a case where the target information includes a graph drawn along a plurality of axes with omitted lines, the control unit 15 of the information processing device 10 may set the numerical values ​​related to the axis in the extrapolation area R3 including the information extrapolated to the graph. That is, the control unit 15 may set the corresponding numerical values ​​of the scale marks to exceed the minimum or maximum value of the original numerical range together with the extrapolation data added by the user to the original graph. In FIG. 9, as an example, the control unit 15 sets the numerical values ​​of the scale marks of 3000 and 4000 to the Y axis for the extrapolation data added to the extrapolation area R3 having a larger Y axis value than the original graph. [Explanation of symbols]

[0081] 10. Information processing device 11 Communications Department 12 Storage section 13 Input section 14 Output section 15 Control section G Graph IM Image Area L omitted line L1 Upper wavy line L2 Lower wavy line M1 scale M2 scale R0 Range R1 1st area R2 2nd area R3 extrapolation region

Claims

1. A method executed by an information processing device, comprising: Obtaining an image containing target information; determining whether the image includes an omission line superimposed on the target information; When it is determined that the image includes the omission line, first information regarding the omission line is obtained; obtaining second information relating to an axis indicated along the object information; Calculating a positional relationship between the omitted line and the axis based on the acquired first information and the acquired second information; and setting a value for the axis associated with the axis based on the second information obtained; Including, method.

2. 2. The method of claim 1 , The method further includes dividing the image into two areas, a first area and a second area, with the omission line as a boundary, based on the calculated positional relationship, and identifying the divided areas. method.

3. 3. The method according to claim 1 or 2, and receiving a user input specifying a first region and a second region in the image, the first region and the second region being bounded by the omission line. method.

4. 4. The method of claim 3, obtaining the second information includes accepting user input specifying a numerical interval along the axis for each of the first region and the second region with respect to a numerical value associated with the axis; method.

5. 5. The method according to claim 1 , further comprising the steps of: The acquiring of the first information includes accepting a user input specifying a range surrounding the ellipsis line, and reading the ellipsis line within the range. method.

6. 5. The method according to claim 1 , further comprising the steps of: The acquiring of the first information includes reading the omission line included in the image by image recognition alone. method.

7. 7. The method according to any one of claims 1 to 6, comprising: the target information includes a graph drawn along a plurality of the axes with the omitted lines; setting the axis-associated values ​​for the axis includes setting the axis-associated values ​​for the axis in an extrapolation region that includes information extrapolated to the graph. method.

8. An information processing device including a control unit, Acquire an image containing the target information; determining whether the image includes an ellipsis line superimposed on the target information; When it is determined that the image includes the ellipsis line, first information regarding the ellipsis line is obtained; obtaining second information relating to an axis indicated along the object information; Calculating a positional relationship between the omitted line and the axis based on the acquired first information and second information; setting a value for the axis related to the axis based on the acquired second information; Information processing device.

9. 9. The information processing device according to claim 8, The control unit divides the image into two areas, a first area and a second area, with the omission line as a boundary, based on the calculated positional relationship, and identifies the divided areas. Information processing device.

10. 10. The information processing device according to claim 8, The control unit accepts a user input for designating a first region and a second region in the image, the first region and the second region being bounded by the omission line. Information processing device.

11. The information processing device according to claim 10, the control unit acquires the second information by accepting a user input specifying a numerical interval along the axis for each of the first region and the second region with respect to a numerical value related to the axis. Information processing device.

12. 12. The information processing device according to claim 8, the control unit receives a user input specifying a range surrounding the ellipsis line, and acquires the first information by reading the ellipsis line within the range. Information processing device.

13. 12. The information processing device according to claim 8, The control unit acquires the first information by reading the omission line included in the image only by image recognition. Information processing device.

14. 14. The information processing device according to claim 8, the target information includes a graph drawn along a plurality of the axes with the omitted lines; The control unit sets a numerical value associated with the axis in an extrapolation region including information extrapolated to the graph, for the axis. Information processing device.

15. In the information processing device, Obtaining an image containing target information; determining whether the image includes an omission line superimposed on the target information; When it is determined that the image includes the omission line, first information regarding the omission line is obtained; obtaining second information relating to an axis indicated along the object information; Calculating a positional relationship between the omitted line and the axis based on the acquired first information and the acquired second information; and setting a value for the axis associated with the axis based on the second information obtained; performing an action including program.

16. The program according to claim 15, The operation further includes dividing the image into two areas, a first area and a second area defined by the omission line, based on the calculated positional relationship, and identifying the divided areas. program.

17. 17. The program according to claim 15 or 16, The operations further include accepting user input specifying a first region and a second region in the image, the first region and the second region being bounded by the omission line. program.

18. 18. The program according to claim 17, obtaining the second information includes accepting user input specifying a numerical interval along the axis for each of the first region and the second region with respect to a numerical value associated with the axis; program.

19. 19. The program according to any one of claims 15 to 18, The acquiring of the first information includes accepting a user input specifying a range surrounding the ellipsis line, and reading the ellipsis line within the range. program.

20. 19. The program according to any one of claims 15 to 18, The acquiring of the first information includes reading the omission line included in the image by image recognition alone. program.

Images