Image processor, method for processing information, and program

Abstract

To reduce work load for specifying processing to execute on an arbitrary part of an image.SOLUTION: An image processor includes: a detection unit for detecting a first drawing and a second drawing from an image and specifying a first region corresponding to the first drawing and a second region corresponding to the second drawing; an extraction unit for extracting a symbol from the second region; and a processing execution unit for executing processing according to the symbol for the first region.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] 2. Description of the Related Art Image processing apparatuses are provided with a function for detecting an area to which identification information is added on a document and performing processing such as OCR on the detected area.

[0003] For example, in Patent Document 1, identification information that a user adds to a given sheet of paper can be associated with a process that the image processing device is to execute. Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, the user is required to bear the burden of the work of registering the correspondence between the identification information and the processing to be executed in the image processing device.

[0005] The present invention has been made in consideration of the above-mentioned points, and has an object to reduce the workload involved in specifying a process to be executed on an arbitrary portion of an image. [Means for solving the problem]

[0006] In order to solve the above problem, the image processing device has a detection unit that detects a first figure and a second figure from an image and identifies a first area corresponding to the first figure and a second area corresponding to the second figure, an extraction unit that extracts a symbol from the second area, and a processing execution unit that performs processing on the first area according to the symbol. Effect of the Invention

[0007] This reduces the workload for specifying the processing to be performed on any part of an image. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a hardware configuration of an image processing device 10 according to a first embodiment. [Diagram 2] 1 is a diagram illustrating an example of a functional configuration of an image processing device 10 according to a first embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of a document according to the first embodiment. [Figure 4] 1 is a flowchart illustrating an example of a processing procedure executed by the image processing device 10 according to the first embodiment. [Diagram 5] 11A and 11B are diagrams for explaining the detection process of the processing mark mr. [Figure 6] FIG. 13 is a diagram for explaining a detection process of the indication mark me. [Figure 7] FIG. 13 is a diagram for explaining the association between a processing region and a designation region. [Figure 8] 13A and 13B are diagrams illustrating an example of a result of determining a correspondence relationship between a processing region and a specified region. [Figure 9] 5A to 5C are diagrams for explaining the processing content executed for each processing region in accordance with a character string in a designated region in the first embodiment. [Figure 10] FIG. 4 is a diagram showing an example of a result of executing processing on each processing region in the first embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a result of executing mark erasure. [Figure 12] FIG. 11 is a diagram showing an example of a document according to a second embodiment. [Figure 13] 13 is a flowchart illustrating an example of a processing procedure executed by the image processing device 10 according to the second embodiment. [Figure 14] FIG. 11 is a diagram for explaining a process of detecting a strikethrough. [Figure 15] 13 is a diagram for explaining the process executed for each processing region in accordance with a character string in a designated region in the second embodiment. FIG. [Figure 16]13A to 13C are diagrams illustrating an example of a result of executing processing on each processing region in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a diagram showing an example of the hardware configuration of an image processing device 10 in a first embodiment. In Fig. 1, the image processing device 10 has hardware such as a controller 11, a scanner 12, a printer 13, a modem 14, an operation panel 15, a network interface 16, and an SD card slot 17.

[0010] The controller 11 has a CPU 111, a RAM 112, a ROM 113, a HDD 114, and a NVRAM 115. The ROM 113 stores various programs, data used by the programs, and the like. The RAM 112 is used as a storage area for loading programs, a work area for the loaded programs, and the like. The CPU 111 realizes various functions by processing the programs loaded into the RAM 112. The HDD 114 stores programs, various data used by the programs, and the like. The NVRAM 115 stores various setting information and the like.

[0011] The scanner 12 is hardware (image reading means) for reading image data from an original. The printer 13 is hardware (printing means) for printing print data on a printing sheet. The modem 14 is hardware for connecting to a telephone line and is used for transmitting and receiving image data by FAX communication. The operation panel 15 is hardware including an input means such as a button for receiving input from a user and a display means such as a liquid crystal panel. The liquid crystal panel may have a touch panel function. In this case, the liquid crystal panel also functions as an input means. The network interface 16 is hardware for connecting to a network such as a LAN (whether wired or wireless). The SD card slot 17 is used to read a program stored in the SD card 80. That is, in the image processing device 10, not only the program stored in the ROM 113 but also the program stored in the SD card 80 can be loaded into the RAM 112 and executed. The SD card 80 may be replaced by another recording medium (for example, a CD-ROM or a USB (Universal Serial Bus) memory). That is, the type of recording medium corresponding to the position of the SD card 80 is not limited to a specific one. In this case, the SD card slot 17 may be replaced by hardware corresponding to the type of recording medium.

[0012] Fig. 2 is a diagram showing an example of a functional configuration of the image processing device 10 in the first embodiment. In Fig. 2, the image processing device 10 has an input unit 121, a reading control unit 122, a detection unit 123, a correspondence determination unit 124, an extraction unit 125, a process execution unit 126, an erasure unit 127, and an output unit 128. Each of these units is realized by a process executed by the CPU 111 of one or more programs installed in the image processing device 10.

[0013] The input unit 121 accepts input of instructions from a user. The instructions from the user include, for example, setting information related to the process to be executed by the image processing device 10, an instruction to start execution of the process, and the like.

[0014] The reading control unit 122 controls the scanner 12 to obtain an image read by the scanner 12 from a paper document (original).

[0015] FIG. 3 is a diagram showing an example of a document in the first embodiment. In the document p1 shown in FIG. 3, figures such as rectangular marks mr1 to mr4 (hereinafter, when there is no distinction between them, they will be referred to as "processing marks mr") and elliptical marks me1 to me4 (hereinafter, when there is no distinction between them, they will be referred to as "instruction marks me") are not components of the document p1, but are drawn by a user on the document p1 by hand or the like as instructions regarding the processing to be executed by the image processing device 10 for an image (hereinafter, referred to as "target image") read from the document p1. The processing mark mr refers to only the rectangular frame part, and the instruction mark me refers to only the elliptical frame part. Note that drawing the processing mark mr or the instruction mark me on the document will be referred to as "marking" below. Also, the range (area) related to the processing mark mr or the instruction mark me will be referred to as the "marking area" below. The marking area of ​​the processing mark mr will be particularly referred to as the "processing area", and the marking area of ​​the instruction mark me will be particularly referred to as the "instruction area".

[0016] The processing area is the range in the target image that is to be processed. The instruction area is an area that includes a symbol indicating the processing to be performed on the processing area. In this embodiment, an example is shown in which a character string is used as the symbol, but the symbol may be composed of one or more symbols other than characters as long as the symbols are character-recognizable. Note that there is a one-to-one correspondence between the processing area (processing mark mr) and the instruction area (instruction mark me). Therefore, the symbol in one instruction area indicates the processing to be performed on one processing area.

[0017] The user simply surrounds the range of the document p1 that is to be processed with the process mark mr, draws a symbol indicating the process to be performed on that range, and then surrounds that symbol with the instruction mark me.

[0018] The detection unit 123 detects the processing mark mr and the instruction mark me from the target image to identify the processing region and the instruction region.

[0019] When there are a plurality of processing regions and designation regions, the correspondence determination unit 124 determines the correspondence between each processing region and each designation region corresponding to the processing region based on the positional relationship between the processing region and the designation region. In the present embodiment, the designation region closest to a certain processing region is determined to be the designation region corresponding to the processing region.

[0020] The extraction unit 125 extracts a character string from the pointing area related to the detected pointing mark me. The extraction of the character string can be performed using a known character recognition (OCR (Optical Character Recognition)).

[0021] The processing execution unit 126 executes, for each processing region, a process corresponding to the symbol in the designated region that is determined to correspond to the processing region. The process is performed on the target image. Therefore, the target image changes as a result of the process.

[0022] When the user designates erasure of the processing mark mr and the instruction mark me, the erasing unit 127 erases the processing mark mr and the instruction mark me from the target image. The erasure of the instruction mark me also includes the erasure of the character string within the instruction mark me.

[0023] The output unit 128 executes output processing of the target image.

[0024] The following describes the processing procedure executed by the image processing device 10. Fig. 4 is a flowchart for explaining an example of the processing procedure executed by the image processing device 10 in the first embodiment.

[0025] In step S110, the input unit 121 accepts input of an instruction to execute a process from the user, for example, via the operation panel 15. At this time, setting information related to the process is also input. For example, a setting related to whether or not the process mark mr and the instruction mark me added to the document p1 are to be finally erased from the target image (hereinafter referred to as an "operation mode") is input. In addition, settings such as whether the image obtained as a result of executing the process on the target image is to be output as a paper medium (i.e., printed) or output as an electronic image (for example, saved in a specified storage device) may be input. Note that the user sets the document p1 (FIG. 3) in the scanner 12 before inputting an instruction to execute the process.

[0026] Next, the reading control unit 122 controls the scanner 12 to obtain an image (target image) read by the scanner 12 from the document p1 (S120).

[0027] Next, the detection unit 123 detects all the process marks mr from within the target image to identify all the process areas (S130). For example, the coordinates of each vertex of the process area (coordinates in the target image) are identified. That is, when multiple process marks mr are added, such as in the document p1 of FIG. 3, the detection unit 123 detects the multiple process marks mr.

[0028] The detection of the processing mark mr can be realized by using figure detection. The reason for using figure detection is that in this embodiment, it is necessary to detect two types of marks, the processing mark mr and the instruction mark me, and it is necessary to distinguish and detect these two types of marks. In order to detect only the processing mark mr from a situation in which these two types of marks with different shapes are mixed, the detection unit 123 detects the corners of each figure detected from the target image and determines how many sides each figure has from the number of corners, thereby detecting the processing mark mr. In this embodiment, since the processing mark mr is rectangular, the detection unit 123 detects a figure with four corners as the processing mark mr.

[0029] Fig. 5 is a diagram for explaining the detection process of the process mark mr. In Fig. 5, the image g1 on the left side is a target image read from the document p1. The image g1 on the right side shows each processing area identified based on the process mark mr detected in the image g1. That is, in the image g1 on the right side, the processing areas 1 to 4, which are dashed rectangular, are processing areas identified based on the process marks mr1 to 4.

[0030] In this embodiment, the processing mark mr (processing region) is rectangular, but the shape of the processing mark mr may be, for example, designated by the user in advance or in step S110. In this case, multiple shapes may be provided as options, and the shape selected by the user may be set as the shape of the processing mark mr.

[0031] Next, the detection unit 123 detects all the pointing marks me from within the target image, thereby identifying all the pointing regions (S140). For example, the coordinates (coordinates in the target image) of each vertex of the minimum bounding rectangle of the pointing region are identified.

[0032] The detection of the indication mark me can be realized by utilizing figure detection, similar to the detection of the processing mark mr. However, the figure (shape) to be detected in the detection of the indication mark me is different from the processing mark mr. Specifically, the detection unit 123 detects a figure having more than a predetermined number of corners (e.g., 10) as an ellipse, which is the indication mark me, and specifies the range of the indication mark me (e.g., the range of the minimum circumscribing rectangle of the indication mark me) as the indication area. This method of detecting an ellipse is based on a method in which a large number of corners are detected when corner detection is performed on an image representing an arc. However, an ellipse may be detected as the indication mark me by other known methods rather than by detecting the corners.

[0033] Fig. 6 is a diagram for explaining the detection process of the indication mark me. The image g1 on the left side in Fig. 6 is the image g1 on the right side in Fig. 5. The image g1 on the right side in Fig. 6 shows each indication region identified based on the indication mark me detected in the image g1 on the left side. That is, in the image g1 on the right side, the indication regions A to D, which are dashed rectangular regions, are indication regions identified based on the indication marks me1 to 4.

[0034] In this embodiment, the indication mark me (indication area) is an ellipse, but the shape of the indication mark me may be, for example, selectable by the user in advance or in step S110. In this case, a plurality of shapes may be provided as options, and the shape selected by the user may be set as the shape of the indication mark me. However, the shapes of the indication mark me and the processing mark mr must be different.

[0035] Next, the correspondence determination unit 124 determines the correspondence between the processing area identified in step S130 and the designation area identified in step S140 (S150). Determining the correspondence between the processing area and the designation area refers to determining which designation area corresponds to each processing area, and refers to associating (linking) the processing area with the designation area. By associating the processing area with the designation area, it is possible to identify what kind of processing is instructed for each processing area.

[0036] When there is one processing region and one designation region, the correspondence determination unit 124 associates the processing region with the designation region. On the other hand, when there are multiple processing regions and multiple designation regions, the correspondence determination unit 124 associates the processing region with the designation region by the following process.

[0037] The correspondence determination unit 124 calculates the physical distance (hereinafter simply referred to as "distance") between each processing region and each designated region. The physical distance between the processing region and the designated region may be evaluated, for example, by the distance between their respective central pixel positions (X coordinate, Y coordinate). The central pixel position of a certain region is ((Xmin+Xmax) / 2, (Ymin+Ymax) / 2), where Xmin and Xmax are the minimum and maximum values ​​of the X coordinate of the region, respectively, and Ymin and Ymax are the minimum and maximum values ​​of the Y coordinate of the region, respectively.

[0038] For each processing area, the correspondence determination unit 124 associates the designated area that is closest in physical distance to the processing area with the processing area. When the same designated area corresponds to multiple processing areas, the correspondence determination unit 124 associates the designated area with the processing area that is closer. When multiple designated areas correspond to the same processing area, the correspondence determination unit 124 associates the designated area that is closest to the processing area with the processing area, and associates the other designated areas with the processing area that is next closest to the processing area. The correspondence determination unit 124 recursively performs such associations to establish one-to-one association between processing areas and designated areas.

[0039] Fig. 7 is a diagram for explaining the correspondence between processing regions and designated regions. Image g1 on the left side in Fig. 7 is image g1 on the right side in Fig. 6. The right side of Fig. 7 shows the correspondence between processing regions and designated regions. (x1-4, y1-4) in each processing region indicates the central pixel coordinates of each processing region, and (xA-D, yA-D) in each designated region indicates the central pixel coordinates of each designated region.

[0040] 7, the designation region closest to processing region 1 is designation region A. The distance between processing region 1 and designation region A is shorter than the distance between processing region 2 and designation region A, and shorter than the distance between processing region 4 and designation region A. Therefore, designation region A is associated with processing region 1.

[0041] Fig. 8 is a diagram showing an example of a result of determining the correspondence relationship between a processing region and a designated region. In the example of Fig. 7, the correspondence determination unit 124 outputs the correspondence relationship shown in Fig. 8. Fig. 8 shows that the processing region and the designated region assigned to the same row are associated with each other.

[0042] Next, the extraction unit 125 extracts character strings from all the designated areas (S160). Extraction of character strings from a certain designated area can be performed by performing optical character recognition (OCR) on the designated area.

[0043] Next, the process execution unit 126 executes a process for each processing region according to a character string (hereinafter, referred to as an "instruction character string") extracted from an instruction region associated with the processing region (S170). The process execution unit 126 already knows which process corresponds to each instruction character string. The correspondence between the instruction character string and the process may be incorporated in the algorithm of the process execution unit 126, or may be defined outside the algorithm, such as in a file. When the correspondence between the instruction character string and the process is defined outside the algorithm, the process can be easily extended according to the extension of the type of instruction character string. For example, correspondence information between the instruction character string and a program as a plug-in may be stored in the HDD 114, the NVRAM 115, or the like. In this case, the process execution unit 126 may execute a process according to the instruction character string by calling a plug-in associated with the instruction string.

[0044] In the example of FIG. 5 etc., the character strings extracted from each specified region are "bold", "blue", "English", and "green". "Bold" indicates an instruction to execute a process to make the character string extracted from the corresponding processing region (hereinafter referred to as the "processed character string") bold. "Blue" indicates an instruction to execute a process to change the color of the foreground in the corresponding processing region ("ka kaki ku ke ko" in the example of FIG. 5) to blue. "English" indicates an instruction to execute a process to translate the processed character string in the corresponding processing region into English. "Green" indicates an instruction to execute a process to change the color of the foreground in the corresponding processing region ("sa shi su se so" in the example of FIG. 5) to green. Therefore, the processing contents for each processing region based on the correspondence in FIG. 8 are as shown in FIG. 9.

[0045] Fig. 9 is a diagram for explaining the processing content executed for each processing area according to the character string of the designated area in the first embodiment. Fig. 9 shows the instruction character string of the designated area corresponding to the processing area and the processing content for each processing area specified in the image g1 of Fig. 5. The processing content is the content of the processing executed for the image in the processing area according to the instruction character string.

[0046] Of the options "bold," "blue," "English," and "green," for "English," the meaning of the processing string needs to be identified, so the processing execution unit 126 extracts the processing string ("Hello") from the processing area 3 by character recognition, and replaces the image in the processing area 3 with an image of the string obtained by translating the processing string into English.

[0047] For "bold", the processing execution unit 126 may replace the image of the processing area 1 with an image of a character string obtained by extracting a processing character string from the processing area 1 by character recognition and converting the processing character string into a bold font. Alternatively, the processing execution unit 126 may make the character string in the processing area 1 appear bold by performing image processing such as thickening the lines in the image without treating the image of the processing area 1 as a character string.

[0048] For "blue" and "green," the content in the processing region is not necessarily a character, so the processing execution unit 126 sets the foreground pixels in the processing region to blue or green. However, even in the case of "blue" and "green," the processing execution unit 126 may replace the image of each processing region with an image of a character string obtained by extracting a processing character string from each processing region by character recognition and converting the processing character string into a specified color.

[0049] In the present embodiment, the instruction character string specified in the instruction area is merely an example. For example, it may be possible to specify an instruction character string indicating other processing, such as changing the font, changing the typeface, or changing to a color other than green or blue.

[0050] The processing by the processing execution unit 126 is performed on the processing area of ​​the image g1. In other words, the processing result by the processing execution unit 126 is reflected on the processing area of ​​the image g1. For example, the processing execution unit 126 converts the processing result on the image of a certain processing area into an image of the size of the processing area, and combines the image with the processing area. As a result, the image g1 on the left side of FIG. 5 changes as follows.

[0051] FIG. 10 is a diagram showing an example of the results of executing processing on each processing area in the first embodiment. In FIG. 10, image g1 on the left is the target image before execution of processing (i.e., image g1 on the left in FIG. 5). Image g1 on the right is the target image after execution of processing. The inside of each processing area changes due to processing according to the instruction character string. Although not shown in FIG. 10, the color of "sa-shi-su-se-so" is green, and the color of "ka-ki-ku-ke-ko" is blue.

[0052] Next, the erasing unit 127 judges whether erasing of the processing marks mr and the instruction marks me (hereinafter referred to as "mark erasure") is specified in the setting of the operation mode (S180). If mark erasure is specified (Yes in S180), the erasing unit 127 erases all of the processing marks mr and all of the instruction marks me from the image g1 (S190). The erasure of the processing marks mr and the instruction marks me can be achieved by changing the color of the pixels constituting the processing marks mr or the instruction marks me to the background color.

[0053] FIG. 11 is a diagram showing an example of the result of executing mark erasure. In FIG. 11, image g1 on the left is the target image before mark erasure is executed (image g1 on the right in FIG. 10). Image g1 on the right is the target image after mark erasure is executed. By erasing the marks, the target image becomes an image from which all processing marks mr and all instruction marks me have been erased. As a result, the user can obtain an image showing the result of executing processing according to the instruction character string on an image showing the original contents of the document.

[0054] If the answer is No in step S180, or following step S190, the output unit 128 outputs the image g1 in a mode corresponding to the setting information (S200). For example, the output unit 128 causes the printer 13 to print the image g1 or stores the image g1 in the HDD 114.

[0055] As described above, according to the first embodiment, a user can manually mark or draw an instruction character string on a paper document (original), and then execute processing according to the instruction character string on the range of an image read from the paper document to which a processing mark mr is added. This reduces the workload of specifying the processing to be executed on any part of an image.

[0056] Next, a second embodiment will be described. In the second embodiment, differences from the first embodiment will be described. Therefore, the points not specifically mentioned may be the same as the first embodiment.

[0057] In the second embodiment, a rescue measure is disclosed for cases where a user has made a marking on a document by mistake or wants to cancel a marking made as intended. Specifically, a user can invalidate a process mark mr by adding a predetermined figure or symbol (hereinafter referred to as a "cancellation figure") that signifies cancellation to the process mark mr that the user wants to cancel. In this embodiment, an example is shown in which a double line (hereinafter referred to as a "cancellation line") is used as the cancellation figure, but other figures or symbols may be used as the cancellation figure.

[0058] Fig. 12 is a diagram showing an example of a document in the second embodiment. In Fig. 12, the same parts as in Fig. 3 are given the same reference numerals, and their explanation will be omitted. Fig. 12 shows an example in which a strikeout line c3 is added to the process mark mr3, and a strikeout line c4 is added to the process mark mr4 in a document p1. The strikeout line c3 and the strikeout line c4 are strikeout lines drawn by a user who wishes to cancel (invalidate) the process mark mr3 and the process mark mr4.

[0059] In the second embodiment, such an original p1 is the object to be read.

[0060] Fig. 13 is a flowchart for explaining an example of a processing procedure executed by the image processing device 10 in the second embodiment. In Fig. 13, the same steps as those in Fig. 4 are given the same step numbers, and their explanations are omitted. In Fig. 13, step S135 is added between step S130 and step S140. Also, step S170 is replaced with S170a.

[0061] In step S135, the detection unit 123 executes a process of detecting a strikeout line from each processing area identified in step S130. A known pattern matching technique can be used to detect the strikeout line. That is, one or more images of one type as a strikeout line pattern are registered in advance in the HDD 114 or the like. The detection unit 123 determines the presence or absence of a strikeout line based on whether or not a portion matching the image is detected from the periphery of each processing area.

[0062] Fig. 14 is a diagram for explaining the process of detecting strikeout lines. In Fig. 14, image g1 on the left side is a target image read from document p1 (Fig. 12) in step S120. Image g1 in the center is an image g1 in which a rectangular area is specified in step S130. Image g1 on the right side is a target image showing the detection result of strikeout lines (presence or absence of strikeout lines) for each rectangular area.

[0063] The detection unit 123 performs pattern matching with the image of the strikeout line for the periphery of each of the processing regions 1 to 4. In the case of Fig. 14, the detection unit 123 detects the strikeout line from the processing region 3 and the processing region 4. The detection unit 123 associates a label indicating the presence of the strikeout line ("Strikeout line present") with the processing region in which the strikeout line is detected, and associates a label indicating the absence of the strikeout line ("Strikeout not present") with the processing region in which the strikeout line is not detected.

[0064] In this embodiment, it is assumed that the strikethrough is added to the frame line of the processing mark mr1, so the periphery of the processing area is the range of pattern matching, but the range of pattern matching may be changed as appropriate depending on which part the strikethrough figure is added to.

[0065] In step S170a, for each processing region associated with "without strikethrough", the processing execution unit 126 executes processing according to the instruction character string extracted from the instruction region associated with the processing region for the processing character string extracted from the processing region. In other words, the processing execution unit 126 does not execute processing for the processing region associated with "with strikethrough".

[0066] Fig. 15 is a diagram for explaining the processing content executed for each processing area according to the character string in the designated area in the second embodiment. As in Fig. 9, Fig. 15 shows, for each processing area specified in image g1, the designated character string in the designated area corresponding to the processing area and the processing content, as well as whether or not there is a strikethrough. The presence or absence of a strikethrough indicates which label, "with strikethrough" or "without strikethrough", is associated. "With" indicates that "with strikethrough" is associated, and "without" indicates that "without strikethrough" is associated.

[0067] As described above, the processing execution unit 126 does not execute processing for the processing areas associated with "no strikethrough". Therefore, the processing contents of processing areas 3 and 4 are "no change", indicating that no processing is executed. By executing the processing contents shown in FIG. 15, the image g1 on the left side of FIG. 14 changes as follows.

[0068] FIG. 16 is a diagram showing an example of the results of executing processing on each processing area in the second embodiment. In FIG. 16, image g1 on the left is the target image before executing processing (i.e., image g1 on the left in FIG. 5). Image g1 on the right is the target image after executing processing. Processing areas 1 and 2 have changed due to the execution of processing, but processing areas 3 and 4 do not change because no processing is executed. Although not shown in FIG. 16, the color of "sa-shi-suse-so" is not green.

[0069] As described above, according to the second embodiment, the marking can be cancelled (invalidated) even after it has been performed.

[0070] 4 and 13, the processes from step S130 onward may be executed by a computer connected to the image processing device 10 via a network. In this case, the computer may receive the target image from the image processing device 10 via the network.

[0071] Each function of the above-described embodiment can be realized by one or more processing circuits. In this specification, the term "processing circuit" includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0072] In the above embodiments, the processing mark mr is an example of a first figure. The processing area is an example of a first area. The instruction mark me is an example of a second figure. The instruction area is an example of a second area. The strikethrough is an example of a third figure.

[0073] Although the embodiment of the present invention has been described in detail above, the present invention is not limited to such specific embodiment, and various modifications and variations are possible within the scope of the gist of the present invention described in the claims.

[0074] For example, aspects of the present invention are as follows. <1> a detection unit that detects a first figure and a second figure from within an image and identifies a first region corresponding to the first figure and a second region corresponding to the second figure; an extraction unit for extracting a symbol from the second region; a processing execution unit that executes a process corresponding to the symbol on the first region; 13. An image processing device comprising: <2> The extraction unit extracts a character string from the first region; the processing execution unit executes processing on the character string extracted from the first region according to the symbol extracted from the second region, and combines an image based on a processing result with the first region. Characterized by <1> The image processing device described herein. <3> the detection unit detects the first figures and the second figures from within the image to identify the first regions and the second regions; the processing execution unit executes, for each of the plurality of first regions, a process corresponding to a symbol extracted from any of the second regions identified based on a positional relationship with the first region; Characterized by <1> or <2> The image processing device described herein. <4> an erasing unit that erases the first graphic and the second graphic from an image in which the processing corresponding to the symbol has been performed on the first region; characterized in that <1> ~ <3> 13. The image processing device according to claim 12 . <5> The detection unit further determines whether a third figure is added to the first figure, the processing execution unit does not execute a process corresponding to the symbol for the first region related to the first graphic to which the third graphic is added. Characterized by <1> ~ <4> 13. The image processing device according to claim 12 . <6> a detection step of detecting a first figure and a second figure from within an image and identifying a first region corresponding to the first figure and a second region corresponding to the second figure; an extraction step of extracting symbols from the second region; a processing execution step of executing a process corresponding to the symbol on the first region; The image processing method according to claim 1, wherein the image processing method is executed by a computer. <7> a detection step of detecting a first figure and a second figure from within an image and identifying a first region corresponding to the first figure and a second region corresponding to the second figure; an extraction step of extracting symbols from the second region; a processing execution step of executing a process corresponding to the symbol on the first region; A program characterized by causing a computer to execute the above. [Explanation of symbols]

[0075] 10 Image processing device 11 Controller 12 Scanner 13 Printers 14 Modem 15 Operation Panel 16 Network Interfaces 17 SD card slot 80 SD card 111 CPU 112 RAM 113 ROM 114 HDD 115 NVRAM 121 Input section 122 Reading control unit 123 Detection unit 124 Response Judgment Unit 125 Extraction part 126 Processing Execution Unit 127 Eraser 128 Output section [Prior art documents] [Patent documents]

[0076] [Patent Document 1] JP 2022-140208 A

Claims

1. a detection unit that detects a first figure and a second figure from within an image and identifies a first region corresponding to the first figure and a second region corresponding to the second figure; an extraction unit for extracting a symbol from the second region; a processing execution unit that executes a process corresponding to the symbol on the first area; 13. An image processing device comprising:

2. The extraction unit extracts a character string from the first region; the processing execution unit executes processing on the character string extracted from the first region according to the symbol extracted from the second region, and combines an image based on a processing result with the first region.

2. The image processing apparatus according to claim 1,

3. the detection unit detects a plurality of the first figures and a plurality of the second figures from within the image to identify a plurality of the first regions and a plurality of the second regions; the processing execution unit executes, for each of the plurality of first regions, a process corresponding to a symbol extracted from any of the second regions specified based on a positional relationship with the first region; 2. The image processing apparatus according to claim 1,

4. an erasing unit that erases the first graphic and the second graphic from an image in which the processing corresponding to the symbol has been performed on the first region; 2. The image processing apparatus according to claim 1, further comprising:

5. The detection unit further determines whether a third figure is added to the first figure, the processing execution unit does not execute the processing according to the symbol for the first region related to the first graphic to which the third graphic is added.

2. The image processing apparatus according to claim 1,

6. a detection step of detecting a first figure and a second figure from within an image, and identifying a first region corresponding to the first figure and a second region corresponding to the second figure; an extraction step for extracting symbols from the second region; a processing execution step of executing a process corresponding to the symbol on the first region; The image processing method according to claim 1, wherein the image processing method is executed by a computer.

7. a detection step of detecting a first figure and a second figure from within an image, and identifying a first region corresponding to the first figure and a second region corresponding to the second figure; an extraction step for extracting symbols from the second region; a processing execution step of executing a process corresponding to the symbol on the first region; A program characterized by causing a computer to execute the above.

Images