Storage media and image processing devices

Abstract

The present invention provides a storage medium storing an image processing program and an image processing device, wherein the image processing program and the image processing device reduce the complexity of operations performed on a character string acquired through OCR processing. The image processing program of the embodiment enables a computer to function as an image processing device having an acquisition unit and a control unit. The acquisition unit acquires image data. The control unit detects character strings of each color contained in the image data, and uses the character strings of the color to perform control processing corresponding to the color.

Description

Technical Field

[0001] Embodiments of the present invention relate to a storage medium and an image processing device. Background Art

[0002] In the past, an image processing device performed optical character recognition (OCR) on the entire area or a specified area of ​​image data to obtain a character string. The character string obtained by the OCR process was also copied or saved.

[0003] However, after OCR processing, the acquired text string needs to be operated, which has the problem of complicated operations.

[0004] An object of the present invention is to provide an image processing program and an image processing device that reduce the complexity of operations performed on a character string acquired through OCR processing. Summary of the invention

[0005] The storage medium of the embodiment stores an image processing program that causes a computer to function as an image processing device having an acquisition unit and a control unit. The acquisition unit acquires image data. The control unit detects character strings of each color contained in the image data and uses the character strings of the color to perform control processing corresponding to the color. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Figure 1 : is a block diagram showing a hardware configuration example of the image processing device according to the embodiment.

[0007] Figure 2 1 is a general block diagram showing an example of a functional structure of the image processing device according to the first embodiment.

[0008] Figure 3 This is a diagram showing an example of a document image according to the first embodiment.

[0009] Figure 4 It is a diagram showing a first example of parameters in the first embodiment.

[0010] Figure 5 It is a diagram showing a processing flow of the image processing device according to the first embodiment.

[0011] Figure 6 It is a diagram showing a second example of the parameters of the first embodiment.

[0012] Figure 7 This is a diagram showing an example of data output by the image processing apparatus according to the first embodiment.

[0013] Figure 8It is a diagram showing a processing flow of the image processing system according to the second embodiment.

[0014] Description of Reference Numerals

[0015] 100…image processing device, 200…image forming device, 300…information processing device, 101…CPU, 102…communication module, 103…interface, 104…RAM, 105…ROM, 106…HDD, 107…image processing program, 108…parameter table, 110…acquisition unit, 111…area determination unit, 112…text recognition unit, 113…control processing unit. DETAILED DESCRIPTION

[0016] Hereinafter, an image processing program and an image processing device according to an embodiment will be described with reference to the drawings.

[0017] Figure 1 : is a diagram showing an example of a device configuration of an image processing system including an image processing device 100 according to an embodiment. Figure 1 The image processing system shown includes an image processing apparatus 100, an image forming apparatus 200, and an information processing apparatus 300. The image processing apparatus 100 is connected to the image forming apparatus 200 via a communication cable.

[0018] The image forming device 200 is, for example, a multifunction machine. The image forming device 200 includes an image reading unit 201. The image reading unit 201 optically reads an original document image of a reading object and generates image data having color information. The image reading unit 201 is configured using an image sensor such as a CCD (Charge Coupled Device) or a COMS (Complementary Metal Oxide Semiconductor) sensor. The image reading unit 201 outputs the generated image data to the image processing device 100.

[0019] The image processing device 100 acquires the image data output by the image reading unit 201. The image processing device 100 detects the character strings of each color contained in the image data, and uses the character strings of the color to perform control processing corresponding to each color. The image data has color information. The image data includes an image of the character string. In other words, the image data is, for example, image data of an original image recording the character string. In addition, the image data may be image data of a whiteboard screen. In addition, the image data may also be image data generated by taking an image using a camera.

[0020] The image processing device 100 is a computer including a CPU (Central Processing Unit) 101, a communication module 102, an interface (Interface) 103, etc. The image processing device 100 also includes a RAM (Random Access Memory) 104, a ROM (Read Only Memory) 105, a HDD (Hard Disk Drive) 106, etc. The communication module 102 may be a device for wireless communication between the image forming device 200 and the information processing device 300, or a device for wired communication. The RAM 104 stores an image processing program 107 and a parameter table 108.

[0021] <First embodiment>

[0022] Figure 2 1 is a general block diagram showing the functional structure of the image processing device 100 according to the first embodiment.

[0023] CPU 101( Figure 1 ) reads out and executes the image processing program 107 stored in the RAM 104 or the like ( Figure 1 ). Thus, the image processing device 100 realizes the functions of the acquisition unit 110, the area determination unit 111, the character recognition unit 112, and the control processing unit 113. In addition, some of these functions 110 to 113 can be realized by the image processing device 100 using electronic circuits.

[0024] The acquisition unit 110 acquires image data of the original image. The area determination unit 111 detects a color area of ​​each color from the image data. The color area displays the range of text strings recorded in the same color in the image data. In other words, the color area displays the area of ​​the image data that includes a collection of text strings of the same color. In addition, the color area may be a range in which text strings in the image data are decorated with the same color. Decoration, for example, is an operation of overlapping a text string with a highlighter or a marker, or circling a text string. In the present embodiment, the same color includes a range of colors that can be regarded as a certain color. In addition, the same color includes a range of the color determined by the name of the color, such as "red" or "blue".

[0025] The character recognition unit 112 uses OCR processing to detect the character string (text data) contained in each color area detected by the area determination unit 111. Specifically, the character recognition unit 112 recognizes the characters in each color area and determines what each character is. The character recognition unit 112 detects the character string composed of the determined characters. In addition, the character string may include only one character. The characters may include numerical values, mathematical expressions, symbols, etc.

[0026] The control processing unit 113 refers to the parameter table 108 to obtain the control processing corresponding to each color. The control processing unit 113 uses the character string that has been character-recognized in the color area of ​​each color to perform the control processing corresponding to the color. Figure 4 An example of the parameter table 108 will be described.

[0027] Figure 3 FIG. 1 is a diagram showing an example of a document image 10 in the present embodiment. Figure 3 The image data of the document image 10 shown is processed as input. Figure 3 The document image 10 shown includes a character string and graphics such as a chart. The character string included in the document image 10 is, for example, a file name, a date, a department name, and a text.

[0028] Specifically, in Figure 3 In the document image 10 shown, each set of text strings is recorded in a different color. For example, in the color area 11a of the document image 10, the document name "ABC document" is recorded in red. In the color area 11b, the date "YYYY / MM / DD" is recorded in black, and a yellow highlighter is used to underline it. In the color area 11c, the department name "DDD Division" is recorded in blue. In the color areas 11d and 11f, each document is recorded in black. In the color areas 11e and 11g, each document is recorded in black, and the document is circled with a green marker. For example, in the color areas 11e and 11g, the document is circled with an ellipse or a rectangle.

[0029] in this way, Figure 3 The document image 10 includes images of a plurality of color character strings. Figure 3 The document image 10 shown includes character strings in five colors. However, the number of colors of the character strings included in the document image 10 is not limited to this example. The document image 10 in the present embodiment may include an image of character strings in two or more colors.

[0030] Figure 4 1 is a diagram showing an example of the parameter table 108 in this embodiment. The parameter table 108 has a correspondence relationship between colors and control processes.

[0031] according to Figure 4 In the parameter table 108 shown, the color "black" corresponds to the control process "stored as the contents of file 1". The color "red" corresponds to the control process "specified as the file name of file 1". The color "blue" corresponds to the control process "specified as a folder name". In addition, the color "green" corresponds to the control process "stored as the contents of file 2". The color "yellow" corresponds to the control process "specified as the file name of file 2".

[0032] That is, in Figure 4 In the parameter table 108 shown, it is specified that the file 1 storing the black area character string is generated by using the red area character string as the file name. In addition, it is specified that the file 2 storing the green area character string is generated by using the yellow area character string as the file name. In addition, it is specified that files 1 and 2 are generated in a folder with the folder name of the blue area character string.

[0033] In addition, in this embodiment, the parameter table 108 is pre-stored in the image processing device 100, but the present invention is not limited to this example. The parameter table 108 may be input to the image processing device 100 together with the image data. The parameter table 108 may be completely different from the image data, or may be used in common between a plurality of image data. In addition, the information of the parameter table 108 may be input by the user when performing control processing.

[0034] In addition, Figure 3 In the parameter table 108 shown, the content of the control process is associated with each color, but the present invention is not limited to these examples. In the parameter table 108, the content of the control process may be associated with only a part of the plurality of colors.

[0035] Figure 5 1 is a diagram showing the processing flow of the image processing device 100 in this embodiment. The acquisition unit 110 of the image processing device 100 acquires image data (ACT 11). Specifically, the acquisition unit 110 acquires the image data output by the image reading unit 201 via the communication module 102. In addition, the acquisition unit 110 can acquire image data stored in a storage device such as the HDD 106.

[0036] The area determination unit 111 extracts a color area for each color in the image data acquired by the acquisition unit 110 (ACT 12). The area determination unit 111 extracts a range in which a text string is written in the same color in the image data as a color area. In addition, the area determination unit 111 extracts a range in which a text string is decorated with the same color in the image data as a color area. The area determination unit 111 detects a color area in which a text string is written in the color from the image data.

[0037] according to Figure 3 In the example of the document image 10, the area determination unit 111 detects the color areas 11a to 11g from the image data of the document image 10. Hereinafter, when the color areas 11a to 11g are not distinguished, they are also referred to as the color area 11.

[0038] Specifically, the region determination unit 111 extracts each color region 11 as follows, for example. The region determination unit 111 divides the image data into blocks of a predetermined size and obtains the average value of the color information of each block. The block includes a plurality of adjacent pixels. The color information is, for example, an RGB value. The region determination unit 111 detects a plurality of adjacent blocks whose difference values ​​from the average values ​​of adjacent blocks are within a predetermined range. The region determination unit 111 detects a region including the detected plurality of blocks as a color region. The region determination unit 111 detects the color of the detected color region 11 based on the image data.

[0039] In addition, the region determination unit 111 may detect each color region 11 according to another method. Similarly, the region determination unit 111 divides the image data into blocks of a predetermined size and obtains the average value of the color information of each block. The region determination unit 111 stores the sample values ​​of the color information of each color (for example, black, red, blue, green, yellow, etc.) in advance. The region determination unit 111 detects a plurality of adjacent blocks whose differences between the sample values ​​of the color information of each color and the average value are within a predetermined range. The region determination unit 111 detects the region including the detected plurality of blocks as the color region 11.

[0040] In addition, the area determination unit 111 can detect the color area 11 circled with a marker pen or the like as follows. The area determination unit 111 scans each pixel of the image data sequentially from the upper left end, and simultaneously obtains the color information of each pixel. The area determination unit 111 determines that pixels with the same color information are continuous when the difference in pixel color information before and after the scanning sequence is within a prescribed range. In this case, the area determination unit 111 determines whether the surrounding pixels of the pixels with the same color information that are continuous have the same color information. The area determination unit 111 detects a pixel group that demarcates a rectangle or ellipse, etc., having the same color information, based on the positions of the surrounding pixels having the same color information. The area determination unit 111 detects the color area 11 based on the detected pixel group.

[0041] The method of detecting the color region 11 is not limited to the above example. The region determination unit 111 can detect each color region 11 in the image data using various techniques generally known in image processing.

[0042] The character recognition unit 112 performs OCR processing on each color region 11 detected by the region determination unit 111. Thus, the character recognition unit 112 detects the character string included in each color region 11 as text data (ACT 13). Figure 3For example, the text recognition unit 112 detects the text strings contained in each color area 11a to 11g of the image data. Specifically, the text recognition unit 12 performs OCR processing on the color area 11a and detects the text string "ABC document". The text recognition unit 12 detects the text strings in the other color areas in the same manner. In this way, the text strings of each color in the image data are detected. As described above, the text strings of each color include text strings recorded in a specified color and text strings decorated with a specified color.

[0043] In addition, Figure 5 In the processing flow of , the case where the text recognition process (ACT13) is performed after the detection process (ACT12) of the color region 11 is illustrated. However, the present invention is not limited to this example. For example, after the text recognition process (ACT13), the text string of each color can be detected from the image data by performing the detection process (ACT12) of the color region 11.

[0044] In this case, for example, the text recognition unit 112 performs OCR processing on the entire image data to detect the text string. The area determination unit 111 obtains the color information of each text string and the pixels around the text string based on the image data. The area determination unit 111 detects the text string with the same color information in the continuous text string. In addition, the area determination unit 111 detects the text string circled with the same color information in the continuous text string. In this way, the text string of each color contained in the image data can be detected.

[0045] The control processing unit 113 refers to the parameter table 108 and uses the character string of each color to perform the control processing corresponding to the color (ACT 14). Specifically, the control processing unit 113 refers to the parameter table 108 to obtain the content of the control processing corresponding to each color. The control processing unit 113 obtains the character string of each color detected by the character recognition unit 112. The control processing unit 113 uses the character string to perform the control processing corresponding to the color of the obtained character string.

[0046] Here, according to Figure 3 The original image 10 and Figure 4 The parameter table 108 of the control processing unit 113 is used to illustrate an example of the processing (ACT14).

[0047] As mentioned above, in Figure 3In the original image 10, the document name "ABC document" is recorded in red in the color area 11a. The department name "DDD business department" is recorded in blue in the color area 11c. The document is recorded in black in the color areas 11d and 11f. The control processing unit 113 refers to the parameter table 108 to obtain the content of the control processing corresponding to the colors "red", "blue" and "black". As described above, the color "black" corresponds to the control processing "stored as the content of file 1". The color "red" corresponds to the control processing "specified as the file name of file 1", and the color "blue" corresponds to the control processing "specified as the folder name".

[0048] Therefore, the control processing unit 113 generates a file for storing the document of the color areas 11d and 11f. In addition, the control processing unit 113 sets the file name of the generated document to the character string "ABC document". The control processing unit 113 stores the generated file in a folder named "DDD Business Department". In addition, the folder "DDD Business Department" can be an existing folder or a newly generated folder.

[0049] In addition, in this embodiment, the case where the name of the folder (DDD Division) is specified as the folder name is exemplified, but the present invention is not limited to this example. The full path name showing the name of the folder and the hierarchy may be specified as the folder name.

[0050] Similarly, in the color area 11c, the date "YYYY / MM / DD" is underlined with a yellow highlighter, and the documents in the color areas 11e and 11g are circled with a green marker. The control processing unit 113 generates a file storing the text string in the color areas 11e and 11g, and sets the file name of the generated file to the text string "YYYY / MM / DD". The control processing unit 113 stores the generated file in the folder "DDD Business Unit".

[0051] Thus, in the present embodiment, the first color corresponds to the control process of using a string of characters as a file name, and the second color corresponds to the control process of storing the string of characters in a file. The image processing apparatus 100 stores the string of characters in the second color, and simultaneously generates a file in which the string of characters in the first color is set as the file name. For example, a user generates a manuscript image 10 in which a string of characters desired as a file name or a folder name is recorded or decorated in a prescribed color. For example, the user can write a string of characters in a printed manuscript image 10 in a prescribed color. The user can also decorate the string of characters in the printed manuscript image 10 in a prescribed color. Thus, the image processing apparatus 100 can store the string of characters contained in the image data, and generate a file with a desired name.

[0052] The manuscript image 10 may include a handwritten string of characters or decorations. For example, in the case of a discussion based on the manuscript image 10, there is a case where information is written to the manuscript image 10 using a red pen or a blue pen. For example, a user writes a string of characters to be designated as a file name in the manuscript image 10 using a red pen or the like. In addition, the user circles a string of characters in the manuscript image 10 to be saved as another file using a green marker or the like. Thus, the image processing device 100 can generate a file that has the document pre-recorded in the manuscript image 10 as content and has a file name designated in red characters. In addition, the image processing device 100 can store the string of characters recorded in green characters in the manuscript image 10 in another file.

[0053] As described above, the image data may be image data of a printed image of a whiteboard. Character strings are written in the whiteboard using markers of multiple colors. For example, important information is written using a red marker. In this case, for example, the image processing device 100 can effectively utilize the important information by matching the red character string with a prescribed control process.

[0054] <Variation 1>

[0055] Modification 1 describes another example of the control process. Modification 1 can also be used in combination with the first embodiment.

[0056] Figure 6 1 is a diagram showing an example of parameter table 108-1 in Modification 1. Figure 4 As described in , the parameter table 108-1 has a correspondence between colors and control processing contents. Figure 6 In the parameter table 108-1 shown, each color corresponds to a process of associating a character string with a predetermined identification information. Specifically, the color "black" corresponds to a process associated with the identification information "ID01". In addition, the color "red" corresponds to a process associated with the identification information "ID02", and the color "blue" corresponds to a process associated with the identification information "ID03".

[0057] The control processing unit 113 associates the character string obtained by the OCR process with the identification information corresponding to the color and outputs the character string. Therefore, the control processing unit 113 associates the documents in the color areas 11d and 11f with the identification information "ID01" and associates the character string "ABC document" with the identification information "ID02". In addition, the control processing unit 113 associates the character string "DDD business unit" with the identification information "ID03".

[0058] In Modification 1, a case where the control processing unit 113 outputs each character string associated with the identification information to the same folder is exemplified.

[0059] Figure 7FIG. 1 is a diagram showing an example of an output file in Modification 1. Figure 7 In the output file 20 shown, the front end of the documents in the color areas 11d and 11f is assigned identification information "ID01". Similarly, the front end of the text string "ABC document" is assigned identification information "ID02", and the front end of the text string "DDD business department" is assigned identification information "ID03".

[0060] In this way, the character string is given identification information. Thus, for example, the user can identify the category of each character string based on the identification information by referring to the output file 20. In addition, other applications can read the output file 20 and register the character string in the database based on the identification information. For example, other applications register each character string of the output file 20 as data in an item corresponding to the identification information of the database.

[0061] In addition, identification information is not limited to Figure 6 For example, the identification information may be a tag of a markup language. In this case, for example, the identification information including the information assigned to the front end of the character string and the information assigned to the end of the character string is specified. Thus, the control processing unit 113 can generate a file that assigns a specified tag to each character string after OCR processing.

[0062] Thus, in variation 1, the third color corresponds to the control process of adding specified identification information to a character string and outputting the character string. The image processing device 100 detects a character string of the third color in the image data, adds specified identification information to the character string, and outputs the character string. That is, the image processing device 100 adds specified identification information to the character string and outputs the character string, and the character string is a character string of a color corresponding to the process associated with the specified identification information. For example, the user generates a manuscript image 10 in which a character string associated with desired identification information is recorded or decorated according to a color corresponding to the identification information. Thus, the image processing device 100 can give the character string specified identification information corresponding to the color based on the image data of the manuscript image 10.

[0063] <Variation 2>

[0064] Modification 2 describes another example of the control process. Modification 2 may be used in combination with the first embodiment, modification 1, or both.

[0065] Although not shown, in the second modification, as the content of the control process, each color is associated with a process of outputting a character string to a predetermined output destination in the parameter table 108. The output destination is, for example, another application running on the image processing device 100. Alternatively, the output destination may be a process or thread running on the image processing device 100. Alternatively, the output destination may be an existing file.

[0066] In the parameter table 108, for example, the color "black" corresponds to a process output to the process A of the application. In addition, the color "red" corresponds to a process output to the process B of the application. Therefore, the control processing unit 113 outputs the document of the color areas 11d and 11f to the process A of the application. In addition, the control processing unit 113 outputs the text string "ABC document" to the process B of the application. The control processing unit 113 outputs the text string to the process of the output destination using, for example, inter-process communication.

[0067] Thus, in the second modification, the third color corresponds to the control process of outputting a character string to a specified output destination. The image processing device 100 detects a character string of the third color in the image data, and outputs the character string to a specified output destination. That is, the image processing device 100 outputs a character string of a color corresponding to the process of outputting to a specified output destination to the specified output destination. For example, the user generates a document image 10 in which a character string to be output to a desired output destination is recorded or decorated according to a color corresponding to the output destination. Thus, the image processing device 100 can output a character string to a corresponding output destination based on the image data of the document image 10.

[0068] As described above, the image processing device 100 in the first embodiment includes the acquisition unit 110 for acquiring image data and the control units (111 to 113). The control unit detects character strings of each color included in the image data and uses the character strings of the color to perform control processing corresponding to the color.

[0069] Thus, the control processing of the text string obtained by the OCR processing of the image data of the original image 10 can be specified in advance. In other words, the control processing of the text string obtained by the OCR processing can be specified according to the color. The image processing device 100 can perform the control processing using the text string of each color and corresponding to the color based on the color of the text string contained in the image data. Therefore, the user can perform the processing corresponding to the color only by including the text string of the specified color in the original image 10 without performing the operation after the OCR processing. Thus, the complexity of the operation performed on the text string obtained by the OCR processing can be reduced.

[0070] In addition, the image processing device 100 can make the control process after the OCR process different according to each color corresponding to the character string. Therefore, arbitrary control process can be specified according to each color. In addition, by generating the parameter table 108 according to the image data, different control processes can be performed according to the image data.

[0071] In addition, in the present embodiment, the case where the image processing apparatus 100 is separated from the image forming apparatus 200 is illustrated, but the image processing apparatus 100 may also be included in the image forming apparatus 200. In this case, the image reading unit 201 performs the reading process of the document image 10, and then performs the process of the image processing apparatus 100 in the present embodiment. That is, after the document image is read, the control process corresponding to the color of the character string can be performed using the character string included in the image data. As a result, the complexity of the operation performed on the character string of the image data can be reduced.

[0072] <Second embodiment>

[0073] The image processing device 100 in the second embodiment performs control processing in cooperation with other devices. The configuration example of the image processing system in the second embodiment is the same as that in the first embodiment ( Figure 1 The functional structure of the image processing device 100 in the second embodiment is also the same as that in the first embodiment ( Figure 2 ) are the same. The processing contents of the control processing unit 113 in the second embodiment are different from those in the first embodiment. The processing contents of the control processing unit 113 in the second embodiment are described below according to the processing flow.

[0074] Figure 8 1 is a diagram showing a processing flow of the image processing system in the present embodiment. In the information processing device 300 in the present embodiment, a collaborative program (not shown) that performs processing in collaboration with the image processing program 107 operates. The collaborative program is, for example, a program that collects and manages data and simultaneously performs classification or analysis of the data. The collaborative program, for example, stores various data in a database (not shown).

[0075] The user logs in to the image forming device 200 (ACT 21). Specifically, the image forming device 200 displays a screen for receiving an ID and a password. If the user enters the ID and the password, the image forming device 200 performs an authentication process. If the authentication is successful, the image forming device 200 instructs the image processing program 107 of the image processing device 100 to start.

[0076] The image processing program 107 of the image processing apparatus 100 performs a startup process (ACT 22). The image forming apparatus 200 notifies the started image processing program 107 of the input ID and password. The image processing program 107 notifies the information processing apparatus 300 of the ID and password notified by the image forming apparatus 200. The cooperation program running in the information processing apparatus 300 performs an authentication process based on the ID and password notified by the image processing apparatus 100 (ACT 23). If the authentication is successful, the cooperation program notifies the image forming apparatus 200 of information indicating the success of the authentication.

[0077] When receiving the notification, the image forming apparatus 200 instructs the image reading unit 201 to read the document image 10. The image reading unit 201 reads the document image 10 and generates image data (ACT 24). The image reading unit 201 transmits the generated image data to the image processing apparatus 100.

[0078] The image processing device 100 acquires the image data sent by the image forming device 200 (ACT 25). Figure 5 The processes ACT12 and ACT13 described above are the same. The control processing unit 113 refers to the parameter table 108 and uses the character string of the color to execute the control process corresponding to the color (ACT28).

[0079] In this embodiment, as the content of the control process in the parameter table 108, an API (Application Programming Interface) is called corresponding to each color. The API is the API of the collaborative program. The image processing program 107 can use the functions of the collaborative program or use the managed data, etc. by calling the API of the collaborative program.

[0080] The API of the collaborative program is, for example, a command for executing data login, update, or data acquisition. Specifically, for example, the first API is a command for inputting data to the project X managed by the collaborative program. In addition, the second API is a command for inputting data to the project Y managed by the collaborative program. In the parameter table 108, for example, the color "black" corresponds to calling the first API. In addition, the color "green" corresponds to calling the second API.

[0081] The control processing unit 113 uses the character string to call the API corresponding to the color of the character string, and the cooperative program performs input processing of the character string (ACT 29). Figure 3, the control processing unit 113 calls the first API using the character string in the color areas 11d and 11f. In addition, the control processing unit 113 calls the second API using the character string in the color areas 11e and 11g. Thus, the character string in the color areas 11d and 11f is input to item X of the data of the collaborative program, and the character string in the color areas 11e and 11g is input to item Y.

[0082] In this way, the user generates, for example, document image 10 in which character strings to be input to items of the linked program are written in colors corresponding to the items. Thus, image processing apparatus 100 can input OCR-processed character strings as data for each item managed by the linked program.

[0083] As described above, when discussing using the document image 10, there is a case where the user writes information on the document image 10 using a red or blue pen. The image processing device 100 acquires the image data of the document image 10 written by the user. Thus, the image processing device 100 can effectively input the character string written by the user in red or blue into a predetermined item of data of the collaborative program.

[0084] In addition, the API is not limited to the above content. For example, the API may be a command to send an email. In addition, the API may also be a command to output a text string to a specified process or thread of a collaborative program. In this case, the control processing unit 113 may output a text string written in a specified color to the process of the collaborative program corresponding to the color.

[0085] As described above, in the second embodiment, the fourth color corresponds to a control process of calling a prescribed API using a character string. The image processing device 100 includes an acquisition unit 110 for acquiring image data and a control unit (111 to 113). The control unit detects character strings of each color contained in the image data, and calls a prescribed API using a character string of the fourth color. That is, the image processing device 100 uses a character string of a prescribed color to execute an API corresponding to the prescribed color.

[0086] Thus, the image processing apparatus 100 can execute the API corresponding to the color using the text string of each color based on the color of the text string contained in the image data. The user generates the document image 10 in which the text string used when calling the desired API is recorded or decorated with the color corresponding to the desired API. Thus, the image processing apparatus 100 can execute the desired API using the desired text string based on the image data of the document image 10 without performing operations after OCR processing. Thus, the complexity of the operations performed on the text string obtained by OCR processing can be reduced.

[0087] The second embodiment may be used in combination with the first embodiment and modifications 1 and 2. By using the operation in combination, control processing using each character string of image data can be more appropriately realized.

[0088] Although several embodiments have been described above, these embodiments are only presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other ways, and various omissions, substitutions, and changes can be made without departing from the scope of the purpose of the invention. These embodiments and their variations are included in the scope and purpose of the invention, and are also included in the invention described in the claims and their equivalents.

Claims

1. A storage medium storing an image processing program, characterized in that: The image processing program is used to make a computer function as an image processing device, and the image processing device includes: An acquisition unit, which acquires image data; an area determination unit that divides the image data into blocks of a specified size, obtains an average value of color information of each block, detects a plurality of adjacent blocks whose difference values ​​from the average values ​​of adjacent blocks are within a specified range, and detects an area including the detected plurality of blocks as a color area; as well as The control unit detects the character strings of each color contained in each color area, and refers to a parameter table having a correspondence relationship between each color and each control process, and uses the character strings of the color to execute the control process corresponding to the color. The first color corresponds to a control process of using the character string as a file name, and the second color corresponds to a control process of storing the character string in a file. The control unit stores the character string of the second color and generates the file having the character string of the first color as the file name, The third color corresponds to a control process of adding predetermined identification information to the character string and outputting the character string, or corresponds to a control process of outputting the character string to a predetermined output destination. The control unit adds the predetermined identification information to the character string of the third color and outputs the character string, or outputs the character string of the third color to the predetermined output destination. The parameter table is pre-stored in the image processing device or is input into the image processing device by a user when performing the control process.

2. The storage medium storing the image processing program according to claim 1, wherein: The fourth color corresponds to a control process that uses the character string to call a predetermined API. The control unit calls the predetermined API using the character string in the fourth color.

3. An image processing device, characterized in that: have: An acquisition unit, which acquires image data; an area determination unit that divides the image data into blocks of a specified size, obtains an average value of color information of each block, detects a plurality of adjacent blocks whose difference values ​​from the average values ​​of adjacent blocks are within a specified range, and detects an area including the detected plurality of blocks as a color area; as well as The control unit detects the character strings of each color contained in each color area, and refers to a parameter table having a correspondence relationship between each color and each control process, and uses the character strings of the color to execute the control process corresponding to the color. The first color corresponds to a control process of using the character string as a file name, and the second color corresponds to a control process of storing the character string in a file. The control unit stores the character string of the second color and generates the file having the character string of the first color as the file name, The third color corresponds to a control process of adding predetermined identification information to the character string and outputting the character string, or corresponds to a control process of outputting the character string to a predetermined output destination. The control unit adds the predetermined identification information to the character string of the third color and outputs the character string, or outputs the character string of the third color to the predetermined output destination. The parameter table is pre-stored in the image processing device or is input into the image processing device by a user when performing the control process.

Images