Image processing system, image processing device, image processing method, and program

Abstract

The present invention provides an image processing system, image processing device, image processing method, and program that can generate augmented data without damaging the read results, without outputting sensor data externally from the image processing device. [Solution] The image processing device comprises a reading control unit that acquires sensor data, a first storage unit that stores the sensor data and first identification information in association, an image processing unit that generates a first read image by image processing, and a transmission unit that transmits the first read image to a server device. The server device comprises a receiving unit that receives the first read image, a generation unit that generates a set of image processing parameters, and a request unit that requests the image processing device to augment the first read image. The image processing unit reads the sensor data from the first storage unit and generates a second read image by image processing of the sensor data using the set.

Description

Technical Field

[0001] The present invention relates to an image processing system, an image processing apparatus, an image processing method, and a program.

Background Art

[0002] In an image reading apparatus, in many cases, the data read by a reading sensor is subjected to image processing, converted into a format such as an image file or PDF (Portable Document Format), and transmitted to a server or a user terminal. In this case, raw data read by the reading sensor (hereinafter sometimes referred to as sensor data) may contain confidential information depending on the manufacturer, and it may be undesirable to send it outside the image reading apparatus.

[0003] Also, when using an artificial intelligence that takes an image read by an image reading apparatus as an input, it is preferable to use the actually read image as learning data in order to improve the performance of the artificial intelligence's judgment. By adding an image with further changes to the image prepared as learning data, the range that can be identified by the artificial intelligence can be expanded. In this case, by changing the image processing parameters of the image reading apparatus variously and preparing the result of applying image processing to sensor data as an augmented image, it can be expected to improve the accuracy of the artificial intelligence's judgment. However, as described above, sensor data may contain confidential information, and it is difficult for developers of artificial intelligence to prepare such data.

[0004] As a technique for obtaining multiple images as described above, a technique has been disclosed in which OCR (Optical Character Recognition) processing is applied to images read by multiple reading conditions within an image reading device, and the image with high recognition accuracy is used (for example, Patent Document 1). In addition, a technique has been disclosed in which a large number of diverse images are generated by dividing an image into three elements: characters, geometric figures, and background, and performing different image processing on each element, in order to automatically generate image data with diverse layouts (for example, Patent Document 2). [Overview of the project] [Problems that the invention aims to solve]

[0005] However, the technologies described in Patent Documents 1 and 2 are not clear about whether or not sensor data is stored, and neither has considered the issue of generating augmented images without outputting confidential information contained in the sensor data to the outside. Furthermore, the technology described in Patent Document 2 does not apply image processing to the sensor data itself, but rather applies further image processing to image data that has already been generated as a read image. As a result, for example, it is difficult to generate a color image from a monochrome image, or multiple scaling processes are performed, causing the gradation to differ from the image actually read by the image reader. In short, augmented images that differ from the actual results read by the image reader are generated.

[0006] The present invention has been made in view of the above, and aims to provide an image processing system, an image processing device, an image processing method, and a program that can generate augmented data without damaging the read results, without outputting sensor data to an external source from the image processing device. [Means for solving the problem]

[0007] To solve the above-mentioned problems and achieve the objective, the present invention provides an image processing system including an image processing device for reading images and a server device for managing image augmentation, wherein the image processing device includes a reading control unit that causes a reading operation to be performed on a document using a reading sensor and acquires sensor data read by the reading sensor, a first storage unit that stores the sensor data and first identification information that identifies the sensor data in association, an image processing unit that generates a first read image by image processing using predetermined image processing parameters for the sensor data, and a transmission unit that transmits the first read image to the server device, the server device transmitting by the transmission unit The system comprises: a receiving unit that receives the transmitted first read image; a generating unit that generates a set of image processing parameters for augmenting the first read image selected by the user terminal from among the first read images received by the receiving unit; and a requesting unit that requests the image processing device to augment the first read image using the set and the first identification information corresponding to the first read image selected by the user terminal. The image processing device, upon receiving the request, reads the sensor data corresponding to the first identification information in the request from the first storage unit and generates a second read image by image processing of the sensor data using the set in the request. [Effects of the Invention]

[0008] According to the present invention, augmented data can be generated without damaging the read results, without outputting sensor data to an external source from the image processing device. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 shows an example of the overall configuration of an information processing system according to the embodiment. [Figure 2] Figure 2 is a sequence diagram showing an example of the general operation flow of the information processing system according to the embodiment. [Figure 3] Figure 3 shows an example of the hardware configuration of the image reading device according to the embodiment. [Figure 4] Figure 4 shows an example of the hardware configuration of the learning data server according to the embodiment. [Figure 5] Figure 5 shows an example of the configuration of the functional block of the image reading device according to this embodiment. [Figure 6] Figure 6 shows an example of a sensor data database. [Figure 7] Figure 7 shows an example of the configuration of the functional blocks of the learning data server according to the embodiment. [Figure 8] Figure 8 shows an example of the parameter condition setting screen. [Figure 9] Figure 9 shows an example of an image processing parameter set used for image augmentation. [Figure 10] Figure 10 shows an example of a read image database. [Figure 11] Figure 11 shows an example of an augmented reading image. [Figure 12] Figure 12 is a sequence diagram showing an example of the reading operation flow of the image reading device according to the embodiment. [Figure 13] Figure 13 is a sequence diagram showing an example of the flow of the augmented image generation operation of the image reading device according to the embodiment. [Figure 14] Figure 14 is a sequence diagram showing an example of the operation flow of the learning data server according to the embodiment. [Modes for carrying out the invention]

[0010] Embodiments of the image processing system, image processing apparatus, image processing method, and program according to the present invention will be described in detail below with reference to the drawings. Furthermore, the present invention is not limited by the following embodiments, and the components in the following embodiments include those that are easily conceivable by those skilled in the art, those that are substantially the same, and those that are equivalent. Moreover, various omissions, substitutions, modifications, and combinations of components can be made without departing from the spirit of the following embodiments.

[0011] (Overall configuration of the information processing system) Figure 1 is a diagram showing an example of the overall configuration of the information processing system according to this embodiment. The overall configuration of the information processing system 1 according to this embodiment will be described with reference to Figure 1.

[0012] Information processing system 1 is a system for generating data by augmenting data acquired by an information processing device for use as training data for machine learning. As an example, information processing system 1 is an image processing system for generating images by augmenting images read by an image reader. As shown in Figure 1, information processing system 1 includes image readers 10a and 10b, a training data server 20, and a user terminal 30. The image readers 10a and 10b, the training data server 20, and the user terminal 30 can communicate with each other via network N. However, the data can be of any type as long as it corresponds to information acquired from sensors possessed by the information processing device or sensors connected to the information processing device. Sensors are devices that acquire sensor data such as mechanical, electromagnetic, thermal, acoustic, and chemical properties. Information acquired by these sensors is sometimes referred to as sensor data. Information processing system 1 may be connected to multiple information processing devices, each having different types of sensors. The following section describes a case where an image sensor, an example of a sensor, acquires an image, an example of data, using an image reader, an example of an information processing device.

[0013] The image reading devices 10a and 10b are devices (an example of an image processing device) that perform a reading operation on a document using a reading sensor such as an image sensor, and generate a read image by performing image processing on the obtained sensor data. The image reading devices 10a and 10b are operated by a device user. Therefore, hereinafter, the read image will be described as an image obtained by performing image processing on sensor data. The image reading devices 10a and 10b are, for example, scanner devices, or MFPs (Multifunction Peripherals) having a scanner function or the like. However, the image reading device is not limited to this, and any device that acquires sensor data by an image sensor may be used, such as a camera or the like.

[0014] In addition, in FIG. 1, two image reading devices 10a and 10b are shown, but it is not limited to this, and one or three or more may be used. Also, for the image reading devices 10a, 10b, etc., when indicating or generically referring to an arbitrary image reading device, it shall simply be referred to as "image reading device 10".

[0015] The learning data server 20 is a server device that makes a request to the image reading device 10 to generate a read image by magnifying a specific read image from a set of image processing parameters set by the user terminal 30, and accumulates the obtained read image as learning data to be used for machine learning. Hereinafter, in some cases, generating new data by processing sensor data based on parameters may be expressed as expansion or magnification.

[0016] The user terminal 30 is an information terminal for specifying a read image to be magnified by a learning data user and setting image processing parameters to be used for image processing.

[0017] (Outline of the operation of the information processing system) FIG. 2 is a sequence diagram showing an example of the flow of the outline operation of the information processing system according to the embodiment. With reference to FIG. 2, the flow of the outline operation of the information processing system 1 according to the present embodiment will be described.

[0018] <Steps S101 and S102> The device user performs an image reading execution operation on the desired document with respect to the image reading device 10a. Then, the image reading device 10a performs a reading operation by a reading sensor on the document, generates a read image by performing image processing on the obtained sensor data, and stores the sensor data in an internal storage device.

[0019] <Step S103> Then, the image reading device 10a transmits the generated read image, sensor data identification information (for example, the file name of the sensor data, etc.) for identifying the sensor data obtained from the reading sensor, and device identification information (for example, the device name of the image reading device 10a, IP address, or MAC address, etc.) for identifying the image reading device 10a to the learning data server 20 via the network N. The learning data server 20 stores the received read image.

[0020] <Steps S104 and S105> Also, the device user performs an image reading execution operation on the desired document with respect to the image reading device 10b. Then, the image reading device 10b performs a reading operation by a reading sensor on the document, generates a read image by performing image processing on the obtained sensor data, and stores the sensor data in an internal storage device.

[0021] <Step S106> Then, the image reading device 10b transmits the generated read image, sensor data identification information (for example, the file name of the sensor data, etc.) for identifying the sensor data obtained from the reading sensor, and device identification information (for example, the device name of the image reading device 10b, IP address, or MAC address, etc.) for identifying the image reading device 10b to the learning data server 20 via the network N. The learning data server 20 stores the received read image.

[0022] <Step S107> A user of the learning data operating on the user terminal 30 performs a viewing operation on the read images stored on the learning data server 20.

[0023] <Step S108> The user of the training data selects the images to be augmented and determines the conditions for generating the image processing parameters used for augmentation. This makes it possible to augment the images that the user wants to augment. The selected images and the conditions for generating the image processing parameters are then sent from the user terminal 30 to the training data server 20.

[0024] <Step S109> The learning data server 20 determines the destination for the request to generate an augmented image (hereinafter sometimes referred to as an augmented image) from the read image indicated by the received selection result (i.e., the image reading device 10 that will be the source of the read image indicated by the selection result).

[0025] <Step S110> The learning data server 20 sends an augmentation generation request to the image reading device 10a, which is the recipient of the generation request, which includes a set of augmented image processing parameters generated from the received image processing parameter generation conditions, and sensor data identification information corresponding to the read image to be augmented.

[0026] <Steps S111, S112> The image reading device 10a generates an augmented reading image by performing image processing on the sensor data using the augmentation image processing parameter set included in the received augmentation generation request. The image reading device 10a then transmits the augmented reading image to the learning data server 20.

[0027] <Step S113> The learning data server 20 sends an augmentation generation request to the image reading device 10b, which is the recipient of the generation request, which includes a set of augmented image processing parameters generated from the received image processing parameter generation conditions, and sensor data identification information corresponding to the read image to be augmented.

[0028] <Steps S114, S115> The image reading device 10b generates an augmented reading image by performing image processing on the sensor data using the augmentation image processing parameter set included in the received augmentation generation request. The image reading device 10b then transmits the augmented reading image to the learning data server 20.

[0029] <Step S116> When the learning data server 20 receives an augmented image, it sends a notification to the user terminal 30 indicating that the generation of the augmented image is complete.

[0030] (Hardware configuration of the image reading device) Figure 3 shows an example of the hardware configuration of the image reading device according to this embodiment. The hardware configuration of the image reading device 10 according to this embodiment will be described with reference to Figure 3. Here, the image reading device 10 will be described as an MFP (Multifunction Printer).

[0031] As shown in Figure 3, the image reading device 10 is configured such that the controller 600, the operation display unit 610, the FCU (Facsimile Control Unit) 620, the plotter 631, and the scanner 632 are connected via a PCI (Peripheral Component Interface) bus.

[0032] The controller 600 is a device that controls the overall control, drawing, communication, and input from the operation display unit 610 of the image reading device 10.

[0033] The operation display unit 610 is, for example, a touch panel, and is a device that accepts input to the controller 600 (input function) and displays the status of the image reading device 10, etc. (display function). The operation display unit 610 is directly connected to the ASIC (Application Specific Integrated Circuit) 606, which will be described later.

[0034] The FCU620 is a device that implements fax functionality and is connected to the ASIC606, for example, via a PCI bus.

[0035] The plotter 631 is a device that provides printing functionality. The plotter 631 is connected to the ASIC 606, for example, via a PCI bus.

[0036] Scanner 632 is a component that implements the scanning function and is connected to ASIC 606, for example, by a PCI bus. Scanner 632 includes the reading sensor of the image reading device 10 described above.

[0037] As shown in Figure 3, the controller 600 includes a CPU (Central Processing Unit) 601, a system memory (MEM-P) 602, a northbridge (NB) 603, a southbridge (SB) 604a, a network interface 604b, a USB interface 604c, a Centronics interface 604d, a sensor interface 604e, an ASIC 606, a local memory (MEM-C) 607, and an auxiliary storage device 608.

[0038] The CPU 601 is an arithmetic unit that performs overall control of the image reading device 10. The CPU 601 is connected to a chipset consisting of system memory 602, northbridge 603, and southbridge 604a, and is connected to other devices via this chipset.

[0039] System memory 602 is a memory used for storing programs and data, for expanding programs and data, and for drawing printer data, etc., and has ROM (Read Only Memory) and RAM (Random Access Memory). Of these, ROM is a read-only memory used for storing programs and data, and RAM is a writable and readable memory used for expanding programs and data, and for drawing printer data, etc.

[0040] The Northbridge 603 is a bridge for connecting the CPU 601 with the system memory 602, the Southbridge 604a, and the AGP (Accelerated Graphics Port) bus 605. It includes a memory controller that controls reading and writing to the system memory 602, as well as a PCI master and an AGP target.

[0041] The Southbridge 604a is a bridge that connects the Northbridge 603 to PCI devices and peripheral devices. The Southbridge 604a is connected to the Northbridge 603 via the PCI bus, to which the Network I / F 604b, USB I / F 604c, Centronics I / F 604d, and Sensor I / F 604e are connected.

[0042] The AGP bus 605 is a bus interface for graphics accelerator cards proposed to accelerate graphics processing. The AGP bus 605 speeds up graphics accelerator cards by providing high-throughput direct access to system memory 602.

[0043] The ASIC606 is an integrated circuit (IC) for image processing applications that has hardware elements for image processing, and acts as a bridge connecting the AGP bus 605, PCI bus, auxiliary storage device 608, and local memory 607, respectively. The ASIC606 consists of a PCI target and an AGP master, an arbiter (ARB) which is the core of the ASIC606, a memory controller that controls the local memory 607, multiple DMACs (Direct Memory Access Controllers) that perform image data rotation etc. using hardware logic, and a PCI unit that performs data transfer via the PCI bus between the plotter 631 and scanner 632. For example, the FCU620, plotter 631, and scanner 632 are connected to the ASIC606 via the PCI bus.

[0044] Local memory 607 is memory used as a copy image buffer and a code buffer.

[0045] The auxiliary storage device 608 is a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), SD (Secure Digital) card, or flash memory, and is used for storing image data, programs, font data, and forms.

[0046] Note that the hardware configuration of the image reading device 10 shown in Figure 3 is just one example, and it is not necessary to have all of the components, nor is it possible to include other components. For example, the image reading device 10 may be equipped with an ADF (Automatic Document Feeder), etc.

[0047] (Hardware configuration of the training data server) Figure 4 shows an example of the hardware configuration of the learning data server according to this embodiment. The hardware configuration of the learning data server according to this embodiment will be described with reference to Figure 4.

[0048] As shown in Figure 4, the learning data server 20 includes a CPU 501, ROM 502, RAM 503, auxiliary storage device 505, media drive 507, display 508, network I / F 509, keyboard 511, mouse 512, and DVD (Digital Versatile Disc) drive 514.

[0049] The CPU 501 is a processing unit that controls the overall operation of the learning data server 20. The ROM 502 is a non-volatile memory device that stores programs such as the IPL (Initial Program Loader) that are initially executed by the CPU 501. The RAM 503 is a volatile memory device used as the work area for the CPU 501.

[0050] The auxiliary storage device 505 is a non-volatile storage device that stores various data such as programs. The auxiliary storage device 505 is, for example, an HDD or an SSD.

[0051] The media drive 507 is a device that controls the reading or writing of data to or from a recording medium 506, such as flash memory.

[0052] Display 508 is a liquid crystal display (LCD) or an organic EL (electro-luminescence) display, etc., that displays various information such as cursors, menus, windows, characters, or images.

[0053] Network I / F509 is an interface for data communication using network N. Network I / F509 is, for example, a NIC (Network Interface Card) that enables communication using the TCP (Transmission Control Protocol) / IP (Internet Protocol) protocol. Network I / F509 may also be a communication interface with wireless communication capabilities based on standards such as Wi-Fi (registered trademark).

[0054] Keyboard 511 is an example of an input device equipped with multiple keys for inputting characters, numbers, various instructions, etc. Mouse 512 is a type of input device used for selecting and executing various instructions, selecting processing targets, moving the cursor, etc.

[0055] The DVD drive 514 is a device that controls the reading or writing of various types of data to a DVD 513, which is an example of a removable storage medium. The DVD 513 is, for example, a DVD-RW (Digital Versatile Disk Rewritable), a DVD-R (Digital Versatile Disk Recordable), a CD-RW (Compact Disc Rewritable), or a CD-R (Compact Disc Recordable).

[0056] The CPU 501, ROM 502, RAM 503, auxiliary storage device 505, media drive 507, display 508, network interface 509, keyboard 511, mouse 512, and DVD drive 514 are all connected to each other via bus lines 510, such as an address bus and a data bus, enabling them to communicate with one another.

[0057] Note that the hardware configuration of the learning data server 20 shown in Figure 4 is just one example, and it is not necessary to have all the components, nor is it necessary to have other components. The hardware configuration of the user terminal 30 should also be similar to the configuration shown in Figure 4.

[0058] (Configuration and operation of the functional blocks of the image reading device) Figure 5 shows an example of the configuration of the functional block of the image reading device according to this embodiment. Figure 6 shows an example of the sensor data database. The configuration and operation of the functional block of the image reading device 10 according to this embodiment will be described with reference to Figures 5 and 6.

[0059] As shown in Figure 5, the image reading device 10 includes a transmission unit 101, a reception unit 102 (request reception unit), a reading control unit 103, an augmentation control unit 104, a parameter specification unit 105, an image processing unit 106, an input unit 107, and a storage unit 108 (first storage unit).

[0060] The transmission unit 101 is a functional unit that transmits the read image generated by the image processing unit 106, sensor data identification information that identifies the sensor data obtained from the reading sensor, and device identification information (second identification information) that identifies the image reading device 10 to the learning data server 20 via the network interface 604b. The transmission unit 101 also transmits the augmented read image generated by the image processing unit 106 to the learning data server 20 via the network interface 604b. Note that, as will be described later, if the sensor data includes sensor data identification information, the transmission unit 101 may omit transmitting the sensor data identification information.

[0061] The receiving unit 102 is a functional unit that receives a data augmentation generation request from the learning data server 20 via the network interface 604b, which includes a set of image processing parameters for augmentation and sensor data identification information corresponding to the read image to be augmented.

[0062] The reading control unit 103 is a functional unit that controls the reading operation. The reading control unit 103 is an example of an acquisition unit. Specifically, the reading control unit 103 causes the reading sensor to perform a reading operation on the document, acquires sensor data from the reading sensor, and outputs it to the image processing unit 106. The reading control unit 103 also associates the acquired sensor data with sensor data identification information (first identification information) that identifies the sensor data, and stores it in the sensor data DB shown in Figure 6 in the storage unit 108.

[0063] As shown in Figure 6, the sensor data database is a database that manages sensor data in association with sensor data identification information (e.g., the file name of the sensor data) that identifies the sensor data. The sensor data managed in the sensor data database may also be the path on the storage unit 108 where the sensor data is stored. The method of associating sensor data with sensor data identification information is not limited to this. For example, adding information such as the file name and the date and time the sensor data was created as metadata to the sensor data also constitutes associating sensor data with sensor data identification information. In other words, the sensor data may have sensor data identification information as metadata.

[0064] The image augmentation control unit 104 is a functional unit that controls the processing related to image augmentation in response to an image augmentation generation request received by the receiving unit 102. Specifically, the image augmentation control unit 104 outputs the set of image processing parameters for image augmentation included in the image augmentation generation request to the parameter specification unit 105. The image augmentation control unit 104 also notifies the image processing unit 106 of the sensor data identification information included in the image augmentation generation request.

[0065] The parameter specification unit 105 is a functional unit that specifies (notifies) the image processing parameters to be used for image processing to the image processing unit 106. Specifically, during normal reading, the parameter specification unit 105 notifies the image processing unit 106 of the image processing parameters used for normal reading. Also, when generating augmented reading images, the parameter specification unit 105 notifies the image processing unit 106 of the set of augmentation image processing parameters received from the augmentation control unit 104.

[0066] The image processing unit 106 is an example of a processing unit. The image processing unit 106 is a functional unit that performs image processing, which is an example of information processing, on sensor data using image processing parameters, which are an example of parameters, and generates a read image. Specifically, during normal reading, the image processing unit 106 performs image processing on the sensor data received from the read control unit 103 using image processing parameters used for normal reading specified by the parameter specification unit 105, and generates a read image (first read image). Here, the read image is an example of data, and the first read image may be referred to as the first data. The image processing unit 106 then sends the generated read image and the sensor data identification information of the sensor data used to obtain the read image to the transmission unit 101. The image processing unit 106 may also generate a read image to which the sensor data identification information is attached as metadata. For example, the file name of the read image may be set to be the same as the file name of the sensor data. This makes it possible to omit the process of sending the sensor data identification information to the transmission unit 101. Furthermore, when generating an augmented reading image, the image processing unit 106 reads the sensor data indicated by the sensor data identification information notified by the augmentation control unit 104 from the sensor data DB in the storage unit 108, and performs image processing on the sensor data using the augmentation image processing parameter set specified by the parameter specification unit 105 to generate an augmented reading image (second reading image). Note that the augmented reading image is an example of augmented data, and the second reading image may be referred to as the second data. The image processing unit 106 then sends the generated augmented reading image to the transmission unit 101.

[0067] The input unit 107 is a functional unit that receives operation input from the device user. For example, during normal reading, the input unit 107 receives operation from the device user to specify image processing parameters to be used for image processing. The input unit 107 is implemented by the operation display unit 610 shown in Figure 3.

[0068] The memory unit 108 is a functional unit that stores sensor data DB and the like. The memory unit 108 is implemented by the auxiliary storage device 608 shown in Figure 3.

[0069] The above-mentioned transmitting unit 101, receiving unit 102, reading control unit 103, augmentation control unit 104, parameter specification unit 105, and image processing unit 106 are implemented, for example, by a program executed by the CPU 601 shown in Figure 3. The transmitting unit 101, receiving unit 102, reading control unit 103, augmentation control unit 104, parameter specification unit 105, and image processing unit 106 may be implemented by hardware such as integrated circuits, or by a combination of software and hardware.

[0070] It should be noted that the functional units of the image reading device 10 shown in Figure 5 are conceptual representations of their functions and are not limited to this configuration. For example, multiple functional units shown as independent functional units in the image reading device 10 in Figure 5 may be configured as a single functional unit. Alternatively, the functions of a single functional unit in the image reading device 10 shown in Figure 5 may be divided into multiple functions and configured as multiple functional units. Furthermore, each functional unit of the image reading device 10 does not need to be configured as a clear software module as a block as shown in Figure 5; the functions of each functional unit as a whole may be realized by the execution of a program in the image reading device 10.

[0071] (Configuration and operation of the functional blocks of the learning data server) Figure 7 shows an example of the configuration of the functional blocks of the learning data server according to this embodiment. Figure 8 shows an example of the parameter condition setting screen. Figure 9 shows an example of the image processing parameter set for augmentation. Figure 10 shows an example of the read image database. Figure 11 shows an example of augmented read images. The configuration and operation of the functional blocks of the learning data server 20 according to this embodiment will be explained with reference to Figures 7 to 11.

[0072] As shown in Figure 7, the learning data server 20 includes a first receiving unit 201 (receiving unit), a first transmitting unit 202, a second receiving unit 203, a second transmitting unit 204, a parameter set generation unit 205 (generation unit), an augmentation request unit 206 (request unit), an image storage unit 207, and an augmentation storage unit 208 (second storage unit).

[0073] The first receiving unit 201 is a functional unit that receives from the image reading device 10 via the network I / F 509 the read image generated by the image reading device 10, sensor data identification information of the sensor data corresponding to the read image, and device identification information that identifies the image reading device 10. The first receiving unit 201 then associates the received read image, sensor data identification information, and device identification information and stores them in the read image DB shown in Figure 10 in the image storage unit 207.

[0074] As shown in Figure 10, the read image database is a database that manages read images, sensor data identification information that identifies the sensor data used to generate the read image, and device identification information that identifies the image reading device 10 that generated the read image, in association with each other. The read images managed in the read image database may also be defined as paths on the image storage unit 207 where the read images are stored.

[0075] Furthermore, the first receiving unit 201 receives the augmented read images generated by the image reading device 10 from the image reading device 10 via the network I / F 509. The first receiving unit 201 then stores the received augmented read images in the augmentation storage unit 208.

[0076] The first transmission unit 202 is a functional unit that transmits the augmentation generation request generated by the augmentation request unit 206 to the image reading device 10 via the network I / F 509. Here, the first transmission unit 202 identifies the image reading device 10 to which the augmentation generation request should be sent based on the device identification information received from the augmentation request unit 206, and transmits the augmentation generation request to the identified image reading device 10. The augmentation generation request also includes an augmentation image processing parameter set generated by the parameter set generation unit 205, and sensor data identification information.

[0077] The second receiving unit 203 is a functional unit that receives the selection result of the image to be augmented and the image processing parameter generation conditions used for augmentation from the user terminal 30 via the network I / F 509. The second receiving unit 203 then outputs the received selection result to the augmentation request unit 206 and outputs the image processing parameter generation conditions to the parameter set generation unit 205.

[0078] Here, the parameter condition setting screen 1000 for setting image processing parameter generation conditions on the user terminal 30 will be explained with reference to Figure 8. As shown in Figure 8, the parameter condition setting screen 1000 includes a minimum density setting area 1001a, a maximum density setting area 1001b, a color type setting area 1002, a document type setting area 1003, an automatic color adjustment setting area 1004, a resolution setting area 1005, a minimum scaling setting area 1006a, a maximum scaling setting area 1006b, a scaling interval setting area 1006c, and an OK button 1011.

[0079] The minimum density setting area 1001a is the area where the minimum density value in image processing is set. The maximum density setting area 1001b is the area where the maximum density value in image processing is set.

[0080] The color type setting area 1002 is for setting the color type (monochrome, color) in image processing. The document type setting area 1003 is for setting the document type (text, diagrams, photographs). The automatic color adjustment setting area 1004 is for setting whether automatic color adjustment in image processing is ON or OFF. The resolution setting area 1005 is for setting the resolution in image processing (e.g., 100 [dpi], 300 [dpi], 600 [dpi]).

[0081] The minimum scaling value setting area 1006a is the area for setting the minimum scaling value in image processing. The maximum scaling value setting area 1006b is the area for setting the maximum scaling value in image processing. The scaling interval setting area 1006c is the area for setting the scaling interval in image processing.

[0082] The OK button 1011 is used to create image processing parameter generation conditions based on the settings configured in each of the above settings areas. When the OK button 1011 is pressed by the user of the training data, the user terminal 30 creates image processing parameter generation conditions based on the settings configured in each of the above settings areas and sends them to the training data server 20.

[0083] Note that the settings shown in the parameter condition setting screen 1000 in Figure 7 are just an example, and the image processing parameter generation conditions may include only some of these, or may include other settings as well.

[0084] The second transmission unit 204 is a functional unit that reads the image from the image storage unit 207 in response to a viewing operation from the user terminal 30, and transmits the read image to the user terminal 30 via the network interface 509.

[0085] The parameter set generation unit 205 is a functional unit that generates an augmented image processing parameter set from the image processing parameter generation conditions received from the second transmission unit 204. For example, the parameter set generation unit 205 generates an augmented image processing parameter set based on the combination of image processing parameters indicated by the image processing parameter generation conditions. The parameter set generation unit 205 outputs the generated augmented image processing parameter set to the augmentation request unit 206. The augmented image processing parameter set shown as an example in Figure 9 is a set of augmented image processing parameters generated by the parameter set generation unit 205 based on the combination of image processing parameters set in the parameter condition setting screen 1000 shown in Figure 8.

[0086] The augmentation request unit 206 is a functional unit that generates an augmentation generation request to request the image reading device 10 to augment a predetermined number of read images. Specifically, the augmentation request unit 206 refers to the read image DB in the image storage unit 207 and reads out device identification information and sensor data identification information corresponding to the read image indicated by the selection result received from the second receiving unit 203. Here, for example, the file name of the read image indicated by the selection result can be used to read out the device identification information and sensor data identification information from the read image DB. The augmentation request unit 206 then generates an augmentation generation request that includes the read sensor data identification information and the augmentation image processing parameter set received from the parameter set generation unit 205. The augmentation request unit 206 then outputs the read device identification information and the generated augmentation generation request to the first transmission unit 202.

[0087] The image storage unit 207 is a functional unit that stores the read image database, etc. The image storage unit 207 is implemented by the auxiliary storage device 505 shown in Figure 4.

[0088] The augmentation storage unit 208 is a functional unit that stores augmented read images generated by the image reading device 10, which are received by the first receiving unit 201. The augmentation storage unit 208 is implemented by the auxiliary storage device 505 shown in Figure 4. Note that the augmentation storage unit 208 and the image storage unit 207 may be implemented by different storage devices, rather than the same storage device (in this case, the auxiliary storage device 505).

[0089] Here, Figure 11 shows an example of an augmented read image received by the first receiving unit 201 and stored in the augmentation storage unit 208. Figure 11(a) shows an example of a read image designated (selected) as the target for augmentation, and Figure 11(b) shows an example of an augmented read image generated by image processing using a set of augmentation image processing parameters that indicate enlargement / reduction, brightness, rotation, etc.

[0090] The augmented images stored in the augmentation memory unit 208 are used as training data for machine learning.

[0091] The first receiving unit 201, first transmitting unit 202, second receiving unit 203, second transmitting unit 204, parameter set generation unit 205, and augmentation request unit 206 described above are implemented, for example, by the execution of a program by the CPU 501 shown in Figure 4. The first receiving unit 201, first transmitting unit 202, second receiving unit 203, second transmitting unit 204, parameter set generation unit 205, and augmentation request unit 206 may be implemented by hardware such as integrated circuits, or by a combination of software and hardware.

[0092] Note that the functional units of the learning data server 20 shown in Figure 7 are conceptual representations of their functions and are not limited to this configuration. For example, multiple functional units shown as independent functional units in the learning data server 20 in Figure 7 may be configured as a single functional unit. Alternatively, the functions of one functional unit in the learning data server 20 shown in Figure 7 may be divided into multiple functions and configured as multiple functional units. Furthermore, each functional unit of the learning data server 20 does not need to be configured as a clear software module as a block as shown in Figure 7; the functions of each functional unit as a whole may be realized by the execution of a program on the learning data server 20.

[0093] (Flow of the image reading device's reading operation) Figure 12 is a sequence diagram showing an example of the reading operation flow of the image reading device according to this embodiment. The reading operation of the image reading device 10 according to this embodiment will be described with reference to Figure 12.

[0094] <Steps S11, S12> The device user performs image processing parameter setting operations on the input unit 107. The input unit 107 then sends the set image processing parameters to the parameter specification unit 105.

[0095] <Steps S13, S14> The device user then performs a read operation on the input unit 107. The input unit 107 then sends an image read execution command to the read control unit 103, which commands the execution of the read operation.

[0096] <Steps S15~S17> The reading control unit 103, in accordance with the image reading execution command, causes the reading sensor to perform a reading operation on the document and acquires sensor data from the reading sensor. The reading control unit 103 then associates the acquired sensor data with sensor data identification information that identifies the sensor data and stores it in the sensor data DB in the storage unit 108.

[0097] <Step S18> Furthermore, the reading control unit 103 outputs the acquired sensor data and sensor data identification information that identifies the sensor data to the image processing unit 106.

[0098] <Step S19> When the image processing unit 106 receives sensor data and sensor data identification information, it requests image processing parameters from the parameter specification unit 105.

[0099] <Step S20> The parameter specification unit 105 outputs image processing parameters to the image processing unit 106 in response to a request from the image processing unit 106.

[0100] <Step S21> The image processing unit 106 performs image processing on the sensor data received from the reading control unit 103 using the image processing parameters received from the parameter specification unit 105 to generate a read image. The image processing unit 106 may also count the number of times each image processing parameter has been used for image processing and store this count in the storage unit 108.

[0101] <Step S22> The image processing unit 106 sends the generated read image and the sensor data identification information of the sensor data used to obtain the read image to the transmission unit 101.

[0102] <Step S23> The transmission unit 101 is a functional unit that transmits the read image generated by the image processing unit 106, sensor data identification information that identifies sensor data obtained from the reading sensor, and device identification information that identifies the image reading device 10 to the learning data server 20 via the network interface 604b.

[0103] (Image reading device's operation to generate augmented images) Figure 13 is a sequence diagram showing an example of the flow of the augmented image generation operation of the image reading device according to this embodiment. The flow of the augmented image generation operation of the image reading device 10 according to this embodiment will be explained with reference to Figure 13.

[0104] <Steps S31, S32> The receiving unit 102 receives an augmentation generation request from the learning data server 20 via the network interface 604b, which includes a set of image processing parameters for augmentation and sensor data identification information corresponding to the read image to be augmented. The receiving unit 102 then outputs the augmentation generation request to the augmentation control unit 104.

[0105] <Steps S33, S34> The augmentation control unit 104 outputs the set of image processing parameters for augmentation included in the augmentation generation request to the parameter specification unit 105. The augmentation control unit 104 also notifies the image processing unit 106 of the sensor data identification information included in the augmentation generation request.

[0106] <Steps S35, S36> The image processing unit 106 refers to the sensor data DB in the storage unit 108 and reads the sensor data indicated by the sensor data identification information notified by the augmentation control unit 104 from the sensor data DB.

[0107] <Step S37> The image processing unit 106 requests image processing parameters from the parameter specification unit 105.

[0108] <Step S38> Then, the parameter specification unit 105 notifies the image processing unit 106 of the set of image processing parameters for augmentation that it received from the augmentation control unit 104 in response to the request.

[0109] <Step S39> The image processing unit 106 performs image processing on the sensor data read from the sensor data DB of the storage unit 108 using the augmentation image processing parameter set notified by the parameter specification unit 105, and generates an augmented read image.

[0110] Furthermore, in step S21 shown in Figure 12, if the memory unit 108 stores the number of times each image processing parameter has been used for image processing, the image processing unit 106 may determine the number of augmented read images to be generated using that image processing parameter, according to the number of times that the image processing parameter included in the augmented image processing parameter set has been stored in the memory unit 108. In this case, the image processing unit 106 may add noise similar to the noise generated during the reading operation by the reading sensor to the sensor data, and then generate the above number of augmented read images. This makes it possible to increase the number of augmented read images generated for image processing parameters that are frequently used by the device user.

[0111] <Steps S40~S45> The image processing unit 106 sequentially generates augmented read images using an augmentation image processing parameter set and sends them to the transmission unit 101. The transmission unit 101 then transmits these augmented read images to the learning data server 20 via the network interface 604b.

[0112] (Operation flow of the learning data server) Figure 14 is a sequence diagram showing an example of the operation flow of the learning data server according to this embodiment. The operation flow of the learning data server 20 according to this embodiment will be explained with reference to Figure 14.

[0113] <Step S51> The first receiving unit 201 receives from the image reading device 10 via the network I / F 509 the read image generated by the image reading device 10, sensor data identification information for the sensor data corresponding to the read image, and device identification information for identifying the image reading device 10.

[0114] <Steps S52, S53> The first receiving unit 201 associates the received read image, sensor data identification information, and device identification information, and stores them in the read image DB in the image storage unit 207.

[0115] <Step S54> The user terminal 30 sends a request to the learning data server 20 to view the image read by the image reading device 10, in accordance with the operation performed by the learning data user.

[0116] <Steps S55, S56> When the second receiving unit 203 receives a request to view a read image, it reads the read image from the read image DB in the image storage unit 207 and sends the read image to the second transmitting unit 204.

[0117] <Step S57> The second transmission unit 204 transmits the read image read from the read image DB of the image storage unit 207 to the user terminal 30 via the network interface 509. The user terminal 30 then displays the read image received from the learning data server 20 on the display 508 of the user terminal 30.

[0118] <Step S58> The user of the training data selects the image to be augmented from the list of read images displayed on the display 508 of the user terminal 30. The user of the training data also sets the image processing parameter generation conditions on the parameter condition setting screen 1000 displayed on the display 508 of the user terminal 30.

[0119] <Step S59> The user terminal 30 sends the image processing parameter generation conditions set on the parameter condition setting screen 1000 to the learning data server 20. The second receiving unit 203 then receives these image processing parameter generation conditions via the network interface 509.

[0120] <Step S60> The second receiving unit 203 outputs the received image processing parameter generation conditions to the parameter set generation unit 205.

[0121] <Steps S61, S62> The parameter set generation unit 205 generates an augmented image processing parameter set from the image processing parameter generation conditions received from the second transmission unit 204. The parameter set generation unit 205 then outputs the generated augmented image processing parameter set to the augmentation request unit 206.

[0122] <Step S63> Furthermore, the user terminal 30 transmits the selection result of the images to be augmented, selected by the learning data user, to the learning data server 20. The second receiving unit 203 then receives this selection result via the network interface 509.

[0123] <Step S64> The second receiving unit 203 outputs the received selection result to the augmentation request unit 206.

[0124] <Step S65, S66> The augmentation request unit 206 refers to the read image DB in the image storage unit 207 and reads out the device identification information and sensor data identification information corresponding to the read image indicated by the selection result received from the second receiving unit 203.

[0125] <Step S67> The augmentation request unit 206 generates an augmentation generation request that includes the read sensor data identification information and the augmentation image processing parameter set received from the parameter set generation unit 205. The augmentation request unit 206 then outputs the read device identification information and the generated augmentation generation request to the first transmission unit 202.

[0126] <Step S68> The first transmission unit 202 transmits the augmentation generation request received from the augmentation request unit 206 to the image reading device 10 via the network I / F 509.

[0127] As described above, in the information processing system 1 according to this embodiment, the reading control unit 103 causes the reading sensor to perform a reading operation on the document and acquires the sensor data read by the reading sensor, the storage unit 108 stores the sensor data in association with sensor data identification information that identifies the sensor data, the image processing unit 106 generates a read image by image processing using predetermined image processing parameters on the sensor data, the transmission unit 101 transmits the read image to the learning data server 20, the first receiving unit 201 receives the read image transmitted by the transmission unit 101, and the parameter set generation unit 205 receives the first receiving unit 201 The image processing unit 206 generates a set of image processing parameters for augmenting the image selected by the user terminal 30 from among the transmitted read images. The augmentation request unit 206 requests the image reading device 10 to augment the read image using the set of image processing parameters for augmentation and sensor data identification information corresponding to the read image selected by the user terminal 30. When the image processing unit 106 receives the request, it reads the sensor data corresponding to the sensor data identification information in the request from the storage unit 108 and generates an augmented read image by image processing of the sensor data using the set of image processing parameters for augmentation in the request. This makes it possible to generate an augmented image without damaging the read result without outputting sensor data to the outside from the image reading device.

[0128] Furthermore, the program executed by the image reading device 10 and learning data server 20 of the above-described embodiment may be configured to be pre-installed and provided in ROM or the like. Alternatively, the program executed by the image reading device 10 and learning data server 20 of the above-described embodiment may be configured to be provided as a computer program product by recording it in an installable or executable file format on a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory), flexible disk (FD), CD-R (Compact Disk-Recordable), or DVD (Digital Versatile Disk). Alternatively, the program executed by the image reading device 10 and learning data server 20 of the above-described embodiment may be stored on a computer connected to a network such as the Internet and provided by allowing download via the network. Finally, the program executed by the image reading device 10 and learning data server 20 of the above-described embodiment may be provided or distributed via a network such as the Internet.

[0129] Furthermore, the program executed by the image reading device 10 and the learning data server 20 in the above-described embodiment has a modular configuration that includes each of the functional units described above. In actual hardware, the CPU (processor) reads the program from ROM and executes it, thereby loading each of the functional units onto the main memory, and creating each functional unit on the main memory.

[0130] The embodiments of the present invention are as follows. <1> An image processing system including an image processing device for reading images and a server device for managing image augmentation, The aforementioned image processing device is A reading control unit that performs a reading operation on a document using a reading sensor and acquires sensor data read by the reading sensor, A first storage unit that stores the sensor data and a first identification information that identifies the sensor data in association, An image processing unit that generates a first read image by image processing using predetermined image processing parameters on the sensor data, A transmission unit that transmits the aforementioned first read image to the server device, Equipped with, The server device is A receiving unit receives the first read image transmitted by the transmitting unit, A generation unit generates a set of image processing parameters for augmenting the first read image selected by the user terminal from among the first read images received by the receiving unit, A request unit that requests the image processing device to augment the first read image based on the aforementioned set and the first identification information corresponding to the first read image selected by the user terminal, Equipped with, The image processing unit is an image processing system that, upon receiving a request, reads the sensor data corresponding to the first identification information in the request from the first storage unit and generates a second read image by image processing of the sensor data using the set in the request. <2> The transmission unit transmits the second read image generated by the image processing unit to the server device. The server device further comprises a second storage unit for storing the second read image transmitted by the transmission unit. <1> This is the image processing system described in [reference]. <3> The generation unit generates the set according to the generation conditions of the image processing parameters determined by the user terminal. <1> or <2> This is the image processing system described in [reference]. <4> The transmitting unit transmits the first identification information, the first read image indicated by the first identification information, and the second identification information for identifying the image processing device to the server device. The receiving unit receives the first identification information, the first read image, and the second identification information transmitted by the transmitting unit. The request unit makes the request to the image processing device identified by the second identification information, which corresponds to the first read image selected by the user terminal. <1> ~ <3> The image processing system is one of the systems described in any one of the items. <5> The second read image is used as training data for machine learning. <1> ~ <4> The image processing system is one of the systems described in any one of the items. <6> The aforementioned image processing unit, For each image processing parameter, count the number of times it was used to generate the first read image. The number of second read images to be generated is determined according to the number of times the image processing parameters included in the set are treated. <1> ~ <5> The image processing system is one of the systems described in any one of the items. <7> The image processing unit adds noise similar to the noise generated by the reading operation of the reading sensor to the sensor data, and then generates the second reading image for the specified number of times. <6> This is the image processing system described in [reference]. <8> A reading control unit that performs a reading operation on a document using a reading sensor and acquires sensor data read by the reading sensor, A first storage unit that stores the sensor data and a first identification information that identifies the sensor data in association, An image processing unit that generates a first read image by image processing using predetermined image processing parameters on the sensor data, A transmission unit that transmits the aforementioned first read image to a server device, A request receiving unit receives a request from the server device for augmenting the first read image based on a set of image processing parameters for augmenting the first read image selected by the user terminal and the first identification information corresponding to the first read image. Equipped with, The image processing unit is an image processing device that, when the request is received by the request receiving unit, reads the sensor data corresponding to the first identification information in the request from the first storage unit and generates a second read image by image processing of the sensor data using the set in the request. <9> An image processing method for an image processing system, comprising an image processing device for reading images and a server device for managing image augmentation, The image processing device performs a reading operation on the document using a reading sensor and acquires sensor data read by the reading sensor in a reading control step. The image processing device performs a first storage step of associating the sensor data with first identification information that identifies the sensor data and storing it in a first storage unit, Image processing step of generating a first read image by image processing using predetermined image processing parameters on the sensor data, The image processing device performs a transmission step of transmitting the first read image to the server device, The server device receives the first read image transmitted in the transmission step, The server device performs a generation step in which it generates a set of image processing parameters for augmenting the first read image selected by the user terminal from among the first read images received in the reception step, A request step in which the server device requests the image processing device to augment the first read image based on the set and the first identification information corresponding to the first read image selected by the user terminal, When the image processing device receives the request, it reads the sensor data corresponding to the first identification information in the request from the first storage unit, and generates a second read image by image processing of the sensor data using the set in the request. This is an image processing method that has [a certain characteristic]. <10> On the computer, A reading control step involves causing a reading operation to be performed on the document using a reading sensor and acquiring the sensor data read by the reading sensor. A storage step of associating the sensor data with first identification information that identifies the sensor data and storing it in a first storage unit, Image processing step of generating a first read image by image processing using predetermined image processing parameters on the sensor data, A transmission step of sending the aforementioned first read image to the server device, A request receiving step of receiving a request from the server device for augmenting the first read image based on a set of image processing parameters for augmenting the first read image selected by the user terminal and the first identification information corresponding to the first read image, When the aforementioned request is received, the steps include: reading the sensor data corresponding to the first identification information in the request from the first storage unit, and generating a second read image by image processing of the sensor data using the set in the request; This is a program to execute [the command / action]. <11> On the computer, An acquisition step in which sensor data is acquired by the sensor, A storage step of associating the sensor data with first identification information that identifies the sensor data and storing it in a first storage unit, A processing step of generating first data by information processing using predetermined parameters on the sensor data, A transmission step of sending the aforementioned first data to the server device, A request receiving step of receiving a request from the server device for augmenting the first data selected by the user terminal, based on a set of parameters for augmenting the first data and the first identification information corresponding to the first data, When the aforementioned request is received, the steps include reading the sensor data corresponding to the first identification information in the request from the first storage unit, and generating second data by information processing of the sensor data using the set in the request, This is a program to execute [the command / action]. [Explanation of symbols]

[0131] 1. Information Processing System 10, 10a, 10b Image reading device 20. Training data server 30 User terminals 101 Transmitter 102 Receiving Unit 103 Reading Control Unit 104 Increasing Control Unit 105 Parameter specification section 106 Image Processing Unit 107 Input section 108 Storage section 201 First Receiving Unit 202 First Transmitter 203 Second Receiving Unit 204 Second Transmitter 205 Parameter set generation unit 206 Inflated Request Section 207 Image storage unit 208 Storage Unit for Amplification 501 CPU 502 ROM 503 RAM 505 Auxiliary storage 506 Recording media 507 Media Drive 508 displays 509 Network Interface 510 Bus Line 511 keyboard 512 mice 513 DVD 514 DVD drive 600 Controllers 601 CPU 602 System Memory (MEM-P) 603 Northbridge (NB) 604a Southbridge (SB) 604b Network Interface 604c USB I / F 604d Centronics I / F 604e Sensor I / F 605 AGP 606 ASIC 607 Local Memory (MEM-C) 608 Auxiliary storage 610 Operation display section 620 FCU 631 Plotter 632 Scanners 1000 Parameter Condition Setting Screen 1001a Minimum concentration setting region 1001b Maximum concentration setting range 1002 Color type setting area 1003 Document Type Setting Area 1004 Automatic color adjustment settings area 1005 Resolution setting area 1006a Minimum multiplication value setting area 1006b Maximum multiplication setting area 1006c Variable multiplication interval setting area 1011 OK button N Network [Prior art documents] [Patent Documents]

[0132] [Patent Document 1] Japanese Patent Publication No. 2004-234261 [Patent Document 2] Japanese Patent Publication No. 2021-047816

Claims

1. An image processing system including an image processing device for reading images and a server device for managing image augmentation, The aforementioned image processing device is A reading control unit that performs a reading operation on a document using a reading sensor and acquires sensor data read by the reading sensor, A first storage unit that stores the sensor data and first identification information that identifies the sensor data in association, An image processing unit that generates a first read image by image processing using predetermined image processing parameters on the sensor data, A transmission unit that transmits the first read image to the server device, Equipped with, The server device is The receiving unit receives the first read image transmitted by the transmitting unit, A generation unit generates a set of image processing parameters for augmenting the first read image selected by the user terminal from among the first read images received by the receiving unit, A request unit that requests the image processing device to augment the first read image based on the aforementioned set and the first identification information corresponding to the first read image selected by the user terminal, Equipped with, The image processing unit, upon receiving the request, reads the sensor data corresponding to the first identification information in the request from the first storage unit, and generates a second read image by image processing of the sensor data using the set in the request.

2. The transmission unit transmits the second read image generated by the image processing unit to the server device. The image processing system according to claim 1, further comprising a second storage unit for storing the second read image transmitted by the transmission unit, wherein the server device is further provided with the server device.

3. The image processing system according to claim 1 or 2, wherein the generation unit generates the set according to the generation conditions of image processing parameters determined by the user terminal.

4. The transmitting unit transmits the first identification information, the first read image indicated by the first identification information, and the second identification information that identifies the image processing device to the server device. The receiving unit receives the first identification information, the first read image, and the second identification information transmitted by the transmitting unit. The image processing system according to claim 1 or 2, wherein the request unit makes the request to the image processing device identified by the second identification information, which corresponds to the first read image selected by the user terminal.

5. The image processing system according to claim 1 or 2, wherein the second read image is used as training data for machine learning.

6. The aforementioned image processing unit, For each image processing parameter, count the number of times it was used to generate the first read image. The image processing system according to claim 1 or 2, which determines the number of second read images to be generated according to the number of times for the image processing parameters included in the set.

7. The image processing system according to claim 6, wherein the image processing unit adds noise similar to the noise generated by the reading operation by the reading sensor to the sensor data, and then generates the second reading image for the number of generated images.

8. A reading control unit that performs a reading operation on a document using a reading sensor and acquires sensor data read by the reading sensor, A first storage unit that stores the sensor data and first identification information that identifies the sensor data in association, An image processing unit that generates a first read image by image processing using predetermined image processing parameters on the sensor data, A transmission unit that transmits the first read image to a server device, A request receiving unit receives a request from the server device for augmenting the first read image based on a set of image processing parameters for augmenting the first read image selected by the user terminal and the first identification information corresponding to the first read image. Equipped with, The image processing unit, when the request is received by the request receiving unit, reads the sensor data corresponding to the first identification information in the request from the first storage unit, and generates a second read image by image processing of the sensor data using the set in the request.

9. An image processing method for an image processing system, comprising an image processing device for reading images and a server device for managing image augmentation, The image processing device performs a reading operation on the document using a reading sensor and acquires sensor data read by the reading sensor in a reading control step. The image processing device performs a first storage step of associating the sensor data with first identification information that identifies the sensor data and storing it in a first storage unit, Image processing step of generating a first read image by image processing using predetermined image processing parameters on the sensor data, The image processing device performs a transmission step of transmitting the first read image to the server device, The server device receives the first read image transmitted in the transmission step, The server device performs a generation step in which it generates a set of image processing parameters for augmenting the first read image selected by the user terminal from among the first read images received in the reception step, The server device makes a request to the image processing device to augment the first read image based on the set and the first identification information corresponding to the first read image selected by the user terminal, When the image processing device receives the request, it reads the sensor data corresponding to the first identification information in the request from the first storage unit, and generates a second read image by image processing of the sensor data using the set in the request. An image processing method having the following characteristics.

10. On the computer, A reading control step involves causing a reading operation to be performed on the document using a reading sensor and acquiring the sensor data read by the reading sensor. A storage step of associating the sensor data with first identification information that identifies the sensor data and storing it in a first storage unit, Image processing step of generating a first read image by image processing using predetermined image processing parameters on the sensor data, A transmission step of sending the aforementioned first read image to a server device, A request receiving step of receiving a request from the server device for augmenting the first read image based on a set of image processing parameters for augmenting the first read image selected by the user terminal and the first identification information corresponding to the first read image, When the aforementioned request is received, the steps include: reading the sensor data corresponding to the first identification information in the request from the first storage unit, and generating a second read image by image processing of the sensor data using the set in the request; A program to execute.

11. On the computer, An acquisition step in which sensor data is acquired by the sensor, A storage step of associating the sensor data with first identification information that identifies the sensor data and storing it in a first storage unit, A processing step of generating first data by information processing using predetermined parameters on the sensor data, A transmission step of sending the aforementioned first data to a server device, A request receiving step of receiving a request from the server device for augmenting the first data selected by the user terminal, based on a set of parameters for augmenting the first data and the first identification information corresponding to the first data, When the aforementioned request is received, the steps include reading the sensor data corresponding to the first identification information in the request from the first storage unit, and generating second data by information processing of the sensor data using the set in the request, A program to execute.

Images