Image processing apparatus, image transmission method, and program
By generating two images with different clarity and compression for image processing devices, the device addresses the challenge of large data sizes and unclear diagnostics, facilitating efficient transmission and diagnosis of image abnormalities.
Patent Information
- Application Number
- JP2023075311
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-28
- Publication Date
- 2024-11-08
AI Technical Summary
Existing image processing devices face challenges in efficiently transmitting image data with abnormalities due to large data sizes at high resolution, which can exceed email server capacities, and reducing resolution compromises image clarity, making it difficult to diagnose the cause of image abnormalities.
The device generates two images: a high-clarity image of the abnormal area and a lower-clarity image of the rest, with different compression rates and smoothing processes applied to each, ensuring efficient data transmission while maintaining diagnostic clarity.
This approach reduces the data size of the lower-clarity image while preserving high clarity in the abnormality image, enabling quick and efficient transmission and diagnosis of image issues.
Smart Images

Figure 2024159350000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing device, an image transmission method, and a program. [Background technology]
[0002] Image processing devices such as MFPs (Multifunction Peripherals) execute various jobs such as scan jobs, print jobs, and copy jobs. When these jobs are executed in the image processing device, image abnormalities may occur. For example, in the case of a scan job, streaky image stains may occur in image data generated by reading an image of an original (sheet). Similarly, in the case of a print job, streaky image stains may occur in an image formed on a sheet such as printing paper. However, image abnormalities that occur in the image processing device are not limited to streaky image stains, and various other abnormalities may occur.
[0003] Meanwhile, in recent years, service personnel at the service center have been communicating with users of the image processing devices via telephone lines to identify the cause of problems that have occurred with the image processing devices, and either instruct the users on how to replace parts or clean the devices themselves, or dispatch a service personnel to carry out maintenance work.
[0004] However, when an image abnormality occurs in an image processing device, it is difficult for a user without specialized knowledge to adequately explain the symptoms. Descriptions of image abnormalities tend to be abstract, and differ from person to person. For this reason, it is difficult for a service technician to identify the cause of the image abnormality by simply talking to the user.
[0005] Therefore, it is possible to adopt a method of reading an image with an image abnormality using a scan job of an image processing device, sending the image data to a service center, and diagnosing the actual image at the service center (for example, Patent Document 1). [Prior art documents] [Patent documents]
[0006] [Patent Document 1] JP 2000-278471 A Summary of the Invention [Problem to be solved by the invention]
[0007] However, when an image is scanned at a high resolution during a scan job, the amount of image data increases, which causes a problem that it takes a long time to transmit the image data. Also, when transmitting image data by attaching it to an e-mail, if the amount of image data exceeds the capacity of the e-mail server, there is a problem that the e-mail cannot be transmitted.
[0008] On the other hand, if the compression rate of the image data is increased or the resolution is reduced taking into account the transmission time of the image data or the capacity of the email server, the image becomes unclear, making it difficult to identify the cause of the image abnormality.
[0009] Another possible method is to extract and transmit only the portion of the image data in which the image abnormality occurs. However, in order to properly identify the cause of the image abnormality, it is preferable to analyze the entire image, rather than analyzing only the portion in which the image abnormality occurs.
[0010] Therefore, in order to solve the above-mentioned conventional problems, the present invention aims to provide an image processing device, an image transmission method, and a program that enable efficient transmission of the entire image in which an image abnormality has occurred when an image abnormality occurs. [Means for solving the problem]
[0011] In order to achieve the above object, the invention of claim 1 is an image processing device comprising an image reading unit that reads an image of a document and generates image data, an abnormal area detection unit that detects an abnormal area where an image abnormality occurs in the image data, an image generation unit that extracts an image of the abnormal area from the image data to generate a first image and generates a second image from the image data including areas other than the abnormal area, and a communication unit that transmits the first image and the second image to an image diagnostic device, wherein the image generation unit is configured to make the clarity of the first image higher than the clarity of the second image.
[0012] The invention according to claim 2 is the image processing device according to claim 1, characterized in that the image generation unit does not perform image compression on the first image, and performs the image compression on the second image.
[0013] The invention of claim 3 is characterized in that in the image processing device of claim 1, the image generation unit performs image compression on the first image at a predetermined compression rate, and performs image compression on the second image at a compression rate higher than the predetermined compression rate.
[0014] The invention of claim 4 is characterized in that in the image processing device of claim 1, the image generation unit performs lossless compression on the first image and performs image compression at a predetermined compression rate on the second image.
[0015] The invention of claim 5 is characterized in that, in the image processing device of any of claims 1 to 4, the image generation unit does not perform smoothing processing on the first image, and performs the smoothing processing on the second image.
[0016] The invention of claim 6 is characterized in that, in the image processing device of any of claims 1 to 4, the image generation unit sets the combined data volume of the first image and the second image to be less than a predetermined value.
[0017] The invention according to claim 7 is characterized in that, in the image processing device of any one of claims 1 to 4, the abnormal area detection unit detects a designated area designated by a user as the abnormal area.
[0018] An eighth aspect of the present invention provides the image processing device of the seventh aspect, characterized in that the abnormal region detection section detects a rectangular region including the designated region as the abnormal region.
[0019] The invention of claim 9 is characterized in that, in the image processing device of claim 7, it is configured to include a display unit that displays a preview image based on the image data and an operation unit that accepts user operations on the preview image, and the abnormal area detection unit detects the designated area specified via the operation unit as the abnormal area.
[0020] The invention of claim 10 is the image processing device of claim 1, characterized in that when the image abnormality is contained in only a part of an image element contained in the image data, the abnormal area detection unit detects the entire image element as the abnormal area.
[0021] The invention of claim 11 is the image processing device of claim 1, characterized in that, when an image element similar to the abnormal area exists in an area other than the abnormal area in the image data, the abnormal area detection unit further detects the image element as the abnormal area.
[0022] The invention of claim 12 is characterized in that, in the image processing device of claim 1, the image reading unit reads a document including the image abnormality to generate first document image data, and reads a document not including the image abnormality to generate second document image data, and the abnormal area detection unit extracts the difference between the first document image data and the second document image data to detect the abnormal area.
[0023] The invention of claim 13 is an image processing device according to claim 1, further comprising an image memory unit for storing image data generated by the image reading unit, wherein when an image abnormality occurs in the image data stored in the image memory unit, the image reading unit re-reads the image of the original document to generate image data, and the abnormal area detection unit detects the abnormal area by extracting the difference between the image data generated by the image reading unit and the image data stored in the image memory unit.
[0024] The invention of claim 14 is an image processing device according to claim 1, further comprising an image memory unit for storing image data to be printed, and an image forming unit for forming and outputting an image on a sheet based on the image data to be printed, wherein the image reading unit reads the image of the sheet to generate image data when an image abnormality occurs in the image formed on the sheet, and the abnormal area detection unit detects the abnormal area by extracting the difference between the image data generated by the image reading unit and the image data to be printed stored in the image memory unit.
[0025] The invention of claim 15 is characterized in that, in the image processing device of any of claims 1 to 4, the image generation unit generates the second image including the abnormal area and an area other than the abnormal area, and fills the abnormal area in the second image with a predetermined color.
[0026] The invention of claim 16 is characterized in that, in the image processing device of any of claims 1 to 4, the abnormal area detection unit enlarges the abnormal area when a resend request is received from the image diagnostic device after the first image and the second image have been transmitted to the image diagnostic device, and the image generation unit regenerates the first image and the second image based on the abnormal area enlarged by the abnormal area detection unit.
[0027] The invention of claim 17 is an image transmitting method performed in an image processing device, comprising an image reading step of reading an image of an original document to generate image data, an abnormal area detection step of detecting an abnormal area where an image abnormality occurs in the image data, an image generation step of extracting an image of the abnormal area from the image data to generate a first image and generating a second image from the image data including areas other than the abnormal area, and a transmission step of transmitting the first image and the second image to an image diagnostic device, wherein the image generation step is configured to make the clarity of the first image higher than the clarity of the second image.
[0028] The invention of claim 18 is a program executed in an image processing device, which causes the image processing device to execute an image reading step of reading an image of an original document to generate image data, an abnormal area detection step of detecting an abnormal area in which an image abnormality occurs in the image data, an image generation step of extracting an image of the abnormal area from the image data to generate a first image and generating a second image from the image data including areas other than the abnormal area, and a transmission step of transmitting the first image and the second image to an image diagnostic device, wherein the image generation step is characterized in that the clarity of the first image is made higher than the clarity of the second image. Effect of the Invention
[0029] According to the present invention, the first image and the second image are generated by increasing the clarity of the first image from which the image of the abnormal area is extracted, compared to the clarity of the second image including the area other than the abnormal area, so that it is possible to reduce the amount of data of the second image, which has a large image size, while maintaining the clarity of the first image including the image abnormality at a high level. Therefore, the present invention makes it possible to efficiently transmit the entire image in which the image abnormality occurs when the image abnormality occurs. [Brief description of the drawings]
[0030] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a network system including an image processing apparatus. [Diagram 2] FIG. 1 is a block diagram showing an example of the configuration of an image processing device. [Diagram 3] FIG. 13 is a diagram illustrating a concept of processing by an image anomaly processing unit. [Figure 4] 10 is a flowchart illustrating an example of a processing procedure of the image processing apparatus in a remote maintenance mode. [Diagram 5] FIG. 11 is a diagram illustrating an example of an abnormal region detection process. [Figure 6] 13 is a flowchart illustrating an example of a detailed processing procedure of a first image generating process. [Figure 7] 13 is a flowchart illustrating an example of a detailed processing procedure of a second image generating process. [Figure 8] 11 is a diagram showing a processing concept when determining the compression ratio of a second image. FIG. [Figure 9] 11A and 11B are diagrams illustrating an example in which an abnormal area detection unit automatically detects an abnormal area when an image abnormality occurs in a copy job. [Figure 10] 11A and 11B are diagrams illustrating an example in which an abnormal area detection unit automatically detects an abnormal area when an image abnormality occurs in a scan job. [Figure 11] 11A and 11B are diagrams illustrating an example in which an abnormal area detection unit automatically detects an abnormal area when an image abnormality occurs in a print job. [Figure 12] 11A and 11B are diagrams illustrating an example of detecting an abnormal region when an image abnormality is contained in only a portion of image elements included in image data. [Figure 13] 11A and 11B are diagrams illustrating an example of detecting an abnormal region when an image element similar to the abnormal region exists in a region other than the abnormal region. [Figure 14] FIG. 13 is a diagram illustrating an example of enlarging an abnormal region. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0031] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In the following embodiments, elements common to each other are designated by the same reference numerals, and redundant description thereof will be omitted.
[0032] 1 is a diagram showing an example of the configuration of a network system including an image processing device 1 according to an embodiment of the present invention. This network system is a system in which the image processing device 1 installed in a user's local environment 6 and an image diagnostic device 2 installed in a remote service base 7 can communicate with each other via a network 3 such as the Internet.
[0033] A local network 4 such as a Local Area Network (LAN) is installed in the local environment 6. To the local network 4, an image processing device 1 and a plurality of information processing devices 5 are connected.
[0034] The image processing device 1 is composed of an MFP or the like, and executes various jobs such as a scan job, a print job, and a copy job. For example, in the case of a scan job, the image processing device 1 reads an image of an original document set by a user and generates image data. Furthermore, when the image processing device 1 receives a print job from an information processing device 5 via a local network 4, it executes the print job. When the image processing device 1 executes a print job, it forms an image on a sheet such as a printing paper based on image data to be printed specified in the print job, and outputs the image. Furthermore, in the case of a copy job, the image processing device 1 reads an image of an original document set by a user and generates image data, and forms an image based on the image data on a sheet and outputs it.
[0035] In this way, the image processing device 1 outputs an image by executing a job. The user judges whether the job has been executed normally in the image processing device 1 by checking the image output from the image processing device 1. For example, if the image output from the image processing device 1 has stains, bright spots, or streaky stains, the user judges that an image abnormality has occurred. When the user checks the image abnormality, the user contacts a serviceman at the service base 7 and performs work to resolve the image abnormality. For example, the user switches the operation mode of the image processing device 1 from the normal job mode to the remote maintenance mode, and transmits the image in which the image abnormality has occurred to the image diagnostic device 2 at the service base 7.
[0036] The serviceman at the service base 7 checks the image displayed on the image diagnostic device 2 and identifies the cause of the image abnormality in the image processing device 1. Based on the identified cause of the image abnormality, the serviceman guides the user to replace parts or clean the device himself, or dispatches another serviceman to the local environment 6 to perform maintenance work.
[0037] 2 is a block diagram showing an example of the configuration of the image processing device 1. The image processing device 1 includes a control unit 10, an operation panel 11, an automatic document transport unit 12, an image reading unit 13, an image memory 14, a paper feed unit 15, an image forming unit 16, and a communication interface 17, which are configured to input and output data to and from each other via a bus 18.
[0038] The control unit 10 includes a CPU 20 and a memory 21, and comprehensively controls the operation of the image processing device 1. The CPU 20 is a hardware processor that reads and executes a program 22 stored in the memory 21. The memory 21 is a storage unit that stores the program 22.
[0039] The operation panel 11 is a user interface when a user uses the image processing device 1. The operation panel 11 includes a display unit 11a that displays various screens, and an operation unit 11b that accepts operations by the user. The display unit 11a is configured, for example, by a color liquid crystal display. The operation unit 11b is configured, for example, by touch panel keys arranged on the screen of the display unit 11a.
[0040] The automatic document feeder 12 and the image reading unit 13 operate when a scan job or a copy job is executed in the image processing device 1. The automatic document feeder 12 automatically feeds a document set by a user. The image reading unit 13 reads an image of the document set by the user and generates image data. The image reading unit 13 works in conjunction with the document feed operation by the automatic document feeder 12, and can automatically read an image of the document fed by the automatic document feeder 12. For example, when the automatic document feeder 12 automatically feeds multiple documents in succession, the image reading unit 13 can automatically read the images of the multiple documents in succession.
[0041] The image memory 14 is a memory for storing image data generated by executing a job or image data to be printed. The image memory 14 has a sufficiently large data capacity and can store image data for multiple pages.
[0042] The paper feed unit 15 and the image forming unit 16 operate when a print job or a copy job is executed in the image processing device 1. The paper feed unit 15 feeds sheets such as printing paper and transports them to the image forming unit 16. The image forming unit 16 forms an image based on image data to be printed on the sheet fed by the paper feed unit 15, fixes the image on the sheet, and outputs it.
[0043] The communication interface 17 is a communication unit that connects the image processing device 1 to the network 3 and the local network 4 to perform communication. The image processing device 1 receives a print job transmitted from the information processing device 5 via this communication interface 17. In addition, the image processing device 1 communicates with the image diagnostic device 2 via this communication interface 17.
[0044] The CPU 20 of the control unit 10 executes the program 22 to function as a job control unit 23 and an image abnormality processing unit 24. The job control unit 23 is a control unit that operates in a normal job mode, and controls the operation of each of a scan job, a copy job, and a print job.
[0045] The image abnormality processing unit 24 operates when an image abnormality occurs as a result of executing a job in the normal job mode and the operation mode is switched to the remote maintenance mode by the user. The image abnormality processing unit 24 includes an image acquisition unit 25, an abnormal area detection unit 26, and an image generation unit 27.
[0046] The image acquisition unit 25 acquires image data of an image in which an image abnormality occurs due to execution of a job. For example, when an image abnormality occurs in a copy job or a print job, the image abnormality is included in the print image of a sheet output from the image forming unit 16. In this case, the image acquisition unit 25 acquires image data generated by driving the image reading unit 13 based on a user's instruction and reading an image of a sheet containing the image abnormality. Also, when an image abnormality occurs in a scan job, the image abnormality is included in the image data stored in the image memory 14. In this case, the image acquisition unit 25 acquires the image data stored in the image memory 14. For example, when multiple types of image data are stored in the image memory 14, the image acquisition unit 25 acquires image data designated by the user from among the multiple types of image data as image data containing the image abnormality.
[0047] The abnormal region detection unit 26 detects an abnormal region where an image abnormality occurs in the image data acquired by the image acquisition unit 25. For example, the abnormal region detection unit 26 detects an area specified by a user as an abnormal region. The abnormal region detected by the abnormal region detection unit 26 is a rectangular region. Therefore, the abnormal region detection unit 26 detects a rectangular region including a part where an image abnormality occurs as an abnormal region.
[0048] The image generating unit 27 generates a first image including a portion where an image abnormality occurs, and a second image including an image other than the portion where an image abnormality occurs. For example, the image generating unit 27 generates a first image by extracting an image of an abnormal region detected by the abnormal region detecting unit 26 from the image data acquired by the image acquiring unit 25. The image generating unit 27 also generates a second image including an image other than the abnormal region detected by the abnormal region detecting unit 26 from the image data acquired by the image acquiring unit 25. When generating the second image, the image generating unit 27 may generate an image including both an image of the abnormal region and an image other than the abnormal region.
[0049] Fig. 3 is a diagram showing the concept of processing by the image anomaly processing unit 24. The image anomaly processing unit 24 first activates the image acquisition unit 25. The image acquisition unit 25 acquires image data GA including an image anomaly 30 such as a stain, for example, as shown in Fig. 3(a). Fig. 3(a) shows an example in which a circular stain is included as the image anomaly 30 in a part of a graph included in the image data GA.
[0050] When the image acquisition unit 25 acquires image data GA as shown in Fig. 3(a), the image abnormality processing unit 24 activates the abnormal area detection unit 26. The abnormal area detection unit 26 detects an abnormal area ER in which an image abnormality 30 occurs in the image data GA as shown in Fig. 3(b). In the example of Fig. 3(b), a circular stain included in a part of the graph of the image data GA is detected as an abnormal area ER.
[0051] When the abnormal region ER is detected by the abnormal region detection unit 26, the image abnormality processing unit 24 activates the image generation unit 27. As shown in FIG. 3(c), the image generation unit 27 extracts an image of the abnormal region ER from the image data GA to generate a first image G1, and generates a second image G2 including a region other than the abnormal region ER. For example, when generating the second image G2, the image generation unit 27 generates the second image G2 from the entire image data GA, and fills in the abnormal region ER in the second image G2 with a predetermined color. FIG. 3(c) shows an example in which the abnormal region ER in the second image G2 is filled in with black. However, the color for filling in the abnormal region ER is not limited to black, and may be a gray color of a predetermined gradation.
[0052] Returning to FIG. 2, the image generating unit 27 includes an image processing unit 28. The image processing unit 28 performs image processing on each of the first image G1 and the second image generated from the image data GA. Specifically, the image processing unit 28 performs image processing on the first image G1 so as not to reduce the image definition as much as possible. Note that the image processing unit 28 may not perform image processing on the first image G1. The first image G1 includes a portion where an image abnormality 30 occurs. Therefore, a serviceman at the service base can easily identify the symptoms and the cause of the image abnormality 30 by checking the first image G1, which has high definition.
[0053] In response to this, the image processor 28 performs image processing on the second image G2 to reduce the image definition to a level lower than that of the first image G1. The second image G2 includes an image of the periphery of the portion where the image abnormality 30 occurs. For example, when the symptoms and cause of the image abnormality 30 cannot be identified by the first image G1 alone, the second image G2 including the periphery of the image abnormality 30 is useful for identifying the symptoms and cause of the image abnormality 30. In other words, the second image G2 is an image that is secondarily referenced to identify the symptoms and cause of the image abnormality 30. Therefore, the importance of the second image G2 in diagnosing the image abnormality 30 is lower than that of the first image G1, and the second image G2 may be an image with low definition.
[0054] Reducing the image definition can reduce the amount of image data. Therefore, the image processing unit 28 can reduce the amount of data including both the first image G1 and the second image G2 by reducing the definition of the second image G2, which has a larger image size than the first image G1, to reduce the amount of data.
[0055] For example, the image processing unit 28 does not perform image compression such as JPEG on the first image G1, but performs image compression such as JPEG on the second image G2, thereby enabling the image processing unit 28 to maintain high definition of the first image G1 while decreasing the definition of the second image G2 to reduce the amount of data.
[0056] Alternatively, the image processor 28 may perform image compression such as JPEG on the first image G1 at a predetermined compression rate, and perform image compression such as JPEG on the second image G2 at a compression rate higher than the predetermined compression rate. In this case, the first image G1 may lose a little sharpness, but may maintain a sharpness higher than that of the second image G2. In addition, by setting the compression rate of the second image G2 higher than the predetermined compression rate, the image processor 28 may significantly reduce the amount of data of the second image G2.
[0057] The image processing unit 28 may perform lossless compression on the first image G1 and perform image compression (lossy compression) such as JPEG at a predetermined compression rate on the second image G2. In this case, the amount of data of the first image G1 is reduced by lossless compression. Since the compression process on the first image G1 is lossless compression, the image diagnostic device 2 can restore the first image G1 with high original clarity by performing restoration process on the first image G1 received from the image processing device 1. On the other hand, the second image G2 is lossy compressed at a predetermined compression rate, which is a relatively high compression rate, and therefore the amount of data is significantly reduced.
[0058] Moreover, the image processing unit 28 may perform image smoothing processing on the second image without performing image smoothing processing on the first image G1. This allows the image processing unit 28 to maintain the sharpness of the first image G1 high while reducing the sharpness of the second image G2 to reduce the amount of data. Moreover, the image processing unit 28 may perform the smoothing processing on the second image G2 and then perform lossy image compression. By performing the smoothing processing on the second image G2 and then compressing the image, there is an advantage in that the amount of data of the second image G2 can be significantly reduced.
[0059] The image generating unit 27 performs preset image processing on the first image G1 and the second image G2 individually, and then transmits the first image G1 and the second image G2 to the image diagnostic device 2 at the service base 7 via the communication interface 17. As a result, the image diagnostic device 2 receives the first image G1 and the second image G2 from the image processing device 1. At this time, the first image G1 transmitted from the image processing device 1 maintains high definition. In addition, the data amount of the second image G2, which has a large image size, is reduced. In other words, the image generating unit 27 transmits the first image G1 and the second image G2 in a state in which the data amount is reduced while ensuring a state in which the symptoms and the cause of the image abnormality 30 can be easily identified, and therefore the time required for image transmission can be shortened. Therefore, the serviceman at the service base 7 can quickly check the first image G1 and the second image G2 displayed by the image diagnostic device 2 and identify the symptoms and the cause of the image abnormality 30 early.
[0060] 4 is a flowchart showing an example of a processing procedure of the image processing device 1 in the remote maintenance mode. This processing is performed by the CPU 20 of the control unit 10 reading and executing the program 22 stored in the memory 21. When the control unit 10 starts this processing, it determines whether or not the operation mode of the image processing device 1 has been switched to the remote maintenance mode (step S1). If the operation mode is not the remote maintenance mode (NO in step S1), the control unit 10 ends the processing based on the flowchart of FIG. 4.
[0061] When the operation mode is switched to the remote maintenance mode (YES in step S1), the control unit 10 waits until the user issues an instruction to read an image (NO in step S2). For example, the user places a sheet on which an image abnormality has occurred in the automatic document feeder 12, and inputs an instruction to read the image via the operation panel 11. When the control unit 10 detects the instruction to read an image from the user (YES in step S2), it operates the automatic document feeder 12 and the image reader 13 to read the image of the sheet placed by the user (step S3). The control unit 10 stores the image data GA read from the sheet in the image memory 14 (step S4).
[0062] Next, the control unit 10 executes an abnormal area detection process to detect an area where an image abnormality 30 occurs in the image data GA stored in the image memory 14 (step S5). FIG. 5 is a diagram showing an example of the abnormal area detection process. For example, when a user checks a sheet output from the image processing device 1 by a print job or copy job and finds an image abnormality 30 such as a stain, the user handwrites a marking 31 on the sheet surrounding the image abnormality 30. For example, the marking 31 is written on the sheet in a predetermined color such as red. The user sets the sheet on which the marking 31 is written in the automatic document feeder 12 and causes the image processing device 1 to execute a scan job to read the image of the sheet. As a result, the image processing device 1 acquires image data GA as shown in FIG. 5(a) and stores it in the image memory 14.
[0063] In the abnormal region detection process (step S5), the control unit 10 first detects the marking 31 handwritten by the user from the image data GA, as shown in Fig. 5(b). For example, the control unit 10 detects the marking 31 by detecting a predetermined color, such as red, from the image data GA. Upon detecting the marking 31, the control unit 10 assigns a rectangular region that includes the marking 31 to the image data GA, and detects the rectangular region as an abnormal region ER. The control unit 10 detects the abnormal region ER that includes the image anomaly 30 through such abnormal region detection process.
[0064] Also, the marking 31 does not necessarily have to be written on the sheet output from the image processing device 1. For example, when the control unit 10 cannot detect the marking 31 from the image data GA including the image abnormality 30, the control unit 10 may display a preview image based on the image data GA on the display unit 11a of the operation panel 11, and specify the area including the image abnormality 30 based on the user's operation on the preview image. In this case, the control unit 10 detects the user's operation on the operation unit 11b, and specifies the designated area specified by the user on the preview image. Then, the control unit 10 detects the designated area specified by the user on the preview image as the abnormal area ER. In this way, even if the image data GA does not include the marking 31 handwritten by the user, the control unit 10 can detect the abnormal area ER by displaying the preview image on the operation panel 11 and accepting the user's operation to specify the area.
[0065] 4, when the control unit 10 detects the abnormal area ER in the image data GA, the control unit 10 executes a first image generation process (step S6). The first image generation process is a process for generating a first image G1.
[0066] FIG. 6 is a flowchart showing an example of a detailed processing procedure of the first image generation process (step S6). When the control unit 10 starts the first image generation process, it extracts an image of the abnormal region ER from the image data GA (step S10). The control unit 10 generates a first image G1 consisting of the image of the abnormal region ER cut out from the image data GA (step S11). When the control unit 10 generates the first image G1, it judges whether or not to perform image compression on the first image G1 (step S12). For example, whether or not to perform image compression on the first image G1 is set in advance. When the image compression is performed on the first image G1 (YES in step S12), the control unit 10 judges whether or not to perform lossless compression (step S13). For example, when it is set to perform image compression on the first image G1, it is also set in advance whether or not the image compression is lossless compression. When the control unit 10 judges to perform lossless compression (YES in step S13), it executes lossless compression processing on the first image G1 (step S14).
[0067] Also, if it is determined that the compression is not lossless (NO in step S13), the control unit 10 sets a compression rate for the first image G1 (step S15). At this time, the control unit 10 sets a first compression rate lower than a predetermined value so as not to reduce the sharpness of the first image G1 too much. The control unit 10 applies the first compression rate to execute image compression processing for the first image G1 (step S16). As a result, the data amount of the first image G1 is reduced to a certain extent without reducing the sharpness. Note that, if it is determined in step S12 that image compression is not to be performed on the first image G1, the control unit 10 does not execute the processing of steps S13 to S16. Thereafter, the control unit 10 stores the first image G1 in the image memory 14 (step S17). With this, the first image generation processing (step S6) is completed.
[0068] Next, the control unit 10 executes a second image generating process (step S7). The second image generating process is a process for generating a second image G2.
[0069] FIG. 7 is a flowchart showing an example of a detailed processing procedure of the second image generation process (step S7). When the control unit 10 starts the second image generation process, it reads out the image data GA from the image memory 14 and fills in the abnormal area ER of the image data GA with a predetermined color (step S20). The control unit 10 generates a second image G2 consisting of an image in which the abnormal area ER of the image data GA is filled in (step S21). When the control unit 10 generates the second image G2, it determines whether or not to perform a smoothing process on the second image G2 (step S22). For example, whether or not to perform a smoothing process on the second image G2 is set in advance. When the smoothing process is to be performed on the second image G2 (YES in step S22), the control unit 10 executes the smoothing process on the second image G2 (step S23).
[0070] Next, the control unit 10 sets a compression rate for the second image G2 (step S24). At this time, the control unit 10 sets a second compression rate higher than the first compression rate so that the data amount of the second image G2 can be reduced below a predetermined value. The control unit 10 applies the second compression rate to execute image compression processing for the second image G2 (step S25). As a result, the data amount of the second image G2 becomes significantly smaller than that of the image data GA. Thereafter, the control unit 10 stores the second image G2 in the image memory 14 (step S26). This completes the second image generation processing (step S7).
[0071] Returning to the flowchart of FIG. 4, finally, the control unit 10 transmits the first image G1 and the second image G2 stored in the image memory 14 to the image diagnostic device 2 (step S8). That is, the control unit 10 transmits the first image G1 consisting of the abnormal area ER including the image abnormality 30 to the image diagnostic device 2 as a high-definition image, and transmits the large-sized second image G2 including the peripheral part of the abnormal area ER to the image diagnostic device 2 as an image with a small amount of data. Therefore, when the image abnormality 30 occurs due to the execution of a job, the image processing device 1 can efficiently transmit the entire image in which the image abnormality 30 occurs to the image diagnostic device 2. For example, the control unit 10 transmits the first image G1 and the second image G2 to the image diagnostic device 2 as they are using the communication path established with the image diagnostic device 2. However, this is not limited to this, and the control unit 10 may create an e-mail to which the first image G1 and the second image G2 are attached as attachments, and transmit the e-mail to the address of the image diagnostic device 2.
[0072] FIG. 8 is a diagram showing a processing concept when determining the compression rate of the second image G2. For example, when the amount of data obtained by adding the first image G1 and the second image G2 exceeds the allowable amount shown in FIG. 8, the transfer efficiency may decrease. Therefore, when the remaining amount of data up to the allowable amount by generating the first image G1 with high definition is X, the control unit 10 determines the compression rate of the second image G2 so that the data amount of the second image G2 is X or less. As a result, when the control unit 10 performs image compression on the second image G2, the data amount of the second image G2 can be suppressed to X or less. In other words, the control unit 10 can suppress the data amount of the first image G1 and the second image G2 to a predetermined value (allowable amount) or less. As a result, it is possible to prevent the transfer efficiency from decreasing when the first image G1 and the second image G2 are transmitted to the image diagnostic device 2.
[0073] Furthermore, even when the control unit 10 transmits the first image G1 and the second image G2 as attachments to an e-mail, the data volume of the entire e-mail can be kept below the allowable volume. In the case of e-mail, if the data volume of the e-mail exceeds the allowable volume of the e-mail server, the e-mail cannot be transmitted. However, the control unit 10 can reduce the data volume of the second image G2 so as not to exceed the allowable volume of the e-mail server, thereby preventing a problem in which an e-mail with the first image G1 and the second image G2 attached is not transmitted to the imaging diagnostic apparatus 2.
[0074] Next, an embodiment in which the image abnormality processing unit 24 automatically detects an abnormal area ER will be described. Fig. 9 is a diagram showing an example in which the abnormal area detection unit 26 automatically detects an abnormal area ER when an image abnormality occurs in a copy job. When an image abnormality occurs in a copy job, the image abnormality processing unit 24 reads an image of a sheet (first original) 41 on which an image abnormality 32 occurs as shown in Fig. 9(a) by the image reading unit 13, and generates image data (first original image data) GA including the image abnormality 32. Fig. 9(a) shows an example in which a vertical streak-like stain occurs on the sheet 41 as the image abnormality 32.
[0075] Next, as shown in FIG. 9(b), the image abnormality processing unit 24 reads the image of the copy source sheet (second original) 42 used in the copy job by the image reading unit 13, and generates image data (second original image data) GB that does not include the image abnormality 32. As a result, the image data GA and the image data GB are stored in the image memory 14. After that, the image abnormality processing unit 24 activates the abnormal area detection unit 26. The abnormal area detection unit 26 reads the image data GA and GB stored in the image memory 14, and extracts the difference between the image data GA and the image data GB. The image data GA includes the image abnormality 32, and the image data GB does not include the image abnormality 32. Therefore, by extracting the difference between the image data GA and the image data GB, the abnormal area detection unit 26 extracts the image abnormality 32 included in the image data GA, as shown in FIG. 9(c). When the abnormal area detection unit 26 extracts the image abnormality 32, it detects a rectangular area including the image abnormality 32 as an abnormal area ER. At this time, the abnormal area detection unit 26 detects an area slightly larger than the image abnormality 32 as an abnormal area ER. Therefore, when an image anomaly 32 occurs in a copy job, the image anomaly processor 24 can automatically detect an abnormal area ER including the image anomaly 32.
[0076] Next, FIG. 10 is a diagram showing an example in which the abnormal area detection unit 26 automatically detects an abnormal area ER when an image abnormality occurs in a scan job. When an image abnormality occurs in a scan job, the image data GA including the image abnormality 32 is stored in the image memory 14. Therefore, the image abnormality processing unit 24 reads the image of the original sheet 42 used in the scan job with the image reading unit 13 as shown in FIG. 10. As a result, the image data GB not including the image abnormality 32 is stored in the image memory 14. After that, the image abnormality processing unit 24 activates the abnormal area detection unit 26. The abnormal area detection unit 26 reads the image data GA and GB stored in the image memory 14 and extracts the difference between the image data GA and the image data GB. The image data GA includes the image abnormality 32, and the image data GB does not include the image abnormality 32. Therefore, by extracting the difference between the image data GA and the image data GB, the abnormal area detection unit 26 extracts the image abnormality 32 included in the image data GA as shown in FIG. 10. When the abnormal area detection unit 26 extracts the image anomaly 32, it detects a rectangular area including the image anomaly 32 as the abnormal area ER. At this time, the abnormal area detection unit 26 detects an area slightly larger than the image anomaly 32 as the abnormal area ER. In this way, when the image anomaly 32 occurs in the image data GA stored in the image memory 14 as a result of executing a scan job, the image abnormality processing unit 24 re-reads the image of the document to generate image data GB. Then, the abnormal area detection unit 26 extracts the difference between the image data GB generated by the image reading unit 13 and the image data GA stored in the image memory 14 to detect the abnormal area ER. Therefore, even if the image data GA generated by the scan job contains the image anomaly 32, the image abnormality processing unit 24 can automatically detect the abnormal area ER where the image anomaly 32 occurs in the image data GA.
[0077] Next, FIG. 11 is a diagram showing an example in which the abnormal area detection unit 26 automatically detects an abnormal area ER when an image abnormality occurs in a print job. When an image abnormality 32 occurs in a print job, the image abnormality 32 is included in a sheet 41 output from the image processing device 1. Therefore, the image abnormality processing unit 24 reads the image of the sheet 41 output by the print job with the image reading unit 13 as shown in FIG. 11. As a result, the image data GA including the image abnormality 32 is stored in the image memory 14. On the other hand, the image data GB not including the image abnormality 32 has already been stored in the image memory 14 as the image data to be printed. The abnormal area detection unit 26 reads the image data GA and GB stored in the image memory 14 and extracts the difference between the image data GA and the image data GB. The image data GA includes the image abnormality 32, and the image data GB does not include the image abnormality 32. Therefore, by extracting the difference between the image data GA and the image data GB, the abnormal area detection unit 26 extracts the image abnormality 32 included in the image data GA as shown in FIG. 11. When the abnormal area detection unit 26 extracts the image anomaly 32, it detects a rectangular area including the image anomaly 32 as the abnormal area ER. At this time, the abnormal area detection unit 26 detects an area slightly larger than the image anomaly 32 as the abnormal area ER. Therefore, even if the image data GA generated in a print job includes the image anomaly 32, the image anomaly processing unit 24 can automatically detect the abnormal area ER where the image anomaly 32 occurs in the image data GA.
[0078] In this way, when an image abnormality 32 occurs due to execution of a job, the image processing device 1 of this embodiment can automatically detect the abnormal area ER including the image abnormality 32. Therefore, the user does not need to handwrite the above-mentioned marking 31 or the like in the part where the image abnormality 32 occurs.
[0079] Next, Fig. 12 is a diagram showing another example of detecting an abnormal region ER when only a part of an image element included in image data GA contains an image abnormality 30. Fig. 12(a) illustrates a case where only a part of a line graph (image element) 34 included in image data GA contains an image abnormality 30. When an image abnormality 30 is included only in a part of a line graph 34 included in image data GA as shown in Fig. 12(a), the abnormal region detection unit 26 detects the entire line graph 34 as an abnormal region ER as shown in Fig. 12(b). By detecting the entire image element including the image abnormality 30 as an abnormal region ER, a serviceman at a service base can analyze the symptoms of the image abnormality 30 while viewing the entire image element, and therefore the cause of the image abnormality 30 can be more accurately identified.
[0080] Next, FIG. 13 is a diagram showing another example of detecting an abnormal region ER when an image element similar to the abnormal region ER exists in an area other than the abnormal region ER. For example, in FIG. 13(a), image data GA including an image anomaly 30 includes two line graphs 34, 35 that are similar image elements. Also, as shown in FIG. 13(a), one of the two line graphs 34, 35 includes an image anomaly 30 in a part of the line graph 34. When the image anomaly 30 is included only in a part of the line graph 34 as shown in FIG. 13(a), the abnormal region detection unit 26 detects the entire line graph 34 as an abnormal region ER. Next, the abnormal region detection unit 26 determines whether an image element similar to the abnormal region ER exists in an area other than the abnormal region ER in the image data GA. As a result, the abnormal region detection unit 26 detects the other line graph 35 as an image element similar to the abnormal region ER. 13(b), the abnormal region detection unit 26 also detects the region of the line graph 35, which is an image element similar to the image element containing the image abnormality 30, as an abnormal region ER. This allows a serviceman at the service base to analyze the symptoms of the image abnormality 30 by comparing multiple similar image elements, and therefore allows the cause of the image abnormality 30 to be identified more accurately.
[0081] However, even if a serviceman at a service base checks the first image G1 and the second image G2 displayed on the image diagnostic device 2, he or she may not be able to identify the cause of the image abnormality 30. In that case, the serviceman operates the image diagnostic device 2 to transmit a request to resend the images to the image processing device 1. Upon receiving the resend request from the image diagnostic device 2, the image processing device 1 generates the first image G1 and the second image G2 again and transmits them to the image diagnostic device 2. At this time, the abnormal area detection unit 26 enlarges the abnormal area ER more than the previous time. Therefore, the image generation unit 27 generates the first image G1 and the second image G2 again based on the abnormal area ER enlarged by the abnormal area detection unit 26, and transmits them to the image diagnostic device 2.
[0082] FIG. 14 is a diagram showing an example of enlarging the abnormal region ER. For example, assume that the image data GA contains vertical stripe-like stains as an image abnormality 32 as shown in FIG. 14(a), and the first abnormal region ER is set in a state including the image abnormality 32. In this case, the image processing device 1 generates a first image G1 consisting of only the image contained in the abnormal region ER shown in FIG. 14(a) and a second image G2 consisting of the entire image data GA, and transmits them to the image diagnostic device 2. If the serviceman at the service base checks the first image G1 and the second image G2 but cannot identify the cause of the image abnormality 32, the serviceman operates the image diagnostic device 2 to transmit a request to resend the image to the image processing device 1. When the image processing device 1 receives the resend request, it enlarges the abnormal region ER from the previous time as shown in FIG. 14(b). Then, the image processing device 1 generates a first image G1 consisting of only the image contained in the abnormal region ER shown in FIG. 14(b) and a second image G2 consisting of the entire image data GA, and transmits them again to the image diagnostic device 2. This allows the service person to relatively easily identify the cause of the image abnormality 30 by checking the enlarged first image G1.
[0083] As described above, the image processing device 1 of the present embodiment includes the abnormal area detection unit 26 that detects the abnormal area ER in the image data GA where an image abnormality occurs, and the image generation unit 27 that extracts an image of the abnormal area ER from the image data GA to generate a first image G1 and generates a second image G2 including an area other than the abnormal area ER from the image data GA. The image generation unit 27 sets the definition of the first image G1 to be higher than that of the second image, and generates the first image G1 and the second image G2. When an image abnormality occurs, the image processing device 1 having such a configuration can efficiently transmit the entire image in which the image abnormality occurs to the image diagnostic device 2. In addition, since such an image processing device 1 transmits the part in which the image abnormality occurs as a high-definition image, the image diagnostic device 2 can appropriately identify the cause of the image abnormality.
[0084] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications are possible.
[0085] For example, in the above embodiment, a case where an image abnormality occurs in one location of the image data GA is exemplified. However, this is not limited to this, and image abnormalities may occur in multiple locations of the image data GA. In that case, the image processing device 1 may generate multiple first images G1 from the image data GA to detect multiple abnormal areas ER in the image data GA.
[0086] Furthermore, the program 22 described in the above embodiment is not limited to being stored in advance in the memory 21 of the image processing device 1. For example, the program 22 may be a subject of trading by itself. In this case, the program 22 may be provided in a downloadable form via a network such as the Internet, or may be provided in a state recorded on a computer-readable recording medium such as a CD-ROM. [Explanation of symbols]
[0087] 1 Image processing device 2. Diagnostic imaging equipment 11 Operation Panel 11a Display section 11b Operation section 13 Image reading unit 14 Image memory (image storage section) 16 Image forming section 23 Job Control Section 24 Image abnormality processing section 25 Image acquisition unit 26 Abnormal area detection section 27 Image Generation Unit 28 Image Processing Section 30,32 Image abnormalities GA image data ER abnormal area G1 1st image G2 2nd image
Claims
1. an image reading unit that reads an image of a document and generates image data; an abnormal area detection unit that detects an abnormal area in which an image abnormality occurs in the image data; an image generating unit that generates a first image by extracting an image of the abnormal region from the image data and generates a second image including a region other than the abnormal region from the image data; a communication unit that transmits the first image and the second image to an image diagnostic apparatus; Equipped with The image processing device according to claim 1, wherein the image generating section increases the definition of the first image to be higher than the definition of the second image.
2. The image processing apparatus according to claim 1 , wherein the image generating section does not perform image compression on the first image, but performs the image compression on the second image.
3. The image processing apparatus according to claim 1 , wherein the image generating section performs image compression on the first image at a predetermined compression rate, and performs image compression on the second image at a compression rate higher than the predetermined compression rate.
4. The image processing apparatus according to claim 1 , wherein the image generating section performs lossless compression on the first image and performs image compression at a predetermined compression rate on the second image.
5. 5. The image processing apparatus according to claim 1, wherein the image generating section does not perform a smoothing process on the first image, and performs the smoothing process on the second image.
6. 5. The image processing apparatus according to claim 1, wherein the image generating section sets a total data amount of the first image and the second image to a predetermined value or less.
7. 5. The image processing apparatus according to claim 1, wherein the abnormal region detection unit detects a designated region designated by a user as the abnormal region.
8. The image processing apparatus according to claim 7 , wherein the abnormal region detection unit detects a rectangular region including the specified region as the abnormal region.
9. a display unit that displays a preview image based on the image data; an operation unit that receives a user's operation on the preview image; Equipped with The image processing apparatus according to claim 7 , wherein the abnormal region detection unit detects the designated region designated via the operation unit as the abnormal region.
10. The image processing apparatus according to claim 1 , wherein, when the image abnormality is contained in only a part of an image element contained in the image data, the abnormal area detection section detects the entire image element as the abnormal area.
11. The image processing device according to claim 1 , wherein when an image element similar to the abnormal region exists in an area other than the abnormal region in the image data, the abnormal region detection unit further detects the image element as the abnormal region.
12. the image reading unit reads a document including the image anomaly to generate first document image data, and reads a document not including the image anomaly to generate second document image data; The image processing apparatus according to claim 1 , wherein the abnormal area detection section detects the abnormal area by extracting a difference between the first document image data and the second document image data.
13. an image storage unit that stores image data generated by the image reading unit; Further comprising: the image reading unit reads the image of the document again to generate image data when an image abnormality occurs in the image data stored in the image storage unit; 2 . The image processing device according to claim 1 , wherein the abnormal area detection unit detects the abnormal area by extracting a difference between the image data generated by the image reading unit and the image data stored in the image storage unit.
14. an image storage unit for storing image data to be printed; an image forming unit that forms an image on a sheet based on the print target image data and outputs the image; Further comprising: the image reading unit reads the image on the sheet to generate image data when an image abnormality occurs in the image formed on the sheet; 2 . The image processing device according to claim 1 , wherein the abnormal area detection unit detects the abnormal area by extracting a difference between the image data generated by the image reading unit and the image data to be printed stored in the image storage unit.
15. 5. The image processing device according to claim 1, wherein the image generating unit generates the second image including the abnormal region and a region other than the abnormal region, and fills the abnormal region in the second image with a predetermined color.
16. the abnormal region detection unit, when receiving a retransmission request from the image diagnostic apparatus after the first image and the second image are transmitted to the image diagnostic apparatus, enlarges the abnormal region; 5. The image processing apparatus according to claim 1, wherein the image generating section regenerates the first image and the second image based on the abnormal area enlarged by the abnormal area detecting section.
17. An image transmission method performed in an image processing device, comprising: an image reading step of reading an image of a document and generating image data; an abnormal area detection step of detecting an abnormal area in which an image abnormality occurs in the image data; an image generating step of generating a first image by extracting an image of the abnormal region from the image data, and generating a second image including a region other than the abnormal region from the image data; a transmitting step of transmitting the first image and the second image to an image diagnostic device; having The image transmission method according to claim 1, wherein the image generating step comprises making the first image sharper than the second image.
18. A program executed in an image processing device, the program comprising: an image reading step of reading an image of a document and generating image data; an abnormal area detection step of detecting an abnormal area in which an image abnormality occurs in the image data; an image generating step of generating a first image by extracting an image of the abnormal region from the image data, and generating a second image including a region other than the abnormal region from the image data; a transmitting step of transmitting the first image and the second image to an image diagnostic device; Run the command, The program, wherein the image generating step is characterized in that a clarity of the first image is made higher than a clarity of the second image.
Citation Information
Patent Citations
Image processor, image processing method and medical image system
JP2005287927A
Image processor, control method for image processor, system, and program
JP2015119269A
Image inspection apparatus, image forming system, and image compression method
JP2018151494A
Image inspecting apparatus, image forming apparatus, and program
JP2020026091A
Image forming device, image forming method, and image forming program
JP2020069739A
