Processing system, processing method, and processing program

Abstract

To provide a processing system capable of notifying a user of the content of an abnormality when an abnormal sound is detected even when transport at a reading portion is not stopped.SOLUTION: An image processing system 10 includes a scanning unit 12 that transports a plurality of documents and reads each of the documents, and at least one processor. The processor acquires sound data representing collected information on the operating sounds generated in the scanning unit 12 as the documents are transported, detects abnormal sounds that differ from sounds emitted under normal conditions from the operation history and sound data of the scanning unit 12, estimates the content of the abnormality by performing frequency analysis that compares the abnormal sound with reference data on the content of the abnormality, and outputs the content of the abnormality.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a processing system, a processing method, and a processing program. [Background technology]

[0002] The following Patent Document 1 discloses an image forming apparatus that includes a display means, an error detection means that detects an operation error, an error release detection means that detects that the operation error has been released, and a display control means that, when an operation error is detected by the error detection means, causes the display means to display the fact that an operation error has occurred, and, when the error release detection means detects that the operation error has been released, causes the display means to display an operating method for preventing the occurrence of the operation error.

[0003] The following Patent Document 2 discloses an image reading device that executes a job to read an image of a document, the image reading device comprising: a conveying means that separates, conveys, and discharges documents loaded on a document table one by one; a detecting means that detects the shape of the document conveyed by the conveying means; a reading means that reads an image of the document conveyed by the conveying means; a receiving means that, if the detecting means detects that the shape of the document is not normal after conveyance of the document begins, accepts that the detecting means will not detect the shape of the document for the next document to be conveyed; and a first control means that, if the receiving means accepts that the detecting means will not detect the shape of the document for the next document to be conveyed, controls the detecting means not to detect whether the shape of the document is normal for the document to be conveyed by the conveying means.

[0004] Patent Document 3 listed below discloses an image forming device having an operation sound acquisition unit that acquires operation sounds within the device, the image forming device including an operation sound memory that stores the operation sounds of each component within the device, an abnormal sound detection unit that determines whether the operation sounds stored in the operation sound memory are abnormal sounds, a scanner unit that reads printed matter formed by the image forming device, an image inspection unit that determines whether there are any defects in the print quality based on the read image of the printed matter, and an image formation control unit that controls whether to continue image formation based on the determination result of the image inspection unit when the abnormal sound detection unit determines that there is an abnormal sound. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2017-225081 [Patent Document 2] Japanese Patent Application Publication No. 2018-088632 [Patent Document 3] Japanese Patent Application Laid-Open No. 2016-038411 Summary of the Invention [Problem to be solved by the invention]

[0006] The present invention aims to provide a processing system, processing method, and processing program that can notify the user of the content of the abnormality when an abnormal sound is detected, even if the transport of the document in the reading unit is not stopped. [Means for solving the problem]

[0007] The processing system according to the first aspect includes a reading unit that transports a plurality of documents and reads each of the documents, and at least one processor. The processor acquires sound data representing collected information on operating sounds generated in the reading unit as the documents are transported, detects abnormal sounds that differ from sounds emitted under normal conditions from the operation history of the reading unit and the sound data, performs frequency analysis to compare the abnormal sounds with reference data on the abnormality content, estimates the content of the abnormality, and outputs the content of the abnormality.

[0008] A processing system according to a second aspect is the processing system according to the first aspect, wherein the abnormality is an abnormality that does not hinder the transport of the document.

[0009] The processing system according to the third aspect is the processing system according to the first aspect, wherein the processor estimates the reading location of the image read by the reading unit that corresponds to the document from which the abnormal sound occurred based on the operation history and the sound data, and outputs the reading location together with the details of the abnormality.

[0010] A processing system according to a fourth aspect is the processing system according to the first aspect, wherein the processor outputs details of the abnormality to a display unit that displays information.

[0011] A processing system according to a fifth aspect is the processing system according to the third aspect, wherein the processor outputs the read location together with the content of the abnormality to a display unit that displays information.

[0012] The processing system described in the sixth aspect is the processing system described in the second aspect, wherein the processor stops the reading of the document by the reading unit when a jam occurs in the document or a jam is detected in the document during transport of the document.

[0013] A processing system according to a seventh aspect is the processing system according to the sixth aspect, wherein the processor detects the abnormal sound and estimates the nature of the abnormality when no jamming of the document occurs during transport of the document.

[0014] The processing system according to an eighth aspect is the processing system according to the first aspect, wherein the processor, when receiving an operation to reread the document, causes the reading unit to reread the document.

[0015] In the processing system described in a ninth aspect, in the processing system described in the third aspect, when the processor receives an operation to re-read the part of the document corresponding to the reading location, the processor re-reads the document using the reading unit and replaces the reading location in the read image with the image obtained by the re-reading.

[0016] A processing system according to a tenth aspect is the processing system according to the first aspect, wherein the processor displays a read image on a display unit that displays information after the reading unit reads the document.

[0017] In the processing method described in the eleventh aspect, a computer acquires sound data representing collected information on operating sounds generated in association with the transport of a plurality of documents in a reading unit that transports and reads each of the documents, detects abnormal sounds that differ from sounds emitted under normal circumstances from the operation history of the reading unit and the sound data, performs frequency analysis to compare the abnormal sounds with reference data on the abnormality content, thereby estimating the content of the abnormality, and performs processing to output the content of the abnormality.

[0018] The processing program described in the twelfth aspect causes a computer to execute a process of acquiring sound data representing collected information on operating sounds generated in a reading unit that transports multiple documents and reads each of the documents as the documents are transported, detecting abnormal sounds that differ from sounds emitted under normal conditions from the operation history of the reading unit and the sound data, estimating the content of the abnormality by performing frequency analysis that compares the abnormal sound with reference data on the content of the abnormality, and outputting the content of the abnormality. [Effects of the Invention]

[0019] According to the processing system of the first aspect, even if the transport of the document in the reading unit is not stopped, when an abnormal sound is detected, the user can be notified of the details of the abnormality.

[0020] According to the processing system of the second aspect, even when the transport of the document has been completed in the reading unit, the user can check the details of the abnormality.

[0021] According to the processing system of the third aspect, even if the transport of the document in the reading unit is not stopped, the user can check the content of the abnormality as well as the reading location.

[0022] According to the processing system of the fourth aspect, the content of the abnormality can be more accurately notified to the user than when the content of the abnormality is notified by an alarm sound.

[0023] According to the processing system of the fifth aspect, the user can be informed of the read location and the content of the abnormality more accurately than when the content and the read location of the abnormality are informed by an alarm sound.

[0024] According to the processing system of the sixth aspect, it is possible to suppress the occurrence of abnormalities in the read image, compared to when reading of the document is continued after a document jam occurs.

[0025] According to the processing system of the seventh aspect, even if no document jam occurs, when an abnormal sound is detected, the user can be notified of the details of the abnormality.

[0026] According to the processing system of the eighth aspect, the document can be reread by the user's operation to reread the document.

[0027] According to the processing system of the ninth aspect, the time required for re-reading can be reduced compared to when re-reading the document from the beginning.

[0028] According to the processing system of the tenth aspect, the user can check for abnormalities in the read image, compared to when the read image is not displayed on the display unit.

[0029] According to the processing method of the eleventh aspect, even if the transport of the document in the reading unit is not stopped, when an abnormal sound is detected, the user can be notified of the details of the abnormality.

[0030] According to the processing program of the twelfth aspect, even if the transport of the document in the reading unit is not stopped, when an abnormal sound is detected, the user can be notified of the details of the abnormality. [Brief explanation of the drawings]

[0031] [Figure 1] 1 is a block diagram showing a schematic configuration of an image processing system according to a first embodiment. [Figure 2] FIG. 10 is a block diagram showing the hardware configuration of a processing device in an image processing system according to a second embodiment. [Figure 3] 10A and 10B are diagrams illustrating an example of sound pressure versus time and an operation log in the image processing system. [Figure 4] FIG. 10 is a diagram showing an example of profile data obtained by calculating noise levels for each time period and for each frequency period from frequency analysis data. [Figure 5] 4 is a flowchart showing the flow of processing that is handled by a processing device of the image processing system according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0032] Hereinafter, an example of an embodiment of the present disclosure will be described with reference to the drawings.

[0033] [First embodiment] In the first embodiment, an image processing system will be described as an example of a processing system. Fig. 1 is a block diagram showing a schematic configuration of the image processing system according to the first embodiment.

[0034] 1, the image processing system 10 includes a scanning unit 12, a printing unit 13, a processing device 14, a sound sensor 16, and a document sensor 40. The processing device 14 further includes an image processing control unit 17, an abnormal sound detection processing unit 18, a display unit 32, an operation unit 34, and a communication interface 36.

[0035] Scan unit 12 is an example of a reading unit that transports multiple documents and reads each document. Scan unit 12 performs a document reading process accompanied by operating sounds. As an example of the document reading process, the process of transporting the document to a reading position of scan unit 12, the process of reading the document, and the process of discharging the document are performed sequentially and continuously for multiple documents. When an operation command to read a document is input from image processing control unit 17, scan unit 12 reads the document, obtains image data of the read image, and discharges the document to a discharge unit.

[0036] The document sensor 40 is a sensor that detects the position of the document when the document is transported to the reading position of the scan unit 12 and then discharged. As an example, the document is placed in a document setting unit, transported to the reading position of the scan unit 12, and then discharged to a discharge unit. For example, a plurality of document sensors 40 are arranged, and the position of the document is detected by the plurality of document sensors 40. For example, if a document jam occurs, the document sensor 40 detects the document jam.

[0037] The printing unit 13 prints image data and the like on recording paper. For example, the printing unit 13 performs processes such as transporting recording paper to a printing position of the printing unit 13, printing on the recording paper, and discharging the printed recording paper. Specifically, the printing unit 13 includes an electrophotographic printing mechanism and a recording paper transport mechanism. When image data indicating an image to be printed and various operational commands are input from the image processing control unit 17, the printing unit 13 prints on one or both sides of the recording paper and discharges it to an external paper output tray. While the image processing system 10 includes the printing unit 13 in the first embodiment, the present disclosure is not limited thereto, and the image processing system may be configured without the printing unit 13. For example, the image processing system may be configured to be connected to an external printing unit via a communication interface 36.

[0038] The sound sensor 16 collects operating sounds generated in association with the operation of the scanning unit 12. That is, the sound sensor 16 collects operating sounds generated in the image processing system 10 in association with the transport of an original document in the scanning unit 12, etc.

[0039] Image processing control unit 17 outputs an operation command to scan unit 12 to read a document, and controls the operation of scan unit 12. Image processing control unit 17 also outputs an operation command to print image data to print unit 13, and controls the operation of print unit 13. Image processing control unit 17 acquires an operation log of scan unit 12, which will be described later.

[0040] The display unit 32 displays various information. As an example, the display unit 32 is configured with a liquid crystal display. The image processing control unit 17 controls the display screen of the display unit 32.

[0041] The operation unit 34 performs operations such as operation instructions from the user. The image processing control unit 17 accepts operation instructions from the user from the operation unit 34. The operation unit 34 may be, for example, an operation button, or may be a touch panel UI (user interface) configured with a liquid crystal display or the like that allows the user to operate by touching the display. Note that, although the display unit 32 and the operation unit 34 are separate in the first embodiment, they may be configured with an operation panel that has the function of displaying various information and the function of accepting operations by the user.

[0042] The communication interface 36 is an interface for communicating with a network, and uses standards such as Ethernet (registered trademark), FDDI, and Wi-Fi (registered trademark). The network may be, for example, the Internet, or a wired or wireless network. The image processing system 10 can be connected to an external server 50 via the communication interface 36.

[0043] The abnormal sound detection processor 18 acquires sound data representing collected information on the operating sound of the scanning unit 12, and detects abnormal sounds that differ from sounds emitted under normal conditions from the sound data and an operation log (described later) of the scanning unit 12. The abnormal sounds are an example of abnormal sounds. Furthermore, the abnormal sound detection processor 18 estimates the nature of the abnormality by performing frequency analysis to compare the abnormal sound with reference data on the nature of the abnormality.

[0044] Specifically, the abnormal sound detection processing unit 18 has the functions of an abnormal sound detection control unit 20, a sound sensor control unit 22, a frequency analysis unit 24, an abnormal sound detection unit 26, an abnormality content estimation unit 28, and a memory unit 30. The memory unit 30 includes a sound data storage area 30A, an abnormal sound determination data storage area 30B, and an operation log storage area 30C.

[0045] The abnormal sound detection control unit 20 controls each unit of the abnormal sound detection processing unit 18. As an example, after the image processing control unit 17 notifies the abnormal sound detection control unit 20 of the position information of the document, the abnormal sound detection control unit 20 notifies the sound sensor control unit 22 of the start of collecting sound data.

[0046] Furthermore, the abnormal sound detection control unit 20 writes the operation log notified by the image processing control unit 17 to the operation log storage area 30C of the memory unit 30. Here, the operation log refers to information on the operation history recorded regarding the operating status. FIG. 3 is a diagram showing an example of the sound pressure of the operation sound over time and the operation log in the image processing system 10. As shown in FIG. 3, the operation log is information on the operation history indicating which parts (e.g., one or more of parts A, B, C, and D) are operating in accordance with the document position information. For example, the abnormal sound detection control unit 20 refers to the operation log, and upon recognizing that the document scanning process has ended, notifies the sound sensor control unit 22 that the collection of sound data has ended.

[0047] The sound sensor control unit 22 controls the collection of operation sounds (i.e., sound data) by the sound sensor 16. For example, when the sound sensor control unit 22 is notified by the abnormal sound detection control unit 20 to start collecting sound data, it acquires the sound data from the sound sensor 16 and writes it to the sound data storage area 30A of the memory unit 30. Furthermore, when the sound sensor control unit 22 is notified by the abnormal sound detection control unit 20 that the collection of sound data has ended, the sound sensor control unit 22 ends writing of the sound data. For example, if the document has multiple pages, the sound sensor control unit 22 may continuously collect sound data from multiple pages of the document and, based on the collected sound data, extract the sound data that corresponds to one page.

[0048] The frequency analysis unit 24 performs frequency analysis on the sound data collected by the sound sensor 16. For example, when the frequency analysis unit 24 receives a frequency analysis request from the abnormal sound detection control unit 20, it reads the sound data from the sound data storage area 30A of the memory unit 30 and performs frequency analysis. As an example, the frequency analysis data resulting from the frequency analysis is short-time Fourier transform (STFT) data, i.e., data obtained by Fourier transforming sound data for each predetermined time period to extract frequency data and showing time-series changes in this frequency data for each predetermined time period. The frequency analysis unit 24 writes the frequency analysis data resulting from the frequency analysis to the abnormal sound determination data storage area 30B of the memory unit 30. Furthermore, in the first embodiment, as shown in FIG. 4, the frequency analysis unit 24 analyzes the frequency analysis data for one page of paper in the time axis and frequency axis directions to create profile data (i.e., noise levels, which are sound pressures for each frequency, and noise levels, which are sound pressures for each time period). The frequency analysis unit 24 writes the profile data into the abnormal sound detection data storage area 30B of the storage unit 30 as abnormal sound detection data.

[0049] The abnormal sound detection unit 26 detects the presence or absence of an abnormal sound that differs from sounds emitted under normal conditions from the sound data. For example, when the abnormal sound detection unit 26 receives an abnormal sound detection request from the abnormal sound detection control unit 20, the abnormal sound detection unit 26 detects the presence or absence of an abnormal sound. For example, the abnormal sound detection unit 26 reads the sound data from the sound data storage area 30A of the memory unit 30, and detects (detects) the presence or absence of an abnormal sound that differs from sounds emitted under normal conditions from the operation log and sound data of the scanning unit 12. Normal sound data, which is an example of sounds emitted under normal conditions, is stored in advance in the abnormal sound determination data storage area 30B.

[0050] As an example, the abnormal sound detection processing unit 18 may be equipped with a machine learning function and use sound data and learning data to detect the presence or absence of an abnormal sound. Learning data is information required for training a machine learning model. The machine learning function can use this information multiple times to adjust predictions, thereby increasing the accuracy rate.

[0051] When abnormal sound detection unit 26 detects the occurrence of an abnormal sound, it notifies the abnormal sound detection control unit 20. Because abnormal sound detection unit 26 performs real-time processing (processing in which abnormal sounds are detected for each page in synchronization with scanning processing in which multiple pages of documents are read consecutively), it does not identify which part or document transport position the abnormality occurred in.

[0052] When an abnormal sound is detected, the abnormality content estimation unit 28 estimates the content of the abnormality by performing frequency analysis to compare the abnormal sound with reference data for the abnormality content. For example, when the abnormal sound detection control unit 20 is notified of the occurrence of an abnormal sound by the abnormal sound detection unit 26, it notifies the abnormality content estimation unit 28 of a request to estimate the content of the abnormality.

[0053] When an abnormal sound is detected, the abnormality content estimation unit 28 identifies the timing of the abnormal sound by combining the acquired sound data with the data in the operation log. For example, the abnormal sound detection unit 26 identifies the period during which the detection target part is operating from the operation log. As shown in FIG. 3, by referring to the operation log and transport time information from a reference position indicating the transport position information of the paper, the abnormal sound detection unit 26 identifies the period from when the paper reaches the reference position for collecting the operation sound until the detection target part starts operating, and the period from when the detection target part starts operating until it stops operating.

[0054] The abnormality content estimation unit 28 reads out frequency analysis data (profile data shown in FIG. 4 in the first embodiment) from the abnormal sound detection data storage area 30B of the memory unit 30, and estimates the content of the abnormality by comparing the frequency analysis data with reference data of the abnormality content. Examples of the abnormality content include the occurrence of wrinkles or creases in the document or the occurrence of a mix of document types. The reference data of the abnormality content is stored in advance in the abnormal sound detection data storage area 30B. Examples of the reference data of the abnormality content include abnormal sound information (information such as frequency) when wrinkles or creases in the document occur, and abnormal sound information when a mix of document types occur.

[0055] For example, as shown in FIG. 3, the identified detection target part is part B, which is highly likely to cause creasing of the document, and the period during which the detection target part is in operation is the period of signal 1.

[0056] Information about the detection target parts (i.e., which parts are to be detected) may be acquired from outside by connecting to an external server 50 via the communication interface 36. The detection target parts of interest may change depending on the time of installation and the operating time after installation. The abnormality content estimation unit 28 may extract and read out frequency analysis data for the period during which the detection target parts are operating from the abnormal sound determination data storage area 30B, based on the period during which the identified detection target parts are operating.

[0057] For example, when the abnormal sound that has occurred is equivalent to reference data (for example, frequency band and waveform) that is abnormal sound information when wrinkles occur in paper, which is an example of abnormal sound, the abnormality content estimation unit 28 estimates that wrinkles have occurred in paper.

[0058] As an example, abnormal sound information (information such as frequency) when paper wrinkles occur is data obtained by collecting and frequency-analyzing sounds collected during paper transport for various paper types and types of wrinkles during the design and development of the printing device.Furthermore, data obtained by frequency-analyzing sounds collected during paper transport for various paper types and types of wrinkles may be trained as a large amount of machine learning data, and this training data may be used to determine the nature of the abnormality.

[0059] Furthermore, the abnormality content estimation unit 28 may estimate the reading location of the image read by the scanning unit 12 that corresponds to the document from which the abnormal sound occurred, based on the operation log and sound data during the period when the detection target part is in operation.

[0060] For example, the abnormality content estimation unit 28 outputs the estimated content of the abnormality to the abnormal sound detection control unit 20. Furthermore, when the abnormality content estimation unit 28 estimates the reading location corresponding to the document where the abnormal sound occurred, it outputs the reading location corresponding to the document where the abnormal sound occurred to the abnormal sound detection control unit 20 along with the content of the abnormality.

[0061] As an example, the abnormality is an abnormality that does not hinder the transport of the document. When a document jam occurs during the transport of the document (for example, when a document jam is detected), image processing control unit 17 stops the scanning unit 12 from reading the document. For example, a document jam is detected by a signal from document sensor 40. Abnormality content estimation unit 28 may be configured to estimate the abnormality when a document jam does not occur during the transport of the document.

[0062] The abnormal sound detection control unit 20 may output the details of the abnormality to the display unit 32 via the image processing control unit 17. As a result, the details of the abnormality and the like are displayed on the display unit 32. Furthermore, the abnormal sound detection control unit 20 may output the details of the abnormality, as well as the read portion corresponding to the document from which the abnormal sound occurred, to the display unit 32 via the image processing control unit 17. As a result, the details of the abnormality and the read portion are displayed on the display unit 32.

[0063] When receiving an operation to reread the document from the user, image processing control unit 17 may cause scanning unit 12 to reread the document. For example, when a document is set in the document setting unit of scanning unit 12 and an instruction to reread the document is input via operation unit 34, scanning unit 12 may cause the document to be reread.

[0064] In addition, when the image processing control unit 17 receives an operation to re-read the part of the document corresponding to the read location of the document where the abnormal noise occurred, it may perform a re-read of the document by the scanning unit 12 and replace the read location of the read image with the image obtained by the re-reading.

[0065] FIG. 2 is a block diagram showing the hardware configuration of the processing device 14 in the image processing system 10 according to the first embodiment.

[0066] 2, the image processing system 10 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, a storage 114, a display unit 32, an operation unit 34, a communication interface 36, and an input / output interface 115. Each component is connected to each other via a bus 119 so as to be able to communicate with each other.

[0067] The CPU 111 is a central processing unit that executes various programs and controls each component. The CPU 111 is an example of a processor. The CPU 111 reads a program from the ROM 112 or the storage 114, and executes the program using the RAM 113 as a work area. The CPU 111 controls the above components and performs various arithmetic processing in accordance with the program recorded in the ROM 112 or the storage 114. In this embodiment, an information processing program is stored in the ROM 112 or the storage 114.

[0068] The CPU 111 functions as the image processing control unit 17, the abnormal sound detection control unit 20 in the abnormal sound detection processing unit 18, the sound sensor control unit 22, the frequency analysis unit 24, the abnormal sound detection unit 26, and the abnormality content estimation unit 28. In other words, the CPU 111 performs various processes by the image processing control unit 17, and various processes by the abnormal sound detection control unit 20, the sound sensor control unit 22, the frequency analysis unit 24, the abnormal sound detection unit 26, and the abnormality content estimation unit 28. As an example, the image processing system 10 is configured such that each unit is controlled by a single CPU 111.

[0069] The ROM 112 stores various programs and various data. The RAM 113 temporarily stores programs or data as a working area. The storage 114 is configured with an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs including an operating system and various data.

[0070] In the first embodiment, the RAM 113 or the storage 114 functions as the storage unit 30. The processing device 14 shown in FIG.

[0071] The input / output interface 115 is an interface for transmitting and receiving information to and from peripheral devices. In the first embodiment, information may be transmitted and received to and from the scanning unit 12, printing unit 13, sound sensor 16, document sensor 40, and the like via the input / output interface 115. Furthermore, any one or more of the scanning unit 12, printing unit 13, sound sensor 16, and document sensor 40 may be directly connected via the bus 119.

[0072] (Operation of the first embodiment) Next, the operation of the image processing system 10 of the first embodiment will be described.

[0073] 5 is a flowchart showing the flow of information processing handled by the processing device 14 of the image processing system 10 of the first embodiment. In the processing device 14, the CPU 111 reads an information processing program from the ROM 112 or the storage 114, expands it in the RAM 113, and executes it, thereby performing information processing.

[0074] CPU 111 starts scanning (i.e., reading) the document using scan unit 12 (step S201). For example, CPU 111 receives an instruction to start scanning the document when the user issues an instruction to start scanning the document from operation unit 34. CPU 111 starts scanning the document by outputting an operation command to start scanning to scan unit 12.

[0075] The CPU 111 starts collecting operation sounds using the sound sensor 16 (step S202). For example, the operation sounds are collected by recording the operation sounds. The CPU 111 writes sound data, which is information about the collected operation sounds, into the sound data storage area 30A of the memory unit 30. Also, for example, the CPU 111 acquires an operation log of the scan unit 12 and writes the operation log into the operation log storage area 30C of the memory unit 30.

[0076] The CPU 111 starts detecting abnormal sounds (step S203). For example, the CPU 111 acquires the operation log of the scan unit 12 from the operation log storage area 30C, and acquires sound data from the sound data storage area 30A. Furthermore, the CPU 111 acquires normal sound data, which is sound generated under normal conditions and corresponds to the operation log of the scan unit 12, from the abnormal sound detection data storage area 30B. The CPU 111 starts detecting abnormal sounds that differ from the normal sound data from the operation log and the sound data. For example, if the CPU 111 detects an abnormal sound, it writes information about the abnormal sound to the abnormal sound detection data storage area 30B.

[0077] CPU 111 determines whether a document jam has occurred (step S204). For example, CPU 111 determines that a document jam has occurred when a signal from document sensor 40 indicates that the document has not been conveyed to a position determined in accordance with the time since the start of document conveyance. Alternatively, for example, CPU 111 may determine that a document jam has occurred by detecting an abnormal sound that is different from normal sound data.

[0078] If a document jam occurs (step S204: YES), CPU 111 stops scanning by scanning unit 12 (step S205).

[0079] If no document jam occurs (step S204: NO), CPU 111 detects the occurrence of a scan abnormality after the scan is completed (step S208). For example, after the scan is completed, CPU 111 detects the occurrence of a scan abnormality by performing frequency analysis to compare the abnormal sound with reference data on the abnormality content based on the information on the abnormal sound detected in step S203, thereby estimating the content of the scan abnormality.

[0080] For example, CPU 111 acquires abnormal sound detection data (e.g., profile data shown in FIG. 4) from abnormal sound detection data storage area 30B and identifies the period during which the detection target component is operating from the operation log. Furthermore, CPU 111 uses abnormal sound detection data (e.g., profile data shown in FIG. 4) obtained by frequency-analyzing sound data from the period during which the detection target component is operating and compares the data with reference data for the abnormality content to estimate the content of the scanning abnormality. The reference data for the abnormality content is acquired from abnormal sound detection data storage area 30B. In this example, reference data for abnormal sounds made when a document is wrinkled or folded and reference data for abnormal sounds made when a mixture of document types occurs are acquired as the reference data for the abnormality content, and the content of the scanning abnormality is estimated.

[0081] After stopping the scan by the scan unit 12 in step S205, the CPU 111 outputs information on the stop of the scan and the document jam to the display unit 32 (step S206).

[0082] CPU 111 determines whether an instruction to perform a rescan has been received (step S207). For example, when the user resets the document in the document setting unit based on the information on scan stop and document jam displayed on display unit 32 and issues an instruction to perform a rescan from operation unit 34, it is determined that an instruction to perform a rescan has been received.

[0083] If the instruction to perform rescanning has been received (step S207: YES), CPU 111 returns to the process of step S201. That is, CPU 111 outputs an operation command to start scanning to scanning unit 12, thereby starting rescanning of the document.

[0084] If the instruction to perform a rescan has not been received (step S207: NO), CPU 111 ends the processing based on the information processing program of image processing system 10. For example, if the instruction to perform a rescan has not been received within a predetermined time, CPU 111 ends the processing based on the information processing program.

[0085] After the process in step S208, CPU 111 determines whether or not the document has been wrinkled (step S209). If the estimated scan abnormality is a wrinkle in the document, CPU 111 determines that the document has been wrinkled.

[0086] If the document is wrinkled or folded (step S209: YES), CPU 111 outputs the occurrence of wrinkles or folds in the document to display unit 32 (step S210). CPU 111 may also identify the reading location corresponding to the document from which the abnormal noise occurred, and output the reading location corresponding to this document to display unit 32.

[0087] The CPU 111 determines whether or not an instruction to perform a rescan has been received (step S211). For example, when the user resets the document in the document setting unit and issues an instruction to perform a rescan from the operation unit 34, the CPU 111 determines that an instruction to perform a rescan has been received.

[0088] If the instruction to perform rescanning is received (step S211: YES), CPU 111 returns to the process of step S201. That is, CPU 111 outputs an operation command to start scanning to scanning unit 12, thereby starting rescanning of the document.

[0089] At this time, the user may reset all of the documents in the document setting unit and instruct to rescan all of the documents, or may reset only the document at the reading location where the abnormality occurred in the document setting unit and instruct to rescan only the document at the reading location where the abnormality occurred. For example, when only the document at the reading location where the abnormality occurred is reset in the document setting unit and rescanned, the CPU 111 replaces the read location of the document in the scanned image with the image obtained by rescanning.

[0090] If the instruction to perform a rescan has not been received (step S211: NO), CPU 111 ends the processing based on the information processing program of image processing system 10. For example, if the instruction to perform a rescan has not been received within a predetermined time, CPU 111 ends the processing based on the information processing program.

[0091] If no creases or folds occur in the document (step S209: NO), CPU 111 determines whether or not a mixture of document types has occurred (step S212). For example, if the estimated scan abnormality is a mixture of document types, CPU 111 determines that a mixture of document types has occurred.

[0092] Furthermore, if a mixture of document types has occurred (step S212: YES), CPU 111 outputs the occurrence of a mixture of document types to display unit 32 (step S213). Furthermore, CPU 111 may identify the reading location corresponding to the document from which the abnormal noise has occurred, and output the reading location corresponding to this document to display unit 32.

[0093] The CPU 111 determines whether or not an instruction to perform a rescan has been received (step S214). For example, when the user resets the document in the document setting unit and issues an instruction to perform a rescan from the operation unit 34, it is determined that an instruction to perform a rescan has been received.

[0094] If the instruction to perform rescanning has been received (step S214: YES), CPU 111 returns to the process of step S201. That is, CPU 111 outputs an operation command to start scanning to scanning unit 12, thereby starting rescanning of the document.

[0095] At this time, the user may reset all of the documents in the document setting unit and instruct to rescan all of the documents, or may reset only the document at the reading location where the abnormality occurred in the document setting unit and instruct to rescan only the document at the reading location where the abnormality occurred. For example, when only the document at the reading location where the abnormality occurred is reset in the document setting unit and rescanned, the CPU 111 replaces the read location of the document in the scanned image with the image obtained by rescanning.

[0096] If the instruction to perform a rescan has not been received (step S214: NO), CPU 111 ends the processing based on the information processing program of image processing system 10. For example, if the instruction to perform a rescan has not been received within a predetermined time, CPU 111 ends the processing based on the information processing program.

[0097] If no mixture of document types occurs (step S212: NO), the processing based on the information processing program of the image processing system 10 ends.

[0098] In general, image processing systems stop scanning a document if a jam or other problem is detected during scanning. However, if there is little risk of damage to the document, such as wrinkles or folds, the scanning operation does not stop, and the scanning operation ends immediately without the user noticing. The user may later notice an abnormality when looking at the scanned image data. Examples of abnormalities include image cutoffs due to wrinkles or folds in the document, the presence of paper other than regular paper such as cardboard or irregularly sized documents, or a skewed document. If an abnormality is found in the image data, it may be necessary to scan the document again.

[0099] In the image processing system 10 described above, the CPU 111 acquires sound data representing collected information on the operating sounds generated by the scanning unit 12 as the document is transported. Furthermore, the CPU 111 detects abnormal sounds that differ from sounds emitted under normal conditions from the operation log and sound data of the scanning unit 12, estimates the nature of the abnormality by performing frequency analysis to compare the abnormal sounds with reference data on the abnormality, and outputs the nature of the abnormality. Therefore, in the image processing system 10, even if the document transport in the scanning unit 12 is not stopped, the user can be notified of the nature of the abnormality when an abnormal sound is detected.

[0100] Furthermore, in the image processing system 10, the abnormality is one that does not impede the transport of the document. Therefore, in the image processing system 10, the user can check the abnormality even when the transport of the document has been completed in the scanning unit 12.

[0101] Furthermore, in image processing system 10, CPU 111 estimates the scanned portion of the image scanned by scan unit 12 that corresponds to the document from which the abnormal sound occurred, based on the operation log and sound data, and outputs the scanned portion along with the details of the abnormality. The output may be, for example, a warning sound. Therefore, in image processing system 10, the user can confirm the scanned portion along with the details of the abnormality even if the document transport by scan unit 12 is not stopped.

[0102] Furthermore, in the image processing system 10, the CPU 111 outputs the details of the abnormality to the display unit 32. Therefore, in the image processing system 10, the user can be informed of the details of the abnormality more accurately than in the case where the details of the abnormality are notified by an alarm sound.

[0103] Furthermore, in the image processing system 10, the CPU 111 outputs the read location along with the details of the abnormality to the display unit 32. Therefore, in the image processing system 10, the user can be informed of the read location and the details of the abnormality more accurately than in the case where the details of the abnormality and the read location are informed by a warning sound.

[0104] Furthermore, in the image processing system 10, if a document jam occurs or is detected during document transport, the CPU 111 suspends document reading by the scanning unit 12. Therefore, in the image processing system 10, the occurrence of abnormalities in the read image can be reduced compared to when document reading is continued after a document jam occurs.

[0105] Furthermore, in image processing system 10, CPU 111 detects an abnormal sound and estimates the nature of the abnormality when no document jam occurs during document transport. Therefore, in image processing system 10, even when no document jam occurs, the user can be notified of the nature of the abnormality when an abnormal sound is detected.

[0106] Furthermore, in the image processing system 10, when the CPU 111 receives an operation to rescan the document, it causes the scanning unit 12 to rescan the document. Therefore, in the image processing system 10, the document can be rescanned in response to an operation to rescan the document by the user.

[0107] Furthermore, in image processing system 10, when CPU 111 receives an instruction to re-read the portion of the document corresponding to the reading location where the abnormality occurred, CPU 111 causes scanning unit 12 to re-scan the document and replaces the reading location of the scanned image with the image obtained by the re-scan. Therefore, in image processing system 10, the time required for re-scanning can be reduced compared to when re-scanning from the beginning of the document.

[0108] Furthermore, in the image processing system 10, after the scanning unit 12 scans the document, the CPU 111 displays the read image on the display unit 32. Therefore, in the image processing system 10, the user can check for abnormalities in the read image, compared to when the read image is not displayed on the display unit.

[0109] [Modification] In the image processing system 10 of the first embodiment, the occurrence of creases or folds in the document and the occurrence of mixed document types are estimated as the content of the scan abnormality, but the present disclosure is not limited to this configuration. For example, other abnormality content may be estimated by using reference data of other abnormality content, such as damage caused by folding the edge of the document.

[0110] 〔others〕 In the above embodiment, the image processing system 10 has been described as an example of a processing system, but the processing system is not limited to the image processing system 10. For example, the processing system may be an image forming system, a reading device equipped with a reading unit that transports documents and reads each document, or another processing device.

[0111] Furthermore, in the above embodiments, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPUs, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0112] Furthermore, the operations of the processors in the above embodiments may not only be performed by a single processor, but may also be performed by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processors is not limited to the order described in the above embodiments, and may be changed as appropriate.

[0113] The processing performed by the processor according to the above embodiment may be software, hardware, or a combination of both. The processing performed by the processor may be stored as a program on a storage medium and distributed.

[0114] Furthermore, the present disclosure is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit of the present disclosure.

[0115] The following additional notes are provided regarding the above-described embodiments. (((1))) a reading unit that conveys a plurality of documents and reads each of the documents; at least one processor; The processor: Acquiring sound data representing collected information of operation sounds generated in the reading unit in association with the transport of the document; Detecting an abnormal sound that is different from a sound emitted under normal conditions from the operation history of the reading unit and the sound data; Estimating the content of the abnormality by performing a frequency analysis that compares the abnormal sound with reference data of the content of the abnormality; A processing system that outputs the details of the abnormality.

[0116] (((2))) The processing system according to (((1))), wherein the content of the abnormality is an abnormality that does not hinder the transport of the document.

[0117] (((3))) The processor: based on the operation history and the sound data, estimating a read portion of the image read by the reading unit that corresponds to the document where the abnormal sound occurred; The processing system according to (((1))) or (((2))), wherein the read location is output together with the content of the abnormality.

[0118] (((4))) The processing system according to any one of (((1))) to (((3))), wherein the processor outputs details of the abnormality to a display unit that displays information.

[0119] (((5))) The processing system according to (((3))), wherein the processor outputs the read location together with the content of the abnormality to a display unit that displays information.

[0120] (((6))) The processor: A processing system described in any one of (((1))) to (((3))), wherein if a jam occurs or is detected in the document during transport, the reading unit stops reading the document.

[0121] (((7))) The processor: The processing system according to (((6))), wherein if no jamming of the document occurs during transport of the document, the abnormal sound is detected and the nature of the abnormality is estimated.

[0122] (((8))) The processor: The processing system according to any one of (((1))) to (((7))), wherein, when an operation to reread the document is received, the reading unit rereads the document.

[0123] (((9))) The processor: When an operation to reread the document corresponding to the read location is received, the document is reread by the reading unit; The processing system according to (((3))), wherein the read portion of the read image is replaced with the re-read image.

[0124] (((10))) The processor: The processing system according to any one of (((1))) to (((9))), wherein after the document is read by the reading unit, a read image is displayed on a display unit that displays information.

[0125] (((11))) The computer Acquiring sound data representing collected information of operation sounds generated in a reading unit that conveys a plurality of documents and reads each of the documents while the documents are being conveyed; Detecting an abnormal sound that is different from a sound emitted under normal conditions from the operation history of the reading unit and the sound data; Estimating the content of the abnormality by performing a frequency analysis that compares the abnormal sound with reference data of the content of the abnormality; A processing method for outputting the details of the abnormality.

[0126] (((12))) On the computer, Acquiring sound data representing collected information of operation sounds generated in a reading unit that conveys a plurality of documents and reads each of the documents while the documents are being conveyed; Detecting an abnormal sound that is different from a sound emitted under normal conditions from the operation history of the reading unit and the sound data; Estimating the content of the abnormality by performing a frequency analysis that compares the abnormal sound with reference data of the content of the abnormality; A processing program for executing a process for outputting the details of the abnormality.

[0127] According to the processing system described in (((1))), even if the transport of the document in the reading unit is not stopped, when an abnormal sound is detected, the user can be notified of the content of the abnormality.

[0128] According to the processing system described in (((2))), even when the transport of the document has been completed in the reading unit, the user can check the details of the abnormality.

[0129] According to the processing system described in (((3))), even if the transport of the document in the reading unit is not stopped, the user can check the content of the abnormality as well as the reading location.

[0130] According to the processing system described in (((4))), the content of the abnormality can be more accurately notified to the user than when the content of the abnormality is notified by a warning sound.

[0131] According to the processing system described in (((5))), the user can be informed of the read location and the content of the abnormality more accurately than when the content and the read location of the abnormality are informed by a warning sound.

[0132] According to the processing system described in (((6))), it is possible to suppress the occurrence of abnormalities in the read image compared to when reading of the document continues after a document jam occurs.

[0133] According to the processing system described in (((7))), even if no document jam occurs, when an abnormal sound is detected, the user can be notified of the details of the abnormality.

[0134] According to the processing system described in (((8))), the document can be reread by the user's operation to reread the document.

[0135] According to the processing system described in (((9))), the time required for re-reading can be reduced compared to when re-reading the document from the beginning.

[0136] According to the processing system described in (((10))), the user can check for abnormalities in the read image, compared to when the read image is not displayed on the display unit.

[0137] According to the processing method described in (((11))), even if the transport of the document in the reading unit is not stopped, when an abnormal sound is detected, the user can be notified of the content of the abnormality.

[0138] According to the processing program described in (((12))), even if the transport of the document in the reading unit is not stopped, when an abnormal sound is detected, the user can be notified of the details of the abnormality. [Explanation of symbols]

[0139] 10 Image Processing System 12 Scanning section 14 Processing equipment 16 Sound Sensor 17 Image processing control unit 18 Abnormal sound detection processing unit 20 Abnormal noise detection control unit 22 Sound sensor control unit 24 Frequency analysis section 26 Abnormal noise detection unit 28 Abnormal content estimation part 30 Storage section 30A Sound data storage area 30B Data storage area for abnormal noise detection 30B Sound data storage area 30C Operation log storage area 32 Display section 34 Control section 36 Communication Interface 40 Document sensor 50 external servers 111 CPU (an example of a processor)

Claims

1. a reading unit that conveys a plurality of documents and reads each of the documents; at least one processor; The processor: Acquiring sound data representing collected information of operation sounds generated in the reading unit in association with the transport of the document; Detecting an abnormal sound that is different from a sound emitted under normal conditions from the operation history of the reading unit and the sound data; Estimating the content of the abnormality by performing a frequency analysis that compares the abnormal sound with reference data of the content of the abnormality; A processing system that outputs the details of the abnormality.

2. The processing system according to claim 1 , wherein the abnormality does not hinder the transport of the document.

3. The processor: based on the operation history and the sound data, estimating a read portion of the image read by the reading unit that corresponds to the document where the abnormal sound occurred; The processing system according to claim 1 , wherein the read location is output together with the content of the abnormality.

4. The processing system according to claim 1 , wherein the processor outputs details of the abnormality to a display unit that displays information.

5. The processing system according to claim 3 , wherein the processor outputs the read location together with the content of the abnormality to a display unit that displays information.

6. The processor:

2. The processing system according to claim 1, wherein when a jam of the document occurs or is detected during transport of the document, the reading unit stops reading the document.

7. The processor:

7. The processing system according to claim 6, wherein the abnormal sound is detected and the nature of the abnormality is estimated when no jamming of the document occurs during transport of the document.

8. The processor: The processing system according to claim 1 , wherein when an operation to reread the document is received, the document is reread by the reading unit.

9. The processor: When an operation to reread the document corresponding to the read location is received, the document is reread by the reading unit; The processing system according to claim 3 , wherein the read portion of the read image is replaced with the re-read image.

10. The processor: The processing system according to claim 1 , wherein after the document is read by the reading section, a read image is displayed on a display section that displays information.

11. The computer Acquiring sound data representing collected information of operation sounds generated in a reading unit that conveys a plurality of documents and reads each of the documents while the documents are being conveyed; Detecting an abnormal sound that is different from a sound emitted under normal conditions from the operation history of the reading unit and the sound data; Estimating the content of the abnormality by performing a frequency analysis that compares the abnormal sound with reference data of the content of the abnormality; A processing method for outputting the details of the abnormality.

12. On the computer, Acquiring sound data representing collected information of operation sounds generated in a reading unit that conveys a plurality of documents and reads each of the documents while the documents are being conveyed; Detecting an abnormal sound that is different from a sound emitted under normal conditions from the operation history of the reading unit and the sound data; Estimating the content of the abnormality by performing a frequency analysis that compares the abnormal sound with reference data of the content of the abnormality; A processing program for executing a process for outputting the details of the abnormality.

Images