Image processing device and method for identifying abnormal noise from image processing device

Abstract

To provide an image processing apparatus and an image processing method that can efficiently identify an unusual sound at the occurrence of a trouble that is an important element to determine the cause of the trouble.SOLUTION: An image processing apparatus comprises acquisition means, playback means, changing means, and determination means. The acquisition means acquires a plurality of pieces of sound data indicating sounds different from each other. The playback means plays back one piece of sound data of the pieces of sound data. The changing means changes the one piece of sound data to another piece of sound data. The determination means determines one piece of sound data from the pieces of sound data.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The embodiments of the present invention relate to an image processing device and an image processing Identifying abnormal noises from equipment Regarding the method. [Background technology]

[0002] When a malfunction occurs in an image processing device such as an MFP (digital multi-functional peripheral), an abnormal noise may be generated. For an operator performing maintenance work on the image processing device, the abnormal noise generated when the malfunction occurs is an important factor in identifying the cause of the malfunction. However, even if an operator asks the user what kind of abnormal noise was heard, it is difficult to identify the abnormal noise from the user's words alone. Furthermore, if the abnormal noise occurs only once, it is not possible to reproduce the abnormal noise. Therefore, there is a demand for a system that can efficiently identify the abnormal noise generated when a malfunction occurs. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-179863 Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide an image processing device and an image processing method that can efficiently identify abnormal noises that occur when a malfunction occurs, which is an important factor in identifying the cause of the malfunction. Identifying abnormal noises from equipment It aims to provide a method. [Means for solving the problem]

[0005] The image processing device The device includes a processor and a memory. The memory stores a program that causes the processor, when instructed to identify an abnormal sound when a malfunction occurs, to acquire a playback list indicating a playback order of multiple sample audio abnormal sounds in descending order of frequency of occurrence and an audio source file containing the sample audio abnormal sounds, to play one sample audio abnormal sound determined in accordance with the playback order indicated by the playback list, and, when instructed that the played sample audio abnormal sound is the same as or similar to the abnormal sound heard by the user when the malfunction occurs, to determine that the played sample audio abnormal sound is the same as or similar to the abnormal sound heard by the user when the malfunction occurs. [Brief explanation of the drawings]

[0006] [Figure 1]FIG. 2 is a block diagram showing the main circuit configuration of the MFP. [Figure 2] FIG. 2 is a block diagram showing the main circuit configuration of a management server. [Figure 3] FIG. 10 is a schematic diagram showing an example of a playlist. [Figure 4] FIG. 2 is a schematic diagram showing an example of the data structure of an audio source record stored in an audio source file. [Figure 5] 4 is a flowchart showing a control procedure for a main part of a processor in the MFP. [Figure 6] 4 is a flowchart showing a control procedure for a main part of a processor in the MFP. [Figure 7] 10 is a flowchart showing a procedure for controlling the main parts of a processor in the management server. [Figure 8] FIG. 10 is a schematic diagram showing an example of a defect report screen. [Figure 9] FIG. 10 is a schematic diagram showing an example of an abnormal sound search screen. DETAILED DESCRIPTION OF THE INVENTION

[0007] An embodiment will be described below with reference to the drawings.

[0008] 1 is a block diagram showing a schematic configuration of an MFP 10 according to an embodiment. The MFP 10 is an example of an image processing device. The MFP 10 includes a scanner 11, a printer 12, a control system 13, and an operation panel 14. The scanner 11, the printer 12, and the operation panel 14 are connected to the control system 13.

[0009] The scanner 11 is a device that optically reads an image of a document and converts it into image information in response to an operational instruction from the control system 13. The scanner 11 outputs the read image information of the document to the control system 13.

[0010] The printer 12 prints an image on paper based on image information supplied from the control system 13 under various printing conditions specified by the control system 13. Printers using various image forming methods can be used as the printer 12. For example, the printer 12 may be an electrophotographic printer, an inkjet printer, a thermal transfer printer, or the like.

[0011] The control system 13 comprehensively controls the operations of each section, such as the scanner 11, the printer 12, and the operation panel 14. The control system 13 also executes various processes, such as image processing. The control system 13 includes a processor 131, a RAM (random-access memory) 132, a ROM (read-only memory) 133, a data memory 134, an image memory 135, an image processing unit 136, a FAX (facsimile) interface (I / F) 137, and a communication interface (I / F) 138.

[0012] The processor 131 executes processes such as calculations and controls in accordance with a program. The processor 131 is, for example, a CPU (central processing unit). The processor 131 realizes various processing functions by executing programs stored in the ROM 133 or the data memory 134. The RAM 132 is a working memory. The RAM 132 is, for example, a volatile memory. The ROM 133 is a program memory. The ROM 133 is, for example, a non-volatile memory.

[0013] The data memory 134 stores control data, control programs, setting information, etc. The data memory 134 is, for example, a non-volatile memory. The image memory 135 is configured with a hard disk drive, page memory, etc. The image memory 135 stores image information. The image processing unit 136 performs image processing on the image information.

[0014] The FAX interface 137 is an interface for performing FAX communication. The communication interface 138 is a network interface for performing data communication with an external device such as the management server 20 via a network such as the Internet 1.

[0015] The operation panel 14 is a user interface. The operation panel 14 includes a touch panel 141 and an input device 142. The touch panel 141 is configured by stacking a display, such as a liquid crystal display or an organic electroluminescence (EL) display, and a sensing device that detects touch input. The input device 142 is, for example, a button, a keyboard, a keypad, or a touchpad.

[0016] The management server 20 provides a plurality of sound data representing different sounds that are necessary to identify abnormal sounds during maintenance work on the MFP 10. The management server 20 provides a playlist and sound source files to the MFP 10 via the Internet 1. The playlist and sound source files will be described later.

[0017] 2 is a block diagram showing the main circuit configuration of the management server 20. The management server 20 includes a processor 21, a main memory 22, an auxiliary storage device 23, a communication interface 24, and a system transmission path 25. The system transmission path 25 includes an address bus, a data bus, a control signal line, etc. The management server 20 connects the processor 21, the main memory 22, the auxiliary storage device 23, and the communication interface 24 to the system transmission path 25. In the management server 20, a computer is configured by the processor 21, the main memory 22, the auxiliary storage device 23, and the system transmission path 25 that connects them.

[0018] The processor 21 controls each unit in accordance with an operating system or an application program to realize various functions of the management server 20. The processor 21 is, for example, a CPU.

[0019] The main memory 22 includes a nonvolatile memory area and a volatile memory area. The main memory 22 stores an operating system or application programs in the nonvolatile memory area. The main memory 22 stores data required for the processor 21 to execute processes for controlling each part in the volatile memory area. The above data may also be stored in the nonvolatile memory area. The main memory 22 uses the volatile memory area as a work area where data can be rewritten by the processor 21 as appropriate. The nonvolatile memory area is, for example, ROM. The volatile memory area is, for example, RAM.

[0020] The auxiliary storage device 23 is, for example, an EEPROM (registered trademark) (electric erasable programmable read-only memory), an HDD (hard disk drive), or an SSD (solid state drive). The auxiliary storage device 23 stores data used by the processor 21 when performing various processes, or data created by the processes in the processor 21. The auxiliary storage device 23 may also store the above-mentioned application programs.

[0021] The communication interface 24 is an interface circuit for transmitting and receiving data to and from the MFP 10 connected via the Internet 1 in accordance with a predetermined communication protocol.

[0022] The management server 20 configured as above stores a playlist 231 (see FIG. 3) and a plurality of sound source files 232 in the auxiliary storage device 23. The playlist 231 is a list indicating the playback order of the plurality of sound source files 232. The sound source file 232 stores a sound source record 2321 (see FIG. 4) for each sound source file name.

[0023] FIG. 3 is a schematic diagram showing an example of a playlist 231. As shown in FIG. 3, the playlist 231 has areas for storing pointer N and sound source file names. Pointer N is a unique value assigned to each sound source file 232 to identify the sound source file 232. The sound source files 232 are played in ascending order of pointer N value, i.e., from the beginning of the playlist 231. The playback order is prioritized and played in descending order of priority. For example, the order may be the order of sound source files that frequently generate abnormal noises related to the MFP 10 in the market, sound source files that have a high risk of sound source harm, sound source files with distinctive sounds, or sound source files related to parts of the MFP 10 that are highly deteriorated. In this embodiment, the playback order is set in advance by an operator or the like. Note that the storage destination of the playlist 231 and the sound source files 232 is not limited to the auxiliary storage device 23. The playlist 231 and the sound source files 232 may be stored in a volatile memory area of ​​the main memory 22. The playlist 231 is not limited to the data of the above-mentioned items.

[0024] FIG. 4 is a schematic diagram showing an example of the data structure of a sound source record 2321 stored in the sound source file 232. As shown in FIG. 4, the sound source record 2321 includes sample sound data of the abnormal sound, related parts data, defect data, and the risk of the sound source. The related parts data is, for example, information on components of the MFP 10 that are expected to be the source of the abnormal sound. The defect data is, for example, information on the occurrence of white streaks during printing when an abnormal sound occurs. The risk of the sound source is the degree of possibility that the abnormal sound will cause a malfunction of the MFP 10. The sound source record 2321 is not limited to the data of the items described above.

[0025] 5 and 6 are flowcharts showing the main information processing procedures executed by processor 131 of MFP 10 in accordance with a control program. FIG. 7 is a flowchart showing the main information processing procedures executed by processor 21 of management server 20 in accordance with a control program. The operations of MFP 10 and management server 20 will be described below using these figures. Note that the operation procedures and their contents described below are merely examples. The procedures and contents are not limited as long as similar results are obtained.

[0026] During maintenance work on the MFP 10, the worker switches the operation mode of the MFP 10 from normal mode to malfunction mode. When the worker touches a malfunction button displayed on the touch panel 141, the operation mode switches to malfunction mode. That is, in ACT 1, processor 131 of MFP 10 waits for a touch on a problem button displayed on touch panel 141. If the problem button is touched, processor 131 determines YES in ACT 1 and proceeds to ACT 2. In ACT 2, processor 131 causes touch panel 141 to display problem report screen 100 (see FIG. 8) as a problem mode.

[0027] FIG. 8 is a schematic diagram showing an example of a defect report screen 100. As shown in FIG. 8, the defect report screen 100 displays a check box 101 for selecting a defect, a check box 102 for inputting an abnormal sound if one is generated when the defect occurs, and an abnormal sound button 103 for identifying a sample sound of the abnormal sound. The defect may be, for example, a paper jam, a white streak, or the like. The defect report screen 100 also displays a send button 104 for confirming transmission after a check is entered in the check box 101 or in the check boxes 101 and 102. The abnormal sound button 103 may be enabled when a check is entered in the check box 102. Note that the content of the text data displayed in FIG. 8 is an example.

[0028] Returning to the explanation of Figure 5, in ACT 3, the processor 131 of the MFP 10 checks whether the abnormal sound button 103 on the malfunction report screen 100 has been touched. If the abnormal sound button 103 has been touched, the processor 131 determines YES in ACT 3 and proceeds to ACT 4.

[0029] The processor 131 controls the communication interface 138 to request the playlist 231 and the first sound source file 232 of the playlist 231 from the management server 20 as ACT4. By this control, a list request command is sent via the communication interface 138.

[0030] The processor 21 of the management server 20 waits for a list request command to be received from the MFP 10 via the communication interface 138 as ACT31 in FIG.

[0031] When a list request command is received, the processor 21 determines YES in ACT 31 and proceeds to ACT 32. In ACT 32, the processor 21 controls the communication interface 24 to transmit the playlist 231 and the first sound source file 232 of the playlist 231 to the MFP 10. By this control, the playlist 231 and the first sound source file 232 of the playlist 231 are transmitted via the communication interface 24.

[0032] Returning to the explanation of Figure 5. The processor 131 of the MFP 10, which controlled the transmission of the list request command in ACT4, waits for the playlist 231 and the first sound source file 232 of the playlist 231 from the management server 20 in ACT5. When the playlist 231 and the first sound source file 232 of the playlist 231 are received from the management server 20, the processor 131 determines YES in ACT5 and proceeds to ACT6.

[0033] In ACT6, the processor 131 stores the sound source file 232 in the data memory 134. In ACT7, the processor 131 causes the touch panel 141 to display the unusual sound search screen 200 (see FIG. 9).

[0034] FIG. 9 is a schematic diagram showing an example of an unusual sound search screen 200. As shown in FIG. 9, the unusual sound search screen 200 displays a sound source file name 201, data included in a sound source record 2321, and a seek bar 202. When the operator taps or drags the seek bar 202, a sample sound of the selected point is played. The unusual sound search screen 200 also displays an image of a forward button 203, an image of a back button 204, and an image of a select button 205. When the operator touches the forward button 203, the sound source file 232 to be played next is changed. Then, a sample sound of that sound source file 232 is played. When the operator touches the back button 204, the sound source file 232 to be played previously is changed. Then, a sample sound of that sound source file 232 is played. The select button 205 is touched when the sample sound of that sound source file 232 is the same as or similar to the unusual sound heard by the user. Note that the content and image of the text data displayed in FIG. 9 are merely examples.

[0035] Returning to the explanation of Figure 5. In ACT8, the processor 131 initializes the pointer N of the playlist 231 to "1." In ACT9, the processor 131 plays back the sample sound of the sound source file 232 whose pointer N is "1."

[0036] The processor 131 checks whether the forward button 203 has been touched in ACT10 of Fig. 6. If the forward button 203 has been touched, the processor 131 determines YES in ACT10 and proceeds to ACT 11. In ACT11, the processor 131 increments the pointer N of the playlist 231 by "1".

[0037] In ACT12, the processor 131 checks whether the sound source file 232 corresponding to the additional value "N+1" of the pointer N is stored in the data memory 134. If the sound source file 232 is stored, the processor 131 determines YES in ACT12 and returns to ACT9 in Fig. 5. That is, the processor 131 plays back the sample sound of the sound source file 232 corresponding to the additional value "N+1" of the pointer N.

[0038] If the sound source file 232 is not stored, the processor 131 determines NO in ACT 12 and proceeds to ACT 13. In ACT 13, the processor 131 controls the communication interface 138 to request the sound source file 232 corresponding to the additional value "N+1" of the pointer N from the management server 20. By this control, a file request command is sent via the communication interface 138. The file request command includes the name of the sound source file corresponding to the additional value "N+1" of the pointer N.

[0039] The processor 21 of the management server 20 waits for reception of a file request command from the MFP 10 via the communication interface 138 as ACT33 in FIG.

[0040] If a file request command is received, the processor 21 determines YES in ACT33 and proceeds to ACT34. In ACT34, the processor 21 controls the communication interface 24 to transmit the sound source file 232 corresponding to the additional value "N+1" of the pointer N to the MFP 10. By this control, the sound source file 232 corresponding to the additional value "N+1" of the pointer N is transmitted via the communication interface 24. Then, the processor 131 returns to ACT33.

[0041] Returning to the explanation of Figure 6. The processor 131 of the MFP 10, which controlled the transmission of the file request command in ACT13, waits for the sound source file 232 corresponding to the increment value "N+1" of the pointer N from the management server 20 in ACT14. When the sound source file 232 is received from the management server 20, the processor 131 determines YES in ACT14 and proceeds to ACT15.

[0042] The processor 131 stores the sound source file 232 in the data memory 134 as ACT15. Then, the processor 131 returns to ACT9 in Fig. 5. That is, the processor 131 plays back the sample sound of the sound source file 232 stored in the processing of ACT15.

[0043] If the forward button 203 is not touched, the processor 131 determines NO in ACT 10 of Fig. 6 and proceeds to ACT 16. In ACT 16, the processor 131 checks whether the back button 204 has been touched.

[0044] If the back button 204 is touched, the processor 131 determines YES in ACT 16 and proceeds to ACT 17. In ACT 17, the processor 131 checks whether the pointer N is "1". If the pointer N is "1", the previous sound source file 232 does not exist. Therefore, the processor 131 determines YES in ACT 17 and returns to ACT 10.

[0045] If the pointer N is not "1", the processor 131 determines YES in ACT 17 and proceeds to ACT 18. In ACT 18, the processor 131 decrements the pointer N of the playlist 231 by "1". Then, the processor 131 returns to ACT 9 in Fig. 5. That is, the processor 131 plays the sample sound of the sound source file 232 corresponding to the decremented value "N-1" of the pointer N.

[0046] If the back button 204 is not touched, the processor 131 determines NO in ACT 16 of Figure 6 and proceeds to ACT 19. The processor 131 checks whether the selection button 205 is touched in ACT 19. If the selection button 205 is not touched, the processor 131 determines NO in ACT 19 and returns to ACT 10.

[0047] If the selection button 205 is touched, the processor 131 determines YES in ACT 19 and returns to ACT 2 in Fig. 5. The processor 131 executes the processes in ACT 2 and ACT 3 described above.

[0048] If the abnormal noise button 103 on the malfunction report screen 100 is not touched, the processor 131 determines NO in ACT 3 and proceeds to ACT 20. In ACT 20, the processor 131 checks whether the send button 104 has been touched.

[0049] If the send button 104 is touched, the processor 131 determines YES in ACT20 and proceeds to ACT21. In ACT21, the processor 131 controls the communication interface 138 to send a report command to the management server 20. This control causes the report command to be sent via the communication interface 138. The report command includes the sound source file name of the sound source file 232 when the select button 205 is touched, and information related to the MFP 10 in which the malfunction has occurred. The information related to the MFP 10 in which the malfunction has occurred includes the name of the MFP 10, the model number, the date and time the malfunction occurred, etc. With this, the processor 131 ends the information processing of the procedure shown in the flowcharts of FIGS. 5 and 6.

[0050] The processor 21 of the management server 20 waits to receive a report command from the MFP 10 via the communication interface 138 as ACT35 in FIG.

[0051] If a report command is received, the processor 21 determines YES in ACT 35 and proceeds to ACT 36. In ACT 36, the processor 21 creates a malfunction report based on the sound source file name included in the report command and information related to the MFP 10 in which the malfunction has occurred. The malfunction report includes a link to the sound source file 232. With this, the processor 21 ends the information processing of the procedure shown in the flowchart of FIG. 7.

[0052] As is clear from the above description, the MFP10, which is an example of an image processing device, constitutes an acquisition unit by executing the processes of ACT1 to ACT6 in Fig. 5. In other words, the MFP10 acquires multiple pieces of sound data representing different sounds.

[0053] The processor 131 of the MFP 10 constitutes a playback unit by executing the process of ACT9 in Fig. 5. That is, the MFP 10 plays back one piece of sound data from among the sound data.

[0054] The processor 131 of the MFP 10 constitutes a change unit by executing the processes of ACT10 to ACT18 in Fig. 6. That is, the MFP 10 changes from one piece of sound data to another piece of sound data.

[0055] The processor 131 of the MFP 10 constitutes a determination unit by executing the process of ACT19 in Fig. 6. That is, the MFP 10 determines one piece of sound data from among the sound data.

[0056] As described above, according to this embodiment, when the operator touches the problem button displayed on the touch panel 141 of the MFP 10, the problem report screen 100 is displayed as the problem mode. Furthermore, when the abnormal sound button 103 on the problem report screen 100 is touched, the abnormal sound search screen 200 is displayed and a sample sound of the sound source file 232 is played. When the forward button 203 is touched, the sound source file 232 is changed to the sound source file 232 scheduled to be played next, and the sample sound of that sound source file is played. When the back button 204 is touched, the sound source file 232 is changed to the previously played sound source file 232, and the sample sound of that sound source file is played. If the sample sound of the sound source file 232 is the same as or similar to the abnormal sound heard by the user, the operator touches the select button 205. Therefore, the operator can identify the abnormal sound when a problem occurs with a simple operation.

[0057] Processor 131 of MFP 10 configures output means by executing the process of ACT21 in Fig. 5. That is, MFP 10 outputs one piece of data determined by the determination means and information related to the image processing device in which the problem occurred, i.e., MFP 10. Therefore, the operator does not need to create a problem report for MFP 10, which saves time and effort.

[0058] Furthermore, the playback list 231 assigns priorities to the sound source files 232, and the sample sounds of the sound source files 232 are played back in descending order of priority. Therefore, the operator can efficiently identify the sound source file 232 that is the same as or similar to the abnormal sound at an early stage.

[0059] Although the image processing device and the image processing method have been described above as embodiments, the embodiments are not limited to these.

[0060] In the above embodiment, the image processing device is the MFP 10. However, the image processing device is not limited to the MFP 10. For example, it may be a copier, a printer, or the like.

[0061] In the above embodiment, it has been described that the playback order is set in advance by an operator or the like. Also, for example, if a user plays one sound source file 232 for a long time, the next sound source file to be played may be a sound source file 232 that has a sound similar to the sound played for that long time. In other words, the playback list 231 may be dynamically generated based on the operation of the operator. The playback list 231 may be common to all MFPs 10, or may be different for each MFP 10.

[0062] In the above embodiment, a case where one sound source file 232 that is the same as or similar to the abnormal sound heard by the user is selected has been exemplified. For example, the operator may select multiple sound source files 232. In this case, the report command includes the sound source file names of the multiple sound source files 232.

[0063] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0064] 1...Internet, 10...MFP, 11...scanner, 12...printer, 13...control system, 14...operation panel, 20...management server, 21, 131...processor, 22...main memory, 23...auxiliary storage device, 24, 138...communication interface, 25...system transmission path, 132...RAM, 133...ROM, 134...data memory, 135...image memory, 136...image processing unit, 137...FAX interface, 141...touch panel, 142...input device, 231...playlist, 232...sound source file.

Claims

1. A processor; the processor, When instructed to identify an abnormal sound that occurs when a malfunction occurs, a playback list showing the playback order of a plurality of sample audio of abnormal sounds in descending order of frequency of occurrence and an audio source file containing the sample audio of abnormal sounds are obtained; Playing a sample sound of one allophone determined according to the playback order indicated in the playback list; If an instruction is given that the reproduced sample audio of the abnormal noise is the same as or similar to the abnormal noise heard by the user when the malfunction occurred, the reproduced sample audio of the abnormal noise is determined to be the same as or similar to the abnormal noise heard by the user when the malfunction occurred. a memory for storing a program for executing the above; An image processing device comprising:

2. A processor; the processor, When instructed to identify abnormal sounds that occur when a malfunction occurs, a playback list indicating the playback order of multiple sample audio of abnormal sounds in descending order of risk and an audio source file including the sample audio of abnormal sounds are obtained, Playing a sample sound of one allophone determined according to the playback order indicated in the playback list; If an instruction is given that the reproduced sample audio of the abnormal noise is the same as or similar to the abnormal noise heard by the user when the malfunction occurred, the reproduced sample audio of the abnormal noise is determined to be the same as or similar to the abnormal noise heard by the user when the malfunction occurred. a memory for storing a program for executing the above; An image processing device comprising:

3. Further comprising a communication interface for communicating with the management server, The memory further stores a program that causes the processor to acquire the playlist and the audio source file from the management server via the communication interface.

3. The image processing device according to claim 1.

4. Further comprising a communication interface for communicating with the management server, The memory further stores a program that causes the processor to output to the management server, as a report for creating a report on the malfunction, the file name of a sound source file that includes a sample audio of the abnormal sound determined to be the same as or similar to the abnormal sound heard by the user when the malfunction occurred, and information identifying the image processing device.

3. The image processing device according to claim 1.

5. An abnormal sound identification method for identifying an abnormal sound in an image processing device, comprising: When the image processing device is instructed to identify an abnormal sound that occurs when a malfunction occurs, the image processing device acquires a playback list indicating a playback order of a plurality of sample audio of abnormal sounds in descending order of risk, and a sound source file including the sample audio of abnormal sounds; the image processing device plays back a sample audio of one allophone determined in accordance with the playback order indicated by the playback list; When the image processing device is instructed that the reproduced sample audio of the abnormal sound is the same as or similar to the abnormal sound heard by the user when the malfunction occurred, the image processing device determines that the reproduced sample audio of the abnormal sound is the same as or similar to the abnormal sound heard by the user when the malfunction occurred. A method for identifying abnormal noise in an image processing device.

Images