Image processing device and method for identifying abnormal sound in image processing device

Abstract

To provide an image processing device and an image processing method capable of efficiently identifying an abnormal sound in occurrence of a failure, that is a factor important to clarify the cause of the failure.SOLUTION: The image processing device comprises acquisition means, reproduction means, change means, and determination means. The acquisition means acquires a plurality of pieces of sound data indicative of sounds different from each other. The reproduction means reproduces one of the pieces of sound data. The change means changes the one of the pieces of sound data to another one of the pieces of sound data. The determination means determines one of the pieces of sound data.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to an image processing device and an image processing Identifying abnormal noises from equipment It concerns the method. [Background technology]

[0002] When a malfunction occurs in an image processing device such as an MFP (digital multi-functional peripheral), an abnormal sound may be generated. For an operator performing maintenance work on the image processing device, the abnormal sound generated when the malfunction occurs is an important factor in identifying the cause of the malfunction. However, even if an operator asks a user what kind of abnormal sound was heard, it is difficult to identify the abnormal sound from the user's words alone. Furthermore, if the abnormal sound occurs only once, it is not possible to reproduce the abnormal sound. Therefore, there is a demand for a mechanism that can efficiently identify the abnormal sound generated when a malfunction occurs. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-179863 A Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide an image processing device and an image processing method capable of efficiently identifying abnormal sounds that occur when a malfunction occurs, which is an important factor in identifying the cause of the malfunction. Identifying abnormal noises from equipment This aims to provide a method. [Means for solving the problem]

[0005] The image processing device includes an acquisition unit, a playback unit, a selection button, a change unit, and a determination unit. If an abnormal noise was detected when the malfunction occurred,A reproduction list indicating the reproduction order of a plurality of abnormal sound sample audios and a sound source file including the abnormal sound sample audios are acquired. A reproduction means reproduces one abnormal sound sample audio determined according to the reproduction order indicated in the reproduction list acquired by the acquisition means. A selection button is used to select the abnormal sound sample audio to be reproduced by the reproduction means. The same or similar abnormal noise as the user heard when the above malfunction occurred The determination means selects a sample sound of the abnormal sound reproduced by the reproduction means when the selection button is selected. The same or similar noise as the user heard when the problem occurred It is determined as follows. [Brief description of the drawings]

[0006] [Figure 1] FIG. 2 is a block diagram showing the main circuit configuration of the MFP. [Diagram 2] FIG. 2 is a block diagram showing a main circuit configuration of a management server. [Diagram 3] FIG. 4 is a schematic diagram showing an example of a playlist. [Figure 4] FIG. 4 is a schematic diagram showing an example of the data structure of an audio source record stored in an audio source file. [Diagram 5] 4 is a flowchart showing a main control procedure of a processor in the MFP. [Figure 6] 4 is a flowchart showing a main control procedure of a processor in the MFP. [Figure 7] 13 is a flowchart showing a procedure for controlling main parts of a processor in the management server. [Figure 8] FIG. 13 is a schematic diagram showing an example of a defect report screen. [Figure 9] FIG. 13 is a schematic diagram showing an example of an allophone search screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, one embodiment will be described with reference to the drawings.

[0008] 1 is a block diagram showing a schematic configuration of an MFP 10 according to an embodiment. The MFP 10 is an example of an image processing device. The MFP 10 includes a scanner 11, a printer 12, a control system 13, and an operation panel 14. The scanner 11, the printer 12, and the operation panel 14 are connected to the control system 13.

[0009] The scanner 11 is a device that optically reads an image of a document and converts it into image information in response to an operational instruction from the control system 13. The scanner 11 outputs the read image information of the document to the control system 13.

[0010] The printer 12 prints an image based on image information supplied from the control system 13 on paper under various printing conditions specified by the control system 13. Printers using various image forming methods can be used as the printer 12. For example, the printer 12 may be an electrophotographic printer, or may be an inkjet printer or a thermal transfer printer.

[0011] The control system 13 comprehensively controls the operations of each section, such as the scanner 11, the printer 12, and the operation panel 14. The control system 13 also executes various processes, such as image processing. The control system 13 includes a processor 131, a random-access memory (RAM) 132, a read-only memory (ROM) 133, a data memory 134, an image memory 135, an image processing unit 136, a FAX (facsimile) interface (I / F) 137, and a communication interface (I / F) 138.

[0012] The processor 131 executes processes such as calculation and control according to a program. The processor 131 is, for example, a CPU (central processing unit). The processor 131 realizes various processing functions by executing a program stored in the ROM 133 or the data memory 134. The RAM 132 is a working memory. The RAM 132 is, for example, a volatile memory. The ROM 133 is a program memory. The ROM 133 is, for example, a non-volatile memory.

[0013] The data memory 134 stores control data, control programs, setting information, etc. The data memory 134 is, for example, a non-volatile memory. The image memory 135 is configured with a hard disk drive, a page memory, etc. The image memory 135 stores image information. The image processing unit 136 executes image processing on the image information.

[0014] The FAX interface 137 is an interface for performing FAX communication. The communication interface 138 is a network interface for performing data communication with an external device such as the management server 20 via a network such as the Internet 1.

[0015] The operation panel 14 is a user interface. The operation panel 14 includes a touch panel 141 and an input device 142. The touch panel 141 is configured by stacking a display, such as a liquid crystal display or an organic EL (electro-luminescence) display, and a sensing device that detects touch input. The input device 142 is, for example, a button, a keyboard, a keypad, or a touchpad.

[0016] The management server 20 provides a plurality of sound data indicating different sounds necessary for identifying abnormal sounds during maintenance work on the MFP 10. The management server 20 provides a play list and a sound source file to the MFP 10 via the Internet 1. The play list and the sound source file will be described later.

[0017] 2 is a block diagram showing the main circuit configuration of the management server 20. The management server 20 includes a processor 21, a main memory 22, an auxiliary storage device 23, a communication interface 24, and a system transmission path 25. The system transmission path 25 includes an address bus, a data bus, a control signal line, and the like. The management server 20 connects the processor 21, the main memory 22, the auxiliary storage device 23, and the communication interface 24 to the system transmission path 25. In the management server 20, a computer is configured by the processor 21, the main memory 22, the auxiliary storage device 23, and the system transmission path 25 that connects them.

[0018] The processor 21 controls each unit in accordance with an operating system or an application program to realize various functions of the management server 20. The processor 21 is, for example, a CPU.

[0019] The main memory 22 includes a nonvolatile memory area and a volatile memory area. The main memory 22 stores an operating system or application programs in the nonvolatile memory area. The main memory 22 stores data required for the processor 21 to execute processes for controlling each part in the volatile memory area. The above data may also be stored in the nonvolatile memory area. The main memory 22 uses the volatile memory area as a work area where data is appropriately rewritten by the processor 21. The nonvolatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0020] The auxiliary storage device 23 is, for example, an EEPROM (registered trademark) (electric erasable programmable read-only memory), a HDD (hard disk drive), or an SSD (solid state drive). The auxiliary storage device 23 stores data used by the processor 21 when performing various processes, or data created by the processes in the processor 21. The auxiliary storage device 23 may also store the above-mentioned application programs.

[0021] The communication interface 24 is an interface circuit for transmitting and receiving data to and from the MFP 10 connected via the Internet 1 in accordance with a predetermined communication protocol.

[0022] The management server 20 thus configured stores a playlist 231 (see FIG. 3) and a plurality of audio source files 232 in the auxiliary storage device 23. The playlist 231 is a list indicating the playback order of the plurality of audio source files 232. The audio source file 232 saves an audio source record 2321 (see FIG. 4) for each audio source file name.

[0023] FIG. 3 is a schematic diagram showing an example of the playlist 231. As shown in FIG. 3, the playlist 231 has an area for storing a pointer N and a sound source file name. The pointer N is a unique value assigned to each sound source file 232 in order to identify the sound source file 232. The sound source files are played in ascending order of the value of the pointer N, that is, from the top of the playlist 231. The playlist 231 is played in descending order of the priority. For example, the order may be the order of sound source files of abnormal sounds that occur frequently in the market related to the MFP 10, the order of sound source files of high risk of sound source, the order of sound source files of characteristic sounds, the order of sound source files related to parts of the MFP 10 that have a high degree of deterioration, etc. In this embodiment, the playlist 231 and the sound source files 232 are set in advance by an operator or the like. Note that the storage destination of the playlist 231 and the sound source files 232 is not limited to the auxiliary storage device 23. The playlist 231 and the sound source files 232 may be stored in a volatile memory area of ​​the main memory 22. The playlist 231 is not limited to the data of the above items.

[0024] Fig. 4 is a schematic diagram showing an example of the data structure of a sound source record 2321 stored in the sound source file 232. As shown in Fig. 4, the sound source record 2321 includes sample sound data of an abnormal sound, related parts data, defect data, and the risk of the sound source. The related parts data is, for example, information on components of the MFP 10 that are expected to be the source of the abnormal sound. The defect data is, for example, information on the occurrence of white streaks during printing along with the occurrence of an abnormal sound. The risk of the sound source is the degree of possibility that the abnormal sound will cause a breakdown of the MFP 10. The sound source record 2321 is not limited to the data of the items described above.

[0025] 5 and 6 are flow charts showing the procedure of main information processing executed by processor 131 of MFP 10 according to a control program. Fig. 7 is a flow chart showing the procedure of main information processing executed by processor 21 of management server 20 according to a control program. The operations of MFP 10 and management server 20 will be explained below using these figures. Note that the procedure and contents of the operation explained below are merely examples. As long as similar results are obtained, the procedure and contents are not limited.

[0026] During maintenance work on the MFP 10, the worker switches the operation mode of the MFP 10 from the normal mode to the malfunction mode. When the worker touches the malfunction button displayed on the touch panel 141, the operation mode is switched to the malfunction mode. That is, processor 131 of MFP 10 waits for a trouble button displayed on touch panel 141 to be touched in ACT 1. If the trouble button is touched, processor 131 determines YES in ACT 1 and proceeds to ACT 2. Processor 131 causes touch panel 141 to display trouble report screen 100 (see FIG. 8) as a trouble mode in ACT 2.

[0027] FIG. 8 is a schematic diagram showing an example of a defect report screen 100. As shown in FIG. 8, the defect report screen 100 displays a check box 101 for selecting a defect, a check box 102 for inputting an abnormal sound when the defect occurs, and an abnormal sound button 103 for identifying a sample sound of the abnormal sound. The defect is, for example, a paper jam, a white streak, etc. The defect report screen 100 also displays a send button 104 for instructing confirmation of sending after checking the check box 101 or the check boxes 101 and 102. The abnormal sound button 103 may be enabled when checking the check box 102. Note that the contents of the text data displayed in FIG. 8 are merely an example.

[0028] Returning to the description of Fig. 5, in ACT3, the processor 131 of the MFP 10 checks whether or not the abnormal sound button 103 on the malfunction report screen 100 has been touched. If the abnormal sound button 103 has been touched, the processor 131 determines YES in ACT3 and proceeds to ACT4.

[0029] The processor 131 controls the communication interface 138 to request the playlist 231 and the first sound source file 232 of the playlist 231 from the management server 20 as ACT4.

[0030] The processor 21 of the management server 20 waits to receive a list request command from the MFP 10 via the communication interface 138 as ACT31 in FIG.

[0031] When a list request command is received, the processor 21 determines YES in ACT 31 and proceeds to ACT 32. In ACT 32, the processor 21 controls the communication interface 24 to transmit the playlist 231 and the first sound source file 232 of the playlist 231 to the MFP 10. By this control, the playlist 231 and the first sound source file 232 of the playlist 231 are transmitted via the communication interface 24.

[0032] Returning to the explanation of Figure 5. The processor 131 of the MFP 10, which controlled the transmission of the list request command in ACT4, waits for the playlist 231 and the first sound source file 232 of the playlist 231 from the management server 20 in ACT5. When the playlist 231 and the first sound source file 232 of the playlist 231 are received from the management server 20, the processor 131 judges YES in ACT5 and proceeds to ACT6.

[0033] The processor 131 stores the sound source file 232 in the data memory 134 in ACT6. The processor 131 causes the touch panel 141 to display the unusual sound search screen 200 (see FIG. 9) in ACT7.

[0034] FIG. 9 is a schematic diagram showing an example of an abnormal sound search screen 200. As shown in FIG. 9, the abnormal sound search screen 200 displays a seek bar 202 together with a sound source file name 201 and data included in a sound source record 2321. When the operator taps or drags the seek bar 202, a sample sound at the selected point is played. In addition, the abnormal sound search screen 200 displays an image of a forward button 203, an image of a back button 204, and an image of a select button 205. When the operator touches the forward button 203, the sound source file 232 to be played next is changed. Then, a sample sound of the sound source file 232 is played. When the operator touches the back button 204, the sound source file 232 to be played last is changed. Then, a sample sound of the sound source file 232 is played. The select button 205 is touched when the sample sound of the sound source file 232 is the same as or close to the abnormal sound heard by the user. Note that the contents and images of the text data displayed in FIG. 9 are merely examples.

[0035] Returning to the explanation of Figure 5. The processor 131 initializes the pointer N of the playlist 231 to "1" as ACT8. The processor 131 plays back the sample sound of the sound source file 232 whose pointer N is "1" as ACT9.

[0036] Processor 131 checks whether forward button 203 has been touched in ACT10 of Fig. 6. If forward button 203 has been touched, processor 131 determines YES in ACT10 and proceeds to ACT11. Processor 131 increments pointer N of playlist 231 by "1" in ACT11.

[0037] The processor 131 checks whether or not the sound source file 232 corresponding to the additional value "N+1" of the pointer N is stored in the data memory 134 in ACT12. If the sound source file 232 is stored, the processor 131 judges YES in ACT12 and returns to ACT9 in Fig. 5. That is, the processor 131 plays the sample sound of the sound source file 232 corresponding to the additional value "N+1" of the pointer N.

[0038] If the sound source file 232 is not stored, the processor 131 determines NO in ACT 12 and proceeds to ACT 13. In ACT 13, the processor 131 controls the communication interface 138 to request the sound source file 232 corresponding to the additional value "N+1" of the pointer N from the management server 20. By this control, a file request command is transmitted via the communication interface 138. The file request command includes the sound source file name corresponding to the additional value "N+1" of the pointer N.

[0039] The processor 21 of the management server 20 waits to receive a file request command from the MFP 10 via the communication interface 138 as ACT 33 in FIG.

[0040] When a file request command is received, the processor 21 determines YES in ACT33 and proceeds to ACT34. In ACT34, the processor 21 controls the communication interface 24 to transmit the sound source file 232 corresponding to the additional value "N+1" of the pointer N to the MFP 10. By this control, the sound source file 232 corresponding to the additional value "N+1" of the pointer N is transmitted via the communication interface 24. Then, the processor 131 returns to ACT33.

[0041] Returning to the explanation of Figure 6. The processor 131 of the MFP 10, which controlled the transmission of the file request command in ACT13, waits for the sound source file 232 corresponding to the increment value "N+1" of the pointer N from the management server 20 in ACT14. When the sound source file 232 is received from the management server 20, the processor 131 judges YES in ACT14 and proceeds to ACT15.

[0042] The processor 131 stores the sound source file 232 as ACT15 in the data memory 134. Then, the processor 131 returns to ACT9 in Fig. 5. That is, the processor 131 plays back the sample sound of the sound source file 232 stored in the processing of ACT15.

[0043] If the forward button 203 is not touched, the processor 131 judges NO in ACT 10 of Fig. 6 and proceeds to ACT 16. In ACT 16, the processor 131 checks whether the back button 204 is touched.

[0044] If the back button 204 is touched, the processor 131 judges YES in ACT16 and proceeds to ACT17. The processor 131 checks whether the pointer N is "1" in ACT17. If the pointer N is "1", the previous sound source file 232 does not exist. Therefore, the processor 131 judges YES in ACT17 and returns to ACT10.

[0045] If the pointer N is not "1", the processor 131 judges YES in ACT 17 and proceeds to ACT 18. In ACT 18, the processor 131 decrements the pointer N of the playlist 231 by "1". Then, the processor 131 returns to ACT 9 in Fig. 5. That is, the processor 131 reproduces the sample sound of the sound source file 232 corresponding to the decrement value "N-1" of the pointer N.

[0046] 6, the processor 131 judges as NO and proceeds to ACT 19. The processor 131 checks whether the selection button 205 has been touched in ACT 19. If the selection button 205 has not been touched, the processor 131 judges as NO in ACT 19 and returns to ACT 10.

[0047] If the selection button 205 is touched, the processor 131 determines YES in ACT19, and returns to ACT2 in Fig. 5. The processor 131 executes the processes in ACT2 and ACT3 described above.

[0048] If the abnormal sound button 103 on the malfunction report screen 100 is not touched, the processor 131 determines NO in ACT 3 and proceeds to ACT 20. In ACT 20, the processor 131 checks whether the send button 104 has been touched.

[0049] If the send button 104 is touched, the processor 131 determines YES in ACT20 and proceeds to ACT21. The processor 131 controls the communication interface 138 to transmit a report command to the management server 20 in ACT21. This control causes the report command to be transmitted via the communication interface 138. The report command includes the sound source file name of the sound source file 232 when the selection button 205 is touched, and information related to the MFP 10 in which the malfunction has occurred. The information related to the MFP 10 in which the malfunction has occurred includes the name and model number of the MFP 10, the date and time when the malfunction has occurred, and the like. With this, the processor 131 ends the information processing of the procedure shown in the flowcharts of FIGS. 5 and 6.

[0050] The processor 21 of the management server 20 waits to receive a report command from the MFP 10 via the communication interface 138 as ACT 35 in FIG.

[0051] If a report command is received, the processor 21 determines YES in ACT35 and proceeds to ACT36. The processor 21 creates a malfunction report in ACT36 based on the sound source file name included in the report command and information related to the MFP 10 in which the malfunction has occurred. The malfunction report includes a link to the sound source file 232. With this, the processor 21 ends the information processing of the procedure shown in the flowchart of FIG. 7.

[0052] As is clear from the above description, the MFP 10, which is an example of an image processing device, constitutes an acquisition unit by executing the processes in ACT1 to ACT6 in Fig. 5. That is, the MFP 10 acquires a plurality of sound data indicating different sounds.

[0053] The processor 131 of the MFP 10 constitutes a playback unit by executing the process of ACT9 in Fig. 5. That is, the MFP 10 plays back one piece of sound data from among the sound data.

[0054] The processor 131 of the MFP 10 constitutes a change unit by executing the processes of ACT10 to ACT18 in Fig. 6. That is, the MFP 10 changes from one piece of sound data to another piece of sound data.

[0055] The processor 131 of the MFP 10 constitutes a determination unit by executing the process of ACT19 in Fig. 6. That is, the MFP 10 determines one piece of sound data from among the sound data.

[0056] Thus, according to this embodiment, when the operator touches the malfunction button displayed on the touch panel 141 of the MFP 10, the malfunction report screen 100 is displayed as a malfunction mode. Furthermore, when the abnormal sound button 103 on the malfunction report screen 100 is touched, the abnormal sound search screen 200 is displayed and the sample sound of the sound source file 232 is played. When the forward button 203 is touched, the sound source file is changed to the sound source file 232 to be played next, and the sample sound is played. When the back button 204 is touched, the sound source file is changed to the sound source file 232 played last, and the sample sound is played. When the sample sound of the sound source file 232 is the same as or similar to the abnormal sound heard by the user, the selection button 205 is touched. Therefore, the operator can specify the abnormal sound when a malfunction occurs with a simple operation.

[0057] Processor 131 of MFP10 configures an output means by executing the process of ACT21 in Fig. 5. That is, MFP10 outputs one piece of data determined by the determination means and information related to the image processing device in which the malfunction has occurred, i.e., MFP10. Therefore, the operator does not need to create a malfunction report for MFP10, which saves time and effort.

[0058] Furthermore, the playback list 231 prioritizes the sound source files 232, and the sample sounds of the sound source files 232 are played back in descending order of priority. Therefore, the operator can efficiently identify the sound source file 232 that is the same as or similar to the abnormal sound at an early stage.

[0059] Although the embodiments of the image processing device and image processing method have been described above, the embodiments are not limited to these.

[0060] In the above embodiment, the image processing device is exemplified as the MFP 10. The image processing device is not limited to the MFP 10. For example, it may be a copy machine, a printer, or the like.

[0061] In the above embodiment, it has been described that the playback order is set in advance by an operator or the like. For example, when a user plays one sound source file 232 for a long time, the next sound source file to be played may be a sound source file 232 having a sound similar to the sound played for the long time. That is, the playback list 231 may be dynamically generated based on the operation of the operator. The playback list 231 may be common to all MFPs 10, or may be different for each MFP 10.

[0062] In the above embodiment, a case where one sound source file 232 that is the same as or similar to the abnormal sound heard by the user is selected is illustrated. For example, the worker may select multiple sound source files 232. In this case, the report command includes the sound source file names of the multiple sound source files 232.

[0063] Although several other embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0064] 1...Internet, 10...MFP, 11...scanner, 12...printer, 13...control system, 14...operation panel, 20...management server, 21, 131...processor, 22...main memory, 23...auxiliary storage device, 24, 138...communication interface, 25...system transmission path, 132...RAM, 133...ROM, 134...data memory, 135...image memory, 136...image processing unit, 137...FAX interface, 141...touch panel, 142...input device, 231...playback list, 232...sound source file.

Claims

1. An acquisition means for acquiring, when it is indicated that an abnormal sound has been generated at the time of the occurrence of a malfunction, a playback list indicating the playback order of a plurality of sample audio of abnormal sounds and a sound source file including the sample audio of the abnormal sounds; a playback means for playing back a sample sound of one allophone, the sample sound being determined according to a playback order indicated by the playback list acquired by the acquisition means; a selection button which is instructed when the sample audio of the abnormal sound reproduced by the reproduction means is the same as or similar to the abnormal sound heard by the user when the malfunction occurred; a determination means for determining, when the selection button is selected, that the sample audio of the abnormal sound reproduced by the reproduction means is the same as or similar to the abnormal sound heard by the user when the malfunction occurred; An image processing device comprising:

2. A communication interface for communicating with a management server; the acquiring means acquires the playlist and the sound source file from the management server via the communication interface; 2. The image processing device according to claim 1.

3. the acquiring means acquires, from the management server, a sound source file including a sample sound of the abnormal sound to be reproduced every time a sample sound of the abnormal sound to be reproduced is determined in accordance with a reproduction order indicated by a reproduction list acquired from the management server; 3. The image processing device according to claim 2.

4. an output means for outputting, when the selection button is selected, a file name of a sound source file including a sample sound of the abnormal sound reproduced by the reproduction means and information indicating the image processing device, to the management server as a report for generating a report on the malfunction.

3. The image processing device according to claim 2.

5. An abnormal sound identifying method for identifying an abnormal sound in an image processing device, comprising: When the image processing device is instructed that an abnormal sound was generated when a malfunction occurred, the image processing device obtains a playback list indicating a playback order of a plurality of sample audios of abnormal sounds and a sound source file including the sample audios of abnormal sounds; the image processing device plays back a sample sound of one allophone determined in accordance with a playback order indicated by the playback list; when a selection button indicating that the reproduced sample audio of the abnormal sound is the same as or similar to the abnormal sound heard by the user when the malfunction occurred is pressed, the image processing device determines that the reproduced sample audio of the abnormal sound is the same as or similar to the abnormal sound heard by the user when the malfunction occurred. A method for identifying abnormal sounds in an image processing device.

Images