Information processing system, information processing device, and program

Abstract

To provide an information processing system capable of notifying sound selected by a user as voice similar to occurred noise.SOLUTION: An information processing system includes an information processing device and an image processing device. The information processing device retrieves occurrence place candidate information indicated by a received inquiry and sound information associated with timing candidate information from a plurality of pieces of sound information in the case of receiving the inquiry indicating the occurrence place candidate information and the timing candidate information from the image processing device, and transmits retrieval result information indicating a retrieved result to the image processing device. The image processing device transmits an inquiry indicating object place candidate information and object timing candidate information to the information processing device in the case of receiving place candidate selection operation and timing candidate selection operation through a first image, and generates failure information including the object place candidate information with the sound indicated by received retrieval result information in the case of receiving the retrieval result information as a response to the transmitted inquiry.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing system, an information processing device, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known an image processing apparatus that notifies a user of a malfunction when the malfunction occurs. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-160364 A Summary of the Invention [Problem to be solved by the invention]

[0004] Here, when a malfunction occurs in an image processing device such as that described in Patent Document 1, an abnormal sound is often generated from the image processing device. An operator who performs maintenance work on the image processing device uses the abnormal sound to identify the cause of the malfunction that occurred in the image processing device. However, the image processing device cannot notify the operator of information indicating a sound similar to the abnormal sound or information indicating the abnormal sound itself. For this reason, the operator often tries to record the abnormal sound. However, at the installation site of the image processing device, recording is often not permitted for security reasons. As a result, the operator may need a lot of time to identify the cause of the malfunction that occurred in the image processing device.

[0005] An object of the present invention is to provide an information processing system, an information processing device, and a program that can notify a user of a sound selected by the user as a sound similar to an abnormal noise that has occurred. [Means for solving the problem]

[0006] The image processing device according to the embodiment includes an operation receiving unit and a control unit. The operation receiving unit receives an operation. The control unit transmits at least one of first sound information corresponding to a first operation received by the operation receiving unit and first sound identification information identifying the first sound information, among a plurality of pieces of sound information indicating different sounds and including information indicating an abnormal sound that may be generated from the image processing device, to another device. [Brief description of the drawings]

[0007] [Figure 1] 1 is an external view showing an example of the overall configuration of an image processing apparatus according to an embodiment; [Diagram 2] FIG. 2 is a diagram illustrating an example of a functional configuration of an image processing device. [Diagram 3] 11 is a diagram showing an example of a process flow for transmitting first voice information selected by a user to another device. FIG. [Figure 4] 11 is a diagram showing an example of a process flow for transmitting first voice information selected by a user to another device. FIG. [Diagram 5] FIG. 13 is a diagram showing an example of a report image displayed on a display. [Figure 6] FIG. 13 is a diagram showing an example of a search image displayed on a display. [Figure 7] FIG. 13 is a diagram showing an example of a selection image displayed on a display. [Figure 8] FIG. 13 is a diagram showing an example of a report image including audio information selected by a user. [Figure 9] FIG. 13 is a diagram illustrating an example of a configuration of an information processing system according to a modified example of the embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a second selected image. [Figure 11] FIG. 13 is a diagram showing another example of the second selected image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an image processing apparatus according to an embodiment will be described with reference to the drawings. In each drawing, the same components are denoted by the same reference numerals. In the following, an image processing apparatus 100 will be described as an example of the image processing apparatus according to the embodiment.

[0009] (Details of image processing device) The image processing device 100 will be described in detail below with reference to FIG.

[0010] 1 is an external view showing an example of the overall configuration of an image processing device 100 according to an embodiment. The image processing device 100 is, for example, a device that performs image processing such as a multifunction device, a scanner, or a FAX (Facsimile). Image processing refers to processing related to an image. Image processing includes, for example, processing for forming an image on a sheet, processing for reading image information of a reading target, processing for recording (storing) image information, processing for transmitting an image to another device, and the like.

[0011] The image processing device 100 includes a display 110, a control panel 120, a printer unit 130, a sheet storage unit 140, and an image reading unit 150. The printer unit 130 of the image processing device 100 may be a device that fixes a toner image, or may be an inkjet device.

[0012] The image processing device 100 reads an image appearing on a sheet, generates digital data, and generates an image file. The sheet is, for example, a manuscript, or paper on which characters, images, etc. are written. The sheet may be any object that can be read by the image processing device 100.

[0013] The display 110 is an image display device such as a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The display 110 displays various information related to the image processing device 100. The display 110 is an example of a display unit.

[0014] The control panel 120 has a plurality of buttons. The control panel 120 accepts operations by a user. The control panel 120 outputs a signal corresponding to the operation performed by the user to a control unit of the image processing device 100. The display 110 and the control panel 120 may be configured as an integrated touch panel. The control panel 120 is an example of an operation accepting unit.

[0015] The printer unit 130 forms an image on a sheet based on image information generated by the image reading unit 150 or image information received via a communication path. The printer unit 130 forms an image by, for example, the following process. The image forming unit of the printer unit 130 forms an electrostatic latent image on a photosensitive drum based on image information. The image forming unit of the printer unit 130 forms a visible image by attaching a developer to the electrostatic latent image. A specific example of the developer is toner. The transfer unit of the printer unit 130 transfers the visible image onto a sheet. The fixing unit of the printer unit 130 fixes the visible image onto the sheet by applying heat and pressure to the sheet. The sheet on which the image is formed may be a sheet stored in the sheet storage unit 140 or a sheet that is manually inserted.

[0016] The sheet storage section 140 stores sheets to be used for image formation in the printer section 130 .

[0017] The image reading unit 150 reads the image information of the reading target as light and dark. The image reading unit 150 records the read image information. The recorded image information may be transmitted to another information processing device via a network. The recorded image information may be formed into an image on a sheet by the printer unit 130.

[0018] (Functional configuration of image processing device) The functional configuration of the image processing device 100 will be described below with reference to FIG. 2. The processing using sound by the image processing device 100 will be described below. Sound includes voice, acoustics, and the like. Therefore, the following will describe, as an example, a case where the sound is voice. Therefore, in the following, all parts referred to as "voice" may be read as "sound" or "acoustic".

[0019] FIG. 2 is a diagram illustrating an example of the functional configuration of the image processing device 100.

[0020] The image processing device 100 includes a display 110, a control panel 120, a printer unit 130, a sheet storage unit 140, and an image reading unit 150. The image processing device 100 also includes a control unit 300, a network interface 310, a storage unit 320, a memory 330, and an audio output unit 340. These functional units included in the image processing device 100 are connected to each other so as to be able to communicate with each other via a system bus.

[0021] The display 110, the control panel 120, the printer unit 130, the sheet storage unit 140, and the image reading unit 150 will be described below as they are similar to those described above. The control unit 300, the network interface 310, the storage unit 320, the memory 330, and the audio output unit 340 will be described below.

[0022] The control unit 300 is an example of a control unit of the image processing device 100. The control unit 300 includes a CPU (Central Processing Unit) of the image processing device 100. The control unit 300 controls the operation of each functional unit of the image processing device 100. The control unit 300 executes various processes by executing a program. The control unit 300 acquires an instruction input by a user from the control panel 120. That is, the control unit 300 accepts an operation from the user through the control panel 120. The control unit 300 executes a control process based on the acquired instruction.

[0023] Here, when a malfunction occurs in an image processing device other than the image processing device 100, the image processing device often generates an abnormal sound corresponding to the malfunction. An operator who performs maintenance work on the image processing device uses the abnormal sound to identify the cause of the malfunction that occurs in the image processing device. However, the image processing device cannot notify the operator of information indicating a sound similar to the abnormal sound or information indicating the abnormal sound itself. For this reason, the operator often tries to record the abnormal sound. However, at the installation site of the image processing device, recording is often not permitted for security reasons. As a result, the operator may need time to identify the cause of the malfunction that occurs in the image processing device. In addition, such an abnormal sound often occurs only once in the image processing device. In such a case, the operator cannot record the abnormal sound in the first place.

[0024] Therefore, the control unit 300 transmits at least one of the first voice information corresponding to the first operation accepted by the control panel 120 and the first voice identification information identifying the first voice information to the other device among the plurality of voice information indicating different sounds. This means that the user can select voice information indicating a sound similar to an abnormal sound generated in the image processing device 100, and the image processing device 100 can notify the other device of the selected voice information. Therefore, the image processing device 100 can notify the other device of the voice selected by the user as a sound similar to the generated abnormal sound. In particular, when each of the plurality of voice information is information indicating an abnormal sound that may be generated from the image processing device 100, the image processing device 100 can more reliably notify the other device of a sound similar to the generated abnormal sound. Furthermore, even if each of the plurality of voice information is a sound different from an abnormal sound that may be generated from the image processing device 100, the image processing device 100 can notify the other device of a sound that the user thinks is similar to the generated abnormal sound. The first voice identification information may be any information capable of identifying the first voice information, such as a uniform resource locator (URL) indicating a storage destination of the first voice information on the Internet. The first voice identification information may also be, for example, a file name of the first voice information. In the following, as an example, a case will be described in which the control unit 300 transmits, to another device, the first voice information corresponding to a first operation accepted by the control panel 120, among a plurality of voice information indicating different voices.

[0025] The network interface 310 transmits and receives data to and from other devices. The network interface 310 operates as an input interface to receive data sent from other devices. The network interface 310 also operates as an output interface to transmit data to other devices.

[0026] The storage unit 320 is, for example, an auxiliary storage device such as a hard disk or a solid state drive (SSD). The storage unit 320 stores various types of information. For example, the storage unit 320 stores a program executed by the control unit 300. The program is, for example, firmware, an application, or the like.

[0027] In the example shown in FIG. 2, n pieces of audio information, namely, audio information S1 to audio information Sn, are stored in the storage unit 320. n may be any integer equal to or greater than 2. These n pieces of audio information are an example of a plurality of pieces of audio information indicating different sounds from each other. It is preferable that some or all of the audio information S1 to audio information Sn are configured to indicate an abnormal sound that may be generated from the image processing device 100. This is because it is easy for a user to select audio information indicating a sound similar to the abnormal sound from among the n pieces of audio information. However, the sound similar to the abnormal sound can also be selected from sounds different from the abnormal sound that may be generated from the image processing device 100. For this reason, some or all of the audio information S1 to audio information Sn may be configured to indicate a sound different from the abnormal sound that may be generated from the image processing device 100.

[0028] The memory 330 is, for example, a random access memory (RAM). The memory 330 temporarily stores information used by each functional unit included in the image processing device 100. The memory 330 may store image information read by the image reading unit 150, a program for operating each functional unit, and the like.

[0029] The audio output unit 340 is, for example, a speaker. The audio output unit 340 outputs audio corresponding to an audio signal output from the image processing device 100. Note that the audio output unit 340 may be a separate unit from the image processing device 100. In this case, the audio output unit 340 is an external speaker.

[0030] (Process of transmitting first voice information selected by a user to another device) As described above, the image processing device 100 can transmit the first voice information selected by the user to another device. Hereinafter, a process of transmitting the first voice information selected by the user to another device among the processes performed by the image processing device 100 will be described.

[0031] 3 and 4 are diagrams showing an example of a process flow for transmitting the first voice information selected by the user to another device. In the following, as an example, a case will be described in which the control unit 300 accepts an operation to display a report image at a timing before the process of ACT110 shown in FIG. 3 is performed. The report image is an image with which the image processing device 100 accepts an operation from the user. The report image is an image with which the image processing device 100 accepts defect information from the user. The defect information is information indicating a defect that has occurred in the image processing device 100. The operation may be performed by a button provided on the control panel 120. The operation may be performed by a software key displayed on the display 110 when the control panel 120 is configured as a touch panel integral with the display 110.

[0032] The control unit 300 causes the display 110 to display the report image (ACT 110). Here, the report image will be described. FIG.

[0033] An example of a report image is shown in image P1 in Fig. 5. Image P1 includes, for example, images CB1 to CB3, image B1, and image B2.

[0034] Image CB1 is an image showing a check box. Furthermore, image CB1 is associated with paper jam occurrence information showing that a paper jam has occurred in image processing device 100. For this reason, in the example shown in FIG. 5, a character string saying "Paper is jammed" is drawn next to image CB1. When a selection operation (click, tap, etc.) is performed on image CB1, a check image is superimposed on the check box indicated by image CB1. A check image is an image indicating that a selection operation has been performed on an image indicating a check box such as image CB1. In this example, a check image is not superimposed on the check box indicated by image CB1. In this case, control unit 300 specifies the paper jam occurrence information associated with image CB1 as one of the pieces of information to be included in the malfunction information indicating a malfunction that has occurred in image processing device 100. Note that image CB1 may be an image indicating another input form having a function similar to that of a check box, instead of an image indicating a check box.

[0035] The image CB2 is an image showing a check box. Moreover, the image CB2 is associated with error occurrence information indicating that an error has occurred in the image processing device 100. For this reason, in the example shown in FIG. 5, a character string saying "An error has occurred" is drawn next to the image CB2. When a selection operation (click, tap, etc.) is performed on the image CB2, a check image is superimposed on the check box shown by the image CB2. In this example, a check image is not superimposed on the check box shown by the image CB2. Furthermore, in this case, the control unit 300 specifies the error occurrence information associated with the image CB2 as one of the pieces of information to be included in the malfunction information indicating a malfunction that has occurred in the image processing device 100. Note that the image CB2 may be an image showing another input form having a function similar to that of a check box, instead of an image showing a check box.

[0036] The image CB3 is an image showing a check box. Moreover, abnormal sound generation information indicating that an abnormal sound has occurred in the image processing device 100 is associated with the image CB3. For this reason, in the example shown in FIG. 5, a character string saying "abnormal sound has been heard" is drawn next to the image CB3. When a selection operation (click, tap, etc.) is performed on the image CB3, a check image is superimposed on the check box shown by the image CB3. In this example, a check image is superimposed on the check box shown by the image CB3. The image CK shown in FIG. 5 is an example of a check image. Moreover, in this case, the control unit 300 specifies the abnormal sound generation information associated with the image CB3 as one of the pieces of information to be included in the malfunction information indicating a malfunction that has occurred in the image processing device 100. Note that the image CB2 may be an image showing another input form having a function similar to that of a check box, instead of an image showing a check box.

[0037] Image B1 is an image showing a button. Image CB3 is associated with image B1. Specifically, when a check image is superimposed on image CB3, image B1 becomes selectable. On the other hand, when the check image superimposed on image CB3 is deleted, image B1 becomes non-selectable.

[0038] Furthermore, when a selection operation (click, tap, etc.) is performed on image B1, control unit 300 causes display 110 to display a search image instead of a report image. The search image is an image with which image processing device 100 accepts an operation from a user. Furthermore, the search image is an image with which image processing device 100 accepts an operation from a user to search for candidates for audio information desired by the user from among multiple pieces of audio information. Note that image B1 may be an image showing another input form having a function similar to that of a button, instead of an image showing a button.

[0039] Image B2 is an image showing a button. When a selection operation (click, tap, etc.) is performed on image B2, control unit 300 generates malfunction information. The process of control unit 300 generating malfunction information will be described later. After generating the malfunction information in this case, control unit 300 transmits the generated malfunction information to another device. The other device is, for example, an information processing terminal of a person who performs maintenance work on image processing device 100, a server of a company that provides the maintenance work as a service, a server of a distributor of image processing device 100, etc. Note that the other device may be another information processing device instead of these. Moreover, image B1 may be an image showing another input form having a function similar to that of a button instead of an image showing a button.

[0040] After displaying the report image on the display 110 in ACT110, the control unit 300 waits until an operation is received via the report image (ACT120).

[0041] When the control unit 300 determines that an operation has been received via the report image (ACT120-YES), it determines whether the received operation is a selection operation for the image B2 (ACT130). Note that in FIG. 3, the process of ACT130 is shown as "Send button pressed?"

[0042] When the control unit 300 determines that the operation received in ACT 120 is a selection operation for image B2 (ACT 130-YES), it performs the process of ACT 260. The process of ACT 260 will be described later.

[0043] On the other hand, when the control unit 300 determines that the operation received in ACT120 is not a selection operation for image B2 (ACT130-NO), the control unit 300 performs the process of ACT140. That is, in this case, the control unit 300 determines whether the operation is a selection operation for image B1 (ACT140). Note that in FIG. 3, the process of ACT140 is shown as "Selection button pressed?"

[0044] When the control unit 300 determines that the operation received in ACT120 is not a selection operation for image B1 (ACT140-NO), it performs processing according to the operation (ACT230). More specifically, in this case, the operation is a selection operation for any of images CB1 to CB3. Therefore, the control unit 300 performs processing according to the image on which the selection operation was performed among images CB1 to CB3.

[0045] For example, when the image on which the selection operation is performed is image CB1, control unit 300 specifies the paper jam occurrence information as one piece of information to be included in the defect information. Then, control unit 300 superimposes a check image on image CB1 in this case. Note that even in this case, when a check image has already been superimposed on image CB1, control unit 300 re-specifies the paper jam occurrence information as information not to be included in the defect information. Then, control unit 300 deletes the check image superimposed on image CB1.

[0046] For example, when the image on which the selection operation was performed is image CB2, control unit 300 specifies the error occurrence information as one piece of information to be included in the defect information. Then, control unit 300 superimposes a check image on image CB2 in this case. Note that even in this case, when a check image has already been superimposed on image CB2, control unit 300 re-specifies the error occurrence information as information not to be included in the defect information. Then control unit 300 deletes the check image superimposed on image CB2.

[0047] For example, when the image on which the selection operation is performed is image CB3, control unit 300 identifies the abnormal sound generation information as one of the pieces of information to be included in the defect information. Then, control unit 300 superimposes a check image on image CB3 in this case. Furthermore, control unit 300 makes image B1 available for selection operation in this case. Note that even in this case, when a check image has already been superimposed on image CB3, control unit 300 re-identifies the abnormal sound generation information as information not to be included in the defect information. Then, control unit 300 deletes the check image superimposed on image CB3. Furthermore, control unit 300 makes image B1 unavailable for selection operation.

[0048] After the process of ACT230 is performed, the control unit 300 transitions to ACT120 and waits again until an operation is received via a report image.

[0049] On the other hand, when the control unit 300 determines that the operation received in ACT120 is a selection operation for the image B1 (ACT140-YES), the control unit 300 causes the display 110 to display the above-mentioned search image (ACT150). Here, the search image will be described. FIG. 6 is a diagram showing an example of the search image displayed on the display 110.

[0050] 6 shows an example of a search image, in which image P2 includes, for example, image PM1, image PM2, and image B3.

[0051] The image PM1 is an image showing a pull-down menu. Moreover, the image PM1 is associated with a plurality of occurrence location candidate information indicating candidates of locations where a defect has occurred in the image processing device 100. For this reason, in the example shown in FIG. 6, a character string "occurrence location" is drawn next to the image PM1. When a selection operation (click, tap, etc.) is performed on the image PM1, the control unit 300 causes the display 110 to display a list of a plurality of occurrence location candidate information associated with the image PM1. The user can select occurrence location candidate information indicating a location where the user presumes that a defect has occurred in the image processing device 100 from the list displayed on the display 110 in this manner. When one of the plurality of occurrence location candidate information is selected by the user, the control unit 300 causes the image PM1 to display the selected occurrence location candidate information. In the example shown in FIG. 6, the control unit 300 causes the image PM1 to display "main body" as the selected occurrence location candidate information.

[0052] Here, the locations indicated by each of the plurality of pieces of candidate generation location information are, for example, the main body of image processing device 100, a finisher, a document feeder, an external paper feed cassette, etc., but are not limited to these. Note that "Main body" displayed in image PM1 shown in Fig. 6 indicates the main body of image processing device 100. Also, image PM1 may be an image showing another input form having the same function as the pull-down menu, instead of an image showing a pull-down menu.

[0053] The image PM2 is an image showing a pull-down menu. In addition, a plurality of pieces of timing candidate information indicating candidates for the timing at which a malfunction occurs in the image processing device 100 are associated with the image PM2. For this reason, in the example shown in FIG. 6, a character string "occurrence timing" is drawn next to the image PM2. When a selection operation (click, tap, etc.) is performed on the image PM2, the control unit 300 causes the display 110 to display a list of a plurality of pieces of timing candidate information associated with the image PM2. The user can select timing candidate information indicating the timing at which the user infers that a malfunction has occurred in the image processing device 100 from the list displayed on the display 110 in this manner. When one of the plurality of pieces of timing candidate information is selected by the user, the control unit 300 causes the image PM2 to display the selected timing candidate information. In the example shown in FIG. 6, the control unit 300 causes the image PM2 to display "printing" as the selected timing candidate information.

[0054] Here, the locations indicated by each of the multiple pieces of timing candidate information are, for example, but not limited to, always, during image reading, during printing, after printing, at startup, etc. Note that image PM2 may be an image showing another input form having the same function as the pull-down menu, instead of an image showing a pull-down menu.

[0055] Image B3 is an image showing a button. When a selection operation (click, tap, etc.) is performed on image B3, the control unit 300 searches for audio information. More specifically, in this case, the control unit 300 searches for one or more pieces of audio information corresponding to the occurrence location candidate information displayed on image PM1 and the timing candidate information displayed on image PM2 from among the n pieces of audio information. For this reason, one or more pieces of occurrence location candidate information and one or more pieces of timing candidate information are associated with each of the n pieces of audio information. This allows the control unit 300 to perform the search. Note that the control unit 300 may be configured to perform the search by comparing the audio learned in a machine learning model (e.g., neural network, deep learning, etc.) with the audio indicated by each of the multiple pieces of audio information. In this case, each of the multiple pieces of audio information may not be associated with each of the occurrence location candidate information and timing candidate information. For example, in this case, after a selection operation is performed on image B3, the control unit 300 may input all of the audio information into the model and extract one or more pieces of audio information corresponding to the occurrence location candidate information and the timing candidate information. Moreover, the image B3 may be an image showing another input form having the same function as the button, instead of an image showing a button. The voice information may be searched for by a search server communicably connected to the image processing device 100. In this case, the n pieces of voice information are stored in the search server.

[0056] After displaying the search image on the display 110 in ACT150, the control unit 300 waits until an operation is received via the search image (ACT160).

[0057] When the control unit 300 determines that an operation has been received via the search image (ACT160-YES), it determines whether the received operation is a selection operation for the image B3 (ACT170). Note that in FIG. 4, the process of ACT170 is shown as "Search button pressed?"

[0058] When the control unit 300 determines that the operation received in ACT160 is not a selection operation on the image B3 (ACT160-NO), it performs processing according to the operation (ACT240). More specifically, in this case, the operation is a selection operation on either the image PM1 or the image PM2. Therefore, the control unit 300 performs processing according to the image on which the selection operation was performed, either the image PM1 or the image PM2.

[0059] For example, when the image on which the selection operation is performed is image PM1, the control unit 300 causes the display 110 to display a list of multiple pieces of candidate occurrence location information associated with image PM1. When the user selects one piece of candidate occurrence location information included in the list, the control unit 300 causes the selected candidate occurrence location information to be displayed on image PM1. For ease of explanation, the following description will refer to the candidate occurrence location information displayed on image PM1, out of the multiple pieces of candidate occurrence location information, as target candidate occurrence location information.

[0060] For example, when the image on which the selection operation is performed is the image PM2, the control unit 300 causes the display 110 to display a list of multiple pieces of timing candidate information associated with the image PM2. When the user selects one piece of timing candidate information included in the list, the control unit 300 causes the selected timing candidate information to be displayed on the image PM2. For ease of explanation, the timing candidate information displayed on the image PM2 out of the multiple pieces of timing candidate information will be referred to as target timing candidate information in the following explanation.

[0061] After the process of ACT240 is performed, the control unit 300 transitions to ACT160 and waits again until an operation is received via the search image.

[0062] On the other hand, when the control unit 300 determines that the operation received in ACT160 is a selection operation for the image B3 (ACT170-YES), it searches for audio information. That is, in this case, the control unit 300 searches for one or more pieces of audio information corresponding to the target occurrence location candidate information and the target timing candidate information from among the n pieces of audio information stored in the storage unit 320. Then, the control unit 300 causes the display 110 to display a selection image corresponding to the result of the search (ACT180). The selection image is an image that the image processing device 100 receives from the user an operation to select desired audio information from the result of the search. Here, the selection image will be described. FIG. 7 is a diagram showing an example of a selection image displayed on the display 110.

[0063] Image P3 shown in Fig. 7 is an example of a selection image. Image P3 displays one or more pieces of audio information extracted from n pieces of audio information as a result of a search for audio information performed by control unit 300. Fig. 7 shows image P3 in which four pieces of audio information extracted from n pieces of audio information are displayed as an example. In the example shown in Fig. 7, the four pieces of audio information are audio information S1 to audio information S4, respectively.

[0064] Here, the arrows shown in FIG. 7 indicate the right and left directions in FIG. 7. In the example shown in FIG. 7, an image SB1 is displayed to the right of the audio information S1. The image SB1 is an image showing a button associated with the audio information S1. When a selection operation (click, tap, etc.) is performed on the image SB1, the control unit 300 identifies the audio information S1 as the audio information desired by the user. Note that the image SB1 may be an image showing another input form having the same function as the button, instead of an image showing the button.

[0065] In the example shown in FIG. 7, an image PB1 is displayed to the left of the audio information S1. Image PB1 shows a button associated with audio information S1. When a selection operation (click, tap, etc.) is performed on image PB1, control unit 300 outputs an audio signal based on audio information S1 to audio output unit 340, and causes audio output unit 340 to output audio indicated by audio information S1. This allows the user to hear what kind of audio indicated by audio information S1 displayed as a search result is. Note that image PB1 may be an image showing another input form having the same function as the button, instead of an image showing the button.

[0066] In the example shown in FIG. 7, an image SB2 is displayed to the right of the audio information S2. The image SB2 is an image showing a button associated with the voice information S2. When a selection operation (click, tap, etc.) is performed on the image SB2, the control unit 300 specifies the voice information S2 as the voice information desired by the user. Note that the image SB2 may be an image showing another input form having the same function as the button, instead of an image showing the button.

[0067] In the example shown in FIG. 7, an image PB2 is displayed to the left of the audio information S2. Image PB2 indicates a button associated with audio information S2. When a selection operation (click, tap, etc.) is performed on image PB2, control unit 300 outputs an audio signal based on audio information S2 to audio output unit 340, and causes audio output unit 340 to output the audio indicated by audio information S2. This allows the user to hear what kind of audio is indicated by audio information S2 displayed as a search result. Note that image PB2 may be an image indicating another input form having the same function as the button, instead of an image indicating the button.

[0068] In the example shown in FIG. 7, an image SB3 is displayed to the right of the audio information S3. The image SB3 is an image showing a button associated with the voice information S3. When a selection operation (click, tap, etc.) is performed on the image SB3, the control unit 300 specifies the voice information S3 as the voice information desired by the user. Note that the image SB3 may be an image showing another input form having the same function as the button, instead of an image showing the button.

[0069] In the example shown in FIG. 7, an image PB3 is displayed to the left of the audio information S3. Image PB3 shows a button associated with audio information S3. When a selection operation (click, tap, etc.) is performed on image PB3, control unit 300 outputs an audio signal based on audio information S3 to audio output unit 340, and causes audio output unit 340 to output the audio indicated by audio information S3. This allows the user to hear what kind of audio is indicated by audio information S3 displayed as a search result. Note that image PB3 may be an image showing another input form having the same function as the button, instead of an image showing the button.

[0070] In the example shown in FIG. 7, an image SB4 is displayed to the right of the audio information S4. Image SB4 is an image showing a button associated with voice information S4. When a selection operation (click, tap, etc.) is performed on image SB4, control unit 300 specifies voice information S4 as the voice information desired by the user. Note that image SB4 may be an image showing another input form having the same function as the button, instead of an image showing the button.

[0071] In the example shown in FIG. 7, an image PB4 is displayed to the left of the audio information S4. Image PB4 shows a button associated with audio information S4. When a selection operation (click, tap, etc.) is performed on image PB4, control unit 300 outputs an audio signal based on audio information S4 to audio output unit 340, and causes audio output unit 340 to output the audio indicated by audio information S4. This allows the user to hear what kind of audio is indicated by audio information S4 displayed as a search result. Note that image PB4 may be an image showing another input form having the same function as the button, instead of an image showing the button.

[0072] As described above, in the selection image, the user can select the audio information desired by the user from one or more pieces of audio information displayed as a search result. That is, the user can select an audio similar to the abnormal sound generated in the image processing device 100, or the abnormal sound itself, from the one or more pieces of audio information. Hereinafter, for convenience of explanation, the images SB1 to SB4 will be collectively referred to as a selection button unless there is a need to distinguish between them. Note that in the selection image, the user may be able to select multiple pieces of audio information. In the following, as an example, a case where the user can select only one piece of audio information in the selection image will be described.

[0073] After displaying the selection image on the display 110 in ACT180, the control unit 300 waits until an operation is received via the selection image (ACT190).

[0074] When the control unit 300 determines that an operation has been received via a selection image (ACT190-YES), it determines whether the received operation is a selection operation for a selection button (ACT200). Note that in FIG. 4, the process of ACT200 is shown as "Selection button pressed?"

[0075] When the control unit 300 determines that the operation received in ACT190 is not a selection operation on the selection button (ACT200-NO), it performs processing according to the operation (ACT250). More specifically, in this case, the operation is a selection operation on one of the images PB1 to PB4. Therefore, the control unit 300 outputs an audio signal according to audio information associated with the image on which the selection operation has been performed among the images PB1 to PB4 to the audio output unit 340. As a result, the control unit 300 causes the audio output unit 340 to output the audio indicated by the audio information.

[0076] For example, when the image on which the selection operation is performed is image PB1, control unit 300 outputs an audio signal corresponding to audio information S1 associated with image PB1 to audio output unit 340. As a result, control unit 300 causes audio output unit 340 to output the audio indicated by audio information S1.

[0077] Furthermore, for example, when the image on which the selection operation is performed is image PB2, control unit 300 outputs an audio signal corresponding to audio information S2 associated with image PB2 to audio output unit 340. As a result, control unit 300 causes audio output unit 340 to output the audio indicated by audio information S2.

[0078] Furthermore, for example, when the image on which the selection operation is performed is image PB3, control unit 300 outputs an audio signal corresponding to audio information S3 associated with image PB3 to audio output unit 340. As a result, control unit 300 causes audio output unit 340 to output the audio indicated by audio information S3.

[0079] Furthermore, for example, when the image on which the selection operation is performed is image PB4, control unit 300 outputs an audio signal according to audio information S4 associated with image PB4 to audio output unit 340. As a result, control unit 300 causes audio output unit 340 to output the audio indicated by audio information S4.

[0080] After the process of ACT250 is performed, the control unit 300 transitions to ACT190 and waits again until an operation is received via the selection image.

[0081] On the other hand, when the control unit 300 determines that the operation received in ACT200 is a selection operation on the selection button (ACT200-YES), it identifies the voice information (ACT210). That is, in this case, the control unit 300 identifies the voice information associated with the selection button on which the selection operation was performed as the voice information desired by the user. The selection operation performed on the selection button is an example of a first operation.

[0082] For example, when the image on which the selection operation is performed is the image SB1, the control unit 300 specifies the audio information S1 associated with the image SB1 as the audio information desired by the user.

[0083] Furthermore, for example, when the image on which the selection operation is performed is the image SB2, the control unit 300 specifies the sound information S2 associated with the image SB2 as the sound information desired by the user.

[0084] Furthermore, for example, when the image on which the selection operation is performed is the image SB3, the control unit 300 specifies the sound information S3 associated with the image SB3 as the sound information desired by the user.

[0085] Furthermore, for example, when the image on which the selection operation is performed is the image SB4, the control unit 300 specifies the sound information S4 associated with the image SB4 as the sound information desired by the user.

[0086] After identifying the audio information desired by the user in ACT210, the control unit 300 displays a report image including the identified audio information (ACT220). Here, FIG. 8 is a diagram showing an example of a report image including audio information selected by the user. As shown in FIG. 8, the control unit 300 displays the audio information identified as the audio information desired by the user to the right of the image B1. In the example shown in FIG. 8, the audio information identified by the control unit 300 as the audio information desired by the user is audio information S1.

[0087] After displaying the report image in ACT220, the control unit 300 transitions to ACT130, where it again determines whether or not the operation accepted via the report image is a selection operation for image B2.

[0088] Then, when it is determined that the operation received via the report image is a selection operation on image B2, the control unit 300 transitions to ACT260 as described above and generates defect information. Here, the process of ACT260 will be described.

[0089] In ACT260, the control unit 300 specifies one or more images on which a selection operation has been performed among the images CB1 to CB3. For example, the control unit 300 specifies an image on which an image indicating that a selection operation has been performed is superimposed among the images CB1 to CB3. Then, the control unit 300 specifies information associated with the specified image as information to be included in the defect information.

[0090] For example, when the control unit 300 identifies the image CB1 as the image on which the selection operation was performed, the control unit 300 identifies the image CB1 as the image for which the paper jam occurrence information associated with the image CB1 is to be included in the malfunction information.

[0091] Furthermore, for example, when the control unit 300 identifies the image CB2 as the image on which the selection operation has been performed, it identifies the image CB1 as the image for which the error occurrence information is to be included in the defect information.

[0092] Also, for example, when the control unit 300 identifies the image CB3 as the image on which the selection operation was performed, it identifies the abnormal sound occurrence information associated with the image CB1 as the image to be included in the defect information. In this case, the control unit 300 identifies the audio information displayed in the report image as the information to be included in the defect information. In the example shown in Fig. 8, the control unit 300 identifies the audio information S1 as the information to be included in the defect information.

[0093] In this manner, the control unit 300 specifies information to be included in the defect information, and then the control unit 300 generates defect information including the specified information.

[0094] After generating the defect information in ACT260, the control unit 300 transmits the defect information to the other device described above (ACT270), and ends the process.

[0095] As described above, the control unit 300 transmits, to another device, among n pieces of audio information (i.e., audio information S1 to audio information Sn) indicating different sounds, audio information corresponding to an operation accepted by the control panel 120. This means that the user can select audio information indicating a sound similar to an abnormal sound generated in the image processing device 100, and the image processing device 100 can notify the other device of the selected audio information. Therefore, the image processing device 100 can notify the other device of the audio selected by the user as a sound similar to the generated abnormal sound. In particular, when each of the n pieces of audio information is information indicating an abnormal sound that may be generated from the image processing device 100, the image processing device 100 can more reliably notify the other device of the audio similar to the generated abnormal sound. Furthermore, even if each of the multiple pieces of audio information is a sound different from an abnormal sound that may be generated from the image processing device 100, the image processing device 100 can notify the other device of the audio that the user thinks is similar to the generated abnormal sound.

[0096] In addition, when the control unit 300 described above transmits the first voice identification information to another device, the control unit 300 performs the following process in ACT260. That is, in this case, the control unit 300 generates information that identifies the voice information identified as information to be included in the defect information in ACT260 as the first voice identification information to be included in the defect information. Then, the control unit 300 generates defect information including the generated first voice identification information. At this time, the control unit 300 may generate defect information that does not include the voice information, or may generate defect information that includes the voice information.

[0097] (Modification of the embodiment) Modifications of the embodiment will be described below.

[0098] FIG. 9 is a diagram showing an example of a configuration of an information processing system 500 according to a modification of the embodiment.

[0099] The information processing system 500 includes the image processing device 100 and the information processing device 200 described above.

[0100] In a modification of the embodiment, the n pieces of audio information S1 to Sn are not stored in the storage unit 320 of the image processing device 100. Instead, in this modification, the n pieces of audio information S1 to Sn are stored in the information processing device 200.

[0101] The information processing device 200 is an example of the above-mentioned search server. The information processing device 200 may be another information processing device such as a desktop PC (Personal Computer) instead of a server as long as it has a function as a search server. In response to a request from the image processing device 100, the information processing device 200 outputs audio information corresponding to the request to the image processing device 100.

[0102] The information processing device 200 performs, for example, a process related to searching for audio information among the processes of ACT150 shown in Fig. 3. More specifically, the information processing device 200 searches for audio information associated with each of the target occurrence location candidate information and the target timing candidate information from among the n pieces of audio information in response to a request from the image processing device 100. Then, the information processing device 200 outputs information indicating the search result to the image processing device 100.

[0103] 4, in response to a request from the image processing device 100, the information processing device 200 outputs audio information indicated by the request to the image processing device 100. For example, when a selection operation is performed on the image PB1 shown in FIG. 7, the image processing device 100 outputs a request to acquire audio information S1 to the information processing device 200. In response to the request, the information processing device 200 outputs the audio information S1 to the image processing device 100. This enables the image processing device 100 to cause the audio output unit 340 to output the audio indicated by the audio information S1.

[0104] Furthermore, the information processing device 200 may be configured to perform the processes of ACT260 and ACT270 shown in FIG.

[0105] <Other Modifications> Note that the control unit 300 described above may be configured to have the user select the occurrence location candidate information via a second selection image as shown in Fig. 10, instead of the configuration in which the user selects the occurrence location candidate information via the image PM1 shown in Fig. 6. The second selection image is an image in which the image processing device 100 accepts the occurrence location candidate information from the user.

[0106] Fig. 10 is a diagram showing an example of a second selected image. Image P4 shown in Fig. 10 is an example of the second selected image. Image P4 includes, for example, five images, images TB1 to TB5. Note that image P4 may include other images instead of some or all of these five images, or in addition to all of these five images.

[0107] Image TB1 is an image showing a button. Information showing a location located on the upper side of the image processing device 100 is associated with image TB1 as occurrence location candidate information. The location located on the upper side of the image processing device 100 is, for example, a location located between the top of the image processing device 100 and the printer unit 130, but is not limited to this. In addition, the location located on the upper side of the image processing device 100 may be a configuration including at least one of the top of the image processing device 100 and the printer unit 130, or may be a configuration including neither the top of the image processing device 100 nor the printer unit 130. In FIG. 10, the location located on the upper side of the image processing device 100 is shown as "a location on the upper side of the image processing device".

[0108] When a selection operation (click, tap, etc.) is performed on image TB1, control unit 300 changes the display mode (e.g., color, size, etc.) of image TB1 to a mode indicating that a selection operation has been performed on image TB1. In addition, control unit 300 accepts, in this case, information indicating a location located on the upper side of image processing device 100 as occurrence location candidate information selected by the user.

[0109] Image TB2 is an image showing a button. Information showing a location located on the lower side of the image processing device 100 is associated with image TB2 as occurrence location candidate information. The location located on the lower side of the image processing device 100 is, for example, a location located between the printer unit 130 and the lowest part of the image processing device 100, but is not limited to this. In addition, the location located on the lower side of the image processing device 100 may be configured to include at least one of the printer unit 130 and the lowest part of the image processing device 100, and may be configured not to include both the printer unit 130 and the lowest part of the image processing device 100. In FIG. 10, the location located on the lower side of the image processing device 100 is shown as a "location on the lower side of the image processing device."

[0110] When a selection operation (click, tap, etc.) is performed on image TB2, control unit 300 changes the display mode (e.g., color, size, etc.) of image TB2 to a mode indicating that a selection operation has been performed on image TB2. In addition, control unit 300 accepts, in this case, information indicating a location located on the lower side of image processing device 100 as occurrence location candidate information selected by the user.

[0111] Image TB3 is an image showing a button. Information indicating a location located on the right side of the image processing device 100 is associated with image TB3 as occurrence location candidate information. The location located on the right side of the image processing device 100 is, for example, a location located between a virtual center line dividing the image processing device 100 into left and right when the image processing device 100 is viewed from the front of the image processing device 100 and the right end of the image processing device 100 in that case, but is not limited to this. Here, the front of the image processing device 100 is the surface of the image processing device 100 on which the sheet storage unit 140 is provided. Note that the location located on the right side of the image processing device 100 may be configured to include the right end of the image processing device 100 in that case, or may not be configured to include the right end of the image processing device 100 in that case. In FIG. 10, the location located on the right side of the image processing device 100 is shown as "a location on the right side when facing the front of the image processing device."

[0112] When a selection operation (click, tap, etc.) is performed on image TB3, the control unit 300 changes the display mode (e.g., color, size, etc.) of image TB3 to a mode indicating that a selection operation has been performed on image TB3. In addition, in this case, the control unit 300 receives information indicating a location located on the right side of the image processing device 100 as occurrence location candidate information selected by the user.

[0113] Image TB4 is an image showing a button. Information indicating a location located on the left side of the image processing device 100 is associated with image TB4 as occurrence location candidate information. The location located on the left side of the image processing device 100 is, for example, a location located between a virtual center line dividing the image processing device 100 into left and right when the image processing device 100 is viewed from the front of the image processing device 100 and the left end of the image processing device 100 in that case, but is not limited to this. Note that the location located on the left side of the image processing device 100 may be configured to include the left end of the image processing device 100 in that case, or may not be configured to include the left end of the image processing device 100 in that case. In FIG. 10, the location located on the left side of the image processing device 100 is shown as "a location on the left side when facing the front of the image processing device."

[0114] When a selection operation (click, tap, etc.) is performed on image TB4, the control unit 300 changes the display mode (e.g., color, size, etc.) of image TB4 to a mode indicating that a selection operation has been performed on image TB4. In this case, the control unit 300 also receives information indicating a location located on the left side of the image processing device 100 as occurrence location candidate information selected by the user.

[0115] Image TB5 is an image showing a button. When a selection operation (click, tap, etc.) is performed on image TB5, the control unit 300 deletes the display of image P4 from the display 110 and displays image P2. In this case, image P2 includes a display area in which one or more pieces of occurrence location candidate information identified by the control unit 300 via image P4 are displayed instead of image PM1. That is, in this case, the control unit 300 displays one or more pieces of occurrence location candidate information identified by the control unit 300 via image P4 in the display area of ​​image P2. In this way, the user can select occurrence location candidate information. Note that any method may be adopted as a method in which the control unit 300 displays image P4 on the display 110.

[0116] In addition, the control unit 300 described above may be configured to allow the user to select candidate occurrence location information via a second selection image as shown in FIG. 11, instead of the configuration in which the user selects candidate occurrence location information via the image PM1 shown in FIG. 6.

[0117] Fig. 11 is a diagram showing another example of the second selection image. Image P5 shown in Fig. 11 is another example of the occurrence location publication information selection image. Image P5 includes, for example, two images, image TB6 and image TB7. Note that image P5 may include another image instead of either or both of these two images, or in addition to both of these two images.

[0118] The image TB6 is an image showing the appearance of the image processing device 100. The area in which the image TB6 is displayed in the display area of ​​the display 110 is divided into a plurality of areas. Each of these areas is associated with a plurality of different parts of the image processing device 100. For example, the printer unit 130 is associated with the area in which the image TB6 is displayed, which corresponds to the appearance of the printer unit 130, as a part of the image processing device 100. That is, the area in which the image TB6 is displayed, which corresponds to the appearance of the part X, is associated with a part of the image processing device 100. When a selection operation (click, tap, etc.) is performed on one of these multiple areas, the control unit 300 accepts information indicating the part associated with the tapped area, among the parts of the image processing device 100, as occurrence location candidate information selected by the user. This allows the image processing device 100 to facilitate the user's selection of occurrence location candidate information.

[0119] Image TB7 is an image showing a button. When a selection operation (click, tap, etc.) is performed on image TB7, the control unit 300 deletes the display of image P5 from the display 110 and displays image P2. In this case, image P2 includes a display area for displaying the occurrence location candidate information identified by the control unit 300 via image P5 instead of image PM1. That is, in this case, the control unit 300 displays the occurrence location candidate information identified by the control unit 300 via image P5 in the display area of ​​image P2. In this way, the user can select the occurrence location candidate information. Note that any method may be adopted as a method for the control unit 300 to display image P5 on the display 110.

[0120] The above-described defect information may include at least one of occurrence location candidate information, timing candidate information, and log information. Here, the log information is information indicating a log about the image processing device 100 during a period before the timing at which the defect occurred in the image processing device 100. The log information includes, for example, some or all of job information during that period, information indicating a self-diagnosis code diagnosed by the image processing device 100 during that period, information indicating an error code output by the image processing device 100 during that period, a firmware version change history during that period, and information indicating a power on / off history of the image processing device 100 during that period. The job information is, for example, information indicating a job for causing the image processing device 100 to print five copies using a color double-sided 2-in-1 setting. The self-diagnosis code is, for example, a code indicating various setting values ​​of the image processing device 100. When the defect information includes the occurrence location candidate information, the control unit 300 specifies the occurrence location candidate information displayed in the image PM1 as the occurrence location candidate information to be included in the defect information when, for example, a selection operation is performed on the image P3 in the image P2. Furthermore, when the defect information includes timing candidate information, for example, when a selection operation is performed on image P3 in image P2, the control unit 300 specifies the timing candidate information displayed on image PM2 as timing candidate information to be included in the defect information. Furthermore, when the defect information includes log information, the control unit 300 specifies, for example, log information within the period of time stored in the storage unit 320 as log information to be included in the defect information. Note that the method of storing the log information in the storage unit 320 by the control unit 300 may be a known method or a method to be developed in the future. Here, the period is, for example, a period from the timing when a selection operation is performed on image P3 in image P2 until 10 minutes before, but is not limited to this.

[0121] Moreover, the abnormal sound in the above description is, more specifically, a sound generated in the image processing device 100 that is different from the sound generated when the image processing device 100 is operating normally, that is, an abnormal sound. In other words, the abnormal sound is a sound generated from the image processing device 100 when an abnormality occurs in the image processing device 100. Specifically, for example, the abnormal sound includes a sound generated in addition to the sound generated when the image processing device 100 is operating normally, a sound generated instead of the sound generated when the image processing device 100 is operating normally, a sound generated when the image processing device 100 is operating normally but lacking a part or all of a series of sounds, and the like.

[0122] As described above, the image processing device (in this example, image processing device 100) includes an operation receiving unit (in this example, control panel 120) that receives an operation, and a control unit (in this example, control unit 300) that transmits to another device first audio information (in this example, audio information S1) corresponding to a first operation (in this example, a selection operation for each of images SB1 to SB4) received by the operation receiving unit from among a plurality of audio information indicating different sounds (in this example, n pieces of audio information S1 to Sn). This allows the image processing device to notify the user of the audio selected as a sound similar to the abnormal sound that has occurred.

[0123] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention.

[0124] A program for implementing the functions of any of the components in the above-described devices (e.g., the image processing device 100 and the information processing device 200) may be recorded in a computer-readable recording medium, and the program may be read into a computer system and executed. The term "computer system" as used herein includes hardware such as an OS (Operating System) and peripheral devices. The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD (Compact Disk)-ROMs, and storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" also refers to storage devices that hold a program for a certain period of time, such as volatile memory (RAM) in a computer system that serves as a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line.

[0125] The above program may be transmitted from a computer system in which the program is stored in a storage device or the like to another computer system via a transmission medium, or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The above program may be for implementing some of the above functions. Furthermore, the above program may be a so-called differential file (differential program) that can implement the above functions in combination with a program already recorded in the computer system. [Explanation of symbols]

[0126] 100... image processing device, 110... display, 120... control panel, 130... printer section, 140... sheet storage section, 150... image reading section, 200... information processing device, 300... control section, 310... network interface, 320... storage section, 330... memory, 340... audio output section, 500... information processing system

Claims

1. An information processing system including an information processing device and an image processing device, The information processing device includes: storing sound information indicating each of a plurality of sounds generated from the image processing device when a malfunction occurs in the image processing device in association with candidate generation location information indicating candidates for a location where the malfunction occurs in the image processing device and candidate timing information indicating candidates for a timing when the malfunction occurs in the image processing device; When receiving an inquiry indicating the occurrence location candidate information and the timing candidate information from the image processing device, searching for the sound information associated with the occurrence location candidate information and the timing candidate information indicated by the received inquiry from among the plurality of pieces of sound information, and transmitting search result information indicating the search result to the image processing device; The image processing device includes: A display and A network interface for communicating with the information processing device; a control unit that generates, as an image to be displayed on the display, a first image that accepts a location candidate selection operation for selecting one of the plurality of occurrence location candidate information as target location candidate information and a timing candidate selection operation for selecting one of the plurality of timing candidate information as target timing candidate information, and when the location candidate selection operation and the timing candidate selection operation are accepted via the first image, transmits the inquiry indicating the target location candidate information and the target timing candidate information to the information processing device, and when search result information is received as a response to the transmitted inquiry, generates defect information including the target location candidate information together with the sound information indicated by the received search result information; Equipped with Information processing system.

2. the plurality of pieces of candidate occurrence location information include information indicating a main body of the image processing apparatus, information indicating a finisher, information indicating a document feeder, and information indicating an external paper feed cassette; The plurality of pieces of timing candidate information include information indicating always, information indicating an image being read, information indicating a printing operation, information indicating an end of printing, and information indicating a start-up time. The information processing system according to claim 1 .

3. The control unit transmits the generated defect information to another device other than the information processing device.

3. The information processing system according to claim 1 or 2.

4. the control unit generates a second image for receiving an operation of selecting the sound information to be included in the defect information from the sound information indicated by the received search result information. The information processing system according to claim 1 .

5. Communicatively connected to the image processing device; storing sound information indicating each of a plurality of sounds generated from the image processing device when a malfunction occurs in the image processing device in association with candidate generation location information indicating candidates for a location where the malfunction occurs in the image processing device and candidate timing information indicating candidates for a timing when the malfunction occurs in the image processing device; when receiving an inquiry indicating the occurrence location candidate information and the timing candidate information from the image processing device, searching for the sound information associated with the occurrence location candidate information and the timing candidate information indicated by the received inquiry from among the plurality of pieces of sound information, and transmitting search result information indicating the search result to the image processing device; Information processing device.

6. A computer of an information processing device communicably connected to the image processing device, storing sound information indicating each of a plurality of sounds generated from the image processing device when a malfunction occurs in the image processing device in association with candidate generation location information indicating candidates for a location where the malfunction occurs in the image processing device and candidate timing information indicating candidates for a timing when the malfunction occurs in the image processing device; when receiving an inquiry indicating the occurrence location candidate information and the timing candidate information from the image processing device, searching for the sound information associated with the occurrence location candidate information and the timing candidate information indicated by the received inquiry from among the plurality of pieces of sound information, and transmitting search result information indicating the search result to the image processing device. program.

Images