Information processing program and information processing device

Abstract

To improve work efficiency at maintenance time of a device to be diagnosed.SOLUTION: When having an operator recognize a component or a region where there is possibly occurrence of abnormality in a device being diagnosed that is obtained by analyzing sound data emanating from the device being diagnosed, the component or the region where there is possibly occurrence of abnormality is displayed by a display unit 24 by superimposing marks 70-73 at corresponding points in visual structure information 61 with which the structure of the device being diagnosed is visually graspable. A list of the components or regions where there is possibly occurrence of abnormality may be displayed by the display unit 24.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to an information processing program and an information processing device. [Background technology]

[0002] 2. Description of the Related Art A system for diagnosing a device to be diagnosed, such as an image forming device, is known from Patent Document 1. When an abnormal sound (strange sound) occurs, this diagnostic system inputs the sound to acquire sound data and receives recording location information, which is the location where the abnormal sound was recorded.The diagnostic system then extracts a frequency spectrum waveform similar to that obtained by frequency analysis of the acquired abnormal sound data.Furthermore, based on the recording location information (abnormal sound location information), the diagnostic system narrows down the components that may be causing the abnormal sound and displays an explanation of the cause of the abnormal sound and how to deal with it.The diagnostic system also displays the name and number of the component that may be causing the abnormal sound. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 5939480 Summary of the Invention [Problem to be solved by the invention]

[0004] However, although the above-described diagnostic system can narrow down the components that are generating the abnormal noise, it cannot visually identify the components that may be the cause of the abnormal noise. Knowledge of the equipment to be diagnosed varies from worker to worker. Inexperienced workers and users themselves often do not know the location of candidate parts causing abnormal noises, even when the candidate parts (information identifying the cause of the abnormal noise) are displayed as text information. In such cases, it is necessary to inquire at a support center or check the location of candidate parts causing abnormal noises by referring to a manual or the like. This leads to a decrease in work efficiency, and there is also a risk of misidentifying the target part because the location of candidate parts causing abnormal noises cannot be visually grasped.

[0005] The present invention has been made in view of the above circumstances, and has as its main object to improve the efficiency of work during maintenance of a device to be diagnosed. [Means for solving the problem]

[0006] In order to achieve the above object, the present invention can be configured as an information processing program for assisting abnormality diagnosis. That is, the information processing program On the computer, visual structure information that allows the structure of the device to be diagnosed to be visually grasped; a mark that enables recognition of a corresponding location in the visual structural information of a part or area in the device to be diagnosed, which is obtained by analyzing sound data generated from the device to be diagnosed, where an abnormality may be occurring; and a display process for displaying an image on the display unit in which the above images are superimposed.

[0007] Here, the image in which the visual structural information and a mark that enables recognition of a corresponding location in the visual structural information of a component or area where an abnormality may have occurred may be superimposed and displayed in the form of raster data such as an image, or vector data such as a graphic. Furthermore, the image in which the visual structural information and the mark are superimposed and displayed may be created by another device such as a server device, or may be created by the computer that performs this processing.

[0008] Therefore, the display unit displays a component or area in which an abnormality may have occurred in the diagnosed device by superimposing a marker on the corresponding location in the visual structural information. Therefore, by looking at the marker superimposed on the visual structural information displayed on the display unit, the worker can visually grasp the location of the component or area in which an abnormality may have occurred in the diagnosed device. As a result, it becomes easier to narrow down the location of the cause of the abnormality by referring to the visual structural information with the marker superimposed.

[0009] In order to achieve the above object, the present invention can also be configured as an information processing device. That is, the information processing device a display unit that displays information; a display control unit that displays on the display unit an image in which visual structure information that allows the structure of the device to be diagnosed to be visually grasped is superimposed with a mark that allows the corresponding location of a part or area in the device to be diagnosed that may have an abnormality, which is obtained by analyzing sound data generated from the device to be diagnosed, to be recognized; and Equipped with.

[0010] Here, the image in which a mark that enables recognition of a location corresponding to a component or area where an abnormality may occur on the visual structural information may be superimposed on the information processing device and displayed on the display unit. Alternatively, the image in which a mark is superimposed on the visual structural information may be formed by another device and displayed on the display unit.

[0011] Therefore, the display control unit displays visual structural information on the display unit that allows the structure of the diagnosed device to be visually grasped, and also superimposes marks on the corresponding locations on the visual structural information to indicate parts or areas where an abnormality may have occurred. Therefore, by looking at the marks superimposed on the visual structural information displayed on the display unit, the worker can visually grasp the location of parts or areas where an abnormality may have occurred in the diagnosed device. As a result, by referring to the visual structural information with the marks superimposed, the worker can more easily narrow down the location where the abnormality is occurring. [Effects of the Invention]

[0012] According to the above configuration, it is possible to improve the efficiency of work during maintenance of the device to be diagnosed. [Brief explanation of the drawings]

[0013] Advantages and features provided by embodiments of the present invention will be more fully understood from the following detailed description and accompanying drawings, which are given by way of example and are not intended to be limiting of the invention. [Figure 1] 1 is a schematic diagram showing an information processing system for supporting abnormal sound diagnosis according to the present invention; [Figure 2A] 1 is a block diagram showing an example of the functional configuration of an information processing device (diagnosis terminal) used in the information processing system according to the present invention. [Figure 2B] 2 is a block diagram showing an example of the functional configuration of a server device used in the information processing system according to the present invention; FIG. [Figure 3] 4 is a flowchart showing an example of operation processing of the information processing device (diagnosis terminal) according to the present invention. [Figure 4] FIG. 2 is a diagram showing an example of an operation screen for collecting abnormal sounds and starting analysis in the information processing device (diagnosis terminal) according to the present invention. [Figure 5] 10 is a diagram showing an example of display of analysis results of the information processing device (diagnosis terminal) according to the present invention. FIG. [Figure 6] 10 is a flowchart showing another example of operation processing of the information processing device (diagnosis terminal) according to the present invention. [Figure 7] 10 is a flowchart showing another example of operation processing of the information processing device (diagnosis terminal) according to the present invention. [Figure 8] FIG. 10 is a diagram showing an example of display on the display unit, showing an example of a list display of candidate abnormal noise generating parts and an example of superimposing markers on the visual structure information to indicate the positions of the candidate abnormal noise generating parts. [Figure 9]FIG. 8 is a diagram showing an example in which the size of the mark indicating the position of the candidate noise generating component is changed to match the size of the component in the display example of FIG. 7. [Figure 10] 9 is a diagram showing an example of a display when the display state of FIG. 8 is changed to visual structure information viewed from a different side of the device to be diagnosed. [Figure 11] FIG. 9 is a diagram showing an example of a display when the display state of FIG. 8 is changed to visual structural information seen from above the diagnosis target device. [Figure 12A] FIG. 9 is a diagram showing a state in which no parts are selected on the display screen in the display example of FIG. 8. [Figure 12B] FIG. 12B is a diagram showing a display example when part A is selected on the screen from the state of FIG. 12A. [Figure 12C] FIG. 12C is a diagram showing a display example when part D is further selected on the screen from the state of FIG. 12B. [Figure 13] FIG. 10 is a diagram showing another example of display in which a list of candidates for abnormal noise generating parts is associated with positional markers in the visual structure information of the candidates for abnormal noise generating parts. [Figure 14] FIG. 10 is a diagram showing an example in which information about a driving source is added to a list of candidates for abnormal noise generating parts. [Figure 15A] FIG. 10 is a diagram showing another example in which information about the drive source is added to the list of candidates for abnormal noise generating parts, and is a diagram showing an example in which there are many candidates for abnormal noise generating parts. [Figure 15B] FIG. 10 is a diagram showing an example in which the number of candidates for abnormal noise generating parts driven by each drive source is displayed in a list of candidates for abnormal noise generating parts; [Figure 15C] FIG. 10 is a diagram showing an example of a list of candidate noise-generating parts in which names of candidate noise-generating parts driven by each drive source are displayed. [Figure 16] FIG. 10 is a diagram showing an example of display on the display unit, showing an example of a list display of areas where abnormal noise may be occurring, and an example of superimposing a marker on the visual structure information for those areas. [Figure 17] FIG. 10 is a control block diagram showing an example in which the diagnosed device, which is the source of the abnormal noise, performs the process from collecting the abnormal noise to analyzing it and displaying various information. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, an embodiment of an information processing apparatus according to the present invention will be described with reference to the drawings. The information processing device according to the present invention is a device that supports abnormality diagnosis to identify the location of an abnormality in a device to be diagnosed. In this embodiment, the device supports identification of the cause of an abnormal noise, and a case where an image forming device 4 is diagnosed will be described. However, the scope of the present invention is not limited to the disclosed embodiment.

[0015] (First embodiment) 1 shows a schematic configuration of an information processing system 1 for identifying the cause of an abnormal noise. The information processing system 1 includes a diagnostic terminal 2 as an information processing device, and a server device 3 connected to the diagnostic terminal 2 so as to be able to communicate with the diagnostic terminal 2.

[0016] The diagnostic terminal 2 is a portable device such as a personal computer, smartphone, or tablet terminal. This diagnostic terminal 2 is carried by a service person who performs maintenance, management, repair, etc. of the device to be diagnosed, such as the image forming apparatus 4 used by the end user. The diagnostic terminal 2 functions as a computer that acquires sound data of abnormal sounds generated in the image forming apparatus 4, extracts candidate parts that may be causing the abnormal sounds by analyzing the acquired sound data, and displays the analysis results, extraction results, etc.

[0017] As shown in FIG. 2A, the diagnostic terminal 2 includes a sound collection unit 21, a diagnostic unit 22, a storage unit 23, a display unit 24, a communication unit 25, and a display control unit 26.

[0018] The sound collection unit 21 is configured by a sound collection microphone 21a, which is a well-known acoustic device that converts detected sound into an electrical signal (sound data). This sound collection microphone 21a may be built into the diagnostic terminal 2 or may be externally attached.

[0019] The diagnosis unit 22 has an arithmetic processing device equipped with one or more CPUs (Central Processing Units), MPUs (Micro-Processing Units), GPUs (Graphics Processing Units), etc. This arithmetic processing device reads and executes programs stored in the storage unit 23, thereby performing various information processing, control processing, etc. related to the diagnosis terminal 2.

[0020] The storage unit 23 stores programs for performing information processing, control processing, etc. in the diagnostic terminal 2, as well as sound data and analysis results collected by the sound collection unit 21. Here, the programs include an information processing program for abnormal sound diagnosis that causes the diagnostic terminal 2 to perform processes such as acquiring and analyzing sound data of abnormal sounds (described later), extracting candidate parts that may be the cause of abnormal sounds (abnormal sound-generating parts), and displaying the analysis results and extraction results. This information processing program may be installed in the storage unit 23 of the diagnostic terminal 2 via a predetermined recording medium. Alternatively, the information processing program may be downloaded via a network and installed in the storage unit 23 of the diagnostic terminal 2.

[0021] The diagnosis unit 22 reads and executes the information processing program loaded into the storage unit 23, and analyzes the sound data collected by the sound collection unit 21. Then, it compares the detection period of the abnormal sound with the pitch period of the moving parts mounted on the image forming device 4, and performs processing to extract candidates for the parts that generate the abnormal sound.

[0022] The storage unit 23 also stores various information for identifying candidates for abnormal noise generating parts. The pitch period of the moving parts of the device to be diagnosed (image forming device 4), Mounting position information that identifies the mounting position of a part that may be the cause of abnormal noise in the diagnosed device (image forming device 4), Size information of parts mounted on the device to be diagnosed (image forming device 4), Information on the drive source of the parts used in the device to be diagnosed (image forming device 4), etc. are stored.

[0023] The storage unit 23 also stores structural information (visual structural information) that visually shows the structure of the device to be diagnosed (image forming device 4) in two or three dimensions. Here, visual structural information of the device to be diagnosed (image forming device 4) refers to information displayed so that the structure of the device to be diagnosed can be visually grasped. This information is a two-dimensional projection image or three-dimensional image such as a photograph, drawing, illustration, or the like of the external structure of the image forming device 4, such as a side or plane, the structure that can be grasped with the door open, or the structure arranged for guidance. In this embodiment, an example using an external structural diagram (two-dimensional projection drawing) of the image forming device 4 is shown.

[0024] The display unit 24 is configured with a flat panel display such as a liquid crystal display, an organic EL display, etc. Based on a display control signal from the display control unit 26, the display unit 24 displays various operation screens, diagnosis results, various images, etc.

[0025] The communication unit 25 is a communication module or a communication interface for communicating with the server device 3 via a wired or wireless network. For example, it is a short-range wireless communication module such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), or a wide-area wireless communication module such as 5G, 4G, or LTE. The diagnostic terminal 2 and the server device 3 are connected via a wired or wireless LAN or the Internet communication network, enabling them to send and receive information.

[0026] The display control unit 26 has an arithmetic processing device that is the same as or different from the diagnosis unit 22, and reads and executes an information processing program loaded into the storage unit 23. The display control unit performs processing such as displaying, on the display unit 24, the diagnosis results obtained by the diagnosis unit 22, candidate abnormal noise generating parts extracted by the diagnosis unit 22, and images visually displaying the positions of the abnormal noise generating parts (details will be described later).

[0027] 2B, the server device 3 includes a communication unit 31, a storage unit 32, and a control unit 33. The server device 3 includes not only a single server device, but also a cloud server device or a virtual server device configured by multiple computers.

[0028] The communication unit 31 is a communication module or communication interface for communicating with the diagnostic terminal 2 via a network, either wired or wirelessly, and connects the diagnostic terminal 2 and the server device 3 via a wired or wireless LAN or the Internet communication network to send and receive information.

[0029] The storage unit 32 stores programs for performing information processing, control processing, etc. in the server device 3, and also stores various pieces of information sent from the diagnostic terminal 2.

[0030] The control unit 33 has one or more arithmetic processing devices such as a central processing unit (CPU), a micro-processing unit (MPU), a graphics processing unit (GPU), etc. Through this arithmetic processing, the control unit 33 reads and executes programs stored in the storage unit 32, thereby performing various information processing, control processing, etc. related to the server device 3.

[0031] The storage unit 23 and the diagnosis unit 22 of the diagnostic terminal 2 may be located on the server device 3 side (they may be substituted by the storage unit 32 and the control unit 33 of the server device 3). In that case, the various information and programs stored in the storage unit 23 of the diagnostic terminal 2 are also stored in the storage unit 32 of the server device 3. Then, sound data of abnormal noises collected by the diagnostic terminal 2 may be transmitted to the server device 3, and the control unit 33 of the server device 3 may perform the same processing as that of the diagnosis unit 22 of the diagnostic terminal 2.

[0032] In this embodiment, a case will be described in which an abnormal noise occurs in an image forming apparatus 4, which is an apparatus to be diagnosed and installed at an end user's location.

[0033] When an abnormal noise occurs in an image forming device 4 installed at an end user's location, a service person carries a diagnostic terminal (for example, a mobile terminal) 2 and goes to the location of the image forming device 4. The service person then uses the diagnostic terminal 2 to record the abnormal noise, thereby obtaining sound data of the abnormal noise, and performs an abnormal noise diagnosis to identify the component causing the abnormal noise.

[0034] The operation of the diagnostic terminal 2 in this embodiment will be described with reference to the flowchart of FIG. First, in the diagnostic terminal 2, the built-in sound collecting microphone 21a (sound collecting unit 21) is brought close to the location of the image forming device 4 where the abnormal sound is generated, the abnormal sound is recorded, and sound data is acquired (sound is collected by the microphone: step S01).

[0035] For example, an operation screen for recording sound, as shown in Fig. 4, is displayed on the display unit 24 of the diagnostic terminal 2. This operation screen includes a setting unit 41 for setting information necessary for recording sound (for example, the name under which the recording file is saved and the recording time), a start button 42 and an end button 43 for instructing the start and end of recording, and the like. By setting the information necessary for recording and pressing the start button 42, sound data of the abnormal sound is stored in the storage unit 23 in a predetermined file format. At this time, the recorded sound data may be transmitted to the server device via the communication unit 25 and stored in the storage unit 32 of the server device 3.

[0036] Next, the acquired sound data is analyzed (step S02). As shown in Fig. 4, the display unit 24 is provided with a file selection unit 44 for selecting a sound file containing recorded sound, a setting unit 45 for setting parameters required for analysis (e.g., detection sensitivity, etc.), an analysis button 46 for executing the analysis, etc. The analysis is executed by specifying a sound data file stored in the storage unit 23, specifying detection sensitivity, etc., and pressing the analysis button 46. This analysis may be performed each time from the screen of FIG. 4, but parameters may be set in advance so that the analysis is performed automatically after the sound recording is completed.

[0037] Various methods can be considered for analyzing sound data. For example, a spectrogram (three-dimensional (frequency x time x amplitude) data) is created by decomposing sound data (audio waveform) into frequency components using a Fourier transform (short-time discrete Fourier transform) and arranging the spectra in the time direction. The data set is then clustered to extract only abnormal sounds, thereby identifying the period of the abnormal sound, and the period of the abnormal sound is compared with the rotation period (pitch period) of each part. By extracting parts with periods that are the same as or close to the abnormal sound period, candidate abnormal sound generating parts that may be the cause of the abnormal sound are extracted (step S03). This extraction of candidate abnormal sound generating parts involves, for example, extracting parts with rotation periods (candidate pitch periods) that are within a predetermined range of difference from the abnormal sound period (detection period).

[0038] As a result of the analysis, the abnormal noise detection period and candidate abnormal noise generating components with periods that are the same as or close to this detection period are displayed in a list, for example, as shown in Fig. 5. On this analysis result screen, components with periods close to the abnormal noise detection period are displayed in order of smallest difference (step S04).

[0039] Thereafter, by pressing the "Display component locations" button 47 provided on the analysis result screen, the display screen is switched to one that allows visual recognition of the location of each of the extracted candidate components causing abnormal noise in the diagnosed device (image forming device 4) (step S05).

[0040] In the above example, analysis of sound data and extraction of candidate parts causing abnormal noise are performed by the diagnostic terminal 2 (this is an example in which the diagnostic terminal 2 performs the process from collecting abnormal noises to displaying the positions of candidate parts causing abnormal noises). However, as mentioned above, sound data collected by the diagnostic terminal 2 may be transmitted to the server device 3, and analysis etc. may be performed on the server device side.

[0041] 6, the sound data of the abnormal noise collected in step S01 is transmitted to the server device 3 (step S10), and after the server device 3 receives this sound data (step S11), the processes of steps S02 to S03 are performed by the server device 3. After that, the analysis results and the extraction results of candidate abnormal noise generating parts are transmitted from the server device 3 to the diagnostic terminal 2 (step S12). After receiving the analysis results and the extraction results (step S13), the diagnostic terminal 2 may perform the processes subsequent to displaying the analysis results (steps S04 and S05). Here, the processes (S10, S11) of transmitting sound data from the diagnostic terminal 2 to the server device 3 and receiving the sound data at the server device 3 utilize a communication line, but data may also be transferred via storage media such as a USB or CD. Furthermore, the processes (S12, S13) of transmitting analysis results and extraction results from the server device 3 to the diagnostic terminal 2 and receiving the analysis results and extraction results at the diagnostic terminal 2 may also transfer data via storage media such as a USB or CD.

[0042] 7, after the processes of steps S02 and S03 are performed by the server device 3, the server device 3 may also form an image (an image visually displaying the component positions) that allows the positions of each of the candidate noise generating components to be visually recognized (step S14). This image data is then transmitted from the server device 3 to the diagnostic terminal 2 (step S15). After receiving the image data (step S16), the diagnostic terminal 2 may display an image visually displaying the positions of each of the candidate noise generating components on the display unit 24 (step S05). Here too, the processes (S10, S11) of transmitting sound data from the diagnostic terminal 2 to the server device 3 and receiving the sound data at the server device 3 utilize a communication line, but data may also be transferred via storage media such as a USB or CD. Also, the processes (S15, S16) of transmitting an image displaying component positions from the server device 3 to the diagnostic terminal 2 and receiving the image displaying component positions at the diagnostic terminal 2 may also transfer data via storage media such as a USB or CD.

[0043] The process of acquiring the sound data of the abnormal noise and transmitting it to the server device 3 in step S01 may be performed by the diagnostic terminal 2 or by a device other than the diagnostic terminal. Furthermore, in the above example, the candidate abnormal noise generating parts (candidate abnormal noise generating parts) extracted as analysis results are displayed, and then the positions of the candidate abnormal noise generating parts extracted are displayed by the operator's operation (pressing the "display part positions" button). Alternatively, the display of the analysis results may be omitted, and a display screen that allows the position of each candidate abnormal noise generating part to be visually recognized may be sent directly to the diagnostic terminal 2, and the diagnostic terminal 2 may receive this and display the screens in Figure 8 and subsequent figures on the display unit 24.

[0044] 8 shows an example of a display on the display unit 24 that allows the user to visually recognize the positions of each of the extracted candidates for abnormal noise generating parts. This display unit 24 displays visual structural information 61 of the image forming apparatus 4 (the apparatus to be diagnosed) that is stored in the storage unit 23. In this example, a left side view of the image forming apparatus 4 is displayed as the visual structural information 61. In addition, the display unit 24 displays a list 62 of candidate abnormal noise generating parts (candidates for parts that may be the cause of abnormal noise) extracted by the analysis next to the visual structural information 61. In addition, the list 62 of candidate parts that may cause abnormal noise (candidate parts that may cause abnormal noise) is displayed in this example as a list in which the extracted candidate parts are numbered consecutively starting from 1 and the part names are arranged vertically.

[0045] Furthermore, marks 70 to 73 indicating the positions of parts that may be the cause of abnormal noise are superimposed on the visual structure information 61 at corresponding locations based on mounting position information that specifies the mounting positions in the diagnosed device of parts that may be the cause of abnormal noise and that is stored in the storage unit 23. In this example, black circles are superimposed as marks that indicate candidates for parts that may be causing abnormal noise.

[0046] The numbers in parentheses ((1), (2), (3), (4)) in Fig. 8 are the numbers of each listed part, displayed in accordance with the position of the candidate abnormal noise generating part in the visual structure information 61. In this example, numbers are assigned to the markers of the candidate abnormal noise generating parts that are superimposed on the visual structure information 61 in the order in which they are displayed from top to bottom. In Fig. 8, there are four candidate abnormal noise generating parts, and in the list 62 of candidate abnormal noise generating parts, the names of the four parts are displayed in the order of the parenthesized numbers in the visual structure information from top to bottom.

[0047] Therefore, on the display unit 24, markers of candidate abnormal noise generating parts are superimposed on the visual structure information 61, and numbers are assigned to the markers in the order displayed from the top, and the list 62 also lists candidate abnormal noise generating parts in the same order as the numbers in the visual structure information 61. As a result, the correspondence between the positions of abnormal noise generating parts in the visual structure information and the positions of abnormal noise generating parts on the list is easy to understand, eliminating the risk of misinterpreting the correspondence.

[0048] The above is an example in which the diagnostic terminal 2 forms an image in which a mark is displayed at a location corresponding to the visual structural information based on the position information of the candidate abnormal noise generating part, and displays this image on the display unit 24. Alternatively, a similar image may be formed on the server device 3 side, transmitted to the diagnostic terminal 2, and displayed on the display unit 24 of the diagnostic terminal 2. Here, the image formed on the server device 3 may be image data in which a mark is superimposed on the visual structural information, and this image data may be transmitted to the diagnostic terminal 2 and displayed on the display unit 24 of the diagnostic terminal 2.

[0049] FIG. 9 shows an example of a display in which the size of the mark indicating the candidate part causing the abnormal noise is changed based on the size information of the parts installed in the device to be diagnosed, which is stored in the memory unit 23. As shown in 70, 71, 72, and 73, the size of the mark of the candidate part causing the abnormal noise, displayed in the visual structure information, is changed depending on the size of the candidate part causing the abnormal noise. In addition to the installation location of the candidate part causing the abnormal noise, the size of the candidate part causing the abnormal noise can also be known on the display screen, making it easier to identify the relevant part when replacing it. For example, in the display example, parts 71 and 72 are installed in close proximity to each other, but are different sizes, which reduces the possibility of mixing up the parts when replacing them.

[0050] Figure 10 shows an example of the display when the appearance is changed from the left side of Figure 9 to the front side. Marks 70, 71, 72, and 73 in Figure 9 correspond to marks 80, 81, 82, and 83 in Figure 10, respectively. By changing the display side, it is possible to more accurately grasp the mounting position on the target device, making it easier to consider replacement parts and reducing the possibility of mix-ups when replacing parts. For example, in the side view of Fig. 9, the mounting positions of 71 and 72 appear close, but by switching to the front view of Fig. 10, it can be confirmed that the mounting positions of 81 and 82 are far apart. This allows the service person to arbitrarily exclude 82 as a candidate part for the part causing the abnormal noise, if they determine that the source of the abnormal noise is coming from the left side when viewed from the front of the diagnosed part, which is expected to make it easier to identify the part to be replaced.

[0051] Figure 11 shows an example of the display when the view is changed from the left side view in Figure 9 to the top view. In Figure 11, the bottom side is the front side, and 70, 71, 72, and 73 in Figure 9 correspond to 93, 90, 91, and 92 in Figure 11, respectively. The display order of the external mounting positions of the diagnosed device has changed due to the change in the display surface. (1), (2), (3), and (4) in Figure 9 do not match (1), (2), (3), and (4) in Figure 11. In this case, the order of the corresponding parts list is rearranged so that it is displayed in the order from top to bottom of the visual structure information. In this display example, the parts list in Figure 9 is listed in the order of parts A, B, C, and D, but in Figure 11 it is rearranged to the order of parts B, C, D, and A. Rearranging the parts list in the order of their mounting positions on the screen (the order displayed from top to bottom of the display screen) makes it easy to link the part mounting positions with the part names.

[0052] 12A, 12B, and 12C show examples of displays for linking part positions with part names.

[0053] Fig. 12A shows the state explained in Fig. 8. When the column for part A in the parts list is selected on the touch panel in this state, the display in the column for this part name switches to indicate that it has been selected, as shown in Fig. 12B, and the display of the marker for the corresponding mounting position (part (1)) in the visual structural information also switches. Next, when the column for part D in the parts list is selected, the display in the column for that part name switches, as shown in Fig. 12C, and at the same time, the display of the marker for the corresponding mounting position (part (4)) in the visual structural information also switches. After that, when the column for part D is touched in the display state of Fig. 12C, the display in the column for part D in the parts list and the marker for the mounting position (4) return to their original state, and the state shown in Fig. 12B is displayed.

[0054] Here, the display of the selected candidate noise generating part may be switched by changing the color as shown in Figures 12B and 12C, or by flashing the column for the name of the selected part or the mark for the mounting position. Also, an arrow pointing to the mark for the mounting position may be displayed, as long as the selected candidate noise generating part can be visually identified.

[0055] In the above, it has been explained that touching a part name in the list 62 also changes the part position mark in the visual structure information 61. Conversely, it is also possible to configure it so that touching a part position mark in the visual structure information 61 changes the display in the column of the corresponding candidate abnormal noise generating part in the list 62 in response to the touch.

[0056] By linking and displaying the part names and part positions in this way, it becomes possible to immediately check the positions of possible parts that may be generating abnormal noise, further reducing the risk of misidentification.

[0057] Display examples for linking part position marks 80-83 on the visual structure information 61 with part names are not limited to touching part names in a list or part positions on the exterior to link them individually. As shown in Fig. 13, each linked part name and part position mark may be distinguished in advance by displaying the same color or pattern. In other words, the correspondence between all part names and marks may be grasped simultaneously by distinguishing the color or pattern display, etc.

[0058] FIG. 14 shows an example of display in which information on the driving source is added as information on the candidate parts. In the list of candidate parts that may be the cause of abnormal noise, the candidate parts and the drive sources that operate them are displayed. In this example, it is indicated that part A is a part that operates when drive source A is operated. Similarly, it is indicated that parts B, C, and D are operated by drive sources A, B, and B. By indicating the drive sources in this way, even if there are multiple candidate parts that may be causing abnormal noise, it is possible to operate only drive source A, and if abnormal noise occurs, parts C and D can be excluded from the candidate parts that may be causing the abnormal noise. This reduces the burden on the user when investigating the parts that are causing the abnormal noise.

[0059] 15A to 15C show examples of switching between displays showing the correspondence between candidate parts that may be causing abnormal noise and drive sources. In particular, these examples are display examples when there are many candidate parts that may be causing abnormal noise.

[0060] 15A is a display that is substantially the same as that of Fig. 14, and shows a case where there are many extracted candidate parts (five in this example). In an image forming apparatus, it is expected that there will be many parts that operate at the same cycle as the part that is making the abnormal noise, so it is efficient to narrow down the presence or absence of the abnormal noise on a drive source basis.

[0061] Therefore, in the display state of FIG. 15A, for example, the screen is swiped to transition to the screen of FIG. 15B.

[0062] The screen shown in Fig. 15B displays the number of parts that can be linked to each drive source among the displayed part candidates. The screen display in Fig. 15A shows that parts A, B, and D are driven by drive source A. The screen in Fig. 15B shows that moving drive source A will cause the three parts to operate.

[0063] When narrowing down the candidates for the part that is causing the abnormal noise, the maintenance technician starts by moving the drive source that moves the most parts at the same time. This increases the probability of the abnormal noise occurring, and if the abnormal noise occurs when drive source A is moved, there is no need to check the operation of the remaining drive sources B and C.

[0064] In addition, instead of the display in Figure 15B, the same effect can be achieved by listing the names of the parts moved by each drive source, rather than the number of parts moved by each drive source, as shown in Figure 15C.

[0065] The above has shown an example in which the display unit 24 displays a list 62 of candidate abnormal noise generating components and a mark indicating the position of the candidate abnormal noise generating components superimposed on the visual structural information 61. As a variation thereof, when identifying the abnormal noise generating components, it is possible to determine an area in the device to be diagnosed where an abnormal noise may be occurring, and to superimpose this area using a mark such as an oval on the corresponding location in the visual structural information of the device to be diagnosed (image forming device 4).

[0066] In the example shown in Fig. 16, candidate parts that may be the cause of the abnormal noise are extracted based on the results of analyzing the sound data of the abnormal noise, and then the area where the abnormal noise may be occurring is displayed based on information such as the mounting position of the parts. In this example, the parts are divided into area A on the left side of visual structure information 61 showing the left side of the image forming apparatus (components (2) and (3)) and area B on the right side (components (1) and (4)). If the abnormal noise is on the right side as viewed from the left side of the image forming apparatus 4, it is possible to narrow down the candidate parts that are in area B where the abnormal noise is occurring. In particular, when there are many candidate parts that are the cause of the abnormal noise, it is efficient to roughly divide the candidate parts into areas and narrow them down. The area may be determined based on the mounting position of the component or based on the processing step of the image forming apparatus. The display forms shown in FIGS. 10 to 13 described above are also possible for displaying such divided areas.

[0067] (Second embodiment) In the above embodiment, the portable terminal is used to collect sound, but the present invention is not limited to this. For example, the image forming device 4 may have a sound collection microphone. In this case, the image forming device itself functions as the information processing device of the present invention. Furthermore, the results of sound collection by the image forming device 4 may be transmitted to the server device 3, or the image forming device 4 itself may diagnose abnormal sounds.

[0068] 17 is a control block diagram showing an example of an image forming apparatus 4 as an example of a case where the diagnosed apparatus, which is the source of the abnormal noise, performs the analysis and displays the analysis results and the location of candidate parts for the abnormal noise. As shown in FIG. 17, the image forming apparatus 4 has an engine control unit 200 and a printer controller 300. The engine control unit 200 controls the toner control unit 210 and the paper feed control unit 220.

[0069] The toner control unit 210 is equipped with a toner-related motor 211, and controls the drive sources for supplying toner from the toner bottle to the sub-hopper and for supplying toner from the sub-hopper to the developing machine. Also connected to the engine control unit 200 are a toner-related sensor 212 and other sensors that indicate when the toner in the sub-hopper has decreased.

[0070] The paper feed control unit 220 is equipped with a transport motor 221, and performs transport motor control such as starting and stopping the transport motor and monitoring it while it is rotating. The sound collection unit 230 uses a sound collection microphone 231 to collect sound during operation. The sound collection microphone 231 may be built into the image forming device 4 or may be external. The sound collection microphone may also be installed in multiple locations on the image forming device 4.

[0071] Printer controller 300 controls RAM 310, HDD 320, scanner 330, FAX IF 340, and operation panel 350. Printer controller 300 is capable of serial communication with engine control unit 200, and provides image data to engine control unit 200 via an image bus, while exchanging data with PCs 360 to 370 via a LAN.

[0072] The RAM 310 and HDD 320 are storage media, with the RAM 310 being superior in terms of transfer speed, and the HDD 320 being inferior to the RAM 310 in terms of transfer speed but tending to have an advantage in terms of storage capacity. The scanner 330 reads an original and generates image data. The FAX IF 340 performs facsimile transmission and reception of image data. The operation panel 350 includes a touch panel and push button keys as hardware, and functions as a display unit that displays various information to the user and also accepts input operations from the user. The print mode is set by input from the operation panel 350.

[0073] When the user sets a print mode from the operation panel 350, the printer controller 300 sends a print preparation command to the engine control unit 200. The engine control unit 200 executes a print preparation operation, and if it is necessary to change the speed of the polygon motor, it changes the speed of the polygon motor. The engine control unit 200 also executes a print preparation operation, and if it is necessary to change the speed of the conveyance motor 221, it changes the speed of the conveyance motor 221. Furthermore, if it is determined that the paper being conveyed is an envelope, it controls the fixing unit to move in the separation direction (if the paper is already in the separation state, this control is not executed).

[0074] In the sound collection unit 230, sound is collected by a sound collection microphone 231 when a device such as a motor is operating. If the occurrence of an abnormal sound is detected, the sound data of the abnormal sound is analyzed, potential causes of the abnormal sound are extracted, the analysis results and extraction results are displayed, and the visual position of potential parts causing the abnormal sound is displayed, in the same manner as in the configuration of Fig. 1. Various displays such as the analysis results are displayed on the operation panel 350. In such a configuration, the image forming device 4 itself analyzes the abnormal noise, extracts and displays the analysis results, candidate parts for the abnormal noise, and displays the visual position information of the candidate parts for the abnormal noise, eliminating the need for the worker to carry the diagnosis terminal 2. Furthermore, there is no need for the worker to collect sounds, which improves work efficiency.

[0075] As described above, the information processing program of this embodiment causes a computer (diagnostic terminal 2, image forming device 4 as the gymnastics device to be diagnosed) to execute a display process that displays on a display unit an image in which visual structural information 61 that enables visual understanding of the structure of the device to be diagnosed and markers (70 to 73, etc.) that enable recognition of corresponding locations in the visual structural information of parts or areas of the device to be diagnosed that may have an abnormality, obtained by analyzing sound data generated from the device to be diagnosed (image forming device 4), are superimposed. In other words, this information processing program can also be considered to cause a computer (diagnostic terminal 2, image forming device 4 as the gymnastics device to be diagnosed) to execute a display process that displays on the display unit (24, operation panel 350) parts or areas in which there may be an abnormality in the device to be diagnosed, which are obtained by analyzing the sound data generated from the device to be diagnosed, as an image in which markers (70 to 73, etc.) are superimposed on corresponding locations in visual structural information 61 that allows the structure of the device to be diagnosed (image forming device 4) to be visually grasped. Furthermore, it can also be considered that the computer (diagnostic terminal 2, image forming device 4 as the gymnastics device to be diagnosed) is caused to execute a display process in which markers (70 to 73, etc.) that enable recognition of parts or areas in the device to be diagnosed (image forming device 4) where an abnormality may be occurring, obtained by analyzing sound data generated from the device to be diagnosed, are superimposed on the corresponding parts or areas of visual structural information 61 that enables visual understanding of the structure of the device to be diagnosed, and the image is displayed on the display unit (24, operation panel 350).

[0076] Therefore, by looking at the marks superimposed on the visual structural information 61 displayed on the display unit, the worker can visually grasp the location of the part or area where an abnormality may be occurring in the diagnosed device. As a result, even if the worker is not familiar with the installation location of each part in the diagnosed device, the worker can easily narrow down the location of the cause of the abnormality by referring to the position of the marks superimposed on the visual structural information. This reduces the time spent checking the location of parts using manuals, etc., and shortens maintenance downtime.

[0077] Here, the computer does not necessarily have to collect and analyze the sound data generated from the device to be diagnosed by itself, and the sound data may be collected and analyzed by another device.

[0078] When the computer itself collects sound data generated from the device to be diagnosed, the information processing program may further cause the computer to execute a process of causing the sound collection unit 21 to collect the sound data generated from the device to be diagnosed. By having a computer collect sound data, the collected sound data can be analyzed by the computer for subsequent processing. Also, the collected sound data can be sent to another device such as a server device, and the results of the analysis of the sound data by the other device can be received by the computer for subsequent processing.

[0079] The computer may also have a function of acquiring information on parts or areas in the diagnosed device where an abnormality may be occurring, obtained by analyzing the sound data. In other words, the information processing program may cause the computer to execute an acquisition process that acquires information about parts or areas of the diagnosed device where an abnormality may be occurring, obtained by analyzing sound data generated from the diagnosed device, and an image formation process that forms an image with a marker superimposed on it, based on the information acquired in the acquisition process.

[0080] Here, the acquisition process may be a process of collecting sound data generated from the device to be diagnosed in a sound collection unit, analyzing the collected sound data, and extracting parts or areas where an abnormality may be occurring. By performing the processes from collecting to analyzing the sound data by a computer, it becomes possible for the computer to function as a standalone diagnostic device.

[0081] The acquisition process may also be a process of receiving information on parts or areas of the diagnosed device that may have an abnormality, obtained by analyzing sound data generated from the diagnosed device by another device. By analyzing the sound data on the server side and having the computer receive the results and perform subsequent processing, it is possible to reduce the load on the computer.

[0082] There are various modes for displaying the image generated by the display processing on the display unit. In the case where there are multiple components or areas where an abnormality may have occurred, the display processing may display an image on the display unit in which a marker is superimposed on a corresponding portion of the visual structural information of each component or area where an abnormality may have occurred.

[0083] Furthermore, the display process can display a list of parts or areas where an abnormality may have occurred on the display unit. By displaying a list of parts or areas where an abnormality may have occurred, the worker can visually grasp the location of the part or area where an abnormality may have occurred from the image with a marker superimposed thereon, and can also grasp the details of the abnormality.

[0084] The display process can display components or areas in which an abnormality may have occurred in the list 62 in a manner that matches the display order of the landmarks superimposed on the visual structure information 61. By displaying in this manner, the display order of components or areas in which an abnormality may have occurred in the visual structure information, i.e., the display order of the landmarks, matches the display order of components or areas in which an abnormality may have occurred in the list. This makes it easier to understand the correspondence between the landmarks and the components or areas, and eliminates the risk of misunderstanding the correspondence.

[0085] The display process can change the size of the part marks superimposed on the visual structure information based on the size information of the parts mounted on the device to be diagnosed. In addition to the position in the visual structure information 61 of the part where an abnormality may occur, the size of the part where an abnormality may occur can also be grasped by looking at the size of the mark, making it easier to identify the part when replacing it.

[0086] Furthermore, the visual structural information displayed on the display unit can be changed, and when the visual structural information displayed on the display unit is changed, the display process can change the display of the list to match the display order of the landmarks superimposed on the changed visual structural information. By changing the order of the list display to match the display order of the landmarks in the changed visual structural information, it is possible to more accurately grasp the installation positions on the diagnosed device, making it easier to consider replacement parts and reducing the possibility of mix-ups when replacing parts.

[0087] The display process may display a means for selecting a part or area displayed on the list where an abnormality may have occurred, and when a part or area where an abnormality may have occurred is selected, a marker superimposed on the corresponding location in the visual structural information of the selected part or area may be displayed in a manner that allows it to be clearly identified. By linking and displaying parts or areas with their positions in the visual structure information in this way, it becomes possible to immediately identify the parts or areas where an abnormality may be occurring, further reducing the risk of misidentification.

[0088] The display process can display information about the drive sources that drive each component in a list 62 of components that may be experiencing an abnormality, based on information about the drive sources of the components used in the device being diagnosed. By indicating the drive source in this way, even if there are multiple parts that may be experiencing an abnormality, it is possible to narrow down the parts that may be experiencing an abnormality by operating a specific drive source, thereby reducing the burden of investigation on workers.

[0089] The display process can change the display of the list 62 to a list that displays information about parts that may have an abnormality, sorted by drive source. Here, the information about parts that may have an abnormality may be the number of parts operated by each drive source or the names of the parts operated by each drive source. When narrowing down the parts that may be malfunctioning, starting with the drive source that moves the most parts simultaneously increases the probability of abnormal noise occurring, making it possible to efficiently find the part that is malfunctioning.

[0090] Furthermore, the information processing device (diagnostic terminal 2, image forming device 4 as the gymnastics device to be diagnosed) of this embodiment has a display unit 24 that displays information, and a display control unit 26 that displays on the display unit (24, operation panel 350) an image in which visual structural information 61 that enables visual understanding of the structure of the device to be diagnosed (image forming device 4) is superimposed with markers (70 to 73, etc.) that enable recognition of parts or areas corresponding to possible abnormalities in the device to be diagnosed, which are obtained by analyzing sound data generated from the device to be diagnosed.

[0091] Therefore, by looking at the marks (70-73, etc.) superimposed on the visual structural information 61 displayed on the display unit 24, the worker can visually grasp the location of the component or area where an abnormality may be occurring in the device to be diagnosed. As a result, even if the worker is not familiar with the mounting position of each component of the device to be diagnosed, the worker can easily narrow down the location of the cause of the abnormality by referring to the position of the marks superimposed on the visual structural information. This reduces the time spent checking the location of components using a manual, etc., and shortens downtime due to maintenance.

[0092] Here, the information processing device may have a sound collection unit 21, 230 that collects sound data. By collecting sound data using the sound collection unit 21, 230 of the information processing device, the collected sound data can be analyzed by the information processing device for subsequent processing. Also, the collected sound data can be transmitted to another device such as a server device, and the results of the analysis of the sound data by the other device can be received by the information processing device for subsequent processing.

[0093] The information processing device may further include an acquisition means for acquiring information on parts or areas of the device to be diagnosed in which an abnormality may be occurring, obtained by analyzing sound data generated from the device to be diagnosed, and an image forming means for forming an image based on the information acquired in the acquisition process.

[0094] Here, the acquisition means may be configured to include a sound collection unit 21 that collects sound data generated from the device to be diagnosed, and a diagnosis unit 22 that analyzes the sound data acquired by the sound collection unit and extracts parts or areas where an abnormality may be occurring. By having the information processing device perform everything from collection to analysis of the sound data, it becomes possible for the information processing device to function as a standalone diagnosis device.

[0095] The acquisition means may also be configured to include a receiving means for receiving information on parts or areas where an abnormality may be occurring, obtained by analyzing sound data generated from the device to be diagnosed by another device. The receiving means may receive information sent from a communication line via the communication unit 25 or via a storage medium. By analyzing the sound data on the server side and having the information processing device receive the results and perform subsequent processing, it is possible to reduce the load on the information processing device (diagnosis terminal).

[0096] The information processing device further includes a device information storage unit (storage unit 23) that stores mounting position information that specifies the mounting positions of components of the device to be diagnosed, and visual structure information that allows the structure of the device to be diagnosed to be visually grasped. The display control unit 26 may also cause the display unit 24 to display the visual structure information 61 stored in the device information storage unit (storage unit 23), and may also cause the display unit 24 to superimpose markers (70 to 73, etc.) on locations corresponding to components or areas in the visual structure information 61 displayed on the display unit 24 where an abnormality may have occurred, based on the mounting position information.

[0097] There are various modes for displaying the image on the display unit 24 by the display control unit 26. When there are multiple parts or areas where an abnormality may have occurred, the display control unit 26 may cause the display unit 24 to display an image in which a marker is superimposed on a corresponding portion of the visual structural information of each part or area where an abnormality may have occurred.

[0098] Furthermore, the display control unit 26 can display a list of parts or areas where an abnormality may have occurred on the display unit 24. By displaying a list of parts or areas where an abnormality may have occurred, the worker can grasp the details of the abnormality in addition to visual position information that can be grasped from an image in which the parts or areas where an abnormality may have occurred are superimposed with markers.

[0099] Here, the display control unit 26 may display in the list 62 parts that may have an abnormality in a manner that matches the display order of the markers superimposed on the visual structure information. By displaying in this way, the display order of parts or areas in the visual structure information where an abnormality may have occurred, i.e., the display order of the markers, matches the positions of parts or areas in the list where an abnormality may have occurred, i.e., the display order on the list, making the correspondence easier to understand and eliminating the risk of misunderstanding the correspondence.

[0100] In addition, the device information storage unit (memory unit 23) may further store size information of components mounted on the device to be diagnosed, and the display control unit 26 may change the size of the mark for a component that may have an abnormality based on the size information. In addition to the position in the visual structural information 61 of the part where an abnormality may occur, the size of the part where an abnormality may occur can also be grasped by looking at the size of the mark, making it easier to identify the part in question when replacing the part.

[0101] The display control unit 26 may be configured to change the visual structural information 61 displayed on the display unit 24, and when the visual structural information 61 to be displayed on the display unit is changed, the display of the list 62 may be changed to match the display order of the landmarks superimposed on the changed visual structural information 61. By changing the order of the list display to match the order in which the markers in the changed visual structure information are displayed, the mounting positions on the target device can be grasped more accurately, making it easier to consider replacement parts and reducing the possibility of mix-ups when replacing parts.

[0102] The display control unit 26 may display a selection means for selecting from the list 62 a candidate part that may have an abnormality, and may display a marker superimposed on the visual structure information of the part selected by the selection means in a manner that allows it to be clearly identified. By linking and displaying parts or areas with their positions in the visual structure information 61 in this way, it becomes possible to immediately check the location of parts or areas where an abnormality may be occurring, further reducing the risk of misidentification.

[0103] The device information storage unit (memory unit 23) may further store information regarding the drive sources of the parts used in the device to be diagnosed, and the display control unit 26 may display, in the list 62, the drive sources that drive the parts that may be experiencing an abnormality, based on the information regarding the drive sources. By displaying the drive source in this way, even if there are multiple parts that may be experiencing an abnormality, it is possible to narrow down the parts that may be experiencing an abnormality by operating a specific drive source, thereby reducing the burden of investigation on workers.

[0104] The display control unit may change the display of the list 62 to a list that displays information about parts that may have an abnormality, sorted by drive source. Here, the information regarding the parts that may have an abnormality may be the number of parts operated by each drive source or a list of the names of the parts operated by each drive source. When narrowing down the parts that may be malfunctioning, starting with the drive source that moves the most parts simultaneously increases the probability of abnormal noise occurring, making it possible to efficiently find the part that is malfunctioning.

[0105] <Supplementary information> Although the embodiments and modifications of the information processing program and information processing device according to the present invention have been described, the present invention is not limited to the above-described embodiments and modifications. The present invention also includes forms obtained by applying various modifications to the above-described embodiments and modifications that would occur to those skilled in the art, and forms realized by arbitrarily combining the components and functions of the embodiments and modifications within the scope of the present invention. The scope of the present invention should be interpreted by the appended claims. [Industrial Applicability]

[0106] The present invention is useful as a technology for visually grasping the location and range of a component in which an abnormality may occur, obtained by analyzing sound data generated from a device to be diagnosed. [Explanation of symbols]

[0107] 1. Information Processing Systems 4. Image forming device 21 Sound collection section 21a Sound collection microphone 22 Diagnostic Department 24 Display 61 Visual structural information 62 List 70~73 Landmark 80~83 Landmark 90~93 Marker

Claims

1. On the computer, visual structural information that allows the structure of the device to be diagnosed to be visually grasped; a mark that enables recognition of a corresponding location in the visual structural information of a part or area in the device to be diagnosed, which is obtained by analyzing sound data generated from the device to be diagnosed, where an abnormality may be occurring; and an information processing program that causes a display process to be performed in which an image in which the above-mentioned items are superimposed is displayed on a display unit.

2. On the computer, The information processing program according to claim 1 , further comprising a collection process for causing a sound collection unit to collect sound data generated from the device to be diagnosed.

3. On the computer, an acquisition process for acquiring information on a part or area in which an abnormality may be occurring in the device to be diagnosed, the information being obtained by analyzing sound data generated from the device to be diagnosed; an image forming process for forming the image based on the information acquired in the acquisition process; 2. The information processing program according to claim 1, further comprising:

4. The acquisition process includes:

4. The information processing program according to claim 3, wherein sound data generated from the device to be diagnosed is collected by a sound collection unit, and the collected sound data is analyzed to extract a component or area in which an abnormality may be occurring.

5. The acquisition process includes:

4. The information processing program according to claim 3, further comprising receiving information on a part or area in the device to be diagnosed that may be experiencing an abnormality, the information being obtained by analyzing sound data generated from the device to be diagnosed by another device.

6. The display process includes:

2. The information processing program according to claim 1, wherein, when there are multiple parts or areas where the abnormality may have occurred, an image is displayed on the display unit in which a marker is superimposed on a corresponding portion of the visual structural information of each part or area where the abnormality may have occurred.

7. The display process includes:

10. The information processing program according to claim 1, further comprising displaying a list of parts or areas in which the abnormality may occur on the display unit.

8. The display process includes: The information processing program according to claim 7, wherein the list displays components or areas in which the abnormality may have occurred in a manner that matches the display order of the markers superimposed on the visual structural information.

9. The display process includes:

10. The information processing program according to claim 1, wherein the size of the mark of the component to be superimposed on the visual structural information is changed based on size information of the component mounted on the device to be diagnosed.

10. The visual structural information displayed on the display unit is changeable; The display process includes:

9. The information processing program according to claim 8, wherein when the visual structure information to be displayed on the display unit is changed, the display of the list is changed to match the display order of the markers superimposed on the changed visual structure information.

11. The display process includes: displaying a means for selecting a part or area displayed on the list in which an abnormality may have occurred; 7. An information processing program as claimed in claim 6, wherein when a part or area in which an abnormality may have occurred is selected, a marker is displayed superimposed on a corresponding portion of the visual structural information of the selected part or area in a manner that makes it clearly identifiable.

12. The display process includes:

8. The information processing program according to claim 7, wherein information about the drive sources that drive each of the components is displayed in a list of components in which the abnormality may occur, based on information about the drive sources of the components used in the device to be diagnosed.

13. The display process includes:

13. The information processing program according to claim 12, wherein the display of the list is changed to a list in which information about the part in which an abnormality may occur is displayed by dividing the information by the driving source.

14. a display unit that displays information; a display control unit that displays on the display unit an image in which visual structure information that allows the structure of the device to be diagnosed to be visually grasped is superimposed with a mark that allows the corresponding location of a part or area in the device to be diagnosed that may have an abnormality, which is obtained by analyzing sound data generated from the device to be diagnosed, to be recognized; and An information processing device having the above.

15. The information processing apparatus according to claim 14, further comprising a sound collection unit that collects the sound data.

16. an acquisition means for acquiring information on a part or area in which an abnormality may be occurring in the device to be diagnosed, the information being obtained by analyzing sound data generated from the device to be diagnosed; an image forming means for forming the image based on the information acquired in the acquisition process; The information processing device according to claim 14, further comprising:

17. The acquisition means a sound collection unit that collects sound data generated from the device to be diagnosed; a diagnosis unit that analyzes the sound data acquired by the sound collection unit and extracts a part or area where an abnormality may occur; The information processing device according to claim 14, comprising:

18. The acquisition means 15. The information processing apparatus according to claim 14, further comprising: a receiving unit that receives information on a part or area in which an abnormality may occur, obtained by analyzing sound data generated from the apparatus to be diagnosed in another apparatus.

19. a device information storage unit that stores mounting position information that identifies mounting positions of components of the device to be diagnosed and visual structure information that allows the structure of the device to be diagnosed to be visually grasped, the display control unit causes the visual structural information stored in the device information storage unit to be displayed on the display unit, and also causes a mark to be superimposed on a location corresponding to a component or area in the visual structural information displayed on the display unit where an abnormality may have occurred, based on the mounting position information.

15. The information processing device according to claim 14.

20. The display control unit 15. The information processing device according to claim 14, wherein, when there are multiple parts or areas where the abnormality may have occurred, an image is displayed on the display unit in which a marker is superimposed on a corresponding portion of the visual structural information of each part or area where the abnormality may have occurred.

21. The display control unit The information processing apparatus according to claim 14 , wherein the display unit displays a list of parts or areas in which the abnormality may occur.

22. The display control unit 20. The information processing apparatus according to claim 19, wherein the list displays the parts in which the abnormality may have occurred in a manner that matches the display order of the marks superimposed on the visual structure information.

23. the device information storage unit further stores size information of components mounted on the device to be diagnosed; The information processing apparatus according to claim 14 or 20, wherein the display control unit changes a size of the mark of the component in which an abnormality may occur based on the size information.

24. 23. The information processing device according to claim 22, wherein the display control unit is capable of changing the visual structure information displayed on the display unit, and when the visual structure information to be displayed on the display unit is changed, changes the display of the list to match the display order of the markers superimposed on the changed visual structure information.

25. The display control unit displaying a selection means for selecting from the list of possible parts that may have an abnormality; 21. The information processing apparatus according to claim 20, wherein the mark to be superimposed on the visual structural information of the part selected by the selection means is displayed in a manner that allows it to be clearly identified.

26. the device information storage unit further stores information about a drive source of a part used in the device to be diagnosed, The information processing apparatus according to claim 21 , wherein the display control unit displays, in the list, the drive sources that drive each component that may have an abnormality, based on information about the drive sources.

27. 27. The information processing apparatus according to claim 26, wherein the display control unit changes the display of the list to a list in which information relating to the part in which an abnormality may occur is displayed by dividing the information into groups for each of the drive sources.

Images