Information processing system, operation procedure guidance method, and program

Abstract

To provide an information processing system, an operation procedure guidance method, and a program that can easily output an operation procedure or the like corresponding to the state of an electronic apparatus on a user's mobile terminal even when the user's mobile terminal is not set to be able to connect to the electronic apparatus by wireless communication.SOLUTION: An information processing system includes an electronic apparatus and a mobile terminal used by a user. The electronic apparatus includes: a state acquisition unit that acquires a state of the electronic apparatus; and a sound wave output unit that outputs a sound wave representing different identification information according to a predetermined state when the state of the electronic apparatus is the predetermined state. The mobile terminal includes: a sound wave analysis unit that analyzes a sound wave around the mobile terminal to acquire the identification information; and an operation procedure output unit that outputs information indicating an operation procedure of the electronic apparatus corresponding to the identification information.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing system, an operation procedure guidance method, and a program. [Background technology]

[0002] 2. Description of the Related Art In electronic devices such as image forming devices, when an error or a condition that requires user action, such as replacement of a consumable item, is detected, operating procedures showing how the user should deal with the problem are displayed on a display unit or the like of the electronic device.

[0003] Furthermore, there is known an information display system that, when a problem occurs with an electronic device, displays a required page of the manual for the electronic device on a mobile terminal connected to the electronic device via wireless communication (see, for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 describes an effect such that, when a trouble occurs with an electronic device, when a service technician responds to the trouble on-site, information related to the trouble that has occurred in the service manual can be automatically displayed on the service technician's mobile terminal.

[0005] This method assumes that the mobile terminal is set up so that it can connect to the electronic device via wireless communication; however, in the case of an electronic device shared by multiple users, such as an image forming device, for example, the user's mobile terminal may not be set up so that it can connect to the electronic device via wireless communication.

[0006] In this way, if the mobile terminal of a user who uses an electronic device is not set up to connect to the electronic device via wireless communication, conventional technology has made it difficult to output operating procedures, etc. corresponding to the status of the electronic device to the user's mobile terminal.

[0007] One embodiment of the present invention has been made in consideration of the above-mentioned problems, and makes it possible to easily output operating procedures, etc. corresponding to the status of an electronic device to a user's mobile terminal even if the user's mobile terminal is not set up to connect to an electronic device via wireless communication. [Means for solving the problem]

[0008] In order to solve the above problems, an information processing system according to one embodiment of the present invention is an information processing system including an electronic device and a mobile terminal used by a user, the electronic device having a status acquisition unit that acquires a status of the electronic device, and a sound wave output unit that outputs sound waves representing different identification information according to a predetermined status when the status of the electronic device is in a predetermined status, and the mobile terminal has a sound wave analysis unit that analyzes sound waves around the mobile terminal to acquire the identification information, and an operation procedure output unit that outputs information indicating an operation procedure of the electronic device corresponding to the identification information. The sound wave output unit is capable of outputting sound waves representing the identification information in a plurality of predetermined frequency bands, and outputs sound waves representing the identification information in a frequency band among the plurality of frequency bands having a lower sound pressure level than the other frequency bands. Effect of the Invention

[0009] According to one embodiment of the present invention, even if a user's mobile terminal is not set up to connect to an electronic device via wireless communication, operating procedures and the like corresponding to the status of the electronic device can be easily output to the user's mobile terminal. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating an example of a system configuration of an information processing system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating another example of the system configuration of the information processing system according to the first embodiment. [Diagram 3] 1 is a diagram illustrating an example of a hardware configuration of an electronic device according to a first embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a mobile terminal according to the first embodiment. [Diagram 5] 1 is a diagram illustrating an example of a functional configuration of an information processing system according to a first embodiment. [Figure 6] 2 is a diagram showing an example of information managed by the information processing system according to the first embodiment; FIG. [Figure 7] 5 is a flowchart showing an example of processing of the electronic device according to the first embodiment. [Figure 8] 6 is a flowchart showing an example of processing of the mobile terminal according to the first embodiment. [Figure 9] 4 is a diagram for explaining an example of information indicating an operation procedure according to the first embodiment; FIG. [Figure 10] 13 is a flowchart showing an example of processing of a mobile terminal according to the second embodiment. [Figure 11] FIG. 13 is a diagram illustrating an example of a system configuration of an information processing system according to a third embodiment. [Figure 12] FIG. 13 is a diagram illustrating another example of the system configuration of the information processing system according to the third embodiment. [Figure 13] FIG. 11 is a diagram for explaining a frequency band of a sound wave according to the third embodiment. [Figure 14] FIG. 11 is a diagram illustrating an example of a functional configuration of an electronic device according to a third embodiment. [Figure 15] 13 is a flowchart showing an example of processing of an electronic device according to a third embodiment. [Figure 16] FIG. 13 is a diagram illustrating an example of a frequency analysis result according to the third embodiment. [Figure 17] 13 is a flowchart showing an example of processing of a mobile terminal according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0012] [First embodiment] <System configuration> Fig. 1 shows an example of a system configuration of an information processing system according to the first embodiment. In the example of Fig. 1, an information processing system 100 includes an electronic device 110 and a mobile terminal 120 used by a user 101.

[0013] The electronic device 110 is, for example, an image forming device such as a printer or an MFP (Multifunction Peripheral) having a scan function, a copy function, a print function, and a facsimile function mounted in one housing. However, the electronic device 110 is not limited thereto, and may be, for example, an output device such as a projector, an IWB (Interactive White Board: a white board having an electronic blackboard function capable of mutual communication), or a digital signage. The electronic device 110 may also be, for example, a HUD (Head Up Display) device, an industrial machine, an imaging device, a sound collecting device, a medical device, a network home appliance, an automobile (Connected Car), or the like. Furthermore, the electronic device 110 may be, for example, a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game machine, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, or a desktop PC. Here, the following description will be given assuming that the electronic device 110 is, for example, an image forming device such as an MFP.

[0014] The electronic device 110 of this embodiment outputs sound waves 102 representing identification information (hereinafter referred to as sound wave ID) corresponding to the state of the electronic device 110 when a specific state that requires operation by the user 101, such as an error or replacement of a consumable item, is detected.

[0015] The mobile terminal 120 is an information terminal such as a smartphone, a tablet terminal, a mobile phone, or a wearable terminal, which is equipped with a microphone (hereinafter, referred to as a microphone) for acquiring surrounding sound waves. The mobile terminal 120 executes an application program (hereinafter, referred to as an app) corresponding to the information processing system 100, thereby acquiring a sound wave ID represented by the sound waves 102 output by the electronic device 110, and outputs information indicating an operation procedure of the electronic device 110 corresponding to the sound wave ID.

[0016] Preferably, the mobile terminal 120 stores operation procedure information in which a plurality of sound wave IDs are associated with information indicating operation procedures of electronic devices corresponding to each sound wave ID in a storage unit or the like of the mobile terminal 120. Alternatively, the mobile terminal 120 may acquire information indicating operation procedures corresponding to a sound wave ID from a communicable external server (server device) 201 or the like via a communication network 202 such as the Internet or a LAN (Local Area Network) as shown in FIG.

[0017] Preferably, electronic device 110 outputs sound waves 102 representing the sound wave ID using a frequency band of 16 kHz or more, preferably a frequency band of 18 kHz or more, within the frequency range (e.g., 20 Hz to 22 kHz) that can be acquired by a microphone included in mobile terminal 120. Sound waves with frequencies of 16 kHz or more (particularly, frequencies of 18 kHz or more) are difficult for ordinary people to hear and have high linearity, and are therefore suitable for notifying mobile terminal 120 of the sound wave ID with sound waves 102.

[0018] In this embodiment, the method of expressing the sound wave ID with sound waves 102 is not particularly limited, but as an example, it is possible to express identification information of multiple bits by using a plurality of predetermined frequencies to express a digital value of "1" when sound waves are output at each frequency and a digital value of "0" when no sound waves are output. In this case, the mobile terminal 120 can acquire the sound wave ID from the sound waves 102 by performing frequency analysis on the sound waves 102 acquired by the microphone and determining whether the sound pressure levels of the sound waves of the plurality of predetermined frequencies are equal to or higher than a threshold value.

[0019] With the above configuration, the information processing system 100 can output information (e.g., a display screen or a voice message) indicating an operating procedure corresponding to a specified state of the electronic device 110 when a specified state occurs in the electronic device 110 used by the user 101.

[0020] As described above, according to this embodiment, even if the mobile terminal 120 of the user 101 is not set to be able to connect to the electronic device 110 via wireless communication, it becomes possible to easily output to the mobile terminal 120 of the user 101 operation procedures and the like corresponding to the state of the electronic device 110.

[0021] <Hardware configuration> (Hardware configuration of electronic devices) Here, as an example, the following description will be given assuming that electronic device 110 is an image forming device.

[0022] 3 is a diagram showing an example of a hardware configuration of the electronic device according to the first embodiment. The electronic device 110 includes, for example, a controller 310, an operation panel 320, an engine control unit 330, a communication I / F (Interface) 340, a sound input / output circuit 350, a speaker 351, a microphone 352, a sensor I / F 360, a plurality of sensors 361a, 361b, ..., and a bus 301. In the following description, "sensor 361" is used to indicate any one of the plurality of sensors 361a, 361b, ....

[0023] The controller 310 is an example of a computer included in the electronic device 110, and includes, for example, a central processing unit (CPU) 311, a random access memory (RAM) 312, a read only memory (ROM) 313, and a storage device 314. The CPU 311 is an arithmetic device that controls the entire electronic device 110 by executing a program stored in a storage medium such as the storage device 314 or the ROM 313. The RAM 312 is a volatile memory used as a work area or the like for the CPU 311. The ROM 313 is a non-volatile memory that stores a program for starting the CPU 311, setting data, or the like. The storage device 314 is a large-capacity storage device that stores, for example, an operating system (OS), programs such as apps, data, information, or the like, and is realized by, for example, a solid state drive (SSD) or a hard disk drive (HDD).

[0024] The operation panel 320 includes an operation section such as a touch panel or operation buttons for accepting operations by a user, and a display section such as a display for displaying a display screen. The engine control section 330 includes, for example, a printer engine for executing a print process, a scanner engine for executing a read process, and a control section for controlling each engine, and executes an image forming process according to an instruction from the controller. The engine control section 330 also notifies the controller 310 of log information including error information generated in the printer engine, scanner engine, control section, etc.

[0025] The communication I / F 340 is an interface for communicating with other devices. The communication I / F 340 may include, for example, a network I / F for connecting to the communication network 202, or an inter-device communication I / F for communicating with other devices connected to the electronic device 110. The sound input / output circuit 350 includes, for example, a circuit for converting sound wave data into a sound wave signal and outputting it to a speaker 351, and a circuit for amplifying a sound wave signal acquired by a microphone 352 and converting it into sound wave data. The sensor I / F 360 controls a plurality of sensors 361a, 361b, etc. to detect the state of each part of the electronic device 110. The bus 301 is commonly connected to each of the above components and transmits, for example, an address signal, a data signal, and various control signals.

[0026] 3 is an example of the hardware configuration of electronic device 110. Electronic device 110 according to this embodiment may have any hardware configuration as long as it has a computer configuration and a configuration capable of inputting and outputting sound waves.

[0027] (Mobile device hardware configuration) 4 is a diagram showing an example of the hardware configuration of a mobile terminal according to an embodiment. The mobile terminal 120 includes, for example, a CPU 401, a ROM 402, a RAM 403, a storage device 404, a CMOS (Complementary Metal Oxide Semiconductor) sensor 405, an image sensor I / F 406, an acceleration / direction sensor 407, a media I / F 409, and a GPS (Global Positioning System) receiving unit 410.

[0028] Of these, the CPU 401 executes a predetermined program to control the overall operation of the mobile terminal 120. The ROM 402 stores a program used to start up the CPU 401, such as an IPL (Initial Program Loader). The RAM 403 is used as a work area for the CPU 401. The storage device 404 is a large-capacity storage device that stores programs such as an OS and applications, and various data, and is realized by, for example, an SSD, a flash ROM, or the like.

[0029] The CMOS sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) under the control of the CPU 401 to obtain image data. The mobile terminal 120 may have an imaging means such as a CCD (Charge Coupled Device) sensor instead of the CMOS sensor 405. The imaging element I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / direction sensor 407 is an electronic magnetic compass that detects geomagnetism, a gyrocompass, an acceleration sensor, or other such sensor. The media I / F 409 controls the reading or writing (storage) of data from / to a media (storage media) 408 such as a flash memory. The GPS receiver 410 receives GPS signals from GPS satellites.

[0030] The mobile terminal 120 also includes a long-distance communication circuit 411, an antenna 411a of the long-distance communication circuit 411, a CMOS sensor 412, an image sensor I / F 413, a microphone 414, a speaker 415, an audio input / output I / F 416, a display 417, an external device connection I / F 418, a short-distance communication circuit 419, an antenna 419a of the short-distance communication circuit 419, and a touch panel 420.

[0031] Of these, the long-distance communication circuit 411 is a circuit that communicates with other devices, for example, via the communication network 202. The CMOS sensor 412 is a type of built-in imaging means that captures an object under the control of the CPU 401 to obtain image data. The image sensor I / F 413 is a circuit that controls the driving of the CMOS sensor 412. The microphone 414 is a built-in circuit that converts sound into an electrical signal. The speaker 415 is a built-in circuit that converts an electrical signal into physical vibrations to generate sound such as music or voice. The sound input / output I / F 416 is a circuit that processes the input / output of sound wave signals between the microphone 414 and the speaker 415 under the control of the CPU 401.

[0032] The display 417 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. The external device connection I / F 418 is an interface for connecting various external devices. The short-distance communication circuit 419 is a circuit that performs various short-distance wireless communications. The touch panel 420 is a type of input means that allows a user to operate the mobile terminal 120 by pressing the display 417.

[0033] The mobile terminal 120 also includes a bus line 421. The bus line 421 includes an address bus, a data bus, and the like for electrically connecting the components such as the CPU 401 shown in FIG.

[0034] 4 is an example of the hardware configuration of the mobile terminal 120. The mobile terminal 120 according to the present embodiment may have any hardware configuration as long as it has a computer configuration, a configuration capable of inputting sound waves, a configuration capable of displaying a display screen, and the like.

[0035] <Functional configuration> FIG. 5 is a diagram illustrating an example of a functional configuration of the information processing system according to the first embodiment.

[0036] (Functional configuration of electronic devices) The electronic device 110 realizes, for example, a device control unit 511, a status acquisition unit 512, a sound wave output unit 513, a communication unit 514, and a storage unit 515, etc., shown in Fig. 5, by executing a predetermined program in the CPU 311 in Fig. 3. Note that at least a part of the above-mentioned functional configurations may be realized by hardware.

[0037] 3, the device control unit 511 executes image forming processes such as printing, scanning, or copying. If the electronic device 110 is a device other than an image forming device, the device control unit 511 controls functions of the electronic device 110. For example, if the electronic device 110 is a projector, the device control unit 511 executes image projection processing.

[0038] Preferably, the device control unit 511 stores log information including information on various events, errors, and the like that have occurred in the device control unit 511 in log information 518 of the storage unit 515 .

[0039] The status acquisition unit 512 executes a status acquisition process to acquire the status of the electronic device 110, for example, using the multiple sensors 361a, 361b, etc. of FIG. 3. When the electronic device 110 is an image forming device, the multiple sensors 361a, 361b, etc. may include, for example, a sensor that detects the open / closed state of a cover, a sensor that detects the state of paper on a conveying path, a sensor that detects the amount of paper in a paper feed tray, or a toner remaining amount sensor. The status acquisition unit 512 acquires the status of the electronic device 110, such as a paper jam, paper out, or toner shortage, using these sensors. Preferably, the status acquisition unit 512 generates a status code indicating the current status of the electronic device 110.

[0040] The status acquisition unit 512 may acquire the status of the electronic device 110 based on the log information 518 stored in the storage unit 515 in addition to (or instead of) the detection results from the multiple sensors 361a, 361b, ...

[0041] When the state of the electronic device 110 is a predetermined state, the sound wave output unit 513 executes a sound wave output process to output a sound wave 102 representing a different sound wave ID (identification information) depending on the predetermined state, for example, using the sound input / output circuit 350 and speaker 351 in FIG. 3.

[0042] Preferably, the sound wave output unit 513 stores sound wave ID information 516 as shown in Figure 6 (A) in the memory unit 515 or the like, and when the status code generated by the status acquisition unit 512 is stored in the sound wave ID information 516, outputs a sound wave representing the sound wave ID corresponding to the status code.

[0043] FIG. 6(A) shows an image of an example of the sonic ID information 516. In the example of FIG. 6(A), the sonic ID information 516 includes information such as "classification", "status code", and "sonic ID" as items. "Classification" is used when classifying the status of the electronic device 110, and in the example of FIG. 6(A), includes "abnormal" indicating an abnormal (error) status such as a paper jam, and "maintenance" indicating a status requiring maintenance such as out of paper or low toner. "Status code" is identification information indicating the status of the electronic device 110, and may be, for example, an error code. "Sonic ID" is a sonic ID (identification information) corresponding to the status code.

[0044] For example, when the status acquisition unit 512 generates a status code "E-001" indicating the status of the electronic device 110, the sound wave output unit 513 outputs the sound wave 102 representing the sound wave ID "000001" corresponding to the status code. At this time, the sound wave output unit 513 may newly create sound wave data for outputting the sound wave 102 representing the sound wave ID, or may acquire sound wave data representing the sound wave ID corresponding to the status code from the sound wave data 517 stored in the storage unit 515.

[0045] 3 to execute a communication process for communicating with other devices connected to the electronic device 110, or communicating with a communicable external server 201 or the like via the communication network 202. Preferably, the communication unit 514 stores log information including information on various events, errors, and the like that have occurred in the communication unit 514 in log information 518 of the storage unit 515.

[0046] 3, the storage device 314, the RAM 312, etc., and stores various information (or data) such as sonic ID information 516, sonic data 517, and log information 518. The information (or data) stored in the storage unit 515 may be possessed by a program executed by the electronic device 110, or may be acquired from the external server 201, etc., via the communication network 202.

[0047] (Mobile device functional configuration) 4 executes a predetermined program (application), thereby implementing an acoustic wave acquisition unit 521, an acoustic wave analysis unit 522, an operation procedure output unit 523, a communication unit 524, a display control unit 525, an audio control unit 526, and a storage unit 527. At least a part of the above functional configurations may be implemented by hardware.

[0048] 4 and the like to acquire sound waves around the mobile terminal 120. For example, the sound wave acquisition unit 521 converts sounds around the mobile terminal 120 acquired by the microphone 414 into sound wave data in a predetermined format and stores the data in the storage unit 527 or the like.

[0049] The sonic wave analysis unit 522 executes a sonic wave analysis process to analyze the sonic waves around the mobile terminal 120 acquired by the sonic wave acquisition unit 521 and acquire a sonic wave ID represented by the sonic waves. For example, the sonic wave analysis unit 522 performs FFT (Fast Fourier Transform Analysis) analysis on the sonic wave data stored in the storage unit 527 or the like by the sonic wave acquisition unit 521 to acquire a sonic wave ID represented by a plurality of predetermined frequencies.

[0050] The operation procedure output unit 523 executes an operation procedure output process of outputting information indicating an operation procedure of the electronic device 110 corresponding to the sonic ID indicating the state of the electronic device 110 acquired by the sonic wave analysis unit 522, using the display control unit 525 or the voice control unit 526, etc. For example, the operation procedure output unit 523 stores and manages operation procedure information 528 as shown in FIG. 6(B) in the storage unit 527, etc., and outputs output data corresponding to the sonic ID acquired by the sonic wave analysis unit 522, using the display control unit 525 or the voice control unit 526.

[0051] Fig. 6(B) shows an example of operation procedure information 528 stored in storage unit 527. As shown in Fig. 6(B), a plurality of sound wave IDs and output data corresponding to each sound wave ID are stored in operation procedure information 528. The output data includes one or more data (or information specifying the data) among still image data, moving image data, text data, and audio data, which indicate the operation procedure corresponding to the sound wave ID.

[0052] 6C, the operation procedure information 528 may store a plurality of sound wave IDs and link information such as a URL (Uniform Resource Locator) indicating the acquisition destination of output data corresponding to each sound wave ID. In this case, the operation procedure output unit 523 acquires output data corresponding to the sound wave ID from the external server 201 shown in FIG. 2 using the communication unit 524.

[0053] The communication unit 524 uses, for example, the long-distance communication circuit 411 in FIG. 4 or the like to connect the mobile terminal 120 to the communication network 202 and executes communication processing for communicating with the external server 201 or the like.

[0054] The display control unit 525, for example, in accordance with instructions from the operation procedure output unit 523, displays a display screen including one or more still images, moving images, and text messages indicating the operation procedures of the electronic device 110 on a display unit such as the display 417.

[0055] For example, in accordance with an instruction from the operation procedure output unit 523, the voice control unit 526 outputs a voice message or the like indicating the operation procedure of the electronic device 110 using the sound input / output I / F 416 and the speaker 415 in FIG.

[0056] The storage unit 527 is realized by, for example, the program executed by the CPU 401 in FIG. 4, the storage device 404, the RAM 403, and the like, and stores various information such as operation procedure information 528 or data.

[0057] <Processing flow> Next, a process flow of the operating procedure guidance method according to the first embodiment will be described.

[0058] (Electronic device processing) Fig. 7 is a flowchart showing an example of processing of the electronic device according to the first embodiment. The electronic device 110 repeatedly executes the processing shown in Fig. 7 in parallel with the original function of the electronic device 110, such as image forming processing, for example.

[0059] In step S701, the status acquisition unit 512 of the electronic device 110 acquires the status of the electronic device 110 based on sensor information acquired from the multiple sensors 361a, 361b, ..., or log information 518 stored in the storage unit 515. For example, based on the sensor information acquired from the multiple sensors 361a, 361b, ..., the status acquisition unit 512 determines whether the electronic device 110 is in a predetermined state including a state requiring an operation by the user 101, such as a paper jam, out of paper, or insufficient toner. Furthermore, when the electronic device 110 is in the predetermined state, the status acquisition unit 512 acquires a status code indicating the state of the electronic device 110.

[0060] In step S702, the sonic wave output unit 513 of the electronic device 110 acquires a sonic ID corresponding to the state of the electronic device 110 from, for example, the sonic ID information 516 as shown in Fig. 6(A). For example, the sonic wave output unit 513 acquires from the sonic ID information 516 a sonic ID corresponding to the state code acquired by the state acquisition unit 512.

[0061] In step S703, if the sonic wave output unit 513 can acquire the sonic wave ID corresponding to the state of the electronic device 110, the process proceeds to step S704. On the other hand, if the sonic wave output unit 513 cannot acquire the sonic wave ID corresponding to the state of the electronic device 110, the process proceeds to step S706.

[0062] When the process proceeds to step S704, the sonic wave output unit 513 acquires or generates sonic data representing the acquired sonic ID. For example, the sonic wave output unit 513 acquires sonic data corresponding to the acquired sonic ID from the sonic data 517 stored in the storage unit 515. Note that the sonic wave output unit 513 may acquire sonic data corresponding to the acquired sonic ID from the external server 201 or the like using the communication unit 514, without being limited to the sonic data 517 stored in the storage unit 515. Also, the sonic wave output unit 513 may generate sonic data representing the acquired sonic ID.

[0063] In step S705, the sound wave output unit 513 outputs the sound wave 102 representing the sound wave ID indicating the state of the electronic device 110 by using the acquired (or generated) sound wave data.

[0064] On the other hand, when the process moves from step S703 to S706, the sonic wave output unit 513 determines whether or not the sonic waves 102 are being output. If the sonic waves 102 are being output, the sonic wave output unit 513 moves the process to step S707 and stops outputting the sonic waves. On the other hand, if the sonic waves 102 are not being output, the sonic wave output unit 513 ends the process of FIG.

[0065] Through the above process, when the electronic device 110 is in a predetermined state (eg, a state requiring an operation by a user), the electronic device 110 outputs a sound wave representing a sound wave ID corresponding to the predetermined state of the electronic device 110.

[0066] (Mobile device processing) Fig. 8 is a flowchart showing an example of processing of the mobile terminal according to the embodiment 1. The mobile terminal 120 executes an application corresponding to the information processing system 100, thereby repeatedly executing, for example, the processing of the mobile terminal as shown in Fig. 8.

[0067] In step S801, the sound wave acquisition unit 521 of the mobile terminal 120 acquires sound waves around the mobile terminal 120, and the sound wave analysis unit 522 analyzes the acquired sound waves to acquire a sound wave ID.

[0068] In step S802, if the sonic wave analysis unit 522 is able to acquire the sonic wave ID, the sonic wave analysis unit 522 shifts the process to step S803. On the other hand, if the sonic wave analysis unit 522 is unable to acquire the sonic wave ID, the mobile terminal 120 ends the process of FIG.

[0069] When the process proceeds to step S803, the operation procedure output unit 523 of the mobile terminal 120 acquires output data corresponding to the acquired sound wave ID. For example, the operation procedure output unit 523 acquires output data corresponding to the sound wave ID acquired by the sound wave analysis unit 522 from the operation procedure information 528 as shown in Fig. 6(B). Alternatively, the operation procedure output unit 523 acquires output data corresponding to the sound wave ID acquired by the sound wave analysis unit 522 from the external server 201 or the like, with reference to the operation procedure information 528 as shown in Fig. 6(C).

[0070] In step S804, the operation procedure output unit 523 outputs information indicating the operation procedure of the electronic device 110 using the acquired output data.

[0071] Through the above process, the mobile terminal 120 outputs at least one of a display screen and a voice message indicating an operating procedure of the electronic device 110 corresponding to a predetermined state of the electronic device 110. As a result, when a predetermined state occurs in the electronic device 110, the user who uses the electronic device 110 can obtain information indicating an operating procedure of the electronic device 110 that the user should execute, simply by starting the app, without having to set up a connection for wireless communication with the electronic device 110 or the like.

[0072] <Example of information showing operation procedures> 9 is a diagram for explaining an example of information showing an operation procedure according to the first embodiment. For example, it is assumed that the electronic device 110 is an image forming device and a "paper jam" occurs in the electronic device 110. In this case, the electronic device 110 outputs the sound wave 102 representing the sound wave ID (for example, the sound wave ID "101001") corresponding to the state of the electronic device 110, "paper jam", by the process shown in FIG.

[0073] On the other hand, when some malfunction occurs in the electronic device 110, the user 101 starts, for example, an application corresponding to the information processing system 100 on the mobile terminal 120. As a result, the mobile terminal 120 displays, for example, a display image 911 shown in Fig. 9 as information indicating an operation procedure corresponding to the sonic ID "101001" by the process shown in Fig. 8, and outputs a message 912 by voice. Note that the message 912 may be displayed on the display screen together with the display image 911 instead of (or in addition to) the voice output.

[0074] When the user 101 opens the cover according to the operating procedure, the state of the electronic device 110 changes to "paper jam" + "cover open", and the electronic device 110 outputs sound waves 102 representing sound wave ID "101002" corresponding to the state "paper jam" + "cover open". As a result, the mobile terminal 120 displays, for example, a display image 921 shown in Fig. 9 as information indicating the operating procedure corresponding to sound wave ID "101002", and outputs message 922 as voice (or displays it on the display screen).

[0075] When the user 101 removes the paper according to the operating procedure, the state of the electronic device 110 changes to "cover open" (no paper jam), and the electronic device 110 outputs sound waves 102 representing sound wave ID "101003" corresponding to the state "cover open" (no paper jam). As a result, the mobile terminal 120 displays, for example, a display image 931 shown in Fig. 9 as information indicating the operating procedure corresponding to sound wave ID "101003", and outputs message 932 as voice (or displays it on the display screen).

[0076] As described above, according to the information processing system 100 of this embodiment, even if the mobile terminal 120 is not set to be able to connect to the electronic device 110 via wireless communication, it is possible to output operation procedures, etc. corresponding to the state of the electronic device to the mobile terminal 120 by simply launching an app.

[0077] Furthermore, according to the information processing system 100 of this embodiment, display screens or voice messages showing different operating procedures can be provided to the user in a timely manner in response to changes in the state of the electronic device 110.

[0078] Furthermore, the information processing system 100 of this embodiment can provide a display image such as that shown in FIG. 9 to a user using the user's 101 mobile terminal 120, even if the electronic device 110 is a printer or the like that does not have a display capable of displaying images.

[0079] [Second embodiment] In the information processing system 100 described in the first embodiment, when the portable terminal 120 is unable to acquire a sonic ID for a predetermined time, it is desirable for the portable terminal 120 to suspend or terminate the output of information indicating an operation procedure output by the portable terminal 120. In the second embodiment, an example of a process for suspending or terminating the output of information indicating an operation procedure output by the portable terminal 120 when the portable terminal 120 is unable to acquire a sonic ID for a predetermined time will be described.

[0080] The system configuration, hardware configuration, functional configuration, and the like of the information processing system 100 according to the second embodiment may be similar to those of the first embodiment.

[0081] <Processing flow> Fig. 10 is a flowchart showing an example of processing of a mobile terminal according to the second embodiment. The mobile terminal 120 executes an application corresponding to the information processing system 100, thereby repeatedly executing the processing of the mobile terminal as shown in Fig. 8, for example. Note that detailed explanations of the processing similar to that of the first embodiment will be omitted here.

[0082] In step S1001, the sound wave acquisition unit 521 of the mobile terminal 120 acquires sound waves around the mobile terminal 120, and the sound wave analysis unit 522 analyzes the acquired sound waves to acquire a sound wave ID.

[0083] In step S1002, if the sonic wave analysis unit 522 can acquire the sonic wave ID, the sonic wave analysis unit 522 shifts the process to step S1003. On the other hand, if the sonic wave analysis unit 522 cannot acquire the sonic wave ID, the sonic wave analysis unit 522 shifts the process to step S1005.

[0084] In step S1003, the operation procedure output unit 523 of the mobile terminal 120 acquires output data corresponding to the acquired sound wave ID.

[0085] In step S1004, the operation procedure output unit 523 outputs information indicating the operation procedure of the electronic device 110 using the acquired output data.

[0086] On the other hand, when the process proceeds from step S1002 to S1005, the operation procedure output unit 523 judges whether or not information indicating an operation procedure is being output. If information indicating an operation procedure is not being output, the operation procedure output unit 523 shifts the process to step S1010. On the other hand, if information indicating an operation procedure is being output, the operation procedure output unit 523 shifts the process to step S1006.

[0087] In step S1006, the operation procedure output unit 523 judges whether or not clocking of the predetermined time has started. If clocking has not started, the operation procedure output unit 523 shifts the process to step S1007 and starts clocking of the predetermined time. On the other hand, if clocking of the predetermined time has started, the operation procedure output unit 523 shifts the process to step S1008.

[0088] When the process proceeds to step S1008, the operation procedure output unit 523 judges whether or not a predetermined time has elapsed since the start of timing. If the predetermined time has not elapsed, the operation procedure output unit 523 ends the process in Fig. 10. On the other hand, if the predetermined time has elapsed, the operation procedure output unit 523 proceeds to step S1009 and stops outputting information indicating the operation procedure.

[0089] In step S1010, the operation procedure output unit 523 stops counting the predetermined time.

[0090] By the above process, the mobile terminal 120 can stop outputting information indicating operation procedures when it cannot acquire the sonic ID for a predetermined time. This can prevent the mobile terminal 120 from continuing to output information indicating operation procedures when, for example, the electronic device 110 returns to a normal state or the user 101 moves away from the electronic device 110.

[0091] [Third embodiment] In the third embodiment, an example will be described in which another electronic device 110 is installed in the vicinity of the electronic device 110 used by the user 101.

[0092] <System configuration> Fig. 11 is a diagram showing an example of a system configuration of an information processing system according to a third embodiment. In the example of Fig. 11, the information processing system 100 includes an electronic device 110a and a mobile terminal 120 used by a user, and one or more other electronic devices 110b, 110c, ... installed in the vicinity of the electronic device 110a. Here, as an example for explanation, it is assumed that the electronic devices 110a, 110b, 110c, ... are image forming devices having the same configuration.

[0093] Fig. 12 is a diagram showing another example of the system configuration of the information processing system according to the third embodiment. In the example of Fig. 12, the information processing system 100 includes an image forming device 1200 and a mobile terminal 120 used by a user 101, and the image forming device 1200 includes a main body 110i and one or more optional units 110j, 110k, ....

[0094] The main body 110i has, for example, the hardware configuration of the electronic device 110 as shown in FIG. 3, and executes image forming processes such as printing, scanning, copying, or faxing. The optional units 110j and 110k have, for example, the hardware configuration of the electronic device 110 as shown in FIG. 3, but may not have the operation panel 320 and the engine control unit 330. The optional units 110j, 110k, etc. include, for example, a paper feed unit, a paper discharge unit, a finisher, etc. In the example of FIG. 12, the optional unit 110j is communicably connected to the main body 110i and the optional unit 110k via a dedicated communication interface 1201 that connects the devices. The main body 110i and one or more optional units 110j, 110k, etc. are examples of the electronic device 110 according to the present embodiment.

[0095] In this way, when multiple electronic devices 110 are installed within a range from which the mobile terminal 120 can acquire sound, it is desirable for each electronic device 110 to output a sound wave 102 representing a sound wave ID using one of multiple frequency bands, for example, as shown in FIG. 13.

[0096] Fig. 13 is a diagram for explaining frequency bands of sound waves according to the third embodiment. In the example of Fig. 13, a frequency band from 18 kHz to 20 kHz is divided into four frequency bands (CH1, CH2, CH3, and CH4).

[0097] 12, when an image forming apparatus 1200 includes a main body 110i and optional units 110j, 110k, etc., the frequency bands to be used by each electronic device 110 may be determined in advance by settings. As an example of the settings, for example, frequency band CH1 may be assigned to the main body 110i, frequency band CH2 to the optional unit 110j, and frequency band CH3 to the optional unit 110k.

[0098] 11, when a plurality of electronic devices 110a, 110b, 110c, etc. are installed, each electronic device 110 may dynamically determine the frequency band for outputting sound waves. Note that, even when an image forming device 1200 includes a main body 110i and optional units 110j, 110k, etc. as shown in FIG. 12, each electronic device 110 may dynamically determine the frequency band for outputting sound waves.

[0099] <Functional configuration> (Functional configuration of electronic devices) 14 is a diagram showing an example of a functional configuration of the electronic device 110 according to the third embodiment. The electronic device 110 according to the third embodiment has, for example, a frequency analysis unit 1401 in addition to the functional configuration of the electronic device 110 according to the first embodiment described in FIG.

[0100] The frequency analysis unit 1401 is realized, for example, by a program executed by the CPU 311 in FIG. 3, and performs FFT analysis on sound waves around the electronic device 110 acquired by the microphone 352, to acquire sound pressure levels in multiple frequency bands (for example, CH1 to CH4).

[0101] Moreover, the sound wave output unit 513 according to the third embodiment outputs a sound wave representing a sound wave ID in a frequency band having a lower sound pressure level than other frequency bands among a plurality of frequency bands (for example, CH1 to CH4).

[0102] Other functional configurations of the electronic device 110 according to the third embodiment than those described above may basically be similar to those of the electronic device 110 according to the first embodiment described with reference to FIG.

[0103] (Functional configuration of mobile terminal) The functional configuration of the mobile terminal 120 according to the third embodiment may basically be the same as the functional configuration of the mobile terminal 120 according to the first embodiment described with reference to FIG.

[0104] However, in the third embodiment, the sound wave analysis unit 522 acquires sound wave IDs in a plurality of predetermined frequency bands (for example, CH1 to CH4). When acquiring a plurality of sound wave IDs, the sound wave analysis unit 522 validates a sound wave ID acquired in a frequency band having a higher sound pressure level than the other frequency bands among the plurality of frequency bands in which the sound wave IDs are acquired, and invalidates the other sound wave IDs.

[0105] <Processing flow> (Electronic device processing) Fig. 15 is a flowchart showing an example of processing by the electronic device according to the third embodiment. Note that, among the processing shown in Fig. 15, the processing in steps S701 to S702 and S706 to S707 is similar to the processing by the electronic device according to the first embodiment described in Fig. 7, and therefore description thereof will be omitted here.

[0106] In step S1501, if the sonic wave output unit 513 can acquire a sonic wave ID corresponding to the state of the electronic device 110, the process proceeds to step S1502. On the other hand, if the sonic wave output unit 513 cannot acquire a sonic wave ID corresponding to the state of the electronic device 110, the process proceeds to step S706.

[0107] When proceeding to step S1502, the sound wave output unit 513 uses the frequency analysis unit 1401 to perform frequency analysis (FFT analysis) on the sound waves around the electronic device 110 acquired by the microphone 352, and acquires sound pressure levels in multiple frequency bands (for example, CH1 to CH4 in FIG. 13).

[0108] In step S1503, the sound wave output unit 513 acquires or generates sound wave data representing a sound wave ID in a frequency band having a lower sound pressure level than the other frequency bands, among a plurality of frequency bands (for example, CH1 to CH4).

[0109] FIG. 16(A) shows an image of an example of a frequency analysis result 1601 by the frequency analysis unit 1401. In FIG. 16(A), the horizontal axis of the graph indicates frequency, and the vertical axis indicates sound pressure level. In this way, the sound wave output unit 513 can obtain sound pressure levels of a plurality of frequency bands (CH1 to CH4) from the frequency analysis result 1601 of the sound waves around the electronic device 110 by the frequency analysis unit 1401. In the example of FIG. 16(A), since the sound pressure level of the frequency band CH1 is lower than the sound pressure levels of the other frequency bands CH2 to CH4, the sound wave output unit 513 obtains sound wave data representing the sound wave ID in the frequency band CH1 from, for example, the sound wave data 517 stored in the storage unit 515. Alternatively, the sound wave output unit 513 may newly generate sound wave data representing the sound wave ID in the frequency band CH1.

[0110] In step S1504, the sound wave output unit 513 outputs a sound wave representing the sound wave ID, using the sound wave data acquired (or generated) in step S1503.

[0111] Through the above process, when there is another electronic device 110 in the vicinity, the electronic device 110 can output sound waves representing the sound wave ID using a frequency band with better sound wave conditions among a plurality of frequency bands.

[0112] (Mobile device processing) Fig. 17 is a flowchart showing an example of processing of a mobile terminal according to the third embodiment. When the mobile terminal 120 executes an application corresponding to the information processing system 100, the mobile terminal 120 repeatedly executes the processing shown in Fig. 17.

[0113] In step S1701, the sound wave acquisition unit 521 of the mobile terminal 120 acquires sound waves around the mobile terminal 120, and the sound wave analysis unit 522 analyzes the acquired sound waves to acquire sound wave IDs in multiple predetermined frequency bands (for example, CH1 to CH4 in FIG. 13).

[0114] In step S1702, the sonic wave analysis unit 522 determines whether or not the sonic wave ID has been acquired, and if the sonic wave ID has been acquired, the process proceeds to step S1703. On the other hand, if the sonic wave ID has not been acquired, the sonic wave analysis unit 522 ends the process of FIG.

[0115] In step S1703, the sonic wave analysis unit 522 determines whether or not multiple sonic wave IDs have been acquired. If multiple sonic wave IDs have been acquired, the sonic wave analysis unit 522 shifts the process to step S1704. On the other hand, if multiple sonic wave IDs have not been acquired, the sonic wave analysis unit 522 shifts the process to step S1705 and validates the acquired sonic wave ID.

[0116] In step S1704, the sound wave analysis unit 522 validates the sound wave ID acquired in a frequency band having a higher sound pressure level than the other frequency bands among the multiple frequency bands in which the sound wave ID was acquired, and invalidates the sound wave ID acquired in the other frequency bands.

[0117] FIG. 16(B) shows an image of an example of a frequency analysis result 1602 by the sound wave analysis unit 522 of the mobile terminal 120. In FIG. 16(B), the horizontal axis of the graph indicates frequency, and the vertical axis indicates sound pressure level. In this way, the sound wave analysis unit 522 can obtain sound pressure levels of a plurality of frequency bands (CH1 to CH4) from the frequency analysis result 1602 of sound waves around the mobile terminal 120 by the sound wave analysis unit 522. In the example of FIG. 16(B), since the sound pressure level of the frequency band CH1 is higher than the sound pressure levels of the other frequency bands CH2 to CH4, the sound wave analysis unit 522 validates the sound wave ID obtained in the frequency band CH1.

[0118] In step S1706, the operation procedure output unit 523 of the mobile terminal 120 acquires output data corresponding to a valid sound wave ID. For example, the operation procedure output unit 523 acquires output data corresponding to a valid sound wave ID from the operation procedure information 528 as shown in FIG. 6B.

[0119] In step S804, the operation procedure output unit 523 outputs information indicating the operation procedure of the electronic device 110 using the acquired output data.

[0120] By performing the above-mentioned processes, for example, as shown in FIG. 11, even if there are other electronic devices 110b, 110c, etc. in the vicinity of the electronic device 110a used by the user 101, the sonic wave ID output by the closest electronic device 110a can be selectively acquired.

[0121] 15 and 17 are merely examples, and various modifications or applications are possible. For example, even if the electronic device 110 is in a normal state, the electronic device 110 may output a sound wave representing a sound wave ID indicating that the electronic device 110 is in a normal state. In this case, if the sound wave ID indicates that the electronic device 110 is in a normal state in step S1706 of FIG. 17, the mobile terminal 120 may cancel the processes of steps S1706 and S1707. The third embodiment can be applied in combination with the second embodiment.

[0122] As described above, according to each embodiment of the present invention, even if the mobile terminal 120 of the user 101 is not set up to connect to the electronic device 110 via wireless communication, it becomes possible to easily output to the mobile terminal 120 of the user 101 operation procedures and the like corresponding to the status of the electronic device 110.

[0123] <Supplementary Information> Each function of each embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0124] 5 may be provided in an external server 201 capable of communicating via a communication network 202. For example, the sonic ID information 516, sonic data 517, and log information 518 stored in the storage unit 515 of the electronic device 110 may be provided in the external server 201. The sonic output unit 513 of the electronic device 110 may create sonic data representing the sonic ID by using a service provided by the external server 201 or the like.

[0125] 5 may be provided in an external server 201 that can communicate with the mobile terminal 120 via a communication network 202. For example, the operating procedure information 528 stored in the storage unit 527 of the mobile terminal 120 may be provided in the external server 201. [Explanation of symbols]

[0126] 100 Information Processing Systems 101 User 110 Electronic equipment 120 Mobile Devices 201 External server (server device) 202 Communication Network 414 Mike 512 Status Acquisition Unit 513 Sound wave output unit 522 Sound Wave Analysis Department 523 Operation procedure output section [Prior art documents] [Patent documents]

[0127] [Patent Document 1] JP 2012-257132 A

Claims

1. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device includes: a status acquisition unit that acquires a status of the electronic device; a sound wave output unit that outputs, when the state of the electronic device is a predetermined state, a sound wave representing different identification information depending on the predetermined state; having The mobile terminal includes: a sound wave analysis unit that analyzes sound waves around the mobile terminal to acquire the identification information; an operation procedure output unit that outputs information indicating an operation procedure of the electronic device corresponding to the identification information; having The sonic wave output unit is capable of outputting sound waves representing the identification information in a plurality of predetermined frequency bands; outputting a sound wave representing the identification information in a frequency band having a sound pressure level lower than that of other frequency bands among the plurality of frequency bands; Information processing system.

2. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device includes: a status acquisition unit that acquires a status of the electronic device; a sound wave output unit that outputs, when the state of the electronic device is a predetermined state, a sound wave representing different identification information depending on the predetermined state; having The mobile terminal includes: a sound wave analysis unit that analyzes sound waves around the mobile terminal to acquire the identification information; an operation procedure output unit that outputs information indicating an operation procedure of the electronic device corresponding to the identification information; having The sonic wave analysis unit is Acquiring the identification information in a plurality of predetermined frequency bands; When a plurality of pieces of identification information are acquired, the identification information acquired in a frequency band having a higher sound pressure level than the other frequency bands is validated among the plurality of frequency bands in which the identification information is acquired. Information processing system.

3. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device includes: a status acquisition unit that acquires a status of the electronic device; a sound wave output unit that outputs, when the state of the electronic device is a predetermined state, a sound wave representing different identification information depending on the predetermined state; having The mobile terminal includes: a sound wave analysis unit that analyzes sound waves around the mobile terminal to acquire the identification information; an operation procedure output unit that outputs information indicating an operation procedure of the electronic device corresponding to the identification information; having the operation procedure output unit stops outputting information indicating an operation procedure of the electronic device when the sound wave analysis unit cannot acquire the identification information for a predetermined time. Information processing system.

4. The information processing system according to claim 1 , wherein the sound wave output unit outputs sound waves representing the identification information at a frequency of 16 kHz or higher within a frequency range that can be picked up by a microphone included in the mobile terminal.

5. The information processing system according to claim 1 , wherein the predetermined state includes a state in which an operation by the user on the electronic device is required.

6. The information processing system according to claim 1 , wherein the operation procedure output unit outputs a display screen indicating the operation procedure of the electronic device corresponding to the identification information, or outputs audio indicating the operation procedure of the electronic device corresponding to the identification information.

7. The information processing system according to claim 1 , wherein the operation procedure output unit obtains the operation procedure of the electronic device corresponding to the identification information from a server device communicatively connected to the mobile terminal via a communication network.

8. In an information processing system including an electronic device and a mobile terminal used by a user, The electronic device comprises: A status acquisition process for acquiring a status of the electronic device; a sound wave output process for outputting, when the state of the electronic device is a predetermined state, a sound wave representing different identification information according to the predetermined state; Run The mobile terminal, A sound wave analysis process for analyzing sound waves around the mobile terminal to obtain the identification information; an operation procedure output process for outputting information indicating an operation procedure of the electronic device corresponding to the identification information; Run The sonic output processing includes: capable of outputting sound waves representing the identification information in a plurality of predetermined frequency bands; outputting a sound wave representing the identification information in a frequency band having a sound pressure level lower than that of other frequency bands among the plurality of frequency bands; Operating procedure guide.

9. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device comprises: A status acquisition process for acquiring a status of the electronic device; a sound wave output process for outputting, when the state of the electronic device is a predetermined state, a sound wave representing different identification information according to the predetermined state; Run The mobile terminal, A sound wave analysis process for analyzing sound waves around the mobile terminal to obtain the identification information; an operation procedure output process for outputting information indicating an operation procedure of the electronic device corresponding to the identification information; Run The sonic analysis process includes: Acquiring the identification information in a plurality of predetermined frequency bands; When a plurality of pieces of identification information are acquired, the identification information acquired in a frequency band having a higher sound pressure level than the other frequency bands is validated among the plurality of frequency bands in which the identification information is acquired. Operating procedure guide.

10. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device comprises: A status acquisition process for acquiring a status of the electronic device; a sound wave output process for outputting, when the state of the electronic device is a predetermined state, a sound wave representing different identification information according to the predetermined state; Run The mobile terminal, A sound wave analysis process for analyzing sound waves around the mobile terminal to obtain the identification information; an operation procedure output process for outputting information indicating an operation procedure of the electronic device corresponding to the identification information; Run When the identification information cannot be acquired for a predetermined time by the sound wave analysis process, the operation procedure output process stops outputting information indicating an operation procedure of the electronic device. Operating procedure guide.

11. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device includes: A status acquisition process for acquiring a status of the electronic device; a sound wave output process for outputting, when the state of the electronic device is a predetermined state, a sound wave representing different identification information according to the predetermined state; Run the command, The mobile terminal, A sound wave analysis process for analyzing sound waves around the mobile terminal to obtain the identification information; an operation procedure output process for outputting information indicating an operation procedure of the electronic device corresponding to the identification information; Run the command, The sonic output processing includes: capable of outputting sound waves representing the identification information in a plurality of predetermined frequency bands; outputting a sound wave representing the identification information in a frequency band having a sound pressure level lower than that of other frequency bands among the plurality of frequency bands; program.

12. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device includes: A status acquisition process for acquiring a status of the electronic device; a sound wave output process for outputting, when the state of the electronic device is a predetermined state, a sound wave representing different identification information according to the predetermined state; Run the command, The mobile terminal, A sound wave analysis process for analyzing sound waves around the mobile terminal to obtain the identification information; an operation procedure output process for outputting information indicating an operation procedure of the electronic device corresponding to the identification information; Run the command, The sonic analysis process includes: Acquiring the identification information in a plurality of predetermined frequency bands; When a plurality of pieces of identification information are acquired, the identification information acquired in a frequency band having a higher sound pressure level than the other frequency bands is validated among the plurality of frequency bands in which the identification information is acquired. program.

13. An information processing system including an electronic device and a mobile terminal used by a user, The electronic device includes: A status acquisition process for acquiring a status of the electronic device; a sound wave output process for outputting, when the state of the electronic device is a predetermined state, a sound wave representing different identification information according to the predetermined state; Run the command, The mobile terminal, A sound wave analysis process for analyzing sound waves around the mobile terminal to obtain the identification information; an operation procedure output process for outputting information indicating an operation procedure of the electronic device corresponding to the identification information; Run the command, When the identification information cannot be acquired for a predetermined time by the sound wave analysis process, the operation procedure output process stops outputting information indicating an operation procedure of the electronic device. program.

Images