Electronic devices, supply devices and supply systems

Abstract

To provide an improved technique for delivering information to a user.SOLUTION: An electronic apparatus comprises a communication unit with directivity, a sensor assembly that detects movement of a user's head, and a control unit. When the control unit determines that the user is staring on the basis of the detection result of the sensor assembly, the control unit provides the user with information based on a signal received by the communication unit from an object in the direction in which the user is staring.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to an electronic device, a providing device, and a providing system.

Background Art

[0002] Techniques for providing information to a user are known. For example, Patent Document 1 describes an information processing apparatus including a control unit that controls to present, to the user by voice, information transmitted from another user around the user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

[0008] The system provided in one embodiment of this disclosure is An electronic device that, when it is determined that the user is staring based on the detection result of the user's head movement, transmits a carrier signal containing the user's identification information using a directional first communication unit, A providing device that, when the carrier signal is received by a directional second communication unit, stores the user's identification information and transmits a response signal to the carrier signal via the second communication unit, Includes. [Effects of the Invention]

[0009] According to one embodiment of this disclosure, an improved technology for providing information to users can be provided. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows a schematic diagram of a provisioning system according to one embodiment of this disclosure. [Figure 2] Figure 1 is a block diagram of the provided system. [Figure 3] Figure 2 is a flowchart showing the procedure for receiving ultrasonic signals performed by the provided device. [Figure 4] Figure 2 is a flowchart showing the procedure for transmitting carrier signals performed by the electronic device shown. [Figure 5] Figure 2 is a flowchart showing the procedure for receiving ultrasonic signals performed by the electronic device shown. [Figure 6] Figure 2 is a sequence diagram showing the operation of the provided system. [Modes for carrying out the invention]

[0011] Hereinafter, embodiments according to the present disclosure will be described with reference to the drawings.

[0012] (Configuration of the provision system) As shown in FIG. 1, the provision system 1 includes a provision device 10 and an electronic device 20. In the present embodiment, the number of the provision device 10 and the electronic device 20 included in the provision system 1 is one each. However, the number of the provision device 10 and the electronic device 20 included in the provision system 1 may be arbitrary.

[0013] The provision device 10 and the electronic device 20 are capable of performing acoustic communication. The acoustic communication according to the present embodiment is communication using ultrasonic waves as a transmission medium. The ultrasonic waves are, for example, sounds in a band of 18 [kHz] or higher. In acoustic communication, ultrasonic waves in a band of 18 [kHz] - 22 [kHz] may be used, or ultrasonic waves in a band of 22 [kHz] or higher may be used. In the transmission protocol in acoustic communication, for example, a digital modulation method such as minimum shift keying (MSK) or phase shift keying (PSK) may be adopted.

[0014] The provision device 10 is, for example, a guide board. However, the provision device 10 may be a signboard. The provision device 10 is located outdoors. However, the provision device 10 may be located indoors such as in a museum. The provision device 10 is, for example, plate-shaped. The provision device 10 has two surfaces. Guide information is described on one surface of the provision device 10. The guide information is, for example, a surrounding map, surrounding information, or information on surrounding exhibits.

[0015] Hereinafter, "in front of the provision device 10" means the direction from the surface of the two surfaces of the provision device 10 on which the guide information is not described to the surface on which the guide information is described.

[0016] The providing device 10 can transmit an ultrasonic signal in front of the providing device 10. The providing device 10 can receive an ultrasonic signal from in front of the providing device 10.

[0017] The electronic device 20 can be worn on the user's head. The electronic device 20 may be a wearable device that can be worn on the user's head. In the present embodiment, the electronic device 20 is a hearable device which is a kind of wearable device. However, the electronic device 20 is not limited to a hearable device as long as it can be worn on the user's head and can provide information to the user, as will be described later. The electronic device 20 may be a headset-type hearable device as shown in FIG. 1, or may be an earphone-type hearable device.

[0018] Hereinafter, "in front of the electronic device 20" means a direction that coincides with the direction in which the user's face faces when the electronic device 20 is worn on the user's head. The direction in which the user's face faces may coincide with the user's line of sight direction.

[0019] The electronic device 20 can transmit an ultrasonic signal in front of the electronic device 20. The electronic device 20 can receive an ultrasonic signal from in front of the electronic device 20.

[0020] The electronic device 20 holds information in which each unique ID of a plurality of providing devices 10 is associated with each audio data of the plurality of providing devices 10. The unique ID of the providing device 10 is identification information of the providing device 10 that can uniquely identify the providing device 10.

[0021] The providing system 1 can provide information about the providing device 10 to a user who is interested in, for example, the guidance information of the providing device 10 by voice. This process will be briefly described below.

[0022] For example, if a user is interested in the information provided by device 10, they will stop in front of device 10. The user who has stopped in front of device 10 will gaze intently at the information provided by device 10.

[0023] When the electronic device 20 determines that the user is gazing at it, it transmits a carrier signal containing the user's identification information forward. The carrier signal is a signal that carries the user's identification information. Hereinafter, the user's identification information will be assumed to be a one-time password.

[0024] The providing device 10 can receive a carrier signal from the front of the providing device 10. When the providing device 10 receives a carrier signal, it stores the one-time password contained in the carrier signal. After storing the one-time password, the providing device 10 sends a response signal to the front of the providing device as a response to the carrier signal.

[0025] After transmitting a carrier signal, the electronic device 20 may receive a response signal from its front. Upon receiving the response signal, the electronic device 20 notifies the user that it is able to provide information about the providing device 10. This notification allows the user to know that they can hear information about the providing device 10 audibly. Furthermore, the electronic device 20 transmits a request signal to its front, requesting the unique ID of the providing device 10.

[0026] Here, if the user wants to hear information about the providing device 10 via voice, they continue to gaze at the providing device 10. If the user continues to gaze at the providing device 10, the request signal transmitted by the electronic device 20 reaches the providing device 10. On the other hand, if the user is not interested in information about the providing device 10, they either move away from the providing device 10 or turn their head away. If the user moves away from the providing device 10, the request signal transmitted by the electronic device 20 forward does not reach the providing device 10.

[0027] When the providing device 10 receives a request signal from the electronic device 20, it transmits a unique signal containing a unique ID as an ultrasonic signal in front of the providing device 10. Upon receiving the unique signal, the electronic device 20 extracts the unique ID from the unique signal. The electronic device 20 then plays back the sound data of the providing device 10 that is associated with the extracted unique ID from the sound data of the providing device 10 that it holds. With this configuration, the user can hear the sound data of the providing device 10 in front of the user.

[0028] (Configuration of provided devices) As shown in Figure 2, the providing device 10 comprises a communication unit 11, a storage unit 14, and a control unit 15. The communication unit 11 is also called the second communication unit.

[0029] The communication unit 11 is directional. The communication unit 11 has a directional property such that the intensity of the ultrasonic signals transmitted and received in front of the providing device 10 is stronger than in other directions. The communication unit 11 is configured to include at least one communication module capable of performing acoustic communication. In this embodiment, the communication unit 11 includes a speaker unit 12 and a microphone unit 13.

[0030] The speaker unit 12 is configured to include at least one speaker capable of outputting ultrasonic waves. The speaker unit 12 is configured to include, for example, a directional speaker or a parametric speaker.

[0031] The speaker unit 12 transmits an ultrasonic signal. The speaker unit 12 is located in the portion of the providing device 10 that can transmit an ultrasonic signal in front of the providing device 10, as shown in Figure 1. The speaker unit 12 is positioned to have a directivity such that the intensity of the ultrasonic signal transmitted in front of the providing device 10 is stronger than in other directions.

[0032] The microphone unit 13 is configured to include at least one microphone capable of collecting ultrasonic waves. The microphone unit 13 may be configured to include, for example, a multi-microphone or a directional microphone capable of collecting ultrasonic waves by beamforming. The microphone unit 13 may also be configured to include a unidirectional microphone or a superdirectional microphone.

[0033] The microphone unit 13 receives ultrasonic signals by collecting ultrasonic waves. The microphone unit 13 is located in the part of the providing device 10 that is capable of receiving ultrasonic signals from the front of the providing device 10, as shown in Figure 1. The microphone unit 13 is arranged to have a directivity such that the intensity of ultrasonic signals received from the front of the providing device 10 is stronger than in other directions. By configuring the microphone unit 13 to include a multi-microphone or a directional microphone, the range in front of the providing device 10 in which the microphone unit 13 can receive ultrasonic signals can be limited.

[0034] The storage unit 14 is configured to include at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or at least two combinations thereof. The semiconductor memory is, for example, RAM (Random Access Memory) or ROM (Read Only Memory). The RAM is, for example, SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory). The ROM is, for example, EEPROM (Electrically Erasable Programmable Read Only Memory). The storage unit 14 may function as a main memory, auxiliary memory, or cache memory. The storage unit 14 stores data used for the operation of the providing device 10 and data obtained by the operation of the providing device 10.

[0035] The control unit 15 is configured to include at least one processor, at least one dedicated circuit, or a combination thereof. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 15 controls each part of the providing device 10 and executes processes related to the operation of the providing device 10.

[0036] The control unit 15 receives the ultrasonic signal via the microphone unit 13. This ultrasonic signal is either a carrier signal or a request signal from the electronic device 20 located in front of the providing device 10. To determine whether the received ultrasonic signal is a carrier signal or a request signal, the control unit 15 extracts a one-time password from the ultrasonic signal. The control unit 15 then determines whether the extracted one-time password matches any of the one-time passwords stored in the storage unit 14.

[0037] If the control unit 15 determines that the extracted one-time password does not match any of the one-time passwords stored in the storage unit 14, it determines that the received ultrasonic signal is a carrier signal. As described above, since the carrier signal is a signal that carries a one-time password, the storage unit 14 does not store the one-time password contained in the carrier signal before receiving the carrier signal. If the control unit 15 determines that the received ultrasonic signal is a carrier signal, it stores the one-time password extracted from the received ultrasonic signal, i.e., the carrier signal, in the storage unit 14. After storing the one-time password, the control unit 15 generates a response signal as a response to the received carrier signal. The control unit 15 includes the one-time password extracted from the received carrier signal in the response signal. The control unit 15 causes the generated response signal to be transmitted to the speaker unit 12 as an ultrasonic signal. The speaker unit 12 transmits the response signal in front of the providing device 10. The control unit 15 may turn on the power to the speaker unit 12 only when transmitting the response signal. With this configuration, the power consumption of the providing device 10 can be reduced.

[0038] If the control unit 15 determines that the extracted one-time password matches any of the one-time passwords stored in the storage unit 14, it determines whether the received ultrasonic signal is a request signal. For example, if the control unit 15 contains a previously transmitted response signal in the received ultrasonic signal, it determines that the received ultrasonic signal is a request signal. If the control unit 15 determines that the received ultrasonic signal is a request signal, it generates a unique signal containing the unique ID of the providing device 10. The control unit 15 may include the one-time password extracted from the request signal in the unique signal. The control unit 15 causes the speaker unit 12 to transmit the generated unique signal as an ultrasonic signal. The speaker unit 12 transmits the unique signal in front of the providing device 10. The control unit 15 may turn on the power to the speaker unit 12 only when transmitting the unique signal. This configuration can reduce the power consumption of the providing device 10.

[0039] (Configuration of electronic equipment) As shown in Figure 2, the electronic device 20 includes a communication unit 21, a communication unit 22, an input unit 25, a speaker unit 26, a positioning unit 27, a sensor unit 28, a vibration unit 29, a storage unit 30, and a control unit 31. The communication unit 22 is also called the first communication unit.

[0040] The communication unit 21 comprises at least one communication module capable of connecting to any network, including mobile communication networks and the Internet. The communication module is, for example, a communication module compatible with mobile communication standards such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation).

[0041] The communication unit 22 is directional. The communication unit 22 has a directional property such that the intensity of the ultrasonic signals transmitted and received in front of the electronic device 20 is stronger than in other directions. When the electronic device 20 is worn on the user's head, the communication unit 22 may have a directional property such that the intensity of the ultrasonic signals transmitted and received in the direction the user's face is facing, i.e., in the user's line of sight, is stronger than in other directions. The communication unit 22 is configured to include at least one communication module capable of performing acoustic communication. In this embodiment, the communication unit 22 includes a speaker unit 23 and a microphone unit 24.

[0042] The speaker unit 23 is configured to include at least one speaker capable of outputting ultrasonic waves. The speaker unit 23 is configured to include, for example, a directional speaker or a parametric speaker.

[0043] The speaker unit 23 transmits an ultrasonic signal. The speaker unit 23 is located in the part of the electronic device 20 that can transmit an ultrasonic signal towards the front of the electronic device 20, as shown in Figure 1. The speaker unit 23 is positioned to have a directivity such that the intensity of the ultrasonic signal transmitted towards the front of the electronic device 20 is stronger than in other directions.

[0044] The microphone unit 24 is configured to include at least one microphone capable of collecting ultrasonic waves. The microphone unit 24 may be configured to include, for example, a multi-microphone or a directional microphone capable of collecting ultrasonic waves by beamforming. The microphone unit 24 may be configured to include a unidirectional microphone or a superdirectional microphone.

[0045] The microphone unit 24 receives ultrasonic signals. The microphone unit 24 is located in a part of the electronic device 20 that is capable of receiving ultrasonic signals from the front of the electronic device 20, as shown in Figure 1. The microphone unit 24 is positioned to have a directivity such that the intensity of ultrasonic signals received from the front of the electronic device 20 is stronger than in other directions. By configuring the microphone unit 24 to include a multi-microphone or a directional microphone, the range in front of the electronic device 20 in which the microphone unit 24 can receive ultrasonic signals can be limited. Here, if the user moves or the user's head moves, a Doppler effect may occur in the ultrasonic signal received by the microphone unit 24. Therefore, the microphone unit 24 may be configured to allow a frequency change of, for example, ±5% from a preset frequency for the frequency of the ultrasonic signal to be received.

[0046] The input unit 25 is capable of receiving input from the user. The input unit 25 is configured to include at least one input interface capable of receiving input from the user. The input interface is, for example, a physical key or a capacitive key.

[0047] The speaker unit 26 is configured to include at least one speaker capable of outputting audible sound. The speaker unit 26 is configured to include, for example, a stereo speaker.

[0048] The speaker unit 26 is located in the part of the electronic device 20 that can output audible sound to the user. For example, the stereo speaker of the speaker unit 26 includes a left speaker and a right speaker. The left speaker is located in the left ear pad of the electronic device 20. The right speaker is located in the right ear pad of the electronic device 20.

[0049] The positioning unit 27 is capable of acquiring location information of the electronic device 20. The positioning unit 27 is configured to include at least one receiving module that corresponds to a satellite positioning system. The receiving module is, for example, a receiving module that corresponds to GPS (Global Positioning System). However, the receiving module is not limited to this. The receiving module may be a receiving module that corresponds to any satellite positioning system.

[0050] The sensor unit 28 is configured to include at least one sensor capable of detecting the movement of the electronic device 20. When the electronic device 20 is worn on the user's head, the sensor unit 28 can detect the movement of the user's head as the movement of the electronic device 20. The movement of the user's head detected by the sensor unit 28 may be, for example, the orientation of the user's head, the acceleration or velocity of the user's head, etc. The sensor unit 28 is configured to include, for example, an inertial sensor.

[0051] The vibrating unit 29 is capable of vibrating the electronic device 20. The vibrating unit 29 is composed of, for example, a vibrating element such as a piezoelectric element.

[0052] The storage unit 30 is configured to include at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or at least two combinations thereof. The semiconductor memory is, for example, RAM or ROM. The RAM is, for example, SRAM or DRAM. The ROM is, for example, EEPROM. The storage unit 30 may function as a main memory, an auxiliary memory, or a cache memory. The storage unit 30 stores data used for the operation of the electronic device 20 and data obtained by the operation of the electronic device 20.

[0053] The memory unit 30 stores, for example, map information. The map information includes the location information of the providing device 10.

[0054] The control unit 31 is configured to include at least one processor, at least one dedicated circuit, or a combination thereof. The processor is, for example, a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA or ASIC. The control unit 31 controls each part of the electronic device 20 and executes processes related to the operation of the electronic device 20.

[0055] <Processing for acquiring sound data from the provided device> The control unit 31 acquires the location information of the electronic device 20 using the positioning unit 27. The location information of the electronic device 20 can be considered as the user's location information because the user is wearing the electronic device 20.

[0056] When the control unit 31 acquires location information of the electronic device 20, it receives the unique ID and sound data of the providing devices 10 located within a predetermined range from the location of the electronic device 20, i.e., the user's location, from an external server via the network using the communication unit 21. The predetermined range may be set based on the density of providing devices 10 installed in the area. For example, the predetermined range is 1 km to 2 km. The control unit 31 associates the received unique ID and sound data of the providing devices 10 and stores them in the storage unit 30.

[0057] The control unit 31 may update the unique ID and sound data of the providing device 10 in the storage unit 30 by acquiring location information of the electronic device 20 and receiving the unique ID and sound data of the providing device 10 at predetermined intervals. The predetermined interval may be set based on the user's walking speed.

[0058] <Transmission process of carrier signals> The control unit 31 obtains the detection result from the sensor unit 28. Based on the detection result from the sensor unit 28, the control unit 31 determines whether or not the user is staring. If the electronic device 20 is attached to the user's head, the detection result from the sensor unit 28 may be the detection result of the user's head movement.

[0059] For example, the control unit 31 may determine that the user is gazing if, based on the detection result of the sensor unit 28, the direction of the user's face is within a predetermined range and above a first time threshold. The first time threshold may be set based on the assumed duration of time a person gazes at an object. The predetermined range may be set based on the assumed range of changes in the direction of a person's face while they are gazing at an object.

[0060] As another example, the control unit 31 may determine that the user is staring if it determines, based on the detection results of the sensor unit 28, that the user's head is stationary for a period of time equal to or longer than a second time threshold. The second time threshold may be set based on the estimated duration for which a person stares at an object.

[0061] The control unit 31 generates a one-time password when it determines that the user is in a gazing state. The control unit 31 may generate a one-time password based on the current time. For example, the control unit 31 may generate a one-time password by combining user-specific information with the current time. The control unit 31 may also generate a one-time password by converting the current time into user-specific ultrasonic band information.

[0062] When the control unit 31 generates a one-time password, it generates a carrier signal that carries the one-time password. In other words, the carrier signal includes the one-time password.

[0063] When the control unit 31 generates a carrier signal, it causes the speaker unit 23 to transmit the carrier signal as an ultrasonic signal. The speaker unit 23 transmits the carrier signal forward of the electronic device 20. As the carrier signal is transmitted forward of the electronic device 20, and the electronic device 20 is then attached to the user's head, the carrier signal is transmitted in the direction of the user's line of sight.

[0064] <Processing of ultrasonic signal reception> When the control unit 31 transmits a carrier signal, it starts processing the ultrasonic signal reception. The ultrasonic signal to be received is a response signal or unique signal from the providing device 10 located in front of the electronic device 20, that is, in the direction the user's face is facing.

[0065] If the control unit 31 receives an ultrasonic signal within a set time after transmitting a carrier signal, it extracts a one-time password from the received ultrasonic signal. The set time may be set to the expected duration for a user to gaze at one of the providing devices 10. For example, the set time is 5 seconds. The control unit 31 determines whether the extracted one-time password matches the one-time password that was generated when the carrier signal was generated. If the extracted one-time password matches the generated one-time password, the received ultrasonic signal is the ultrasonic signal transmitted by the providing device 10 that received the carrier signal from the electronic device 20. Therefore, if the control unit 31 determines that the extracted one-time password matches the generated one-time password, it determines whether the received ultrasonic signal is a response signal or a unique signal. As described below, the control unit 31 performs different processing depending on whether the received ultrasonic signal is a response signal or a unique signal.

[0066] <<Processing of the response signal>> When the control unit 31 determines that the received ultrasonic signal is a response signal, it notifies the user that it can provide information about the providing device 10. For example, the control unit 31 may notify the user that it can provide information about the providing device 10 by vibrating the electronic device 20 with the vibration unit 29. As another example, the control unit 31 may notify the user that it can provide information about the providing device 10 by outputting a sound effect from the speaker unit 26. With such a configuration, the user will know that it is possible to hear information about the providing device 10 in audio form. If the user wants to hear information about the providing device 10 in audio form, they will continue to stare at the providing device 10. On the other hand, if the user is not interested in information about the providing device 10, they will walk away from the providing device 10 or turn their head away.

[0067] When the control unit 31 notifies the user, it generates a request signal. As described above, the request signal is a signal requesting the unique ID of the providing device 10. The control unit 31 may include the one-time password that was generated when the carrier signal was generated in the request signal. The control unit 31 may generate the request signal as a response to a response signal. For example, the control unit 31 generates the request signal as a response to a response signal by including the response signal received from the providing device 10 in the request signal.

[0068] The control unit 31 outputs the generated request signal as an ultrasonic signal to the speaker unit 23. The speaker unit 23 transmits the request signal in the direction the user's face is facing. If, after notification to the user, the user wants to hear information about the providing device 10 by voice and continues to gaze at the providing device 10, the request signal will reach the providing device 10 located in the direction the user's face is facing. On the other hand, if the user is not interested in the information about the providing device 10 and walks away from the providing device 10 or changes the direction of their head, the request signal will not reach the providing device 10.

[0069] <<Processing of Intrinsic Signals>> If the control unit 31 determines that the received ultrasonic signal is a unique signal, it extracts a unique ID from the unique signal. Once the control unit 31 has extracted the unique ID, it retrieves sound data associated with the unique ID from the storage unit 30. After retrieving the sound data, the control unit 31 outputs the retrieved sound data to the speaker unit 26. With this configuration, the user can hear guidance information corresponding to the providing device 10 as sound.

[0070] (Operation of the provided device) Figure 3 is a flowchart showing the procedure for receiving ultrasonic signals performed by the providing device 10 shown in Figure 2. When an ultrasonic signal is transmitted from the electronic device 20 to the providing device 10, the control unit 15 starts the process of step S1.

[0071] The control unit 15 receives the ultrasonic signal via the microphone unit 13 (step S1).

[0072] The control unit 15 extracts a one-time password from the received ultrasonic signal. The control unit 15 determines whether the extracted one-time password matches any of the one-time passwords stored in the storage unit 14 (step S2). If the control unit 15 determines that the extracted one-time password does not match any of the one-time passwords stored in the storage unit 14 (step S2: NO), it proceeds to step S3. On the other hand, if the control unit 15 determines that the extracted one-time password matches any of the one-time passwords stored in the storage unit 14 (step S2: YES), it proceeds to step S6.

[0073] In step S3, the control unit 15 stores the one-time password extracted from the ultrasonic signal, i.e., the carrier signal, received in step 1, in the storage unit 14.

[0074] In step S4, the control unit 15 generates a response signal in response to the carrier signal. In step S5, the control unit 15 causes the response signal generated in step S4 to be transmitted to the speaker unit 12 as an ultrasonic signal.

[0075] In step S6, the control unit 15 determines whether the ultrasonic signal received in step S1 is a requested signal. If the control unit 15 determines that the received ultrasonic signal is a requested signal (step S6: YES), it proceeds to step S7. On the other hand, if the control unit 15 determines that the received ultrasonic signal is not a requested signal (step S6: NO), it terminates the ultrasonic signal reception process.

[0076] In step S7, the control unit 15 generates a unique signal. In step S8, the control unit 15 causes the speaker unit 12 to transmit the unique signal generated in step S7 as an ultrasonic signal.

[0077] Here, in the process of step S2, if the control unit 15 determines that the extracted one-time password matches any of the one-time passwords stored in the storage unit 14, it may obtain the storage time of the stored one-time password. The storage time of the one-time password is, for example, the time from when the one-time password is stored in the storage unit 14 until the process of step S2 is executed. The control unit 15 may also determine whether the storage time of the obtained stored one-time password is equal to or greater than a specified time. The specified time may be set according to the use of the providing device 10. If the control unit 15 determines that the storage time of the obtained stored one-time password is equal to or greater than the specified time, it may consider that the extracted one-time password does not match any of the one-time passwords stored in the storage unit 14 (step S2: NO). In this case, the control unit 15 proceeds to the process of step S3. On the other hand, if the control unit 15 determines that the storage time of the obtained stored one-time password is less than the specified time, it may proceed to the process of step S6.

[0078] In step S3, the control unit 15 may delete one-time passwords stored in the storage unit 14 if their storage time exceeds a specified time.

[0079] (Operation of electronic devices) Figure 4 is a flowchart showing the procedure for transmitting a carrier signal performed by the electronic device shown in Figure 2. When the control unit 31 receives an input from the input unit 25 to turn on the power of the electronic device 20, it starts the process of step S11.

[0080] The control unit 31 obtains the detection result from the sensor unit 28 (step S11). Based on the detection result from the sensor unit 28, the control unit 31 determines whether or not the user is staring (step S12).

[0081] If the control unit 31 determines that the user is in a gazing state (step S12: YES), it proceeds to the process in step S13. If the control unit 31 determines that the user is not in a gazing state (step S12: NO), it returns to the process in step S11.

[0082] In step S13, the control unit 31 generates a one-time password.

[0083] In step S14, the control unit 31 generates a transport signal containing the one-time password generated in step S13.

[0084] In step S15, the control unit 31 outputs the carrier signal generated in step S14 as an ultrasonic signal to the speaker unit 23.

[0085] Figure 5 is a flowchart showing the procedure for receiving ultrasonic signals performed by the electronic device 20 shown in Figure 2. After the processing in step S15 as shown in Figure 4, the control unit 31 starts the processing in step S21.

[0086] The control unit 31 determines whether or not an ultrasonic signal has been received by the microphone unit 24 (step S21). If the control unit 31 does not determine that an ultrasonic signal has been received (step S21: NO), it proceeds to step S22. On the other hand, if the control unit 31 determines that an ultrasonic signal has been received (step S21: YES), it proceeds to step S23.

[0087] In step S22, the control unit 31 determines whether a set time has elapsed since the carrier signal was transmitted in step S15, as shown in Figure 4. If the control unit 31 determines that a set time has elapsed since the carrier signal was transmitted (step S22: YES), it terminates the ultrasonic signal reception process. On the other hand, if the control unit 31 does not determine that a set time has elapsed since the carrier signal was transmitted (step S22: NO), it returns to the process in step S21.

[0088] In step S23, the control unit 31 extracts a one-time password from the ultrasonic signal received in step S21. The control unit 31 determines whether the extracted one-time password matches the one-time password generated in step S13 as shown in Figure 4.

[0089] If the control unit 31 determines that the extracted one-time password matches a previously generated one-time password (step S23: YES), it proceeds to step S24. On the other hand, if the control unit 31 determines that the extracted one-time password does not match a previously generated one-time password (step S23: NO), it returns to step S21.

[0090] In step S24, the control unit 31 determines whether the ultrasonic signal received in step S21 is a response signal. If the control unit 31 determines that the ultrasonic signal received in step S21 is a response signal (step S24: YES), it proceeds to step S25. If the control unit 31 determines that the ultrasonic signal received in step S21 is not a response signal, i.e., it determines that it is a unique signal (step S24: NO), it proceeds to step S28.

[0091] In step S25, the control unit 31 notifies the user that it is possible to provide information about the providing device 10.

[0092] In step S26, the control unit 31 generates a request signal. In step S27, the control unit 31 causes the speaker unit 23 to output the request signal generated in step S26 as an ultrasonic signal. After step S27, the control unit 31 returns to step S21.

[0093] If, after processing in step S25, the user wants to hear the sound data from the providing device 10 and continues to stare at the providing device 10, the request signal sent in processing in step S27 will reach the providing device 10 in front of the user. If, after processing in step S25, the user moves away from the providing device 10 or changes the direction of their head, the request signal sent in processing in step S27 will not reach the providing device 10.

[0094] In step S28, the control unit 31 extracts a unique ID from the unique signal. In step S29, the control unit 31 obtains sound data associated with the unique ID from the storage unit 30. In step S30, the control unit 31 outputs the sound data obtained in step S29 to the speaker unit 26.

[0095] The control unit 31 may execute the processes of steps S11 to S15 in parallel with the processes of steps S21 to S30. In this case, while the control unit 31 is outputting sound data to the speaker unit 26 in the process of step S30, it may acquire sound data for a new supply device 10 in step S29. If sound data for a new supply device 10 is acquired in step S29, the control unit 31 may output the sound data for the new supply device 10 to the speaker unit 26.

[0096] (Operation of the provided system) Figure 6 is a sequence diagram showing the operation of the provided system 1 shown in Figure 2.

[0097] When the electronic device 20 determines that the user is gazing, it transmits a carrier signal (step S41). When the providing device 10 receives the carrier signal, it transmits a response signal (step S42). When the electronic device 20 receives the response signal, it transmits a request signal (step S43). When the providing device 10 receives the request signal, it transmits a unique signal (step S44).

[0098] As described above, in the electronic device 20 according to this embodiment, when the control unit 31 determines that the user is gazing at an object based on the detection result of the sensor unit 28, it presents the user with information based on a signal received by the communication unit 22 from an object in the direction the user is gazing at. For example, the control unit 31 provides information to the user by outputting sound data of the providing device 10 as an object, based on a unique signal received by the directional microphone unit 24. With this configuration, when the user is gazing at the providing device 10, the user can be provided with information about that providing device 10. In other words, the user can be provided with information about the providing device 10 that the user is visually paying attention to. With this configuration, user convenience can be improved. In addition, the possibility of providing the user with information about a providing device 10 that the user is not visually paying attention to can be reduced. As a result, the possibility of the user feeling annoyed can be reduced.

[0099] Therefore, according to this embodiment, an improved technology for providing information to users can be provided.

[0100] Furthermore, in the electronic device 20 according to this embodiment, if the control unit 31 determines that the user is gazing based on the detection result of the sensor unit 28, it may transmit a carrier signal containing the user's identification information via the communication unit 22. By including the user's identification information in the carrier signal, the providing device 10 and the electronic device 20 can include the user's identification information in the ultrasonic signals they transmit and receive. For example, the providing device 10 can include a one-time password as the user's identification information in the response signal and the unique signal. The electronic device 20 can include a one-time password as the user's identification information in the request signal. With this configuration, when ultrasonic signals are transmitted and received between multiple providing devices 10 and multiple electronic devices 20, the possibility of ultrasonic signals becoming confused can be reduced, as will be explained below.

[0101] For example, the providing system 1 includes a plurality of providing devices 10A and 10B as providing devices 10, and a plurality of electronic devices 20A and 20B as electronic devices 20. Furthermore, user 2A of electronic device 20A gazes at providing device 10A, and user 2B of electronic device 20B gazes at providing device 10B. When electronic device 20A determines that user 2A is gazing, it transmits a carrier signal 3A containing user 2A's identification information. When electronic device 20B determines that user 2B is gazing, it transmits a carrier signal 3B containing user 2B's identification information. When providing device 10A receives carrier signal 3A, it stores user 2A's identification information and transmits a response signal 4A containing user 2A's identification information. Also, when providing device 10B receives carrier signal 3B, it stores user 2B's identification information and transmits a response signal 4B containing user 2B's identification information. Here, even if electronic device 20A receives both response signals 4A and 4B, since response signal 4A contains user 2A's identification information, electronic device 20A can transmit request signal 5A as a response to response signal 4A. Similarly, even if electronic device 20B receives both response signals 4A and 4B, since response signal 4B contains user 2B's identification information, electronic device 20B can transmit request signal 5B as a response to response signal 4B. Even if providing device 10A receives both request signals 5A and 5B, since the stored user 2A's identification information matches the user 2A's identification information included in request signal 5A, it can transmit a unique signal 6A to user 2A. Likewise, even if providing device 10B receives both request signals 5A and 5B, since the stored user 2B's identification information matches the user 2B's identification information included in request signal 5B, it can transmit a unique signal 6B to user 2B. Even if electronic device 20A receives both a unique signal 6A containing user 2A's identification information and a unique signal 6B containing user 2B's identification information, it can extract the unique ID of the providing device 10A contained in the unique signal 6A because the unique signal 6A contains user 2A's identification information. In other words, electronic device 20A can provide user 2A with information about the providing device 10A by voice using the unique ID of the providing device 10A.Similarly, even if the electronic device 20B receives both the unique signal 6A and the unique signal 6B, it can provide the user 2B with information about the providing device 10B by voice using the unique ID of the providing device 10B contained in the unique signal 6B.

[0102] Furthermore, in the electronic device 20 according to this embodiment, when the control unit 31 receives a response signal to the carrier signal via the communication unit 22, it may notify the user that it is able to provide information about the providing device 10. Through such notification, the user can learn that it is possible to hear information about the providing device 10 in audio form. If the user wishes to hear information about the providing device 10 in audio form, they continue to gaze at the providing device 10. As long as the user continues to gaze at the providing device 10, communication continues between the providing device 10 and the electronic device 20, and as a result, the electronic device 20 can provide audio about the providing device 10. On the other hand, if the user is not interested in information about the providing device 10, they can move away from the providing device 10 or turn their head away. If the user moves away from the providing device 10, etc., communication will cease between the providing device 10 and the electronic device 20, and as a result, the electronic device 20 will not provide audio about the providing device 10. With this configuration, the user can choose whether or not to receive audio about the providing device 10 based on their own actions. Thus, user convenience can be improved.

[0103] Furthermore, in the electronic device 20 according to this embodiment, the control unit 31 may notify the user that information regarding the providing device 10 is available by vibrating the electronic device 20 with the vibration unit 29. However, some users may find it annoying if the control unit 31 notifies them of the availability of information regarding the providing device 10 with a sound effect each time it receives a response signal to the carrier signal. By notifying the user that information regarding the providing device 10 is available by vibrating the electronic device 20, the possibility of the user finding it annoying can be reduced.

[0104] Furthermore, in this embodiment, communication between the providing device 10 and the electronic device 20 may be acoustic communication. Acoustic communication using ultrasonic signals has a narrower communication range than communication using electromagnetic wave signals. By narrowing the communication range, it is possible to reduce the possibility that the carrier signal will reach other providing devices 10 that the user is not looking at, in addition to the providing device 10 that the user is looking at. As a result, it is possible to reduce the possibility that the electronic device 20 will provide information about the providing device 10 that the user is not looking at by voice.

[0105] Furthermore, in this embodiment, the user's identification information may be a one-time password. By using a one-time password for the user's identification information, the possibility of ultrasonic signals becoming confused when ultrasonic signals are transmitted and received between multiple providing devices 10 and multiple electronic devices 20 can be further reduced.

[0106] In one embodiment, (1) the electronic device is A directional communication unit, A retrieval unit that detects the user's head movements, If the sensor unit determines that the user is gazing at an object based on the detection results of the sensor unit, the control unit provides the user with information based on a signal received by the communication unit from an object in the direction the user is gazing at. It is equipped with.

[0107] (2) In the electronic equipment described in (1) above, If the control unit determines that the user is in a gazing state, it may transmit a carrier signal containing the user's identification information via the communication unit.

[0108] (3) In the electronic equipment described in (1) or (2) above, The control unit may receive a response signal to the carrier signal via the communication unit, and if the response signal includes user identification information, it may notify the user that it is possible to provide information about the providing device.

[0109] (4) In any of the electronic devices described in (1) to (3) above, The electronic device is further equipped with a vibrating part that can vibrate, The control unit may notify the user that it is possible to provide information about the providing device by vibrating the electronic device with the vibrating unit.

[0110] (5) In any of the electronic devices described in (1) to (4) above, The control unit may transmit a request signal via the communication unit to request identification information of the providing device.

[0111] (6) In any of the electronic devices described in (1) through (5) above, When the control unit receives a unique signal containing the user's identification information and the provider's identification information via the communication unit, it may play a sound associated with the provider's identification information.

[0112] (7) In any electronic device described in any one of (1) to (6) above, The communication between the electronic device and the providing device may be acoustic communication.

[0113] (8) In any electronic device described in any one of (1) to (7) above, The user's identification information may be a one-time password.

[0114] (9) In any electronic device described in any one of (1) to (8) above, The electronic device may be attached to the user's head.

[0115] In one embodiment, (10) the providing device is A directional communication unit, When the communication unit receives a carrier signal containing user identification information, the control unit stores the user identification information and transmits a response signal to the carrier signal via the communication unit. It is equipped with.

[0116] In one embodiment, (11) the provided system is An electronic device that, when it is determined that the user is staring based on the detection result of the user's head movement, transmits a carrier signal containing the user's identification information using a directional first communication unit, A providing device that, when the carrier signal is received by a directional second communication unit, stores the user's identification information and transmits a response signal to the carrier signal via the second communication unit, Includes.

[0117] While this disclosure has been described based on the drawings and embodiments, it should be noted that those skilled in the art will find it easy to make various modifications or alterations based on this disclosure. Therefore, it should be noted that these modifications or alterations are within the scope of this disclosure. For example, the functions, etc., included in each functional part can be rearranged in a logically consistent manner. Multiple functional parts, etc., may be combined into one or divided. The embodiments relating to this disclosure described above are not limited to being implemented strictly according to the respective embodiments, but can be implemented by combining features or omitting parts as appropriate. In other words, the contents of this disclosure can be modified and altered in various ways based on this disclosure by those skilled in the art. Therefore, these modifications and alterations are within the scope of this disclosure. For example, in each embodiment, each functional part, each means or each step, etc., can be added to other embodiments in a logically consistent manner, or replaced with each functional part, each means or each step, etc., in other embodiments. Also, in each embodiment, multiple functional parts, each means or each step, etc., can be combined into one or divided. Furthermore, the embodiments of this disclosure described above are not limited to being implemented strictly according to the respective embodiments described, but can also be implemented by combining the features or omitting some of them as appropriate.

[0118] For example, in the embodiments described above, the electronic device 20 was described as a hearable device. However, the electronic device 20 is not limited to a hearable device as long as it can be worn on the user's head and can provide information to the user. As another example, the electronic device 20 may be a glasses-type wearable device. In this case, the electronic device 20 may provide information by displaying text data on the glasses.

[0119] For example, the control unit 31 of the electronic device 20 may receive from an external server the unique ID of the providing device 10 and two or more sound data related to the providing device 10 with respect to that unique ID. In this case, the control unit 31 may store the unique ID of the providing device 10 and the two or more sound data related to the providing device 10 in association with each other in the storage unit 30. The two or more sound data related to the providing device 10 may include a first sound data for providing summary information and a second sound data for providing detailed information. In this case, in the electronic device 20, when the control unit 31 first receives a unique signal containing the unique ID of the providing device 10, it may play the first sound data on the speaker unit 26. By continuing to gaze at the providing device 10, the control unit 31 may receive the unique signal containing the same unique ID again. When the unique signal containing the same unique ID is received again, the control unit 31 may play the second sound data on the speaker unit 26. Here, in the electronic device 20, the control unit 31 may receive a one-time password reset instruction via the input unit 25. If the user wishes to hear the first sound data, they may input a one-time password reset instruction via the input unit 25. When the control unit 31 receives a one-time password reset instruction via the input unit 25 and determines that the user is in a gazing state, it may generate a new one-time password. The control unit 31 may transmit a carrier signal containing the new one-time password via the communication unit 22. With this configuration, the user can hear the first sound data again.

[0120] For example, the control unit 31 of the electronic device 20 may communicate acoustically with two or more providing devices 10 simultaneously. In this case, the control unit 31 may separate acoustic communication with different providing devices 10 by beamforming of the multi-microphone of the microphone unit 24, or by using multiple microphones, each having a different directivity. For example, the control unit 31 may separate acoustic communication with different providing devices 10 in the left-right direction of the electronic device 20.

[0121] For example, the control unit 31 of the electronic device 20 may communicate acoustically with two or more providing devices 10 simultaneously. In this case, the control unit 31 may simultaneously perform notification processing for two or more providing devices 10. When simultaneously performing notification processing for two or more providing devices 10, the control unit 31 may change the sound source localization and volume of the sound effects output from the speaker unit 26 according to the distance from the electronic device 20 to the providing devices 10. The control unit 31 may measure the distance from the electronic device 20 to the providing devices 10 by the intensity of the ultrasonic signal received from the providing devices 10. For example, the control unit 31 may set the volume of sound effects from a providing device 10 that is farther from the electronic device 20 to be lower than the volume of sound effects from a providing device 10 that is closer to the electronic device 20. The control unit 31 may position the sound source localization of sound effects from a providing device 10 that is farther from the electronic device 20 higher above the user than the sound source localization of sound effects from a providing device 10 that is closer to the electronic device 20. With this configuration, the user can orient their head towards the sound source localization of the sound effect of the providing device 10 from which they wish to hear the voice information. The control unit 31 may identify the sound source localization of the sound effect of the providing device 10 from which the user wishes to hear the voice information by detecting the orientation of the user's head with the sensor unit 28. By identifying the sound source localization, the control unit 31 may identify the providing device 10 from which the user wishes to hear the voice information. The control unit 31 may generate and transmit a request signal to the identified providing device 10.

[0122] For example, in the embodiment described above, the providing device 10 was described as an information board. However, the providing device 10 may also be a signboard.

[0123] For example, in the embodiment described above, the providing device 10 was described as being located outdoors. However, the providing device 10 may be located indoors, such as in a museum. In this case, one of the two surfaces of the providing device 10 may have information about the exhibits in the museum. The electronic device 20 may have a dedicated application program for the museum installed. The control unit 31 may download sound information according to this application program. [Explanation of Symbols]

[0124] 1. Provided System 10, 10A, 10B provided devices 11 Communications Department 12 Speaker section 13 Microphone section 14 Storage section 15 Control Unit 20,20A,20B Electronic equipment 21 Communications Department 22 Communications Department 23 Speaker section 24 Microphone section 25 Input section 26 Speaker section 27 Positioning Unit 28. Sensor unit 29 Vibration section 30 Storage section 31 Control Unit 2A, 2B Users 3A,3B carrier signal 4A, 4B response signals 5A,5B request signal 6A,6B unique signal

Claims

1. An electronic device, A directional microphone section and a speaker section, Communications Department and, A retrieval unit that detects the user's head movements, It comprises a control unit and, The control unit, The communication unit receives identification information and sound data of a providing device located within a predetermined range from the position of the electronic device, and associates the received identification information and sound data of the providing device. If the sensor unit determines that the user is gazing at something based on the detection result, and the microphone unit receives identification information of the providing device, which is an object in the direction the user is gazing at, the speaker unit plays a sound corresponding to the received identification information of the providing device. The electronic device is an electronic device in which communication between the electronic device and the providing device is acoustic communication.

2. The electronic device according to claim 1, wherein the control unit determines that the user is in a gazing state, and transmits a carrier signal containing the user's identification information via the communication unit.

3. The electronic device according to claim 2, wherein the control unit receives a response signal to the carrier signal via the communication unit, and if the response signal includes user identification information, it notifies the user that it is possible to provide information about the providing device.

4. The electronic device is further equipped with a vibrating part that can vibrate, The electronic device according to claim 3, wherein the control unit vibrates the electronic device with the vibrating unit to notify the user that it is possible to provide information about the providing device.

5. The electronic device according to claim 3, wherein the control unit transmits a request signal requesting identification information of the providing device via the communication unit.

6. The electronic device according to claim 5, wherein the control unit, when it receives a unique signal including the user's identification information and the providing device's identification information via the communication unit, reproduces a sound associated with the providing device's identification information.

7. The electronic device according to any one of claims 2 to 6, wherein the user identification information is a one-time password.

8. The electronic device is the electronic device according to any one of claims 1 to 6, which is attached to the user's head.

9. A serving system comprising an electronic device and a serving device, The communication between the electronic device and the providing device is acoustic communication. The aforementioned electronic device is A directional microphone section and a speaker section, Communications Department and, A retrieval unit that detects the user's head movements, It comprises a control unit and, The control unit, The communication unit receives identification information and sound data of a providing device located within a predetermined range from the position of the electronic device, and associates the received identification information and sound data of the providing device. A providing system in which, when it is determined that the user is gazing based on the detection result of the sensor unit, and the microphone unit receives identification information of the providing device, which is an object in the direction the user is gazing at, the speaker unit plays a sound associated with the received identification information of the providing device.

Images