Two-way communication method, program, and wearable terminal

By using a directional microphone in the wearable terminal to collect sound from the direction of the wearer's head and sending it first, the problems of howling and sound quality degradation between multiple wearable terminals are solved, and high-quality two-way communication is achieved.

CN121925864APending Publication Date: 2026-04-24FAIRY DEVICES INC +1
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
FAIRY DEVICES INC
Filing Date
2024-08-29
Publication Date
2026-04-24

AI Technical Summary

Technical Problem

In bidirectional communication between multiple wearable devices, there are issues of howling and degraded sound quality, especially due to echo effects caused by delayed sound reproduction and reverberation.

Method used

By using a directional microphone in the wearable terminal to collect sound from the direction of the wearer's head, and prioritizing the recording of these sounds in the storage unit, only sending them to other terminals, the collection and transmission of sound from other directions are suppressed.

Benefits of technology

It effectively suppresses feedback and sound quality degradation, ensuring that necessary sounds are accurately transmitted in two-way communication and improving sound quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121925864A_ABST
    Figure CN121925864A_ABST
Patent Text Reader

Abstract

In bidirectional communication between a plurality of wearable terminals, necessary sounds are transmitted to other wearable terminals. A method according to one embodiment of the present disclosure includes a step of bidirectionally communicating sound between a first wearable terminal including a first microphone, a first storage unit, and a first speaker, and a second wearable terminal including a second microphone, a second storage unit, and a second speaker. The first wearable terminal, in which the sound output by the second speaker or the sound from the direction of the head of the wearer of the second wearable terminal is collected by the first microphone, sets the sound from the direction of the head of the wearer of the first wearable terminal as a sound larger than the other sounds. A step of recording the data in the first storage unit; and a step in which the recorded sound is transmitted to the second wearable terminal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to two-way communication methods, procedures, and wearable terminals. Background Technology

[0002] Previously, a technology for bidirectional audio communication between multiple wearable devices (e.g., web conferencing) was known. For example, Patent Document 1 describes a neckband device equipped with a microphone that wirelessly communicates with a server device in the cloud or other neckband devices.

[0003] <Prior art documents> <Patent Documents> Patent Document 1: Japanese Patent No. 6786139 Summary of the Invention <Problems this disclosure aims to solve> However, in bidirectional communication between multiple wearable terminals (e.g., bidirectional communication between multiple wearable terminals including two wearable terminals (wearable terminal A and wearable terminal B) that are located close to each other in the same meeting room), the following issues arise.

[0004] <Howling> The sound emitted by the wearer of wearable terminal A is transmitted via communication and then reproduced with a delay from the speaker of wearable terminal B. This reproduced sound is picked up by the microphone of wearable terminal A, reproduced with a delay from the speaker of wearable terminal B, then picked up again by the microphone of wearable terminal A, and reproduced with a delay from the speaker of wearable terminal B again, and so on indefinitely, causing a howling sound.

[0005] <Decreased sound quality> The sound emitted by the wearer of wearable device B is not only picked up by the microphone of wearable device B, but also, depending on the physical distance between wearable device A and wearable device B, is delayed and picked up by the microphone of wearable device A. This delay produces reverberation and echo, resulting in a decrease in sound quality.

[0006] Thus, issues arise such as "the problem caused by a wearable terminal receiving and transmitting sound to another wearable terminal for reproduction" and "the problem caused by a wearable terminal receiving and transmitting sound emitted by the wearer of another wearable terminal".

[0007] The purpose of this disclosure is to transmit necessary audio to other wearable devices in bidirectional communication between multiple wearable devices.

[0008] <Methods for solving problems> The method involved in the first aspect of this disclosure includes the following steps: In a system for bidirectional audio communication between a first wearable terminal equipped with a first microphone, a first storage unit, and a first speaker, and a second wearable terminal equipped with a second microphone, a second storage unit, and a second speaker, The sound output by the second speaker or the sound from the direction of the wearer's head in the second wearable terminal is captured by the first microphone of the first wearable terminal. The step of recording the sound from the direction of the wearer's head in the first wearable terminal as a louder sound than any other sound in the first storage unit; and The step of sending the recorded sound to the second wearable terminal.

[0009] According to the first method of this disclosure, it is possible to transmit the necessary sound to other wearable terminals.

[0010] The second aspect of this disclosure, in the method described in the first aspect, includes the following steps: The steps include: if the first wearable terminal does not detect a sound source in the direction of the wearer's head, it either does not send the recorded sound to the second wearable terminal or sends the recorded sound to the second wearable terminal as silent data.

[0011] According to the second method of this disclosure, it is possible to transmit the voice of the wearer of a wearable terminal to other wearable terminals.

[0012] The third aspect of this disclosure, in the method described in the first or second aspect, includes the following steps: The step of the first wearable terminal not sending the recorded sound to the second wearable terminal or sending the recorded sound as silent data to the second wearable terminal when no sound source above a given volume is detected in the direction of the wearer's head.

[0013] According to the third method of this disclosure, it is possible to transmit sounds above a given volume to other wearable terminals.

[0014] The fourth aspect of this disclosure, in any one of the methods from the first to the third aspect, includes the following steps: The step of the first wearable terminal not sending the recorded sound to the second wearable terminal or sending the recorded sound as silent data to the second wearable terminal when no sound source as a human voice is detected in the direction of the wearer's head.

[0015] According to the fourth method of this disclosure, it is possible to send a person's voice to other wearable terminals.

[0016] The fifth aspect of this disclosure, in any one of the methods from the first to the fourth aspect, includes the following steps: The step of the first wearable terminal not sending the recorded sound to the second wearable terminal or sending the recorded sound as silent data to the second wearable terminal when no sound source as a given voiceprint is detected in the direction of the head of the wearer of the first wearable terminal.

[0017] According to the fifth method of this disclosure, it is possible to send the voice of a predetermined person to other wearable terminals.

[0018] The sixth aspect of this disclosure relates to a program used in a system for enabling bidirectional sound communication between a first wearable terminal having a first microphone, a first storage unit, and a first speaker, and a second wearable terminal having a second microphone, a second storage unit, and a second speaker. The sound output by the second speaker or the sound from the direction of the wearer's head in the second wearable terminal is captured by the first microphone, and the first wearable terminal performs the following process: The process of recording the sound from the direction of the wearer's head from the first wearable terminal as a louder sound than any other sound into the first storage unit; The process of sending the recorded sound to the second wearable terminal.

[0019] The seventh aspect of this disclosure relates to a first wearable terminal that performs bidirectional sound communication between a first wearable terminal equipped with a first microphone, a first storage unit, and a first speaker, and a second wearable terminal equipped with a second microphone, a second storage unit, and a second speaker. The first wearable terminal receives sound output from the second speaker or sound from the direction of the wearer's head on the second wearable terminal via the first microphone. It records the sound from the direction of the wearer's head in the first wearable terminal as a louder sound than any other sound in the first storage unit. The recorded sound is sent to the second wearable terminal. Attached Figure Description

[0020] Figure 1 This is a diagram illustrating the overall structure involved in one embodiment of the present disclosure.

[0021] Figure 2 This is an example of a wearable terminal according to one embodiment of the present disclosure.

[0022] Figure 3 This is a diagram used to illustrate the directionality of the microphone of a wearable terminal according to one embodiment of this disclosure.

[0023] Figure 4 This is a diagram illustrating the hardware structure of a wearable terminal according to one embodiment of this disclosure.

[0024] Figure 5 This is a diagram illustrating the hardware structure of a bidirectional communication management device according to an embodiment of the present disclosure.

[0025] Figure 6 This is a functional block diagram of the control unit of a wearable terminal according to one embodiment of the present disclosure.

[0026] Figure 7 This is a sequence diagram of the bidirectional communication process according to one embodiment of the present disclosure. Detailed Implementation

[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0028] <Explanation of Terms> In this specification, "terminal" refers to a terminal used for at least two-way audio communication (e.g., web conferencing) between multiple terminals. For example, a terminal is a wearable terminal equipped with a microphone. Alternatively, a terminal can also be a personal computer equipped with a microphone, or a personal computer connected to one or more microphones, etc.

[0029] <Overall Structure> Figure 1 This is a diagram illustrating the overall structure according to one embodiment of the present disclosure. The two-way communication system 1 includes wearable terminals 10A and 10B (hereinafter collectively referred to as wearable terminal 10), a two-way communication management device 20, and a remote assistive device 30. Additionally, in Figure 1 The following describes the case where there are two wearable terminals 10 and one remote assistive terminal 30, but the number of terminals is not limited to this. These will be explained separately below.

[0030] Wearable Devices Wearable terminal 10 is a terminal equipped with a microphone (hereinafter also referred to as a microphone) used by field workers. For example, wearable terminal 10 is a neckband type terminal. Wearable terminal 10 can send and receive data with bidirectional communication management device 20 via any network.

[0031] Let field worker 11A be the wearer of wearable terminal 10A, and field worker 11B be the wearer of wearable terminal 10B (hereinafter, field workers 11A and 11B are collectively referred to as field worker 11). Let field workers 11A and 11B be located in a place where the reproduced sound of their own wearable terminal or their own voice is picked up by the microphone of another person's wearable terminal (e.g., the same location).

[0032] <<Two-way Communication Management Device>> Two-way communication management device 20 is used to manage multiple terminals (in Figure 1 In this example, the device enables at least two-way audio communication between wearable terminals 10A, 10B, and remote assistive terminal 30. The two-way communication management device 20 consists of one or more computers.

[0033] <<Remote Assistant Terminal>> Remote assistant terminal 30 is a terminal used by remote assistant 31. For example, remote assistant 31 is a person assisting another person at a remote location away from the work site of on-site worker 11. For example, remote assistant terminal 30 is a personal computer. Remote assistant terminal 30 can send and receive data via any network and two-way communication management device 20.

[0034] <Structure of Wearable Terminals> The following is for reference Figure 2 as well as Figure 3 The wearable terminal 10 is described in detail.

[0035] Figure 2 This is an example of a wearable terminal 10 according to one embodiment of this disclosure. For example, the wearable terminal 10 has the following characteristics: Figure 2 The end of that type of neckband. For example, like... Figure 2 As shown, the wearable terminal 10 includes a voice input unit (microphone) 105. Furthermore, as... Figure 2 As shown, the wearable terminal 10 may include an operation unit 104, a sound output unit (speaker) 106, and a camera unit (camera) 107. For details regarding each unit, please refer to... Figure 4 A detailed explanation will follow.

[0036] <<Microphone Directivity>> Here, the directional nature of the microphone function of the wearable terminal 10 will be explained. The microphone function of the wearable terminal 10 is directional. For example, directionality can be achieved using multiple omnidirectional microphones (microphone array), or directional microphones can be used. Figure 2 In the wearable terminal 10, multiple omnidirectional microphones are used to achieve directionality.

[0037] Figure 3 This is a diagram used to illustrate the directionality of the microphone of a wearable terminal according to one embodiment of this disclosure.

[0038] The z-axis is defined as the axis parallel to the wearer's midline passing through the top of their head, with the upper half of the wearer's body designated as positive and the lower half as negative. In other words, the z-axis tilts when the wearer leans. Furthermore, the x-axis is defined as the wearer's left-right direction, and the y-axis as the wearer's front-back direction. Due to the directional nature of the microphone, the wearable terminal 10 can record sound from the positive direction of the z-axis (i.e., the direction in which the wearer speaks) as louder than other sounds.

[0039] <Hardware Structure> The following is for reference Figure 4 To illustrate an example of the hardware structure of the wearable terminal 10, refer to... Figure 5 Here is an example illustrating the hardware structure of the two-way communication management device 20.

[0040] Figure 4 This diagram illustrates the hardware structure of a wearable terminal 10 according to one embodiment of the present disclosure. The wearable terminal 10 may include a control unit (processor) 101, a storage unit (memory) 102, a communication unit 103, an operation unit 104, a voice input unit (microphone) 105, a voice output unit (speaker) 106, a camera unit (camera) 107, and various sensors 108. These will be described separately below.

[0041] The control unit (processor) 101 is a processor that controls the wearable terminal 10. For example, the control unit (processor) 101 is a CPU (Central Processing Unit), GPU (Graphics Processing Unit), etc.

[0042] The storage unit (memory) 102 is a memory that stores arbitrary data.

[0043] The communication unit 103 connects to any network and communicates with other computers (such as the two-way communication management device 20).

[0044] The operation unit 104 includes buttons and the like for field workers 11 to input instructions to the wearable terminal 10.

[0045] The sound input unit (microphone) 105 collects sound. As described above, the sound input unit (microphone) 105 is directional.

[0046] The sound output unit (speaker) 106 outputs sound (e.g., sound acquired from other terminals via the two-way communication management device 20).

[0047] Camera 107 captures still images and moving images.

[0048] The various sensors 108 are one or more arbitrary sensors such as accelerometers and GPS (Global Positioning System).

[0049] Figure 5 This diagram illustrates the hardware structure of a two-way communication management device 20 according to one embodiment of this disclosure. The remote assistant terminal 30 is also applicable. The two-way communication management device 20 may include a control unit (processor) 201, a storage unit (memory) 202, and a communication unit 203. These will be described separately below.

[0050] The control unit (processor) 201 is a processor that controls the bidirectional communication management device 20. For example, the control unit (processor) 201 is a CPU (Central Processing Unit), GPU (Graphics Processing Unit), etc.

[0051] Storage unit (memory) 202 is a memory that stores arbitrary data.

[0052] The communication unit 203 connects to any network and communicates with other computers (wearable terminal 10, remote assist terminal 30, etc.).

[0053] Figure 6 This is a functional block diagram of the control unit 101 of a wearable terminal 10 according to one embodiment of the present disclosure. The control unit 101 of the wearable terminal 10 includes a sound acquisition unit 111, a determination unit 112, and a sound transmission unit 113. The control unit 101 of the wearable terminal 10 functions as the sound acquisition unit 111, the determination unit 112, and the sound transmission unit 113 by executing a program.

[0054] The sound acquisition unit 111 records (stores) the sound "from the direction of the wearer's head on the wearable terminal 10" as louder than "all other sounds" in the storage unit, and records (stores) the "all other sounds" as softer than the sound "from the direction of the wearer's head on the wearable terminal 10" in the storage unit. For example, the sound acquisition unit 111 uses multi-channel sound acquired by multiple omnidirectional microphones (microphone array) to form directional sound, thus creating a single-channel sound.

[0055] In this way, adverse effects caused by the acquisition of sound from the speaker output of other wearable devices or sound from the direction of the head of the wearer of other wearable devices (i.e., sound emitted by the wearer of other wearable devices) can be suppressed.

[0056] The determination unit 112 determines whether the sound recorded in the storage unit by the sound acquisition unit 111 is a valid sound source or an invalid sound source. The following explanation will be divided into two categories: [the case where the sound is determined to be a consistently valid sound source] and [the case where a determination is made regarding whether the sound is a valid or invalid sound source].

[0057] [Case where the sound source is determined to be consistently valid] The determination unit 112 determines the sound from the direction of the wearer's head on the wearable terminal 10 that is recorded in the storage unit by the sound acquisition unit 111 as a always valid sound source.

[0058] [The process of determining whether a sound source is valid or invalid] The determination unit 112 determines whether the sound recorded in the storage unit by the sound acquisition unit 111 is a valid sound source or an invalid sound source. The method for determining whether a sound source is valid or invalid will be explained below. Alternatively, the determination can be made by combining two or more of the following: [directionality + sound source + volume], [directionality + sound source + human voice], and [directionality + sound source + given voiceprint].

[0059] [Directivity + Sound Source] For example, if the determination unit 112 detects a sound source in the direction of the wearer's head on the wearable terminal 10, it determines that the sound recorded in the storage unit is a valid sound source (wherein, the determination unit 112 can estimate the sound source by any method). In this case, it can be designated as a valid sound source only when the wearer makes a sound. On the other hand, if the determination unit 112 does not detect a sound source in the direction of the wearer's head on the wearable terminal 10 (i.e., a sound source is detected outside the direction of the wearer's head on the wearable terminal 10), it determines that the sound recorded in the storage unit is an invalid sound source. Alternatively, the determination unit 112 can also determine that the sound from the direction of the wearer's head on the wearable terminal 10 is a valid sound source when a sound source is detected in the direction of the wearer's head on the wearable terminal 10 and within a certain distance from the microphone.

[0060] [Directivity + Sound Source + Volume] For example, if the determination unit 112 detects a sound source with a volume greater than a given volume in the direction of the wearer's head on the wearable terminal 10, it determines that the sound stored in the storage unit is a valid sound source. In this case, small noises can be excluded, and the sound emitted by the wearer can be designated as a valid sound source. On the other hand, if the determination unit 112 does not detect a sound source with a volume greater than the given volume in the direction of the wearer's head on the wearable terminal 10 (i.e., when a sound source is detected outside the direction of the wearer's head on the wearable terminal 10, or when a sound source with a volume lower than the given volume is detected in the direction of the wearer's head on the wearable terminal 10), it determines that the sound stored in the storage unit is an invalid sound source.

[0061] [Directivity + Sound Source + Human Voice] For example, if the determination unit 112 detects a human voice source in the direction of the wearer's head on the wearable terminal 10, it determines that the sound stored in the storage unit is a valid sound source (wherein, the determination unit 112 can use VAD (Voice Activity Detection) or the like to determine whether it is a human voice). In this case, noise other than human voices can be excluded, and the sound emitted by the wearer can be set as a valid sound source. On the other hand, if the determination unit 112 does not detect a human voice source in the direction of the wearer's head on the wearable terminal 10 (that is, when a sound source other than the wearer's head is detected, or when a sound source other than human voice is detected in the direction of the wearer's head on the wearable terminal 10), it determines that the sound stored in the storage unit is an invalid sound source.

[0062] [Directivity + Sound Source + Given Voiceprint] For example, if the determination unit 112 detects a sound source of a given voiceprint in the direction of the wearer's head of the wearable terminal 10, it determines that the sound stored in the storage unit is a valid sound source. (The determination unit 112 can use a learned model obtained by machine learning, which uses the given voiceprint (specifically, the voiceprint of the wearer of the wearable terminal 10) as learning data, to determine whether the sound is a given voiceprint.) In this case, sounds and noise other than those emitted by the wearer can be excluded, and the sound emitted by the wearer can be designated as a valid sound source. On the other hand, if the determination unit 112 does not detect a sound source of a given voiceprint in the direction of the wearer's head of the wearable terminal 10 (i.e., when a sound source other than the wearer's head is detected, or when a sound source other than the given voiceprint is detected in the direction of the wearer's head of the wearable terminal 10), it determines that the sound stored in the storage unit is an invalid sound source.

[0063] The sound transmitting unit 113 transmits the sound stored in the storage unit to the two-way communication management device 20 (and then the sound is transmitted to other wearable terminals via the two-way communication management device 20). Specifically, the sound transmitting unit 113 transmits the sound that is determined by the determination unit 112 to be a valid sound source to the two-way communication management device 20.

[0064] Furthermore, the sound transmitting unit 113 may also, if it determines that the sound stored in the storage unit is an invalid sound source, either not transmit the sound stored in the storage unit to the two-way communication management device 20 or transmit it as silent data. Specifically, when no sound is transmitted, no data is transmitted (i.e., zero bits), and when the sound is transmitted as silent data, data indicating silence (i.e., zero-continuous data of data length) is transmitted. Alternatively, Gaussian noise data may be used instead of silent data.

[0065] <Signal Processing> The following describes an example of signal processing. The multi-channel sound collected by multiple microphones is divided into two: one becomes directional and serves as channel 1 sound, while the other is used to determine whether it is a valid or invalid sound source.

[0066] If the sound is determined to be a valid sound source, the directional sound from channel 1 is used directly. Additionally, the web conferencing application within the wearable terminal 10 can acquire the directional sound from channel 1 and transmit it to the two-way communication management device 20.

[0067] In cases where a sound source is deemed invalid, the directional 1-channel sound is not used; instead, zero bits (i.e., no sound is transmitted) or zero consecutive data of zero data length (i.e., sound is transmitted as silent data) are used. Furthermore, the web conferencing application within the wearable terminal 10 can acquire the silent data and transmit it to the two-way communication management device 20.

[0068] <Other> In one embodiment of this disclosure, directionality may also be formed only if the sound source is determined to be a valid sound source or an invalid sound source.

[0069] For the wearable terminal 10, the functions involved in this disclosure can be enabled by default (i.e., the function of recording the sound from the direction of the wearer's head as a louder sound than other sounds in the storage unit and sending the recorded sound to other wearable terminals). It can also be enabled when participating in two-way communication such as web conferencing.

[0070] <Handling Method> Figure 7This is a sequence diagram of the bidirectional communication process according to one embodiment of the present disclosure.

[0071] In addition, the microphone of the wearable terminal 10A is directional. Suppose that the microphone of the wearable terminal 10A will collect the sound output by the speaker of the wearable terminal 10B or the sound from the direction of the wearer's head of the wearable terminal 10B (by any method, the wearable terminal 10A can determine whether it is the sound output by the speaker of the wearable terminal 10B or the sound from the direction of the wearer's head of the wearable terminal 10B).

[0072] In step 11 (S11), the wearable terminal 10A stores the sound from the direction of the wearer's head as a louder sound than any other sound in the storage unit.

[0073] In step 12 (S12), the wearable terminal 10A determines whether the sound recorded in the storage unit in S11 is a valid sound source or an invalid sound source. The following explanation will be divided into two categories: [the case where the sound is determined to be a consistently valid sound source] and [the case where the determination is made regarding whether the sound is a valid or invalid sound source].

[0074] [Case where the sound source is determined to be consistently valid] The wearable terminal 10A will determine the sound from the direction of the wearer's head recorded in the storage unit in S11 as a always valid sound source.

[0075] [The process of determining whether a sound source is valid or invalid] The wearable terminal 10A determines whether the sound from the direction of the wearer's head recorded in the storage unit in S11 is a valid sound source or an invalid sound source.

[0076] In step 13 (S13), the wearable terminal 10A transmits the sound stored in the storage unit to the two-way communication management device 20. Specifically, the wearable terminal 10A transmits the sound that was determined to be a valid sound source in S12 to the two-way communication management device 20.

[0077] In addition, if the wearable terminal 10A determines that the sound recorded in the storage unit is an invalid sound source, it may either not send the sound recorded in the storage unit to the two-way communication management device 20 or send it as silent data.

[0078] In steps 14-1 (S14-1) and 14-2 (S14-2), the two-way communication management device 20 will send the sound obtained in S13 (i.e., the sound collected by the wearable terminal 10A) to the wearable terminal 10B and the remote assistant terminal 30.

[0079] When a fixed speaker with a microphone is used as the terminal instead of a wearable terminal, it is difficult to determine the direction of the necessary sound in advance (for example, the positional relationship between the field worker and the fixed speaker with a microphone is fluid). However, when a neckband-type wearable terminal is used as disclosed in this invention, it is possible to determine the sound from the necessary direction in advance, such as the sound from the direction of the wearer's head. Therefore, this is a preferred implementation method.

[0080] The implementation methods have been described above, but it should be understood that various changes in manner and details are possible without departing from the spirit and scope of the claims.

[0081] This international application claims priority based on Japanese Patent Application No. 2023-169463, filed on September 29, 2023, the entire contents of which are incorporated herein by reference.

[0082] Symbol Explanation 1: Two-way communication system 10A: Wearable terminal 10B: Wearable terminal 11A: On-site workers 11B: On-site workers 20: Two-way communication management device 30: Remote Assistant Terminal 31: Remote Supporter 101: Control Unit (Processor) 102: Storage Unit (Memory) 103: Ministry of Communications 104: Operations Department 105: Audio Input Unit (Microphone) 106: Sound output unit (speaker) 107: Camera Department 108: Various Sensors 111: Sound Acquisition Department 112: Judgment Department 113: Voice Transmission Department 201: Control Unit (Processor) 202: Storage Unit (Memory) 203: Ministry of Communications.

Claims

1. A method comprising the following steps: In a system for bidirectional audio communication between a first wearable terminal equipped with a first microphone, a first storage unit, and a first speaker, and a second wearable terminal equipped with a second microphone, a second storage unit, and a second speaker, The sound output by the second speaker or the sound from the direction of the wearer's head in the second wearable terminal is captured by the first microphone of the first wearable terminal. The step of recording the sound from the direction of the wearer's head in the first wearable terminal as a louder sound than any other sound in the first storage unit; and The step of sending the recorded sound to the second wearable terminal.

2. The method according to claim 1, comprising the following steps: The steps include: if the first wearable terminal does not detect a sound source in the direction of the wearer's head, it either does not send the recorded sound to the second wearable terminal or sends the recorded sound to the second wearable terminal as silent data.

3. The method according to claim 1 or 2, comprising the following steps: The step of the first wearable terminal not sending the recorded sound to the second wearable terminal or sending the recorded sound as silent data to the second wearable terminal when no sound source above a given volume is detected in the direction of the wearer's head.

4. The method according to any one of claims 1 to 3, comprising the following steps: The step of the first wearable terminal not sending the recorded sound to the second wearable terminal or sending the recorded sound as silent data to the second wearable terminal when no sound source as a human voice is detected in the direction of the wearer's head.

5. The method according to any one of claims 1 to 4, comprising the following steps: The step of the first wearable terminal not sending the recorded sound to the second wearable terminal or sending the recorded sound as silent data to the second wearable terminal when no sound source as a given voiceprint is detected in the direction of the head of the wearer of the first wearable terminal.

6. A program for causing the first wearable terminal, in a system for bidirectional sound communication between a first wearable terminal having a first microphone, a first storage unit, and a first speaker, and a second wearable terminal having a second microphone, a second storage unit, and a second speaker, to perform the following process when sound output from the second speaker or sound from the direction of the wearer's head of the second wearable terminal is captured by the first microphone: The process of recording the sound from the direction of the wearer's head from the first wearable terminal as a louder sound than any other sound into the first storage unit; The process of sending the recorded sound to the second wearable terminal.

7. A first wearable terminal, in a system for bidirectional sound communication between a first wearable terminal having a first microphone, a first storage unit, and a first speaker, and a second wearable terminal having a second microphone, a second storage unit, and a second speaker, wherein the first wearable terminal receives sound output from the second speaker or sound from the direction of the wearer's head of the second wearable terminal via the first microphone. Sound from the direction of the wearer's head in the first wearable terminal is recorded as a louder sound than any other sound in the first storage unit. The recorded sound is then sent to the second wearable terminal.

Citation Information

Patent Citations

  • Photovoltaic power generation system

    JP2023169463A

  • Voice processing system

    CN105529033A

  • Voice input method and device for wearable equipment

    CN113241077A

  • Sound collection device, program, and method

    JP2019176328A

  • Audio processing system and audio processing method

    JP2022138245A