Adjustment device, method, and program

The system adjusts sound output devices based on environmental and conversational partner information, addressing the limitations of existing noise cancellation technologies by customizing sound parameters for improved user experience.

JP2025157796APending Publication Date: 2025-10-16CASIO COMPUTER CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024060036
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-03
Publication Date
2025-10-16

AI Technical Summary

Technical Problem

Existing sound output devices struggle to adjust volume, strength, and hearing characteristics to suit the user's actual environment and conversational partner, as they primarily focus on canceling external noise based on location information, neglecting individual preferences and environmental nuances.

Method used

A system comprising a sound output device, an adjustment device, and a server that acquires location and conversational partner information to adjust sound output parameters, allowing users to select icons representing environmental and interpersonal settings to customize sound amplification levels for specific frequency bands.

Benefits of technology

Enables the sound output device to adapt to the user's actual usage environment and conversational partner, ensuring clear audio by amplifying or muting specific frequency bands based on environmental and interpersonal parameters, enhancing user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025157796000001_ABST
    Figure 2025157796000001_ABST
Patent Text Reader

Abstract

To provide an adjustment device capable of adjusting a sound output device so as to adapt to a user's actual usage environment.SOLUTION: An adjustment device 20 includes a position information acquisition unit 260 configured to acquire position information, and a control unit 210. When a request is made by a user, the control unit 210 determines an adjustment value for adjusting a sound output device from an environmental parameter based on external noise associated with the position information acquired by the position information acquisition unit 260, and adjusts the sound output device based on the adjustment value.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an adjustment device, a method, and a program. [Background technology]

[0002] For a user of a sound output device to understand spoken language in a real environment, the sound output device needs to be adjusted to suit the environment and the subject of the conversation. For example, Patent Document 1 discloses a technology for setting processing parameters based on a noise cancellation signal that is generated according to the user's position information and that cancels out external noise. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2019-164357 Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology disclosed in Patent Document 1, processing parameters are automatically changed to cancel out external noise according to the user's current location information. However, simply canceling out external noise makes it difficult to adjust the audio output device to achieve the volume, strength, and hearing characteristics of the sound that are preferable for the user at the current location.

[0005] The present invention has been made in view of the above-mentioned circumstances, and aims to provide an adjustment device, method, and program that can adjust a sound output device to adapt to the user's actual usage environment. [Means for solving the problem]

[0006] In order to achieve the above object, one aspect of the adjustment device according to the present invention is to a location information acquisition unit that acquires location information; A control unit; Equipped with The control unit determining an adjustment value for adjusting the sound output device from an environmental parameter based on external noise, the environmental parameter being linked to the location information acquired by the location information acquisition unit; The sound output device is adjusted based on the adjustment value. [Effects of the Invention]

[0007] According to the present invention, it is possible to adjust a sound output device so that it can be adapted to the user's actual usage environment. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a sound output device adjustment system according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram illustrating an example of user parameters according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of a sound output device according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional configuration of an adjustment device according to an embodiment. [Figure 5] FIG. 2 illustrates an example of a functional configuration of a server according to an embodiment. [Figure 6] 10 is a flowchart illustrating a procedure of an adjustment process according to an embodiment. [Figure 7] FIG. 4 is a diagram illustrating an example of environmental parameters according to the embodiment. [Figure 8] FIG. 4 is a diagram illustrating an example of environmental parameter registration data according to the embodiment. [Figure 9] FIG. 10 is a diagram illustrating an example of interpersonal parameters according to the embodiment. [Figure 10] 10 is a flowchart illustrating a procedure for environmental parameter acquisition processing according to the embodiment. [Figure 11] 10 is a flowchart illustrating a procedure for interpersonal parameter setting processing according to the embodiment. [Figure 12] FIG. 10 is a diagram showing an example of interpersonal parameter registration data according to the embodiment. [Figure 13] 10 is a flowchart illustrating a procedure for interpersonal parameter utilization processing according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] The adjustment device and the like according to the embodiment will be described with reference to the drawings, in which the same or corresponding parts are designated by the same reference numerals.

[0010] The adjustment device 20 according to the embodiment is a device that, when a user (a user of a sound output device) feels the need for adjustment while using the sound output device, adjusts the sound output device according to adjustment parameters for the sound output device associated with the icon by the user selecting an icon (option) on the screen of the display unit 230. This allows the sound output device to be adjusted to suit the user's actual usage environment.

[0011] 1, a sound output device adjustment system 100 according to an embodiment includes a sound output device 10, an adjustment device 20, and a server 30. The sound output device 10 and the adjustment device 20 are connected for communication via Bluetooth (registered trademark), for example. The adjustment device 20 is connected to the server 30 via the Internet, Wifi (registered trademark), a wireless LAN (Local Area Network), for example.

[0012] The adjustment device 20 displays a parameter adjustment screen 231 including a plurality of icons, for example, as shown in Fig. 1. When the user selects an icon, the user parameters of the sound output device 10 are adjusted using the adjustment parameters associated with the icon. The user parameters are, for example, the amplification levels for specific frequency bands (for example, frequency bands centered around 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, 4 kHz, and 8 kHz) as shown in Fig. 2.

[0013] The parameter adjustment screen 231 of the adjustment device 20 shown in FIG. 1 displays a date and time and a plurality of icons under the title "Adjustment of Sound Output Device Setting Values," with an "Environmental Settings" icon arranged in the upper row and an "Interaction Partner" icon arranged in the lower row. For example, an icon indicating an interior room labeled "quiet" and an icon of a car labeled "noisy" are arranged as "Environmental Settings" icons in the upper row. Furthermore, an icon indicating the face of a person labeled "high-pitched voice" and an icon of a person labeled "low-pitched voice" are arranged as "Interaction Partner" icons in the lower row. Note that the icons displayed on the parameter adjustment screen 231 are not limited to these.

[0014] The sound output device 10 according to this embodiment is a device for outputting sound, such as a hearing aid or a sound collector, and is a small wearable device that is earphone-type and attached to the user's ear canal as shown in Fig. 1. Note that the sound output device 10 may be of any type other than an ear canal insertion type, such as an ear hook type. As shown in Fig. 3, the sound output device 10 has, as its functional configuration, a control unit 110, a storage unit 120, a sound input unit 130, a sound output unit 140, and a communication unit 150.

[0015] The control unit 110 is configured with a processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The control unit 110 executes programs stored in the storage unit 120 to perform various processes for operating the sound output device 10. For example, the control unit 110 performs processing such as amplification on sound data acquired by the sound input unit 130 based on the adjustment value of the sound output device 10, and causes the sound output unit 140 to output sound using the processed data. In addition, for example, the control unit 110 performs processing such as storing sound information (such as information on the voltage of a microphone) acquired by the sound input unit 130 in the storage unit 120 and transmitting the stored sound information to the adjustment device 20 via the communication unit 150.

[0016] The storage unit 120 stores programs executed by the control unit 110 and necessary data. The storage unit 120 may include, but is not limited to, a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, etc. The storage unit 120 may be provided inside the control unit 110. The adjustment values ​​received by the control unit 110 from the adjustment device 20 via the communication unit 150 are stored in the storage unit 120. Based on these adjustment values, the sound output device 10 adjusts the sound to be output (processing such as amplification).

[0017] The sound input unit 130 includes a microphone, an A / D (Analog / Digital) converter, and the like, and acquires ambient sounds. Note that the sound input unit 130 may acquire not only values ​​obtained by A / D converting ambient sound information, but also voltage values ​​constantly occurring in the microphone. The control unit 110 then continues to record these values ​​acquired by the sound input unit 130 (digital values ​​and voltage values ​​obtained by A / D converting the sound acquired by the microphone) in a ring buffer (sound information ring buffer) in the storage unit 120 at a predetermined sampling frequency (e.g., 44.1 kHz). The size of the ring buffer is arbitrary, but in this embodiment, the ring buffer is set to be capable of storing data for a sound information storage period (e.g., approximately 10 seconds).

[0018] Sound output unit 140 includes a D / A (Digital / Analog) converter, a speaker, etc., and outputs ambient sound adjusted based on the adjustment value by control unit 110. More specifically, control unit 110 amplifies the digital data of sound acquired by sound input unit 130 (data acquired from sounds around the user and converted from analog to digital) based on the adjustment value (such as the amplification degree of each frequency band), and outputs it from sound output unit 140.

[0019] The communication unit 150 is a communication interface for transmitting and receiving data between the sound output device 10 and the adjustment device 20 via Bluetooth (registered trademark). By communicating with the adjustment device 20 via the communication unit 150, the sound output device 10 receives, for example, an adjustment value from the adjustment device 20, or transmits sound information recorded in a ring buffer in the storage unit 120 to the adjustment device 20. However, the communication standard supported by the communication unit 150 is not limited to Bluetooth (registered trademark), and may be a wireless communication interface compatible with wireless LAN or the like.

[0020] Furthermore, the adjustment device 20 according to the embodiment is, for example, a smartphone, and includes, as its functional configuration, a control unit 210, a memory unit 220, a display unit 230, an operation input unit 240, a communication unit 250, and a location information acquisition unit 260, as shown in FIG. 4.

[0021] The control unit 210 is configured with a processor such as a CPU, etc. The control unit 210 executes an environmental parameter acquisition process, an adjustment process, etc., which will be described later, using a program stored in the storage unit 220.

[0022] The storage unit 220 stores programs executed by the control unit 210 and necessary data. The storage unit 220 may include, but is not limited to, RAM, ROM, flash memory, etc. The storage unit 220 may be provided inside the control unit 210. The display unit 230 includes a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display.

[0023] The operation input unit 240 is a user interface such as a push button switch or a touch panel integrated with the display unit 230, and receives operation input from the user. The control unit 210 can acquire what kind of operation input the user has performed based on the detection results of a tap operation on the touch panel or the pressed state of a switch.

[0024] The communication unit 250 is a communication interface that enables the adjustment device 20 to communicate data with the sound output device 10 and external devices (e.g., other smartphones, tablets, PCs (Personal Computers)), and to acquire information from the Internet. The communication unit 250 may include a wireless communication interface for communicating via, for example, Bluetooth (registered trademark) or wireless LAN.

[0025] The location information acquisition unit 260 is a location measurement means for acquiring the current location of the user holding the adjustment device 20, and may include, for example, a GPS (Global Positioning System).

[0026] The server 30 according to the embodiment includes, as functional components, a control unit 310, a storage unit 320, and a communication unit 330, as shown in FIG.

[0027] The control unit 310 is configured with a processor such as a CPU, etc. The control unit 310 executes various processes such as sending and receiving environmental parameter registration data (described later) and storing it in the storage unit 320, using programs stored in the storage unit 320.

[0028] The storage unit 320 stores programs executed by the control unit 310 and necessary data. The storage unit 320 may include, but is not limited to, RAM, ROM, flash memory, etc. The storage unit 320 may be provided inside the control unit 310.

[0029] The communication unit 330 is a communication interface that allows the server 30 to communicate data with the adjustment device 20, external devices, etc., and to acquire information from the Internet. The communication unit 330 may include a wireless communication interface for communicating via Bluetooth (registered trademark) or wireless LAN, for example. The server 30 may also include a display unit for displaying various data and an operation input unit for receiving operation input from the user.

[0030] In the following, the control unit 110 of the sound output device 10 will be referred to as a sound output device control unit, the control unit 210 of the adjustment device 20 will be referred to as an adjustment device control unit or simply as a control unit, and the control unit 310 of the server 30 will be referred to as a server control unit. Also, the communication unit 150 of the sound output device 10 will be referred to as a sound output device communication unit, the communication unit 250 of the adjustment device 20 will be referred to as a sound output device adjustment device communication unit or simply as a communication unit, and the communication unit 330 of the server 30 will be referred to as a server communication unit. Furthermore, the storage unit 120 of the sound output device 10 will be referred to as a sound output device storage unit, the storage unit 220 of the adjustment device 20 will be referred to as an adjustment device storage unit, and the storage unit 320 of the server 30 will be referred to as a server storage unit.

[0031] The sound output device 10 according to the present embodiment adjusts the amplification of the sound output from the sound output device 10 in accordance with the user parameters shown in FIG. 2. The amplification value in the sound output device 10 is expressed as a hearing level (hereinafter referred to as HL) for measuring a hearing level, and is set so that 0 dB corresponds to normal hearing. The HL adjustment environment is a quiet environment, and the sound volume in that environment is approximately 30 dB across all frequency bands. However, if the sound volume in a frequency band of external noise (ambient noise level) is louder than 30 dB (a large dB value), the sound that the user originally wanted to hear for that frequency band will be canceled out by the sound of the external noise. For this reason, the sound output device 10 amplifies the sound by an amount corresponding to an increase in the dB value of the external noise in that frequency band, based on the value of the user parameters. This allows the user to hear the necessary sound even when the external noise in that frequency band is loud.

[0032] However, it is cumbersome to acquire external noise at the user's current location each time and amplify the user parameters of the sound output device 10 in accordance with the level of the external noise. Therefore, in this embodiment, when the user feels the need for adjustment while using the sound output device 10, the user selects an icon on the parameter adjustment screen 231 displayed on the display unit 230 of the adjustment device 20, and the sound output device 10 is adjusted according to the environmental parameters and interpersonal parameters linked to the icon.

[0033] First, it is assumed that the sound output device 10 and the adjustment device 20 are paired in advance. Then, when the power of the sound output device 10 is turned on, the adjustment device 20 connects to the sound output device 10 via the communication unit 250. When the user feels that an adjustment is necessary while using the sound output device 10, the user operates the sound output device 10 by tapping an operator such as an icon associated with the parameter adjustment screen 231 displayed on the adjustment device display unit. This causes the adjustment device control unit to execute a program stored in the adjustment device storage unit and perform adjustment processing.

[0034] The procedure of the environment adjustment process will be described below with reference to the flowchart shown in Fig. 6. The adjustment device control unit determines whether or not location information is available (step S101). This location information is the user's current location information, and is location information acquired by the location information acquisition unit 260 of the adjustment device 20.

[0035] If the use of location information is enabled in advance in the adjustment device 20 (step S101; YES), the adjustment device control unit acquires the location information (step S102). On the other hand, if the use of location information is disabled in advance in the adjustment device 20 (step S101; NO), the adjustment device control unit proceeds to step S105.

[0036] The adjustment device control unit acquires the environmental parameter registration data 221 stored in the adjustment device storage unit, and determines whether the location information acquired in step S102 has been registered (step S103). The environmental parameters are acquired by the sound input unit 130 of the sound output device 10 of external noise in the surrounding environment when the user is using the sound output device 10, and are expressed as the loudness (noise level) of sound for each specific frequency band (for example, frequency bands centered around 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, 4 kHz, and 8 kHz) as shown in Fig. 7.

[0037] The environmental parameter registration data 221 is data that associates date and time, acquisition location, and environmental parameters, as shown in FIG. 8, for example. The date and time is the date and time when the environmental parameters were acquired, and is shown in FIG. 8 as year, month, day, hour, and minute. The acquisition location is location information at which the environmental parameters were acquired, for example, location information acquired by the location information acquisition unit 260 of the adjustment device 20. Furthermore, the environmental parameters are expressed as the loudness (noise level) of external noise acquired by the sound input unit 130 of the sound output device 10, as described above, for each specific frequency band. Note that in FIG. 8, the location information is the latitude and longitude acquired from the location information acquisition unit 260, and the environmental parameters are the loudness of sound for each specific frequency band. However, to avoid complication if all of these were listed, the location information is listed as "Location 1," "Location 2," etc., and the environmental parameters are listed as "Environment 1," "Environment 2," etc.

[0038] Furthermore, even if the location information is the same, the environmental data differs depending on the date and time of acquisition. In this case, even if the location information is the same, the environmental parameters at that date and time are registered in the environmental parameter registration data 221. For example, in FIG. 8, the acquisition location is the same, "Location 2," at the dates and times "2023 / 12 / 1 17:10" and "2023 / 12 / 15 11:40." However, since the environmental data differs depending on the date and time, "Environment 2" and "Environment 3" are registered as the environmental data, respectively.

[0039] Also, it is assumed that the storage unit 320 of the server 30 stores server environment parameter registration data 321 that associates time, location of arrival, and environment parameters, similar to the environment parameter registration data 221.

[0040] If the location information acquired in step S102 is not registered in the environmental parameter registration data 221 (step S103; NO), the adjustment device control unit proceeds to step S105. If the location information acquired in step S102 is already registered in the environmental parameter registration data 221 (step S103; YES), the adjustment device control unit acquires the corresponding environmental parameters from the environmental parameter registration data 221 and sets them as initial values ​​(step S104).

[0041] Next, the adjustment device control unit requests the user to select one of the "environmental settings" icons and one of the "conversational partner" icons on the parameter adjustment screen 231 displayed on the adjustment device display unit (step S105). For example, on the parameter adjustment screen 231 of the adjustment device 20 shown in FIG. 1, an icon showing an interior room labeled "quiet" and an icon of a car labeled "noisy" are arranged as "environmental settings" icons. Furthermore, an icon showing the face of a person labeled "high-pitched voice" and an icon of a person labeled "low-pitched voice" are arranged as "conversational partner" icons. The user selects one of the "environmental settings" icons labeled "quiet" or "noisy" and one of the "conversational partner" icons labeled "high-pitched voice" or "low-pitched voice" depending on the current environment and the conversational partner.

[0042] The adjustment device control unit determines whether the user has selected any of the "Environmental Settings" icons and any of the "Dialogue Partner" icons (step S106). If the user has not selected any of the "Environmental Settings" icons and any of the "Dialogue Partner" icons (step S106; NO), the adjustment device control unit calculates adjustment values ​​for the user parameters according to the environmental parameters set as initial values ​​in step S104, and sets the adjustment values ​​in the sound output device 10 (step S107). In detail, first, the adjustment device control unit calculates adjustment values ​​for the user parameters according to the environmental parameters set as initial values ​​in step S104. The adjustment device control unit transmits the calculated adjustment values ​​to the sound output device 10 via the communication unit 250. The sound output device 10 receives the adjustment values ​​via the communication unit 150. The control unit 110 of the sound output device 10 amplifies each frequency band according to the adjustment values.

[0043] Also, assume that in step S105, the user selected the "noisy" icon in "environment settings" and the "high-pitched voice" icon in "conversational partner." In this case, since the user selected the "environment settings" icon and the "conversational partner" icon (step S106; YES), the adjustment device control unit confirms with the user whether or not they wish to use environmental parameters and interpersonal parameters, which are parameters related to the conversational partner (step S108). For example, a confirmation message and selection buttons for YES and NO are displayed on the display unit 230 of the adjustment device 20. If the user selects the NO button, the adjustment device control unit determines that the user does not wish to select parameters (step S108; NO).

[0044] The adjustment device control unit acquires the environmental parameter registration data 221 stored in the adjustment device storage unit and interpersonal parameters linked to the "conversational partner" icon on the parameter adjustment screen 231 (step S109). The interpersonal parameters are obtained by acquiring the voice of the other party with whom the user conversed while using the sound output device 10 using the sound input unit 130 of the sound output device 10, and represent the loudness (noise level) of the sound for each specific frequency band (for example, frequency bands centered around 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, 4 kHz, and 8 kHz) as shown in FIG.

[0045] The adjustment device control unit determines adjustment values ​​for the user parameters according to the environmental parameters and interpersonal parameters of the acquired environmental parameter registration data 221, and sets them in the sound output device 10 (step S107). For example, if the user selects the "noisy" icon in "environment settings" and the "high-pitched voice" icon in "conversational partner" in step S105, in a noisy environment, the parts of the frequency band of the conversational partner's voice that are quieter than the frequency band of the environmental parameters are amplified so that they become louder than the values ​​of the environmental parameters. Note that in a quiet environment, the parts of the frequency band of the conversational partner's voice that are louder are adjusted so that they become muted in accordance with the values ​​of the environmental parameters.

[0046] Also, in step S108, for example, a confirmation message and YES or NO selection buttons are displayed on the display unit 230 of the adjustment device 20. If the user selects the YES button, the adjustment device control unit determines that the user wishes to select a parameter (step S108; YES). The adjustment device control unit determines whether or not the location information is available (step S110). If the use of location information has been disabled in advance in the adjustment device 20 (step S110; NO), the adjustment device control unit executes steps S109 and S107.

[0047] Furthermore, if the use of location information is enabled in advance in the adjustment device 20 (step S110; YES), the adjustment device control unit executes an environmental parameter acquisition process (step S111). The procedure of the environmental parameter acquisition process will be described below with reference to the flowchart shown in FIG.

[0048] In FIG. 10, the adjustment device control unit acquires previous location information (step S201). The previous location information is the location information at the time when an adjustment value was previously set for the user parameter. The adjustment device control unit acquires the location information acquired in step S102 of FIG. 6. The adjustment device control unit determines whether the location information has been updated (step S202) to confirm whether the current location is different from the previous location. In detail, the adjustment device control unit acquires the current location information and compares it with the location information acquired in step S201. If there is no difference between the two, the adjustment device control unit determines that the location information has not been updated (step S202; NO) and ends the environmental parameter acquisition process.

[0049] If there is a difference between the two, the adjustment device control unit determines that the location information has been updated (step S202; YES) and determines whether the server 30 is available (step S203). If the adjustment device 20 and the server 30 are not connected via a network, the adjustment device control unit determines that the server 30 is unavailable (step S203; NO) and determines whether the environmental parameter registration data 221 is stored in the adjustment device storage unit (step S204).

[0050] If the adjustment device storage unit stores the environmental parameter registration data 221 (step S204; YES), the adjustment device control unit reads the environmental parameters from the environmental parameter registration data 221 (step S205) and ends the environmental parameter acquisition process. If the adjustment device storage unit does not store the environmental parameter registration data 221 (step S204; NO), the adjustment device control unit causes the sound output device 10 to acquire external noise at the current position (step S206). Specifically, the adjustment device control unit causes the sound input unit 130 of the sound output device 10 to acquire external noise at the current position and continues recording the acquired external noise in a ring buffer (sound information ring buffer) in the storage unit 120 at a predetermined sampling frequency (e.g., 44.1 kHz) for a sound information storage period (e.g., approximately 10 seconds).

[0051] The adjustment device control unit acquires data on external noise from the sound output device 10 and calculates environmental parameters (step S207). The adjustment device control unit determines whether the server 30 is available (step S208). If the adjustment device 20 and the server 30 are not connected via a network, the adjustment device control unit determines that the server 30 is unavailable (step S208; NO), and stores the environmental parameters calculated in step S207 in the adjustment device storage unit (step S209). In detail, the adjustment device control unit stores the environmental parameters calculated in step S207 in the adjustment device storage unit as environmental parameter registration data 221, in association with the location information and the date and time when the location information was acquired.

[0052] Furthermore, if the adjustment device 20 and the server 30 are connected via a network, the adjustment device control unit determines that the server 30 is available (step S208; YES), and stores the environmental parameters calculated in step S207 in the server storage unit (step S210). Specifically, the adjustment device control unit stores the environmental parameters calculated in step S207 in association with the location information and the date and time when the location information was acquired as server environment parameter registration data 321 in the server storage unit.

[0053] Furthermore, in step S203, if the adjustment device 20 and the server 30 are connected via a network, the adjustment device control unit determines that the server 30 is available (step S203; YES). The server control unit obtains the location information and the date and time when the location information was obtained from the adjustment device control unit, and determines whether or not they are registered in the server environment parameter registration data 321 of the server storage unit (step S211).

[0054] If there is no registration in the server environment parameter registration data 321 of the server storage unit (step S211; NO), the server control unit causes the sound output device 10 to acquire external noise (step S206). The server control unit causes the adjustment device control unit to execute steps S207 to S210.

[0055] If the server environment parameter registration data 321 in the server storage unit has the registration (step S211; YES), the server control unit acquires the environment parameters from the server environment parameter registration data 321 (step S212). The server control unit ends the environment parameter acquisition process.

[0056] Returning to Fig. 6, the adjustment device control unit determines adjustment values ​​for the user parameters according to the environmental parameters acquired in the environmental parameter acquisition process in step S110, and sets the adjustment values ​​in the sound output device 10 (step S112).

[0057] The adjustment device control unit executes interpersonal parameter setting processing (step S113). The procedure of the interpersonal parameter setting processing will be described below with reference to the flowchart shown in FIG. 11. The adjustment device control unit acquires calendar information stored in the adjustment device storage unit (step S301). The adjustment device control unit determines whether or not the current date and time data on the calendar contains information about a contact person (step S302).

[0058] If there is no information about the other person (step S302; NO), the adjustment device control unit causes the sound output device 10 to acquire the voice of the other person (step S303). In detail, the adjustment device control unit causes the sound input unit 130 of the sound output device 10 to acquire the voice of the other person and to continue recording it in a ring buffer (sound information ring buffer) in the storage unit 120 at a predetermined sampling frequency (for example, 44.1 kHz) for a sound information storage period (for example, about 10 seconds).

[0059] The adjustment device control unit acquires data on the voice of the person in front of the other person from the sound output device 10 and calculates interpersonal parameters (step S304). The interpersonal parameters represent the volume of the voice for each specific frequency band (for example, frequency bands centered around 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, 4 kHz, and 8 kHz) as shown in Fig. 9.

[0060] The adjustment device control unit determines adjustment values ​​for the user parameters according to the acquired interpersonal parameters and adjusts the sound output device 10 (step S305). The adjustment device control unit stores the interpersonal parameters in the adjustment device storage unit in association with the interpersonal person (step S306). In detail, the adjustment device control unit stores the interpersonal parameters in the adjustment device storage unit in association with the interpersonal person as in the interpersonal parameter registration data 222 shown in FIG. 12. As described above, the interpersonal parameters represent the loudness of the voice for each specific frequency band (for example, frequency bands centered around 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, 4 kHz, and 8 kHz) as shown in FIG. 9. Since listing all of them would be cumbersome, in FIG. 12 the interpersonal parameters are described as "person 1," "person 2," etc. to identify individuals.

[0061] Furthermore, in step S302, if there is information about the contact person in the data of the current date and time on the calendar (step S302; YES), the adjustment device control unit determines whether there is an interpersonal parameter for the contact person (step S307).

[0062] If the interpersonal parameter registration data 222 does not contain the interpersonal parameters of the contact person (step S307; NO), the adjustment device control unit executes steps S303 to S306. On the other hand, if the interpersonal parameter registration data 222 contains the interpersonal parameters of the contact person (step S307; YES), the adjustment device control unit reads the interpersonal parameters of the contact person from the interpersonal parameter registration data 222 (step S308).

[0063] The adjustment device control unit executes interpersonal parameter use processing (step S309). The procedure of the interpersonal parameter use processing will be described below with reference to the flowchart shown in Fig. 13. The adjustment device control unit obtains adjustment values ​​for the user parameters according to the interpersonal parameters of the other party acquired in step S307 of Fig. 11, and adjusts the sound output device 10 (step S401).

[0064] The adjustment device control unit determines whether the scheduled meeting time with the contact person has passed based on the current date and time data on the calendar (step S402). If the scheduled meeting time with the contact person has not passed (step S402; NO), the adjustment device control unit repeats step S402. If the scheduled meeting time with the contact person has passed (step S402; YES), the adjustment device control unit causes the sound output device 10 to acquire the voice of the contact person in order to confirm whether the meeting has ended (step S403). In detail, the adjustment device control unit causes the sound input unit 130 of the sound output device 10 to acquire the voice of the contact person and continues to record the voice in a ring buffer (sound information ring buffer) in the storage unit 120 at a predetermined sampling frequency (for example, 44.1 kHz) for a sound information storage period (for example, approximately 10 seconds).

[0065] The adjustment device control unit determines whether the face-to-face time with the face-to-face person has ended based on whether the voice frequency of the face-to-face person acquired by the sound input unit 130 matches the voice frequency of the face-to-face person to be met (step S404). It is assumed that the acquired voice frequency of the face-to-face person matches the voice frequency of the face-to-face person to be met. In this case, it is determined that the face-to-face time with the face-to-face person has not ended (step S404; NO), and the adjustment device control unit repeats step S403. It is also assumed that the acquired voice frequency of the face-to-face person does not match the voice frequency of the face-to-face person to be met. In this case, it is determined that the face-to-face time with the face-to-face person has ended (step S404; YES), and the adjustment device control unit ends the interpersonal parameter use process.

[0066] Returning to FIG. 11, the adjustment device control unit acquires the voice data of the interpersonal partner acquired in step S403 of FIG. 13, and calculates interpersonal parameters (step S310). The adjustment device control unit stores the interpersonal parameters in the adjustment device storage unit in association with the interpersonal partner (step S306). In detail, the adjustment device control unit stores the interpersonal parameters in the adjustment device storage unit in association with the interpersonal partner, as in the interpersonal parameter registration data 222 shown in FIG. 12. The adjustment device control unit ends the interpersonal parameter setting process. Returning to FIG. 6, the adjustment device control unit ends the adjustment process.

[0067] Through the above-described adjustment process, environmental parameter acquisition process, interpersonal parameter setting process, and interpersonal parameter utilization process, when the user feels the need for adjustment while using the sound output device 10, the user can select an icon on the screen of the display unit 230, thereby adjusting the sound output device 10 according to the adjustment parameters of the sound output device 10 linked to the icon. This allows the adjustment device 20 to adjust the sound output device 10 so as to adapt it to the user's actual usage environment.

[0068] (Other variations) The division of roles between the control unit 110 of the sound output device 10 and the control unit 210 of the adjustment device 20 in each of the above-described processes is not limited to the division of roles shown in the above-described embodiment, and can be freely changed. For example, in the embodiment, each step of the adjustment process may be executed by the control unit 110 of the sound output device 10, and the sound output device 10 may be adjusted without the adjustment device 20 (only by the sound output device 10).

[0069] Furthermore, in the above-described embodiment, the adjustment device 20 calculates an adjustment value for adjusting the sound output device 10 in accordance with an environmental parameter or an interpersonal parameter, but the calculated adjustment value may be further adjusted by a user through the operation input unit 240 of the adjustment device 20. Furthermore, the adjustment value for adjusting the sound output device 10 may be input by a user through the operation input unit 240.

[0070] Furthermore, in the above embodiment, the interpersonal parameters are stored in storage unit 220 of adjustment device 20, but they may also be stored in storage unit 320 of server 30.

[0071] In addition, in the above-described embodiment, the server environment parameter registration data 321 is stored in the memory unit 320 of the server 30, but the server environment parameter registration data 321 may store only the user's own environment parameters, or may store the environment parameters of other users together.

[0072] Furthermore, in the above embodiment, the sound output device 10 is described as being connected to the adjustment device 20 wirelessly, but the sound output device 10 and the adjustment device 20 may be connected by wire.

[0073] Furthermore, in the above-described embodiment, the icons displayed on the parameter adjustment screen 231 displayed on the adjustment device display unit are "quiet" and "noisy" icons for "environmental settings," and "high-pitched voice" and "low-pitched voice" icons for "conversational partner." The number and content of the icons displayed on the parameter adjustment screen 231 are not limited to this, and may be any. For example, a "normal" icon may be placed between the "quiet" and "noisy" icons for "environmental settings." Furthermore, a "normal voice" icon may be placed between the "high-pitched voice" and "low-pitched voice" icons for "conversational partner."

[0074] The sound output device 10 can also be realized by a computer such as a wearable device that can output sound to the user's ears that can be adjusted to suit each user. The adjustment device 20 is not limited to a smartphone, and can also be realized by a computer such as a tablet or PC that can acquire sound data acquired by the sound input unit 130 of the sound output device 10. For example, a computer that can execute the above-mentioned processes can be configured by storing and distributing the programs executed by the control unit 110 of the sound output device 10 and the control unit 210 of the adjustment device 20 on a computer-readable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), DVD (Digital Versatile Disc), MO (Magneto-Optical disc), memory card, or USB memory, and reading and installing the programs into a computer.

[0075] Furthermore, the program may be superimposed on a carrier wave and applied via a communication medium such as the Internet. For example, the program may be posted and distributed on a bulletin board system (BBS) on a communication network. The program may then be started and executed under the control of an operating system (OS) in the same way as other application programs, thereby enabling the above-described processes to be performed.

[0076] In addition, the control unit 110 of the sound output device 10 and the control unit 210 of the adjustment device 20 may be configured by any single processor such as a single processor, multiprocessor, or multicore processor, or may be configured by combining any of these processors with processing circuits such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field-Programmable Gate Array).

[0077] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to such specific embodiments, and the present invention includes the inventions described in the claims and their equivalents. [Explanation of symbols]

[0078] 10...sound output device, 20...adjustment device, 30...server, 100...sound output device adjustment system, 110, 210, 310...control unit, 120, 220, 320...storage unit, 130...sound input unit, 140...sound output unit, 150, 250, 330...communication unit, 221...environmental parameter registration data, 222...interpersonal parameter registration data, 230...display unit, 231...parameter adjustment screen, 240...operation input unit, 260...location information acquisition unit, 321...server environmental parameter registration data

Claims

1. a location information acquisition unit that acquires location information; A control unit; Equipped with The control unit determining an adjustment value for adjusting the sound output device from an environmental parameter based on external noise, the environmental parameter being linked to the location information acquired by the location information acquisition unit; adjusting the sound output device based on the adjustment value; Adjustment device.

2. The control unit When a user is having a conversation with a person, an adjustment value for adjusting the sound output device is calculated from interpersonal parameters associated with the person and based on the voice of the person; adjusting the sound output device based on the adjustment value; The adjustment device according to claim 1 .

3. Further comprising a storage unit, The control unit If the environmental parameters are not stored in the storage unit or an external server, the sound output device acquires external noise; determining the environmental parameters based on the acquired external noise; 3. The adjusting device according to claim 1 or 2.

4. Further comprising a storage unit, The control unit If the interpersonal parameters are not stored in the storage unit, the sound output device acquires the voice of the person. determining the interpersonal parameters based on the acquired voice of the interperson; The adjusting device according to claim 2 .

5. A method performed by a coordinating device, comprising: determining an adjustment value for adjusting the sound output device from an environmental parameter based on external noise, the environmental parameter being linked to the location information acquired by a location information acquisition means for acquiring location information; adjusting the sound output device based on the adjustment value; method.

6. On the computer, A process of calculating an adjustment value for adjusting the sound output device from an environmental parameter based on external noise, which is linked to the location information acquired by a location information acquisition means that acquires the location information; a process of adjusting the sound output device based on the adjustment value; A program to execute.

Citation Information

Patent Citations

  • Terminal device, headphone system, and external headphone control method by means of noise cancellation mode

    JP2019164357A