Information generation method that enables objective improvement of tone quality based on human body shape, and sound data processing device that enables intuitive and easy change of sound impression

By averaging head-related transfer functions and adjusting amplitudes based on listener preferences, the method generates a personalized TRC-I to enhance timbre satisfaction in sound-producing devices, addressing subjective timbre changes and improving listener satisfaction.

JP7725043B2Active Publication Date: 2025-08-19FINAL INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2025516494
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2025-08-19
Estimated Expiration
2043-04-28

AI Technical Summary

Technical Problem

Existing sound-producing devices, such as earphones and headphones, have varying levels of listener satisfaction due to subjective changes in timbre depending on the music piece, as manufacturers set their own desirable TRCs without considering individual listener preferences.

Method used

A method to generate a personalized TRC (TRC-I) by averaging head-related transfer functions (HRTFs) from multiple directions, using a data processing device to calculate an average HRTF that reflects the three-dimensional shape of the listener's body, and adjusting amplitudes based on listener preferences to achieve high timbre satisfaction.

Benefits of technology

The method provides an objective indication of amplitude-frequency characteristics that enhance listener satisfaction by personalizing the sound experience, ensuring high timbre satisfaction across different music pieces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007725043000001
    Figure 0007725043000001
  • Figure 0007725043000002
    Figure 0007725043000002
  • Figure 0007725043000003
    Figure 0007725043000003
Patent Text Reader

Abstract

A system S according to one embodiment of the present invention acquires, in an anechoic chamber, head-related transfer functions (HRTFs) exhibited when sound is emitted in a plurality of sound-emitting directions D toward the head of an individual P, averages the plurality of HRTFs, and calculates, as a TPTRC, a TRC for the individual P for clarifying timbre information of the sound. The system S generates a TPTRC(W) by multiplying the TPTRC by each of different multipliers W, makes the individual P listen to sounds conforming to the TPTRC(W)s and select a preferred sound from among the sounds, and stores the TPTRC(W) selected by the individual P as TPTRCadj. The system S averages the TPTRCadjs respectively stored for a plurality of different individuals P1-Pn to generate a general-purpose TPTRCadj. A sound data processor according to one embodiment of the present invention superimposes the general-purpose TPTRCadj on input sound data and outputs the result to an audio device such as earphones.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to acoustic technology, and more particularly to technology for improving tone quality. [Background technology]

[0002] In sound-producing devices such as earphones, headphones, and speakers, their amplitude-frequency characteristics are commercialized by setting an arbitrary target frequency response. This target frequency response is called the target response (hereinafter referred to as "TR"), and the amplitude-frequency characteristics are called the target response curve (hereinafter referred to as "TRC").

[0003] The TRC of a sound-producing device varies from product to product or manufacturer to manufacturer. For example, widely known TRCs include the Harman TRC proposed by the American company Harman, the free-field TRC derived from sound wave propagation to the human body in a free sound field, and the diffuse-field TRC derived from sound wave propagation to the human body in a diffuse sound field.

[0004] Patent Document 1 is an example of a patent document that discloses a technology using a TRC. In the invention described in Patent Document 1, an audio signal input to a speaker is corrected by a graphic equalizer so that a sound having an amplitude-frequency characteristic according to a TRC selected by a listener from among multiple TRCs is generated. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-224100 Summary of the Invention [Problem to be solved by the invention]

[0006] Regarding the sound quality of sound-producing devices, although manufacturers set their own desirable TRC for each product, it is known that satisfaction with the sound quality, especially the timbre, varies greatly among listeners.

[0007] To solve the above problems, listeners commonly change the amplitude-frequency characteristics using parametric equalizers, graphic equalizers, etc. However, this method results in problems such as varying levels of satisfaction with the timbre depending on the music piece, since the timbre is subjectively changed by the listener.

[0008] In view of the above circumstances, the present invention provides a means for generating a sound with a tone that objectively satisfies a listener. [Means for solving the problem]

[0009] The present invention provides a method for generating information for improving tone quality using individual characteristics, the method comprising the steps of: when sound is emitted from multiple directions into a person's head, identifying a transfer function or information equivalent to the transfer function when the sound reaches the person's ear for each of the multiple directions; and calculating a transfer function or information equivalent to the transfer function by averaging the transfer functions or information equivalent to the transfer functions identified for each of the multiple directions. [Effects of the Invention]

[0010] According to the present invention, information is obtained that objectively indicates the amplitude-frequency characteristics of a tone that brings high satisfaction to a listener. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram for explaining a sound generation direction D in a method according to one embodiment. [Figure 2] FIG. 2 is a flow diagram of a method for generating a TRC-I according to one embodiment. [Figure 3] FIG. 3 is a flow diagram of a method for generating a TRC-I according to one embodiment. [Figure 4]FIG. 4 is a flow diagram of a method for generating a TRC-I according to one embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of the configuration of a sound data processing system according to an embodiment. [Figure 6] FIG. 6 is a diagram illustrating the configuration of a sound generation device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] [First embodiment] A method for generating information for improving timbre using individual characteristics according to the present invention will be described below as Embodiment 1. The method described below provides a TRC (hereinafter referred to as "TRC-I") for generating a sound that provides high timbre satisfaction when heard by a listener.

[0013] The generation of the TRC-I is mainly performed by a data processing device. The data processing device used to generate the TRC-I is, for example, a general-purpose computer. The general-purpose computer includes a memory for storing various data, a processor for performing various data processing in accordance with a program stored in the memory, and an interface for inputting, outputting, or transmitting data to and from an external device. The computer's processor performs data processing in accordance with the program according to this embodiment that is continuously stored in the memory, thereby realizing a system (hereinafter referred to as "system S") that performs the operations (including data processing) described below.

[0014] [First Example] A first example of the first embodiment will be described below. In this example, when sounds are emitted from multiple directions toward the head of an individual P, head-related transfer functions (hereinafter referred to as "HRTFs") of the left and right ears for each of the multiple directions are used to generate TRC-I. Hereinafter, the multiple directions from which sounds are emitted for identifying HRTFs will be collectively referred to as sound generation direction D.

[0015] FIG. 1 is a diagram for explaining the sound production direction D in this embodiment. FIG. 1(A) is a diagram showing a polar coordinate system PCS for defining the sound production direction D. FIG. 1(B) is a diagram of an individual P viewed in the -z direction of the polar coordinate system PCS, i.e., from top to bottom. FIG. 1(C) is a diagram of an individual P viewed in the -x direction of the polar coordinate system PCS, i.e., from the front. The head center point C, which is the midpoint of the line segment connecting the left ear L and right ear R of the individual P, is set as the origin of the polar coordinate system PCS, and the position of the individual P in the polar coordinate system PCS is determined so that the front direction of the individual P is the +x direction of the polar coordinate system PCS and the left direction of the individual P is the +y direction of the polar coordinate system PCS. All of the multiple sound production directions D are directions toward the origin (head center point C). Each of the multiple sound generation directions D is identified by a combination of a horizontal angle Φ (see FIG. 1(B)), which is a counterclockwise angle when viewed from above with the +x direction as the reference (0 degrees), and an elevation angle Θ (see FIG. 1(C)), which is an angle when the +z direction is the reference (0 degrees). Hereinafter, a sound generation direction D with a horizontal angle Φ and an elevation angle Θ will be referred to as a sound generation direction D(Φ, Θ). For example, the sound generation direction D (135 degrees, 30 degrees) shown in FIG. 1 means a direction with a horizontal angle of 135 degrees and an elevation angle of 30 degrees, i.e., a direction from a diagonal upper left rear of individual P toward the center point C of the head.

[0016] In this embodiment, the range of the horizontal angle of the sound producing direction D is 0 degrees to 360 degrees, and the range of the elevation angle of the sound producing direction D is 0 degrees to 120 degrees, but is not limited to this.

[0017] In this embodiment, the horizontal angle resolution and elevation angle resolution of the sound production direction D are both 5 degrees, but this is not limited to this. If the horizontal angle resolution and elevation angle resolution of the sound production direction D are both 5 degrees, the number of sound production directions D is (360÷5)×(120÷5)+1=1729.

[0018] FIG. 2 is a flow diagram of a method for generating a TRC-I according to this embodiment.

[0019] The system S assigns an initial value of 0 to each of a counter H, which is a counter for the horizontal angle, and a counter E, which is a counter for the elevation angle (step S101).

[0020] Next, the system S identifies the HRTFs for each of the left and right ears of the individual P when a sound emitted in an anechoic chamber in a sound direction D (H degrees, E degrees) toward the center point C of the head reaches the ear (step S102). Hereinafter, the HRTF for the left ear will be referred to as "HRTF-L," and the HRTF for the right ear will be referred to as "HRTF-R." Furthermore, the HRTF for the sound direction D (H degrees, E degrees) will be referred to as "HRTF-L(H degrees, E degrees)" or "HRTF-R(H degrees, E degrees)."

[0021] Any known method may be used to identify the HRTF, examples of which are given below, but are not limited to these.

[0022] (1) A method in which a measurement sound is emitted from a real speaker in an anechoic chamber and the HRTF at the entrance of the ear canal is measured using a miniature microphone, a probe microphone, etc. (2) A method of calculating HRTFs through simulation based on the wave equation using a three-dimensional morphological model obtained by scanning or photographing the head and outer ear.

[0023] The system S stores the HRTF-L (H degree, E degree) and HRTF-R (H degree, E degree) identified in step S102 (step S103).

[0024] Next, the system S determines whether the counter H is 355 (step S104). If the counter H is not 355 (step S104; No), the system S adds 5 to the counter H (step S105). Thereafter, the system S repeats the processes from step S102 onwards.

[0025] If counter H is 355 (step S104; Yes), system S assigns an initial value of 0 to counter H (step S106). Next, system S determines whether counter E is 120 (step S107). If counter E is not 120 (step S107; No), system S adds 5 to counter E (step S108). Thereafter, system S repeats the processes from step S102 onwards.

[0026] If the counter E is 120 (step S107; Yes), the system S calculates the average value of the 1729 HRTF-Ls stored in step S103 as an averaged HRTF-L (hereinafter referred to as "HRTF-L"). av The average value of 1729 HRTF-Rs was calculated as the averaged HRTF-R (hereinafter referred to as "HRTF-R"). av ") (step S109).

[0027] In this application, the average value of an HRTF refers to the amplitude-frequency characteristic represented by an HRTF (function formula) averaged with respect to amplitude. Furthermore, in this application, when an HRTF is referred to, it refers to the function formula or the amplitude-frequency characteristic represented by that function formula. In other words, the function formula and the amplitude-frequency characteristic obtained by converting that function formula into the frequency domain are equivalent information, and therefore, no distinction is made between them in this application. Furthermore, in this application, when an HRTF is referred to, it may also refer to an impulse response or step response obtained by converting an HRTF. Since these are also equivalent information to an HRTF, no distinction is made between them in this application.

[0028] The average value calculated by the system S in step S109 is not limited to the arithmetic average value (arithmetic mean value, simple average value), but may be any average value in the broad sense, that is, a reference value that is the same as the reference value calculated using actual values when all values in the target set are assumed to be a certain value. In other words, any of the arithmetic mean value, weighted mean value, geometric mean value (geometric mean value), etc. may be adopted.

[0029] The frequency band to be averaged in step S109 may be changed arbitrarily depending on the purpose, etc. That is, the averaging process may be performed on the entire audible range, or, for example, only on the frequency band from 800 Hz to 12 kHz. At the boundary between the frequency band to be averaged and the frequency band not to be averaged, amplitude smoothing is performed by multiplication with a window function, etc.

[0030] HRTF-L av and HRTF-R av Since HRTF-L is an HRTF that averages HRTFs related to various directions, it cancels the information required for the directional perception of sound, and as a result, it plays the role of a TRC that clarifies the information that affects the timbre recognition of sound. av and HRTF-R av The sound with the superimposed timbre is a sound that brings high satisfaction to the listener, individual P.

[0031] For example, the HRTF-L calculated using a method that does not weight the sound direction D, such as a simple average value, av and HRTF-R av On the other hand, the weighted average calculated using different weights for the sound direction D is used to calculate the HRTF-L. av and HRTF-R av When calculating the HRTF-L av and HRTF-R av gives the listener the directional perception that the sound comes from the direction to which a large weight is assigned.

[0032] Therefore, for example, the HRTF-L calculated by weighted averaging using weights assigned as follows: av and HRTF-R av The sound with the superimposed harmonics provides a high level of satisfaction to the listener P in terms of tone, and also gives the listener the feeling that the sound is coming from the front.

[0033] A weight of "1" is assigned to HRTF-L and HRTF-R where the horizontal angle Φ is within the ranges of 0 to 45 degrees and 315 to 360 degrees. A weight of "-2" is assigned to HRTF-L and HRTF-R with horizontal angles Φ of 90 degrees and 270 degrees. A weight of "-4" is assigned to HRTF-L and HRTF-R with horizontal angles Φ of 135 degrees and 225 degrees. A weight of "-6" is assigned to HRTF-L and HRTF-R with a horizontal angle Φ of 180 degrees. For HRTF-L and HRTF-R where the horizontal angle Φ is within the range of 45 degrees to 315 degrees (excluding 45 degrees, 90 degrees, 135 degrees, 180 degrees, 225 degrees, 270 degrees, and 315 degrees), weights are assigned that are interpolated (for example, linearly interpolated) from the weights assigned to the above 45 degrees, 90 degrees, 135 degrees, 180 degrees, 225 degrees, 270 degrees, and 315 degrees.

[0034] Although the above example is an example in which the weight is varied depending on the horizontal angle, the weight may be varied depending on the elevation angle, or the weight may be varied depending on the combination of the horizontal angle and the elevation angle.

[0035] HRTF-L calculated as above av and HRTF-R av can be used as a new TRC that reflects the three-dimensional shape of the body of individual P and clarifies information that influences the timbre recognition of sound. Therefore, in the following explanation, HRTF-L av and HRTF-R av This is called TPTRC (Timbre Personalized Target Response Curve).

[0036] In the following description, unless otherwise specified, no distinction will be made between data processing relating to the left ear and data processing relating to the right ear.

[0037] The system S stores the TPTRC calculated in step 109 (step S110). The TPTRC stored in this manner is TRC-I in this embodiment.

[0038] [Second Example] A second example of the first embodiment will be described below.

[0039] In the method of this embodiment, multiple amplitude-adjusted TPTRCs (hereinafter referred to as "TPTRC(W)") are prepared by multiplying the amplitude of the TPTRC stored in step S110 of the first embodiment by different multipliers (hereinafter referred to as "multipliers W"), and an individual P is made to listen to sounds obtained by superimposing the TPTRC(W) amplitude-adjusted by the different multipliers W on a sound to be evaluated (for example, the sound of an existing piece of music), and the individual P selects his / her favorite sound from these sounds, and the TPTRC(W) that brings the highest satisfaction to the individual P is identified as TRC-I.

[0040] FIG. 3 is a flow diagram of a method for generating a TRC-I according to this embodiment.

[0041] First, the system S assigns an initial value of 0.5 to a variable w that holds the median value of the candidates for the multiplier W (step S201).

[0042] Next, the system S multiplies the amplitude of TPTRC by (w-0.3), w, and (w+0.3), respectively, to generate three amplitude-adjusted TPTRC(W), namely, TPTRC(0.2), TPTRC(0.5), and TPTRC(0.8) (step S202).

[0043] The frequency band to be subjected to the process of multiplying the amplitude by a multiplier in step S202 (and steps S206, S210, and S214 described below) may be changed arbitrarily depending on the purpose, etc. That is, the multiplier multiplication process may be performed on the entire audible range, or, for example, the multiplier multiplication process may be performed only on the frequency band from 900 Hz to 11 kHz. At the boundary between the frequency band to be multiplied by a multiplier and the frequency band to which the multiplier is not applied, the amplitude is smoothed by multiplication with a window function, etc.

[0044] Next, for each of the TPTRC(0.2), TPTRC(0.5), and TPTRC(0.8) generated in step S202, the system S sequentially outputs sounds obtained by superimposing the TPTRC(W) and the inverse characteristic of the TRC of the sound producing device such as an earphone connected to the system S (hereinafter referred to as "inverse characteristic IP") on the evaluation sound to the sound producing device such as an earphone connected to the system S (step S203). Note that if the TRC of the sound producing device is flat, the superimposition of the inverse characteristic IP is not necessary (the same applies to steps S207, S211, and S215 described below).

[0045] In step S203, individual P listens to the sounds produced by the sound producing device, selects the sound that gives the most satisfaction from the three sounds, and inputs the selection result to system S. System S acquires the selection result input by individual P (step S204).

[0046] The system S assigns the multiplier W (hereinafter referred to as "multiplier W1") used to generate the TPTRC(W) superimposed on the sound corresponding to the selection result acquired in step S204 to a variable w (step S205). For example, if the selection result acquired in step S204 indicates a sound superimposed with TPTRC(0.2), the system S assigns 0.2 to the variable w in step S205.

[0047] Next, the system S multiplies the amplitude of TPTRC by (w-0.2), w, and (w+0.2), respectively, to generate three amplitude-adjusted TPTRC(W) (step S206). For example, if 0.2 is substituted for the variable w in step S205, the system S generates TPTRC(0.0), TPTRC(0.2), and TPTRC(0.4) in step S206.

[0048] Next, for each of the three TPTRC(W) generated in step S206, the system S sequentially outputs a sound in which the TPTRC(W) and the inverse characteristic IP are superimposed on the evaluation sound to a sound generating device such as an earphone connected to the system S (step S207).

[0049] In step S207, individual P listens to the sounds produced by the sound producing device, selects the sound that he or she feels is most satisfying from the three sounds, and inputs the selection result to system S. System S acquires the selection result input by individual P (step S208).

[0050] The system S assigns the multiplier W (hereinafter referred to as "multiplier W2") used to generate the TPTRC(W) superimposed on the sound corresponding to the selection result acquired in step S208 to the variable w (step S209). For example, if the selection result acquired in step S208 indicates a sound superimposed with TPTRC(0.4), the system S assigns 0.4 to the variable w in step S209.

[0051] Next, the system S multiplies the amplitude of TPTRC by (w-0.1), w, and (w+0.1), respectively, to generate three amplitude-adjusted TPTRC(W) (step S210). For example, if 0.4 is substituted for the variable w in step S209, the system S generates TPTRC(0.3), TPTRC(0.4), and TPTRC(0.5) in step S210.

[0052] Next, for each of the three TPTRC(W) generated in step S210, the system S sequentially outputs a sound in which the TPTRC(W) and the inverse characteristic IP are superimposed on the evaluation sound to a sound generating device such as an earphone connected to the system S (step S211).

[0053] In step S211, individual P listens to the sounds produced by the sound producing device, selects the sound that he or she feels is most satisfying from the three sounds, and inputs the selection result to system S. System S acquires the selection result input by individual P (step S212).

[0054] The system S assigns the multiplier W (hereinafter referred to as "multiplier W3") used to generate the TPTRC(W) superimposed on the sound corresponding to the selection result acquired in step S212 to the variable w (step S213). For example, if the selection result acquired in step S212 indicates a sound superimposed with TPTRC(0.3), the system S assigns 0.3 to the variable w in step S213.

[0055] Next, the system S multiplies the amplitude of TPTRC by (w-0.05), w, and (w+0.05), respectively, to generate three amplitude-adjusted TPTRC(W) (step S214). For example, if 0.3 is substituted for the variable w in step S213, the system S generates TPTRC(0.25), TPTRC(0.3), and TPTRC(0.35) in step S214.

[0056] Next, for each of the three TPTRC(W) generated in step S214, the system S sequentially outputs a sound in which the TPTRC(W) and the inverse characteristic IP are superimposed on the evaluation sound to a sound generating device such as an earphone connected to the system S (step S215).

[0057] In step S215, individual P listens to the sounds produced by the sound producing device, selects the sound that he or she feels is most satisfying from the three sounds, and inputs the selection result to system S. System S acquires the selection result input by individual P (step S216).

[0058] The system S determines the TPTRC(W) superimposed on the sound according to the selection result obtained in step S216 as the TPTRC(W) that brings the highest satisfaction to the individual P (hereinafter, "TPTRC adj For example, if the selection result obtained in step S216 indicates a sound with TPTRC(0.35) superimposed, the system S stores the TPTRC(0.35) as TPTRC (step S217). adj The TPTRC stored in this way is adjis TRC-I in this embodiment.

[0059] TPTRC, which is the TRC-I finally obtained in this example adj is a TRC in which the degree of clarity of information that influences the timbre perception of a sound is adjusted according to the preferences of individual P.

[0060] In step S217, the system S is TPTRC adj Instead of storing the multiplier W (for example, "0.35") used to generate the TPTRC(W) superimposed on the sound according to the selection result acquired in step S216, the multiplier W may be stored.

[0061] As described above, in this embodiment, a series of steps (hereinafter referred to as the "sound selection step") is repeated multiple times, in which individual P listens to sounds on which amplitude-adjusted TPTRC(W) obtained by multiplying TPTRC by a predetermined number of different multipliers W is superimposed, and individual P selects one sound from these sounds. In the above example, three sound options are presented to individual P in one sound selection step, but the number may be two or more. However, when there are three options, this is desirable because it reduces the burden on individual P when making a selection and obtains a correct result with high accuracy.

[0062] Also, in the above example, the sound selection procedure is repeated four times, but the number of times may be one or more.

[0063] Furthermore, in the above example, the difference between two adjacent values of the multipliers W used to generate the sound options presented to individual P in the preceding sound selection procedure was assumed to be the same, but the difference between two adjacent multipliers W may be changed arbitrarily as long as the variation in the multipliers W used in the subsequent sound selection procedure is smaller than the variation in the multipliers W used in the preceding sound selection procedure.

[0064] Furthermore, if the multiplier W corresponding to the sound selected in the preceding sound selection procedure differs from the multiplier W corresponding to the sound selected in the subsequent sound selection procedure by more than a predetermined threshold, the system S may return to the preceding sound selection procedure and repeat the subsequent processing.

[0065] Furthermore, it may be possible to confirm whether the sound selection is correct by mixing a sound generated using a multiplier W whose value is different from the multiplier W corresponding to the sound selected in the preceding sound selection procedure with the sound presented to the individual P in the subsequent sound selection procedure. In other words, if a sound generated using a multiplier W whose value is different from the multiplier W corresponding to the sound selected in the preceding sound selection procedure is selected in the subsequent sound selection procedure, it is highly likely that the sound selection was incorrect, and the system S may return to the preceding sound selection procedure and repeat the subsequent processes.

[0066] Furthermore, although the multipliers W used in the above examples are all 1 or less, the range of the multiplier W is not limited to 1 or less, and any multiplier W equal to or greater than 0 may be used.

[0067] In addition, individual P is a TPTRC adj After listening to the superimposed sound for a predetermined time or more, the process according to the flow of FIG. 3 is executed again, and the TPTRC for individual P is adj Updates may be made.

[0068] Furthermore, in the above example, the selection of sounds is made subjectively by the individual P, but the selection of sounds may also be made by the system S based on vital information of the individual P. Examples of vital information include brain waves, heart rate, pulse rate, body temperature, etc., but any type of vital information may be used as long as it is correlated with the satisfaction level of the individual P while listening to the sound.

[0069] In this case, while the system S is producing sounds in steps S203, S207, S211, and S215, it acquires vital information (e.g., brain waves) of the individual P measured by a measuring device (e.g., an electroencephalograph), and instead of acquiring the selection results input by the individual P in steps S204, S208, S212, and S216, it evaluates the level of satisfaction of the individual P based on the acquired vital information, and selects the sound that brought the highest level of satisfaction to the individual P based on the evaluation results.

[0070] When sounds are selected based on vital information, the sounds are selected objectively compared to when the sounds are selected based on the subjective opinion of the individual P, which reduces the burden on the individual P and makes it less likely that an incorrect sound will be selected.

[0071] [Third Example] A third example of the first embodiment will be described below.

[0072] In the method of this embodiment, for each of a plurality of individuals (hereinafter referred to as individuals P1 to Pn, where n is an arbitrary natural number), the average value of the TPTRC stored in step S110 of the first embodiment is identified as TRC-I.

[0073] FIG. 4 is a flow diagram of a method for generating a TRC-I according to this embodiment.

[0074] First, the system S acquires the TPTRC for each of the individuals P1 to Pn (step S301).

[0075] Next, the system S calculates the average value of the amplitude of the TPTRC for each of the acquired individuals P1 to Pn as a general-purpose TPTRC (step S302).

[0076] Next, the system S stores the calculated general-purpose TPTRC (step S303). The general-purpose TPTRC stored in this manner is TRC-I in this embodiment.

[0077] The generic TPTRC is the average of the TPTRCs of multiple individuals, and therefore clarifies the information that influences the timbre perception of sound for a person with an average three-dimensional body shape. Therefore, when an individual without HRTF identification listens to sound with the generic TPTRC superimposed, that individual is likely to experience high satisfaction with the timbre.

[0078] In this embodiment, the TPTRC stored in step S217 of the second embodiment is used instead of the TPTRC stored in step S110 of the first embodiment. adj may be used. In that case, TPTRC adj Average value of (general TPTRC adj ) is identified as TRC-I.

[0079] In this embodiment, the TPTRC (or TPTRC adj ) are averaged. Therefore, the generalized TPTRC (or generalized TPTRC) for only the left or right ear is adj ) and use it as the generalized TPTRC for both ears (or generalized TPTRC adj ) can also be used.

[0080] Furthermore, the system S calculates the HRTF-L for each of the plurality of individuals P1 to Pn after averaging in step S109 of the first embodiment. av or HRTF-L av Instead of averaging the HRTF-L or HRTF-R for each of the multiple individuals P1 to Pn, the generalized TPTRC may be calculated by averaging multiple HRTFs-L or HRTFs-R at once before being averaged in step S109 of the first embodiment.

[0081] [Fourth Example] A fourth example of the first embodiment will be described below.

[0082] In the method of this embodiment, for each of a plurality of individuals (hereinafter referred to as individuals P1 to Pn, where n is any natural number), the correspondence between the three-dimensional shape of the body and the TPTRC is identified using the TPTRC stored in step S110 of the first embodiment and information representing the three-dimensional shape of the individual's body corresponding to that TPTRC, and based on that correspondence, a TPTRC suitable for the individual without HRTF identification is identified as TRC-I.

[0083] In executing this embodiment, first, when the first embodiment is executed, information representing the three-dimensional shape of the body of individual P (hereinafter referred to as "body shape data") is acquired. The body shape data represents at least the three-dimensional shape of the head of individual P, and preferably also represents the three-dimensional shape of the outer ears of individual P. Note that the body shape data may be acquired by any method, such as a method of direct measurement by scanning or a method of calculation based on images obtained by photographing from multiple directions. Note that in step S102 of the first embodiment, if the HRTF is identified by simulation and the three-dimensional shape of the body of individual P is measured or calculated for that purpose, data representing the three-dimensional shape is acquired as body shape data. The system S stores the acquired body shape data of individual P in association with the TPTRC of that individual P.

[0084] When the body shape data and TPTRC are stored in correspondence with each other for each of individuals P1 to Pn, system S performs regression analysis using sample data with the body shape data as the explanatory variable and the TPTRC as the objective variable, and calculates a regression equation.

[0085] As described above, in a state where the regression equation has been calculated, the system S acquires body shape data of an individual (hereinafter referred to as individual X) for whom HRTF identification has not been performed.

[0086] Next, the system S substitutes the acquired body shape data as an explanatory variable into a regression equation to obtain the TPTRC calculated as the objective variable. As a result, the TPTRC suitable for the individual X is obtained. The system S stores the calculated TPTRC as the TPTRC for the individual X.

[0087] In addition, when body shape data and TPTRC for a new individual are obtained, the system S may use the data as sample data to recalculate the regression equation.

[0088] A machine learning model may be used instead of the regression equation used in the above-described method. In this case, the system S constructs or updates the machine learning model for each of the individuals P1 to Pn using training data in which the body shape data is an explanatory variable and the TPTRC is an objective variable.

[0089] Then, the system S substitutes the body shape data of the individual X as an explanatory variable into the machine learning model, and obtains the TPTRC that is output as the objective variable. As a result, the TPTRC suitable for the individual X is obtained. The system S stores the calculated TPTRC as the TPTRC for the individual X.

[0090] As described above, the TPTRC for individual X, determined and stored using a regression equation or machine learning model, is TRC-I in this example.

[0091] In this embodiment, the TPTRC stored in step S217 of the second embodiment is used instead of the TPTRC stored in step S110 of the first embodiment. adj may be used. In that case, the TPTRC appropriate for individual X adj is identified as TRC-I.

[0092] [Fifth Example] A fifth example of the first embodiment will be described below.

[0093] In the method of this embodiment, for each of a plurality of individuals (hereinafter referred to as individuals P1 to Pn, where n is an arbitrary natural number), the TPTRC stored in step S217 of the second embodiment is adj and information representing the three-dimensional shape of the body of the individual P, and based on that correspondence, a TPTRC suitable for the individual P who does not follow the sound selection procedure of the second embodiment is generated. adj is identified as TRC-I.

[0094] In carrying out this embodiment, first, for each of the individuals P1 to Pn, the TPTRC adj When the first embodiment is executed, the body shape data of the individual P is acquired. The system S uses the acquired body shape data of the individual P as the TPTRC of the individual P. adj is stored in association with the multiplier W used to generate the

[0095] With the body shape data and multiplier W associated and stored for each of individuals P1 to Pn, system S performs regression analysis using sample data with the body shape data as an explanatory variable and the multiplier W as a response variable to calculate a regression equation.

[0096] As described above, in the state where the regression equation is calculated, the system S determines the TPTRC according to the method of the first embodiment, but the TPTRC according to the method of the second embodiment is not determined. adj Regarding an individual X whose identification has not been performed, the body shape data of the individual X is acquired.

[0097] Next, the system S substitutes the acquired body shape data as an explanatory variable into the regression equation, and obtains a multiplier W calculated as a response variable. As a result, a multiplier W suitable for the individual X is obtained. The system S multiplies the TPTRC for the individual X by the multiplier W calculated in this way to obtain the TPTRC for the individual X. adj Generate.

[0098] When new body shape data and multiplier W for a new individual are obtained, system S may use the data as sample data to recalculate the regression equation.

[0099] A machine learning model may be used instead of the regression equation used in the above-described method. In this case, the system S constructs or updates the machine learning model for each of the individuals P1 to Pn using training data in which the body shape data is an explanatory variable and the multiplier W is a response variable.

[0100] Then, the system S substitutes the body shape data of the individual X as an explanatory variable into the machine learning model, and obtains a multiplier W that is output as a target variable. As a result, the TPTRC suitable for the individual X is calculated. adj The system S calculates the TPTRC for the individual X. adj Remember.

[0101] The TPTRC for individual X generated and stored using the multiplier W determined using a regression or machine learning model as described above. adj is TRC-I in this embodiment.

[0102] [Second embodiment] An embodiment of a device according to the present invention that generates sound data or produces sound using the TRC-I identified in the first embodiment described above will be described below as a second embodiment. The device described below produces a sound that gives a listener high satisfaction in terms of timbre when listening to it.

[0103] 5 is a diagram illustrating an example of the configuration of a sound data processing system 1 according to this embodiment. The sound data processing system 1 shown in FIG. 5 includes a sound data processing device 11 and a sound generation device 12. The sound data processing device 11 includes a sound data acquisition unit 111 that acquires sound data representing sound from an external device, and a sound data processing unit 112 that performs processing such as superimposing TRC-I on the sound data acquired by the sound data acquisition unit 111. The sound data processing unit 112 outputs the generated sound data to the sound generation device 12.

[0104] The sound data processing device 11 may be a device such as a dedicated module or unit, or may be a general-purpose computer (for example, a server device, a personal computer, a smartphone, etc.). When the sound data processing device 11 is realized by a computer, a processor performs processing such as superimposing TRC-I on sound data in accordance with a program according to this embodiment that is persistently stored in a memory.

[0105] The sound generating device 12 is a device that generates sounds represented by the sound data input from the sound data processing device 11, and may be in the form of earphones, headphones, speakers, or the like.

[0106] The sound data input to the sound data processing device 11 and the sound data output from the sound data processing device 11 to the sound generation device 12 may be either a digital signal or an analog signal. The sound data processing device 11 and the sound generation device 12 convert the digital signal to an analog signal or vice versa as necessary.

[0107] Fig. 6 is a diagram illustrating the configuration of a sound generation device 12 implemented in place of the sound data processing system 1 according to this embodiment. The sound generation device 12 shown in Fig. 6 is a sound generation device incorporating the sound data processing device 11 provided in the sound data processing system 1 shown in Fig. 5. That is, the sound generation device 12 shown in Fig. 6 includes, within its housing, the sound data processing device 11 including a sound data acquisition unit 111 that acquires sound data representing sound from an external device and a sound data processing unit 112 that performs processing such as superimposing TRC-I on the sound data acquired by the sound data acquisition unit 111, and a sound generation unit 113 that generates sound represented by the sound data processed by the sound data processing unit 112.

[0108] [First Example] In this embodiment, the sound data processing unit 112 generates sound data by simply superimposing TRC-I on the input sound data, and outputs the generated sound data.

[0109] According to this embodiment, a sound is generated for the listener according to a TRC obtained by adding together a TRC specific to the sound generating device 12 in FIG. 5 or the sound generating unit 113 in FIG. 6 and TRC-I.

[0110] The frequency band on which the sound data processing unit 112 superimposes the TRC-I may be changed arbitrarily depending on the purpose, etc. That is, the TRC-I may be superimposed over the entire audible range, or, for example, the TRC-I may be superimposed only over a frequency band from 1 kHz to 10 kHz. At the boundary between the frequency band on which the TRC-I is superimposed and the frequency band on which it is not superimposed, amplitude smoothing is performed by multiplication with a window function, etc.

[0111] [Second Example] In this embodiment, the sound data processing unit 112 generates sound data by superimposing the following two amplitude frequency characteristics on the input sound data, and outputs the generated sound data.

[0112] (1) Inverse characteristics of TRC inherent to the sound generating device 12 of FIG. 5 or the sound generating unit 113 of FIG. 6 (2) TRC-I

[0113] According to this embodiment, the inherent TRC of the sound generating device 12 in FIG. 5 or the sound generating unit 113 in FIG. 6 is cancelled, and sounds according to only the TRC-I are generated for the listener.

[0114] In this embodiment, as in the first embodiment, the frequency band on which the sound data processing unit 112 superimposes the amplitude frequency characteristics described above may be changed arbitrarily depending on the purpose or the like.

[0115] [Third Example] In this embodiment, the sound data processing unit 112 generates sound data by superimposing the following three amplitude frequency characteristics on the input sound data, and outputs the generated sound data.

[0116] (1) Inverse characteristics of the inherent TRC of the sound generating device 12 of FIG. 5 or the sound generating unit 113 of FIG. 6 (2) TRC-I (3) A specific TRC selected by the product designer, etc.

[0117] According to this embodiment, the inherent TRC of the sound generating device 12 in FIG. 5 or the sound generating unit 113 in FIG. 6 is cancelled, and a sound is generated for the listener according to a TRC that is the sum of a specific TRC selected by, for example, a product designer and TRC-I.

[0118] In this embodiment, as in the first and second embodiments, the frequency band on which the sound data processing unit 112 superimposes the amplitude frequency characteristics described above may be changed arbitrarily depending on the purpose or the like.

[0119] [Fourth Example] In this example, a TPTRC for individual P identified by the method of the first example of the first embodiment, or a general-purpose TPTRC identified by the method of the third example of the first embodiment, is used. In the explanation of this example, the TPTRC for individual P or the general-purpose TPTRC will be simply referred to as TPTRC.

[0120] In this embodiment, the sound data processing unit 112 acquires a multiplier W that changes in response to the listener's operation, and multiplies the acquired multiplier W by TPTRC to obtain TPTRC(W), which is then superimposed on the input sound data and output.

[0121] The sound data processing device 11 (FIG. 5) or the sound generation device 12 (FIG. 6) is provided with, for example, an operator such as a knob or fader (which may be either a physical operator or a virtual operator) that accepts operation by a listener, and obtains a multiplier W according to the operation performed by the listener on the operator.

[0122] Furthermore, the sound data processing device 11 (FIG. 5) or the sound production device 12 (FIG. 6) may acquire a multiplier W transmitted from an external device, such as a terminal device used by the listener, or a multiplier W input from the device, depending on an operation performed by the listener on the external device.

[0123] According to the sound data processing system 1 (FIG. 5) or the sound generating device 12 (FIG. 6) of this embodiment, the listener can change the multiplier W as desired while listening to the sound being generated.

[0124] In this embodiment, similarly to the first to third embodiments, the frequency band on which the sound data processing unit 112 superimposes the TPTRC(W) may be changed arbitrarily depending on the purpose or the like.

[0125] [Fifth Example] In this embodiment, when a listener listens to music or the like, a multiplier W is selected based on the direct-to-indirect ratio of the sounds emitted in the music or the like, i.e., the ratio of the energy of the direct sound to the energy of the indirect sound, and TCTRC(W) whose amplitude has been adjusted using the selected multiplier W is superimposed on the music or the like and emitted.

[0126] First, a plurality of sounds with different direct-indirect ratios are prepared as evaluation sounds. For each of the evaluation sounds, the TPTRC of individual P is calculated according to the method of the second example of the first embodiment. adj The following is the TPTRC determined using the sound for evaluation of the direct-indirect ratio R. adj TPTRC adj It is represented as (R).

[0127] The sound data processing unit 112 temporarily stores the input sound data when the individual P listens to the sound of a piece of music or the like, and specifies the direct-indirect ratio r of the sound represented by the whole or part of the sound data by a known method. Then, it calculates the TPTRC according to the specified direct-indirect ratio r. adj , i.e., TPTRC adj (r) is superimposed on the temporarily stored sound data, and then the sound data is output.

[0128] In addition, the stored TPTRC adj If the R in (R) is discrete, the sound data processing unit 112 interpolates them to obtain the TPTRC adj (r) may be specified. adjInstead of memorizing (R), memorize the multiplier W corresponding to the direct-indirect ratio R, and multiply TPTRC by the multiplier W corresponding to the direct-indirect ratio r of the sound to be pronounced to get TPTRC. adj (r) may be calculated.

[0129] In this example, the TPTRC of individual P adj Instead, general-purpose TPTRC adj may also be used.

[0130] In this embodiment, similarly to the first to fourth embodiments, the frequency band on which the sound data processing unit 112 superimposes the TPTRC(W) may be changed arbitrarily depending on the purpose or the like. [Explanation of symbols]

[0131] 1...sound data processing system, 11...sound data processing device, 12...pronunciation device, 111...sound data acquisition unit, 112...sound data processing unit, 113...pronunciation unit.

Claims

1. A method for generating information for improving timbre using personal characteristics, comprising: a step of determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; Equipped with In the step of calculating the averaged transfer function or information equivalent to the transfer function, averaging is performed only for a predetermined frequency band. method.

2. A method for generating information for improving timbre using personal characteristics, comprising: a step of determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; Equipped with In the step of identifying the transfer function or information equivalent to the transfer function, the transfer function or information equivalent to the transfer function is identified for each of a plurality of people; In the step of calculating the averaged transfer function or information equivalent to the transfer function, the transfer function or information equivalent to the transfer function identified for each of the plurality of people is averaged to calculate the transfer function or information equivalent to the transfer function. method.

3. a step of multiplying the amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; 3. The method according to claim 1 or 2, comprising:

4. A method for generating information for improving timbre using personal characteristics, comprising: a step of determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function determined for each of the plurality of directions; a step of multiplying the amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; Equipped with In the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, a multiplier is applied only to a predetermined frequency band. method.

5. In the step of calculating the averaged transfer function or information equivalent to the transfer function, a weighted average value is calculated using different weights depending on the angle.

5. The method of any one of claims 1, 2 and 4.

6. A method for generating information for improving timbre using personal characteristics, comprising: a step of determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function determined for each of the plurality of directions; a step of multiplying the amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; Equipped with In the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, for each of a plurality of multipliers equal to or greater than 0, the amplitude-adjusted transfer function or information equivalent to the transfer function is calculated using the multiplier; a step of generating sounds in which the plurality of amplitude-adjusted transfer functions or information equivalent to the transfer functions calculated in the step of calculating the amplitude-adjusted transfer functions or information equivalent to the transfer functions are superimposed, and having a person who hears the sounds select one sound. method.

7. In the step of selecting one sound, the inverse characteristic of the target response curve of the sound generating device used for the sound generation is superimposed on the sound to be generated. The method of claim 6.

8. performing the step of selecting one sound a plurality of times; In each of the steps of selecting one sound, which are performed multiple times, the number of sounds played to the person is set to a predetermined number, and the variation in the multiplier by which the transfer function or information equivalent to the transfer function superimposed on each of the predetermined number of sounds is multiplied is made smaller in the subsequent step than in the preceding step. The method of claim 6.

9. performing the step of selecting one sound a plurality of times; Among the steps of selecting one sound that are performed multiple times, a subsequent step is executed after the person has listened to a sound on which a transfer function or information equivalent to a transfer function has been superimposed on the sound selected in the preceding step for a predetermined period of time or more. The method of claim 6.

10. A method for generating information for improving timbre using personal characteristics, comprising: a step of determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function determined for each of the plurality of directions; a step of multiplying the amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; Equipped with In the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, for each of a plurality of multipliers equal to or greater than 0, the amplitude-adjusted transfer function or information equivalent to the transfer function is calculated using the multiplier; a step of generating a sound in which each of the plurality of amplitude-adjusted transfer functions or information equivalent to the transfer functions calculated in the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function is superimposed, acquiring vital information of a person who listens to the sound, and selecting one sound based on the vital information. method.

11. In the step of selecting one sound, the inverse characteristic of the target response curve of the sound generating device used for the sound generation is superimposed on the sound to be generated. The method of claim 10.

12. A method for generating information for improving timbre using personal characteristics, comprising: a step of determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function determined for each of the plurality of directions; a step of multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; a step of specifying a multiplier corresponding to the three-dimensional shape of a specific person's body using a regression equation or a machine learning model in which information representing the three-dimensional shape of the person's body is an explanatory variable and the multiplier used in the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function is a response variable; Equipped with In the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, the multiplier determined in the step of determining the multiplier is used. method.

13. having each of a plurality of people select the one sound; generating or updating a regression equation or machine learning model for each of the plurality of people using data in which information representing the three-dimensional shape of the body of the person is used as an explanatory variable and a multiplier used to calculate the transfer function or information equivalent to the transfer function superimposed on the sound selected in the step of selecting one sound is used as a response variable; a step of specifying a multiplier according to the three-dimensional shape of a specific person's body using the regression equation or machine learning model generated or updated in the step of generating or updating the regression equation or machine learning model; calculating the amplitude-adjusted transfer function or information equivalent to the transfer function for the particular person using the multiplier determined in the step of determining the multiplier; The method of claim 6.

14. selecting said one sound for each of a plurality of people; generating or updating a regression equation or machine learning model for each of the plurality of people using data in which information representing the three-dimensional shape of the body of the person is used as an explanatory variable and a multiplier used to calculate the transfer function or information equivalent to the transfer function superimposed on the sound selected in the step of selecting one sound is used as a response variable; a step of specifying a multiplier according to the three-dimensional shape of a specific person's body using the regression equation or machine learning model generated or updated in the step of generating or updating the regression equation or machine learning model; calculating the amplitude-adjusted transfer function or information equivalent to the transfer function for the particular person using the multiplier determined in the step of determining the multiplier; The method of claim 10.

15. A method for generating information for improving timbre using personal characteristics, comprising: a step of determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function determined for each of the plurality of directions; a step of multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; A step of determining a direct-indirect ratio, which is a ratio of the energy of direct sound and indirect sound contained in the sound to be pronounced; Equipped with In the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, a multiplier corresponding to the direct-indirect ratio specified in the step of specifying the direct-indirect ratio is used. method.

16. having each of a plurality of people select the one sound; a step of calculating a transfer function or information equivalent to a transfer function obtained by averaging the transfer functions or information equivalent to the transfer functions superimposed on the sounds selected by each of the plurality of people; The method of claim 6.

17. selecting said one sound for each of a plurality of people; a step of calculating a transfer function or information equivalent to a transfer function obtained by averaging the transfer function or information equivalent to the transfer function superimposed on the selected sound for each of the plurality of people; The method of claim 10.

18. A system for generating information for improving tone quality using personal characteristics, When a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, a transfer function or information equivalent to the transfer function is identified for each of the plurality of directions when the sound reaches the person's ear; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; When calculating the averaged transfer function or information equivalent to the transfer function, averaging is performed only for a predetermined frequency band. system.

19. A system for generating information for improving tone quality using personal characteristics, When a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, a transfer function or information equivalent to the transfer function is identified for each of the plurality of directions when the sound reaches the person's ear; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; When identifying the transfer function or information equivalent to the transfer function, the transfer function or information equivalent to the transfer function is identified for each of a plurality of people; When calculating the averaged transfer function or information equivalent to the transfer function, the transfer function or information equivalent to the transfer function is calculated by averaging the transfer function or information equivalent to the transfer function specified for each of the plurality of people. system.

20. A system for generating information for improving tone quality using personal characteristics, When a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, a transfer function or information equivalent to the transfer function is identified for each of the plurality of directions when the sound reaches the person's ear; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; When calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, a multiplier is applied only to a predetermined frequency band. system.

21. A system for generating information for improving tone quality using personal characteristics, When a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, a transfer function or information equivalent to the transfer function is identified for each of the plurality of directions when the sound reaches the person's ear; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; When calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, for each of a plurality of multipliers equal to or greater than 0, calculate the amplitude-adjusted transfer function or information equivalent to the transfer function using the multiplier; A sound is generated in which each of the calculated plural amplitude-adjusted transfer functions or information equivalent to the transfer functions is superimposed, and a person who hears the sound is prompted to select one sound. system.

22. A system for generating information for improving tone quality using personal characteristics, When a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, a transfer function or information equivalent to the transfer function is identified for each of the plurality of directions when the sound reaches the person's ear; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; When calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, for each of a plurality of multipliers equal to or greater than 0, calculate the amplitude-adjusted transfer function or information equivalent to the transfer function using the multiplier; A sound is generated in which each of the calculated multiple amplitude-adjusted transfer functions or information equivalent to the transfer functions is superimposed, vital information of a person who listens to the sound is obtained, and one sound is selected based on the vital information. system.

23. A system for generating information for improving tone quality using personal characteristics, When a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, a transfer function or information equivalent to the transfer function is identified for each of the plurality of directions when the sound reaches the person's ear; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; specifying a multiplier corresponding to the three-dimensional shape of a specific person's body using a regression equation or a machine learning model in which information representing the three-dimensional shape of the person's body is used as an explanatory variable and a multiplier used in the step of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function is used as a response variable; The specified multiplier is used when calculating the amplitude-adjusted transfer function or information equivalent to the transfer function. system.

24. A system for generating information for improving tone quality using personal characteristics, When a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to predetermined resolution angles within a predetermined horizontal angle range and a plurality of elevation angles determined according to predetermined resolution angles within a predetermined elevation angle range toward a person's head, a transfer function or information equivalent to the transfer function is identified for each of the plurality of directions when the sound reaches the person's ear; calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; Identify the direct-indirect ratio, which is the ratio of the energy of direct sound to indirect sound contained in the sound produced, When calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, a multiplier corresponding to the specified direct-to-indirect ratio is used. system.

25. On the computer, A program for executing a process for generating information for improving tone quality using personal characteristics, A process for determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to a predetermined resolution angle within a predetermined horizontal angle range and a plurality of elevation angles determined according to a predetermined resolution angle within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; a process of calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; Execute In the process of calculating the averaged transfer function or information equivalent to the transfer function, averaging is performed only for a predetermined frequency band. Program for.

26. On the computer, A program for executing a process for generating information for improving tone quality using personal characteristics, A process for determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to a predetermined resolution angle within a predetermined horizontal angle range and a plurality of elevation angles determined according to a predetermined resolution angle within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; a process of calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; Execute In the process of identifying the transfer function or information equivalent to the transfer function, the transfer function or information equivalent to the transfer function is identified for each of a plurality of people; In the process of calculating the averaged transfer function or information equivalent to the transfer function, the transfer function or information equivalent to the transfer function specified for each of the plurality of people is averaged to calculate the transfer function or information equivalent to the transfer function. Program for.

27. On the computer, A program for executing a process for generating information for improving tone quality using personal characteristics, A process for determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to a predetermined resolution angle within a predetermined horizontal angle range and a plurality of elevation angles determined according to a predetermined resolution angle within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; a process of calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; a process of multiplying the amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; Execute In the process of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, a multiplier is multiplied only for a predetermined frequency band. Program for.

28. On the computer, A program for executing a process for generating information for improving tone quality using personal characteristics, A process for determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to a predetermined resolution angle within a predetermined horizontal angle range and a plurality of elevation angles determined according to a predetermined resolution angle within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; a process of calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; a process of multiplying the amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; Execute In the process of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, for each of a plurality of multipliers equal to or greater than 0, the amplitude-adjusted transfer function or information equivalent to the transfer function is calculated using the multiplier; A sound is generated in which each of the plurality of amplitude-adjusted transfer functions or pieces of information equivalent to the transfer functions calculated in the process of calculating the amplitude-adjusted transfer function or pieces of information equivalent to the transfer function are superimposed, and a person who hears the sound is allowed to select one sound. Program for.

29. On the computer, A program for executing a process for generating information for improving tone quality using personal characteristics, A process for determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to a predetermined resolution angle within a predetermined horizontal angle range and a plurality of elevation angles determined according to a predetermined resolution angle within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; a process of calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; a process of multiplying the amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; Execute In the process of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, for each of a plurality of multipliers equal to or greater than 0, the amplitude-adjusted transfer function or information equivalent to the transfer function is calculated using the multiplier; A sound is generated in which each of the plurality of amplitude-adjusted transfer functions or information equivalent to the transfer functions calculated in the process of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function is superimposed, vital information of a person who listens to the sound is acquired, and one sound is selected based on the vital information. Program for.

30. On the computer, A program for executing a process for generating information for improving tone quality using personal characteristics, A process for determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to a predetermined resolution angle within a predetermined horizontal angle range and a plurality of elevation angles determined according to a predetermined resolution angle within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; a process of calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; a process of multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; A process of specifying a multiplier corresponding to the three-dimensional shape of a specific person's body using a regression equation or a machine learning model in which information representing the three-dimensional shape of the person's body is used as an explanatory variable and a multiplier used in a process of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function is used as a response variable. Execute In the process of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, the multiplier specified in the process of specifying the multiplier is used. Program for.

31. On the computer, A program for executing a process for generating information for improving tone quality using personal characteristics, A process for determining a transfer function or information equivalent to a transfer function when a sound is emitted from a plurality of directions determined by a combination of a plurality of horizontal angles determined according to a predetermined resolution angle within a predetermined horizontal angle range and a plurality of elevation angles determined according to a predetermined resolution angle within a predetermined elevation angle range toward a person's head, when the sound reaches the person's ear in each of the plurality of directions; a process of calculating a transfer function or information equivalent to a transfer function by averaging the transfer function or information equivalent to the transfer function identified for each of the plurality of directions; a process of multiplying an amplitude in the amplitude-frequency characteristic represented by the averaged transfer function or information equivalent to the transfer function by a multiplier of 0 or more to calculate an amplitude-adjusted transfer function or information equivalent to the transfer function; A process for determining the direct-indirect ratio, which is the ratio of the energy of direct sound and indirect sound contained in the sound being pronounced; Execute In the process of calculating the amplitude-adjusted transfer function or information equivalent to the transfer function, a multiplier according to the specified direct-indirect ratio is used in the process of specifying the direct-indirect ratio. Program for.

Citation Information

Patent Citations

  • Method and apparatus for forming stereophonic image

    JP1995248255A

  • Automatic sound field correction system and sound field correction method

    JP2001224100A

  • Coefficient calculation device for head-related transfer function interpolation, sound localizer, coefficient calculation method for head-related transfer function interpolation and program

    JP2010171785A

  • Systems and methods for improving audio virtualization

    US20200322727A1