Information processing methods, information processing programs, information processing systems, and information processing servers

Abstract

To provide an information processing device, an information processing method, and an information processing program that appropriately utilize a head-related transfer function.SOLUTION: An information processing method according to the present disclosure includes: acquiring a head-related transfer function corresponding to a user (S11); transmitting the head-related transfer function corresponding to the user to a server (S13); acquiring a first acquisition address corresponding to the head-related transfer function corresponding to the user from a cloud server 100 (S15, S16); and providing a second application 30 to which the head-related transfer function corresponding to the user is provided with the first acquisition address for the application to acquire the head-related transfer function from the cloud server (S17).SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure Information processing methods, information processing programs, information processing systems, and information processing servers relates to. Specifically, it relates to the use of the head transfer function.

Background Art

[0002] By using a head transfer function that mathematically represents how sound travels from a sound source to the ear, a technique for stereoscopically reproducing sound images in headphones and the like is utilized.

[0003] Since there are large individual differences in the head transfer function, it is desirable to use a head transfer function generated for each individual when using it. For example, a technique is known in which a three-dimensional digital model of the head (hereinafter referred to as "3D model") is generated based on an image of the user's auricle, and the head transfer function of the user is calculated from the generated 3D model.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] According to the prior art, since the head transfer function calculated individually for each user can be used for information processing, the localization feeling of the sound image can be enhanced.

[0006] However, the conventional technology described above does not always allow for the appropriate use of the head-related transfer function (HMF) calculated for each user. For example, users may desire flexible use of their HMF, such as applying their HMF to multiple applications installed on their smartphone, not just a single application (such as a music playback app). Furthermore, adjusting the HMF according to the actual usage situation and the audio equipment used by the user can enhance the sense of realism and provide more accurate localization. However, conventional technology merely calculates the HMF for each user and does not allow the user to flexibly utilize the HMF or change the way the HMF is used according to the situation.

[0007] Therefore, this disclosure proposes an information processing device, an information processing method, and an information processing program that can appropriately utilize head-related transfer functions. [Means for solving the problem]

[0008] To solve the above problems, one form of information processing method according to this disclosure acquires a head transfer function corresponding to a user, transmits the head transfer function corresponding to the user to a server, acquires a first acquisition address corresponding to the head transfer function corresponding to the user from the server, and provides the first acquisition address to an application to which the head transfer function corresponding to the user is provided, for the application to acquire the head transfer function from the server.

[0009] Furthermore, in order to solve the above problems, one form of information processing device according to the present disclosure includes an acquisition unit that acquires a head transfer function corresponding to a user and an identifier associated with the head transfer function; a determination unit that determines whether the identifier associated with the head transfer function matches an identifier that identifies the equipment used by the user; and a setting unit that sets the head transfer function to be activated when the identifier associated with the head transfer function matches the identifier that identifies the equipment used by the user. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows an information processing system according to an embodiment of the present disclosure. [Figure 2] This is a conceptual diagram showing the overall flow of information processing according to the embodiment. [Figure 3] This figure shows an example configuration of a user terminal according to the embodiment. [Figure 4] This figure shows an example of a BRIR table according to the embodiment. [Figure 5] This figure shows an example of a parameter table according to the embodiment. [Figure 6] This is a flowchart (1) showing the information processing procedure according to the embodiment. [Figure 7] This is a flowchart (2) showing the information processing procedure according to the embodiment. [Figure 8] This is a flowchart (3) showing the information processing procedure according to the embodiment. [Figure 9] This is a flowchart (4) showing the information processing procedure according to the embodiment. [Figure 10] This is a conceptual diagram illustrating the use of head-side transfer functions in modified cases. [Figure 11] This is a hardware configuration diagram showing an example of a computer that implements the functions of an information processing device. [Modes for carrying out the invention]

[0011] Embodiments of this disclosure will be described in detail below with reference to the drawings. In each of the following embodiments, the same parts will be denoted by the same reference numerals to avoid redundant descriptions.

[0012] This disclosure will be explained in the order of the items shown below. 1. Embodiment 1-1. Configuration of the Information Processing System According to the Embodiment and an Example of Information Processing 1-2. Configuration of the Information Processing Device According to the Embodiment 1-3. Procedure of information processing according to the embodiment 2. Variation 2-1. Mode of the information processing system 2-2. Mode of sound source playback 2-3. Use of parameters 2-4. Mode of the device 3. Other embodiments 4. Effects of the information processing apparatus according to the present disclosure 5. Hardware configuration

[0013] (1. Embodiment) [1-1. Configuration of the information processing system according to the embodiment and an example of information processing] First, using FIGS. 1 and 2, the configuration of the information processing system 1 according to the present disclosure and an overview of the information processing executed by the information processing system 1 will be described. FIG. 1 is a diagram showing the information processing system 1 according to the embodiment of the present disclosure. The information processing according to the embodiment of the present disclosure is realized by the information processing system 1 shown in FIG. 1. As shown in FIG. 1, the information processing system 1 includes a user terminal 10, headphones 50, a cloud server 100, and a service server 200. Each device included in the information processing system 1 communicates with each other using a wired or wireless network not shown. Note that the number of each device constituting the information processing system 1 is not limited to that shown in the figure.

[0014] The user terminal 10 is an example of the information processing apparatus according to the present disclosure, and is an information processing terminal that executes information processing using a head-related transfer function (hereinafter, may be referred to as HRTF (Head-Related Transfer Function)). The user terminal 10 is realized by, for example, a smartphone having a photographing function.

[0015] The headphones 50 are an example of an acoustic device used by the user. For example, the headphones 50 have a communication function such as Bluetooth (registered trademark) and establish wireless communication with the user terminal 10. Then, the headphones 50 output sound and the like transmitted from the user terminal 10 according to the user's operation.

[0016] The cloud server 100 calculates the HRTF (Head-Related Transfer Function) corresponding to each user and provides the calculated HRTF to the user terminal 10. The cloud server 100 acquires images of the user's ears from the user terminal 10 via the network and calculates the user's HRTF based on the acquired images.

[0017] The service server 200 is a server device that provides sound sources such as music to the user terminal 10. For example, the service server 200 provides streaming sound sources to the user terminal 10 via the network, in accordance with the control of a music playback application or the like installed on the user terminal 10.

[0018] As described above, the user terminal 10 performs information processing using HRTF. HRTF represents changes in sound caused by surrounding objects, including the shape of the human auricle (outer ear) and head, as a transfer function. Generally, measurement data for determining HRTF is obtained by measuring acoustic signals using a microphone or dummy head microphone worn inside the human ear.

[0019] For example, HRTF used in technologies such as 3D audio is often calculated using measurement data acquired with dummy head microphones or the average value of measurement data acquired from many people. However, since HRTF varies greatly from person to person, it is desirable to use the user's own HRTF to achieve more effective sound effects. In other words, by replacing a general HRTF with the user's own HRTF, it is possible to provide the user with a more immersive sound experience.

[0020] One example of a method for calculating an individual user's HRTF is to calculate the user's HRTF from an image of the user's ear shape. For example, the cloud server 100 acquires an image including the shape of the user's ear taken by the user terminal 10, and calculates the individual user's HRTF based on the acquired image. The cloud server 100 then sends the calculated HRTF to the user terminal 10. This allows the user terminal 10 to play sounds with 3D sound reproduction using the individual user's HRTF, or to play immersive videos.

[0021] However, there are several challenges to implementing the above method. For example, the user terminal 10 runs applications that have the function of sending and managing HRTFs (hereinafter simply referred to as "apps"), as well as apps developed by various companies, such as apps for music playback and apps for video playback. In this case, for example, due to OS (Operating System) limitations, it may not be possible to exchange HRTF data between the app that manages HRTFs and the music playback app, etc.

[0022] Furthermore, even if HRTF data can be exchanged, there is a possibility that it may not be used appropriately. For example, HRTF can be calculated regardless of the audio equipment (headphones 50, etc.) actually used by the user, but in order to achieve more effective sound effects, it is desirable to use it in conjunction with variables (parameters) such as output values ​​matched to the impedance of the equipment and delay time based on the shape of the output section of the equipment. However, due to OS limitations, it is difficult for the cloud server 100 or the app that manages HRTF to control the usage when a user uses a music playback app, etc. Therefore, there is a risk that HRTF may be used in a manner not intended by the cloud server 100 or the app that manages HRTF.

[0023] As described above, there are various challenges regarding HRTFs, such as flexibly utilizing HRTFs across multiple applications and appropriately utilizing HRTFs according to the user's environment and device status. The user terminal 10 according to the embodiment solves the above challenges through the information processing of the disclosure described below. Below, an overview of the information processing related to the disclosure will be explained in a step-by-step manner using Figures 1 and 2.

[0024] As shown in Figure 1, the user terminal 10 has the first application 20 and the second application 30 installed. The first application 20 is, for example, an application provided by a service provider that manages the cloud server 100. The first application 20 has functions such as taking images including the user's ear, sending the captured images to the cloud server 100, and managing HRTFs sent from the cloud server 100.

[0025] In the information processing according to the embodiment, first, the first application 20 takes an image including the user's ear in accordance with the user's operation and acquires the image including the ear (step S1). Subsequently, the first application 20 sends the image including the ear to the cloud server 100 (step S2). The first application 20 may perform preprocessing before sending the image to the cloud server 100, such as detecting the image of the user's ear included in the image and cropping the detected ear image from the image.

[0026] The cloud server 100 acquires the image transmitted from the user terminal 10. Then, the cloud server 100 calculates the user's HRTF from the image (step S3). Various methods may be employed by the cloud server 100 to calculate the HRTF. For example, the cloud server 100 may calculate the HRTF using a model that has been trained to output an HRTF corresponding to the ear when a 2D image including an image of the ear is input. Alternatively, the cloud server 100 may generate a 3D model of the user's head from a 2D image including an image of the ear, and calculate the HRTF from the generated 3D model. In the following description, the HRTF calculated according to an individual user may be referred to as personal HRTF to distinguish it from a general HRTF.

[0027] The cloud server 100 may also generate a BRIR (Binaural Room Impulse Response) by convolving the calculated personalized HRTF with a RIR (Room Impulse Response). In the following explanation, the BRIR generated according to the individual user will be referred to as a personalized BRIR to distinguish it from a general BRIR. Also, the data used when playing music on the user terminal 10 may actually be a BRIR rather than an HRTF, but in the following explanation, the two may be interpreted interchangeably. For example, the phrase "send the generated BRIR" also includes the situation of sending the calculated HRTF. Similarly, the phrase "play using the BRIR" also includes the situation of playing using the HRTF.

[0028] Subsequently, the cloud server 100 sends the generated personalized BRIR to the user terminal 10 (step S4). The first application 20 retrieves the personalized BRIR (step S5). In this way, a user can obtain their personalized BRIR by taking a picture of their profile and sending the image to the cloud server 100. The first application 20 then stores the received personalized BRIR in the memory area 21 (step S6).

[0029] Next, using Figure 2, we will explain the processing flow when the user terminal 10 uses the personalized BRIR to play music and the like. Figure 2 is a conceptual diagram showing the overall flow of information processing according to the embodiment.

[0030] The first application 20 acquires the personalized BRIR stored in the memory area 21 when the user initiates the first application 20 (step S11). The first application 20 also recognizes the devices connected to the user terminal 10. In the example in Figure 2, the first application 20 recognizes the headphones 50, which have established communication with the user terminal 10 via a wireless connection such as Bluetooth.

[0031] In this case, the first application 20 obtains information about the connected device, the headphones 50 (step S12). For example, the first application 20 obtains an identifier that identifies the device. The identifier may be a string to identify the device, such as a BT device name if the device has Bluetooth functionality, or a unique string to identify individual devices. Alternatively, the identifier may be a model name assigned by the manufacturer.

[0032] Furthermore, the first application 20 may acquire information such as whether the connected device has communication capabilities. For example, if a device does not have communication capabilities such as Bluetooth, it may not be able to transmit information such as an identifier. In this case, the first application 20 acquires information indicating that the device connected to the user terminal 10 cannot be recognized. Such information is distinguished, for example, by whether the device type is Active (has communication capabilities) or Passive (does not have communication capabilities). In other words, the first application 20 acquires information such as whether the connected device is Active or Passive. In the example in Figure 2, since the headphones 50 have communication capabilities, the first application 20 acquires information that the connected device, the headphones 50, is "Active".

[0033] Next, the first application 20 associates the personalized BRIR with the identifier of the headphones 50, which are the device used by the user. This association means, for example, that since the headphones 50 are currently connected to the user terminal 10, the second application 30 (described later) provides control information to control playback on devices other than the headphones 50. More specifically, the association means providing control information to prevent a variable used for optimizing a particular device (hereinafter referred to as "device optimization parameter") from being mistakenly used on another device.

[0034] Subsequently, the first application 20 sends (uploads) information about the personalized BRIR and headphones 50 to the cloud server 100 (step S13). This process is performed because data cannot be directly passed from the first application 20 to the second application 30, and is therefore necessary to enable the transfer of the personalized BRIR via the cloud server 100.

[0035] The cloud server 100 obtains information about the personalized BRIR and headphones 50. Then, based on the identifier of headphones 50, the cloud server 100 identifies the device optimization parameters for headphones 50 from the information it holds.

[0036] Furthermore, the cloud server 100 issues an address for obtaining the personalized BRIR so that the first application can obtain it (step S14). For example, the address for obtaining the personalized BRIR is a one-time URL (One-Time Uniform Resource Locator) used to access the cloud server 100 and obtain the personalized BRIR. In this way, the cloud server 100 transfers the personalized BRIR via the address for obtaining it. As a result, even if the first application 20 cannot transfer the personalized BRIR to the playback application (second application 30 in the example of Figure 2) due to OS or other constraints, the user terminal 10 can still transfer the personalized BRIR to the second application 30.

[0037] Furthermore, the cloud server 100 also issues a one-time URL, which is an address for obtaining the device optimization parameters for the headphones 50.

[0038] Then, the cloud server 100 sends the address for obtaining the issued personalized BRIR and the address for obtaining the device optimization parameters of the headphones 50 to the first application 20 (step S15).

[0039] The first application 20 obtains the address for obtaining the personalized BRIR and the address for obtaining the device optimization parameters of the headphones 50, which are sent from the cloud server 100 (step S16). The first application 20 may also perform the mapping between the personalized BRIR and the identifier of the headphones 50 at the time of step S16.

[0040] Subsequently, for example, when the second application 30 is launched by user operation, the first application 20 provides the acquired information to the second application 30 (step S17). Specifically, the first application 20 provides the second application 30 with information such as the address for acquiring the personalized BRIR, the address for acquiring the device optimization parameters of the headphones 50, the identifier of the headphones 50, and the model name and device type of the headphones 50.

[0041] The second application 30 is an application for playing audio and video. For example, the second application 30 is provided to the user by the same company that manages the service server 200 that provides streaming audio. As will be described later, the second application 30 has a processing unit called a data control unit 31 and a player 34, and the data control unit 31 may be provided as a shared library by the company that provides the first application 20. In other words, the company that manages the service server 200 may provide only the function corresponding to the player 34 in the second application 30.

[0042] The data control unit 31 of the second application 30 is a library containing executable files for exchanging data with, for example, the first application 20 or the cloud server 100, and is sometimes referred to as a Server Access Library (SAL).

[0043] The data control unit 31 obtains the personalized BRIR from the cloud server 100 via the address for obtaining the personalized BRIR provided by the first application 20 (step S18). The data control unit 31 also obtains the device optimization parameters for the headphones 50 from the cloud server 100 via the address for obtaining the device optimization parameters provided by the first application 20.

[0044] The data control unit 31 stores the acquired personalized BRIR and the device optimization parameters for the headphones 50 in the storage area 32 (step S19).

[0045] Next, the data control unit 31 recognizes the devices connected to the user terminal 10. Specifically, the data control unit 31 recognizes the headphones 50 with which communication has been established with the user terminal 10 (step S20).

[0046] The data control unit 31 then determines whether the identifier of the device associated with the personalized BRIR by the first application 20 matches the identifier that identifies the device the user intends to use at that moment. Specifically, the data control unit 31 determines whether the identifier of the device associated with the HRTF by the first application 20 in step S12 matches the identifier of the device connected at the time of step S20. In the example in Figure 2, both device identifiers indicate headphones 50, so the data control unit 31 determines that they match.

[0047] In this case, the data control unit 31 updates the configuration file 33, which holds the settings for playback of the second application 30. Specifically, the data control unit 31 writes to the configuration file 33 that the acquired personal BRIR and device optimization parameters should be used (enabled) in the playback process.

[0048] On the other hand, if the device identifier associated with the personalized BRIR by the first application 20 does not match the identifier that identifies the device the user intends to use at this time, the data control unit 31 writes a message to not activate the acquired personalized BRIR or device optimization parameters.

[0049] In other words, the data control unit 31 compares the identifier (such as the BT device name) passed from the first application 20 with the identifier of the headphones 50 currently connected to determine the personalized BRIR and device optimization parameters to be used for playback of the sound source. Then, the data control unit 31 updates the configuration file 33 according to the determined information (step S21).

[0050] Thus, the data control unit 31 restricts the use of personalized BRIR and device optimization parameters provided from the cloud server 100 if the actual device being used (headphones 50) has been changed. In other words, by including a step in the second application 30 that actually performs playback to determine the device identifier, the data control unit 31 can prevent inappropriate playback from occurring when music is played due to the application of device optimization parameters for a different device.

[0051] Subsequently, if the user requests music playback, the second application 30 executes the functions of the player 34. The player 34 is a processing unit that plays music or videos based on sound sources such as music files and information set in the configuration file 33.

[0052] The player 34 reads the configuration file 33 and recognizes that it will use personalized BRIR for playback and the device optimization parameters for the headphones 50 (step S22).

[0053] Next, player 34 retrieves the personalized BRIR and device optimization parameters from memory area 32 based on the information set in configuration file 33 (step S23).

[0054] Furthermore, player 34 accesses the service server 200 that provides streaming audio sources and obtains the audio sources (step S24).

[0055] The player 34 then plays the sound source while convolving it with personalized BRIR and device optimization parameters. This allows the player 34 to perform playback using a transfer function tailored to the user's individual ear shape and parameters optimized for the playback environment, such as headphones 50.

[0056] As described above, the user terminal 10, which is an example of an information processing device related to this disclosure, performs the function of associating a personalized BRIR (or personalized HRTF) corresponding to a user with an identifier that identifies the device used by the user. The user terminal 10 then provides the personalized BRIR and the identifier associated with the personalized BRIR to the second application 30, which is the recipient of the personalized BRIR corresponding to the user.

[0057] In other words, the user terminal 10 provides not only the personalized BRIR but also the identifier of the device connected in the environment in which the personalized BRIR is used. In this way, the user terminal 10 also provides information to the playback environment (second application 30, etc.) about what kind of device the user is using to use the personalized BRIR, enabling playback optimized for the user's environment.

[0058] Furthermore, the user terminal 10 obtains the personalized BRIR corresponding to the user and the identifier associated with the personalized BRIR, and determines whether the identifier associated with the personalized BRIR matches the identifier that identifies the device used by the user. Then, if the identifier associated with the personalized BRIR matches the identifier that identifies the device used by the user, the user terminal 10 is configured to enable the personalized BRIR.

[0059] In this way, the user terminal 10 identifies the currently connected devices in the environment in which the personalized BRIR is to be used, and determines whether or not to use the personalized BRIR and device optimization parameters provided by the cloud server 100. This prevents the user terminal 10 from using an inappropriate personalized BRIR or from mistakenly applying different device optimization parameters during playback. As a result, the user terminal 10 can perform playback optimized for the user's environment.

[0060] The above outlines the overall flow of information processing related to this disclosure. Figures 3 and below describe the configuration of the user terminal 10 and then explain the details of the various processes in order.

[0061] [1-2. Configuration of the information processing device according to the embodiment] Using Figure 3, the configuration of a user terminal 10, which is an example of an information processing device according to this disclosure, will be explained. Figure 3 is a diagram showing an example configuration of a user terminal 10 according to an embodiment of this disclosure. As shown in Figure 3, the user terminal 10 has a communication unit 11, an input unit 12, a display unit 13, a detection unit 14, a storage unit 15, and a control unit 16.

[0062] The communication unit 11 is implemented, for example, by a NIC (Network Interface Card). The communication unit 11 is connected to the network N (such as the Internet) by wire or wireless connection, and transmits and receives information with the cloud server 100, service server 200, headphones 50, etc. via the network N.

[0063] The input unit 12 is an input device that receives various operations from the user. For example, the input unit 12 is implemented by operation keys or the like provided on the user terminal 10. The display unit 13 is a display device for displaying various information. For example, the display unit 13 is implemented by a liquid crystal display or the like. If a touch panel is used for the user terminal 10, a part of the input unit 12 and the display unit 13 are integrated.

[0064] The detection unit 14 is a general term for various sensors and detects various information related to the user terminal 10. Specifically, the detection unit 14 detects user operations on the user terminal 10, location information of the user terminal 10, information about devices connected to the user terminal 10, and the environment of the user terminal 10.

[0065] Furthermore, the detection unit 14 includes, as an example of a sensor, a lens and an image sensor for taking pictures. That is, the detection unit 14 functions as a camera, for example, when a user launches an application that operates the shooting function.

[0066] The memory unit 15 is implemented by, for example, semiconductor memory elements such as RAM (Random Access Memory) or flash memory, or by storage devices such as hard disks or optical discs. The memory unit 15 stores various types of data used for information processing.

[0067] As shown in Figure 3, the storage unit 15 includes data tables such as the BRIR table 151 and the parameter table 152. The BRIR table 151 corresponds to, for example, the storage area 21 shown in Figure 2. The parameter table 152 corresponds to, for example, the storage area 32 shown in Figure 2.

[0068] The BRIR table 121 stores information about the personalized BRIR generated by the cloud server 100. Figure 4 shows an example of the BRIR table 151 according to the embodiment of this disclosure. Figure 4 is a diagram showing an example of the BRIR table 151 according to the embodiment. In the example shown in Figure 4, the BRIR table 151 has items such as "personalized BRIR data" and "generation date and time".

[0069] "Personalized BRIR data" refers to the personalized BRIR data generated by the cloud server 100. In Figure 4, the personalized BRIR data is conceptually represented as "A01," but in reality, this item stores specific numerical values ​​or other information indicating the personalized BRIR.

[0070] "Generation date and time" indicates the date and time when the personalized BRIR data was generated. If the user terminal 10 obtains personalized BRIR multiple times, it may keep only the most recent personalized BRIR in the BRIR table 151, or it may keep multiple personalized BRIRs in the BRIR table 151.

[0071] Next, the parameter table 122 will be described. The parameter table 122 stores information about parameters used when playing sound sources and videos. Figure 5 shows an example of the parameter table 152 according to the embodiment of this disclosure. Figure 5 is a diagram showing an example of the parameter table 152 according to the embodiment. In the example shown in Figure 5, the parameter table 152 has items such as "Setting ID", "Personalized BRIR data", "Device optimization parameters", and "Acquisition date and time".

[0072] The "Setting ID" is identification information that identifies a setting indicating that a personalized BRIR and device optimization parameters are associated. The "Personalized BRIR Data" corresponds to the same item shown in Figure 4. The "Device Optimization Parameters" shows the device optimization parameter data obtained from the cloud server 100. In Figure 5, the device optimization parameters are conceptually described as "C01," but in reality, specific numerical values ​​or other information indicating the device optimization parameters are stored in this item.

[0073] "Acquisition Date and Time" indicates the date and time when the personalized BRIR and device optimization parameters were acquired from the cloud server 100. If the user terminal 10 acquires the personalized BRIR and device optimization parameters multiple times, it may keep only the most recent personalized BRIR and device optimization parameters in the parameter table 152, or it may keep multiple personalized BRIR and device optimization parameters in the BRIR table 151.

[0074] Returning to Figure 3, the explanation continues. The control unit 16 is implemented, for example, by a CPU (Central Processing Unit), MPU (Micro Processing Unit), GPU (Graphics Processing Unit), etc., which executes a program (for example, the information processing program related to this disclosure) stored inside the user terminal 10 using RAM (Random Access Memory) or the like as a working area. The control unit 16 is also a controller and may be implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0075] As shown in Figure 3, the control unit 16 has a first application control unit 161 and a second application control unit 165, and realizes or executes the information processing functions and operations described below. The first application control unit 161 includes a generation unit 162, an execution unit 163, and a provision unit 164. The second application control unit 165 includes an acquisition unit 166, a determination unit 167, a setting unit 168, and a playback unit 169. For example, the acquisition unit 166, the determination unit 167, and the setting unit 168 correspond to the data control unit 31 shown in Figure 2. The playback unit 169 corresponds to the player 34 shown in Figure 2. Note that the internal configuration of the control unit 16 is not limited to the configuration shown in Figure 3, and other configurations are also acceptable as long as they perform the information processing described later.

[0076] The generation unit 162 controls the processing related to the generation of HRTF and personalized BRIR. Specifically, the generation unit 162 controls the processing related to capturing the user's profile, including their ears. The generation unit 162 also controls the processing of sending the images obtained from the capture to the cloud server 100 and the processing of acquiring the personalized BRIR generated by the cloud server 100.

[0077] The generation unit 162 appropriately stores the images obtained through shooting and the acquired personal BRIR in the storage unit 15. Note that the generation unit 162 may, instead of sending images captured by the user terminal 10 to the cloud server 100, acquire images captured by, for example, an external camera and send the acquired images to the cloud server 100.

[0078] Furthermore, if personalized HRTFs and personalized BRIRs have already been generated for the user and are stored in the cloud server 100, the generation unit 162 may control only the process of acquiring the personalized HRTFs and personalized BRIRs without sending the images to the cloud server 100. In other words, the process by which the generation unit 162 acquires personalized HRTFs and personalized BRIRs is not limited to a specific method.

[0079] The execution unit 163 performs the process of associating a personalized HRTF or personalized BRIR corresponding to the user with an identifier that identifies the device used by the user.

[0080] For example, when the user launches the first application, the execution unit 163 retrieves the personalized BRIR stored in the BRIR table 151. The execution unit 163 also retrieves an identifier from the headphones 50 that identifies the headphones 50 connected at the time the first application is launched. The execution unit 163 then associates the personalized BRIR with the identifier of the headphones 50 and uploads the personalized BRIR, along with the associated information, to the cloud server 100.

[0081] Subsequently, the execution unit 163 obtains a one-time URL for retrieving the personalized BRIR and headphones 50 issued by the cloud server 100. The execution unit 163 may also associate the personalized BRIR with the identifier of the headphones 50 at the time it obtains the one-time URL for retrieval.

[0082] The provisioning unit 164 provides the personalized BRIR and the identifier associated with the personalized BRIR to the recipient to whom the personalized BRIR corresponding to the user is provided. The recipient is, for example, an application different from the first application (a second application in this embodiment) installed on the user terminal 10. Note that the recipient is not limited to the second application, but may be other external devices (for example, other information processing terminals that can communicate with the user terminal 10), etc.

[0083] The provisioning unit 164 provides the personalized BRIR to the recipient by sending a one-time URL to the recipient for the recipient to obtain the personalized BRIR. In other words, the provisioning unit 164 provides the personalized BRIR to the recipient via a one-time URL. This allows the provisioning unit 164 to provide the personalized BRIR to a second application that cannot receive it directly due to, for example, OS restrictions.

[0084] Furthermore, the provisioning unit 164 may provide the recipient with an identifier along with device-specific variables (device optimization parameters) used in conjunction with the personalized BRIR.

[0085] The provisioning unit 164 provides the device optimization parameters to the recipient by sending a one-time URL to the recipient for the recipient to obtain the device optimization parameters. In other words, the provisioning unit 164 provides the device optimization parameters to the recipient via a one-time URL, similar to the personalized BRIR. This allows the provisioning unit 164 to provide device optimization parameters even to a second application that cannot be directly transferred due to, for example, OS constraints.

[0086] Furthermore, the provisioning unit 164 may provide the device optimization parameters to the recipient only when communication between the user terminal 10, the information processing device, and the headphones 50 is established. In other words, if, for example, communication with the headphones 50 is disconnected at the time the provisioning unit 164 attempts to provide the device optimization parameters to the second application, the provisioning unit 164 does not need to provide the device optimization parameters to the second application. This prevents discrepancies between the device the user intends to use and the optimization parameters it provides.

[0087] The acquisition unit 166 acquires the personalized BRIR corresponding to the user and the identifier associated with the personalized BRIR.

[0088] For example, the acquisition unit 166 acquires the personalized BRIR from the cloud server 100 via a one-time URL provided by the provision unit 164. Specifically, the acquisition unit 166 accesses the destination indicated by the one-time URL and acquires the personalized BRIR by making a request to the cloud server 100 to acquire the personalized BRIR.

[0089] Furthermore, the acquisition unit 166 may acquire device optimization parameters specific to the device, along with the device identifier, when used in conjunction with the personalized BRIR.

[0090] For example, the acquisition unit 166 acquires device optimization parameters from the cloud server 100 via a one-time URL provided by the provision unit 164. Specifically, the acquisition unit 166 accesses the destination indicated by the one-time URL and acquires the device optimization parameters by making a request to the cloud server 100 to acquire the device optimization parameters.

[0091] The acquisition unit 166 stores the acquired information in the storage unit 15 as appropriate. For example, the acquisition unit 166 associates the acquired personalized BRIR and device optimization parameters and stores them in the parameter table 152.

[0092] The determination unit 167 determines whether the identifier associated with the personal BRIR matches the identifier that identifies the device used by the user.

[0093] Specifically, the determination unit 167 determines whether the identifier, such as the BT device name, associated with the personalized BRIR provided by the provision unit 164 matches the identifier, such as the BT device name, of the device currently being used by the user.

[0094] The determination unit 167 determines that a device with which communication has been established with the user terminal 10 is a device used by the user. For example, the determination unit 167 can identify a device with which communication has been established with the user terminal 10 by detecting the device connected to the user terminal 10 using the functions of the OS (libraries, etc.).

[0095] Furthermore, if the determination unit 167 cannot detect the device currently being used by the user, or if it cannot obtain the device identifier, it may determine that the identifier associated with the personalized BRIR does not match the identifier that identifies the device being used by the user. For example, if the device currently being used by the user is passive and does not have the function to transmit an identifier, the determination unit 167 may determine that the identifier associated with the personalized BRIR does not match the device identifier.

[0096] The settings unit 168 is configured to enable the personalized BRIR when the identifier associated with the personalized BRIR matches the identifier that identifies the device used by the user. The device used by the user refers to a device with which communication has been established with the user terminal 10 at the time the personalized BRIR is to be used, such as when playing a sound source.

[0097] For example, if the configuration unit 168 finds that the identifier associated with the personalized BRIR matches the identifier that identifies the device used by the user, it writes a message to the configuration file indicating that the personalized BRIR obtained from the cloud server 100 is available. This allows the playback unit 169, described later, to perform playback using the personalized BRIR stored in the parameter table 152.

[0098] Furthermore, the setting unit 168 may be configured not to enable the personalized BRIR or device optimization parameters if the identifier associated with the personalized BRIR does not match the identifier that identifies the device used by the user.

[0099] As a result, the setting unit 168 can prevent situations that would impair the user experience, such as when the personalized BRIR or device optimization parameters are used incorrectly in environments where the playback status is unknown, preventing optimal sound source playback.

[0100] The setting unit 168 may be configured to disable both the personalized BRIR and the device optimization parameters, or it may be configured to enable the personalized BRIR and disable the device optimization parameters. If the personalized BRIR is disabled, the setting unit 168 writes to the configuration file that, when playing back a sound source, it will use the average BRIR averaged across multiple users instead of the personalized BRIR. Also, if the device optimization parameters are disabled, the setting unit 168 writes to the configuration file that, when playing back a sound source, it will use standard parameters that apply to all devices in common, instead of the device optimization parameters.

[0101] The playback unit 169 plays audio and video. When playing, the playback unit 169 reads a configuration file and identifies the BRIR and parameters to be used for playback. The playback unit 169 then retrieves the personalized BRIR and device optimization parameters written in the configuration file from the parameter table 152 and performs playback.

[0102] For example, the playback unit 169 accesses the service server 200, obtains streaming data, and plays back the obtained streaming data. The playback unit 169 may also play back audio or video stored in the storage unit 15, not just streaming data.

[0103] [1-3. Procedure for information processing according to the embodiment] Next, the information processing procedure according to the first embodiment will be described using Figures 6 to 9. Figure 6 describes the procedure for the user terminal 10 to acquire the personal BRIR. Figure 6 is a flowchart (1) showing the information processing procedure according to the embodiment.

[0104] As shown in Figure 6, the user terminal 10 acquires an image of the user's ear through a shooting process or the like (step S101). Subsequently, the user terminal 10 sends the ear image to the cloud server 100 (step S102).

[0105] Subsequently, the user terminal 10 acquires a personalized BRIR generated based on the ear image (step S103). Then, the user terminal 10 stores the acquired personalized BRIR in the storage unit 15 (BRIR table 151) (step S104).

[0106] Next, using Figure 7, we will explain the procedure for the process by which the user terminal 10 provides the personalized BRIR to the second application. Figure 7 is a flowchart (2) showing the information processing procedure according to the embodiment.

[0107] As shown in Figure 7, the user terminal 10 determines whether or not it has detected the launch of the first application (step S201). If it does not detect the launch of the first application (step S201; No), the user terminal 10 waits until it detects the launch.

[0108] On the other hand, if the launch of the first application is detected (step S201; Yes), the user terminal 10 obtains information about the device connected to the user terminal 10 (for example, the identifier of the headphones 50, etc.) (step S202).

[0109] Subsequently, the user terminal 10 sends the personalized BRIR stored in the BRIR table 151 to the cloud server 100 (step S203). Next, the user terminal 10 obtains the address for retrieving the personalized BRIR issued by the cloud server 100 (step S204).

[0110] Furthermore, the user terminal 10 determines whether or not it has obtained the address for obtaining the device optimization parameters (step S205). If it has obtained the address for obtaining the device optimization parameters (step S205; Yes), the user terminal 10 associates the device identifier with the personalized BRIR (step S206).

[0111] On the other hand, if the address for obtaining device optimization parameters has not been obtained (step S205; No), the user terminal 10 does not need to associate the device identifier with the personalized BRIR. Situations where the address for obtaining device optimization parameters has not been obtained include, for example, when the device is passive and the identifier could not be obtained in step S202, or when the cloud server 100 does not hold the device optimization parameters.

[0112] Then, the user terminal 10 provides the second application with information such as the acquisition address obtained from the cloud server 100 (step S207).

[0113] Next, using Figure 8, the procedure for the user terminal 10 to set the personalized BRIR will be explained. Figure 8 is a flowchart (3) showing the information processing procedure according to the embodiment.

[0114] As shown in Figure 8, the user terminal 10 determines whether or not it has detected the launch of the second application (step S301). If it does not detect the launch of the second application (step S301; No), the user terminal 10 waits until it detects the launch.

[0115] On the other hand, if the launch of the second application is detected (step S301; Yes), the user terminal 10 obtains information provided by the first application (step S302).

[0116] Subsequently, the user terminal 10 uses the provided acquisition address to obtain the personalized BRIR from the cloud server 100 (step S303). Next, the user terminal 10 stores the acquired personalized BRIR in the storage unit 15 (parameter table 152) (step S304).

[0117] Furthermore, the user terminal 10 determines whether or not it has obtained an address for obtaining device optimization parameters from the first application (step S305). If it has obtained an address for obtaining device optimization parameters (step S305; Yes), the user terminal 10 uses the address to obtain the device optimization parameters from the cloud server 100 (step S306). The user terminal 10 stores the obtained device optimization parameters in the storage unit 15 (parameter table 152) in association with the personalized BRIR (step S307).

[0118] Furthermore, the user terminal 10 obtains information about the devices currently connected (step S308). The user terminal 10 then determines whether the device identifier obtained in step S308 matches the identifier associated with the personalized BRIR (step S309).

[0119] If the device identifier obtained in step S308 matches the identifier associated with the personalized BRIR (step S309; ​​Yes), the user terminal 10 registers in the configuration file that it will use the personalized BRIR and device optimization parameters. In other words, the user terminal 10 activates the personalized BRIR and device optimization parameters (step S310).

[0120] On the other hand, if the user terminal 10 does not obtain the address for obtaining device optimization parameters from the first application (step S305; No), or if the device identifier obtained in step S308 does not match the identifier associated with the personalized BRIR (step S309; ​​No), the user terminal 10 registers in the configuration file that it will not use the personalized BRIR and device optimization parameters. In other words, the user terminal 10 is configured not to enable the personalized BRIR and device optimization parameters (step S311).

[0121] In addition, in step S311, the user terminal 10 may be configured not to enable either the personalized BRIR or the device optimization parameters, but rather to disable only the device optimization parameters. For example, if the device is passive, the user terminal 10 may allow the user to use only the personalized BRIR.

[0122] Next, using Figure 9, the procedure for the user terminal 10 to perform playback using the personalized BRIR will be explained. Figure 9 is a flowchart (4) showing the information processing procedure according to the embodiment.

[0123] The user terminal 10 determines whether or not it has detected the launch of the player in the second application (step S401). Note that the launch of the player may be interpreted as, for example, the user performing an operation to play an audio source in the second application.

[0124] If the player is not detected to be running (Step S401; No), the user terminal 10 waits until it detects that the player is running. On the other hand, if the player is detected to be running (Step S401; Yes), the user terminal 10 reads the configuration file (Step S402).

[0125] Next, the user terminal 10 obtains the sound source from the service server 200 (step S403). Then, the user terminal 10 plays the sound source while incorporating, for example, personalized BRIR and device optimization parameters into the sound source based on the configuration file (step S404).

[0126] While the audio source is playing, the user terminal 10 determines whether the connected device has changed (step S405). If the connected device has changed (step S405; Yes), that is, if the headphones used by the user have changed or the communication has been interrupted, the configuration file is modified (step S406). For example, the user terminal 10 disables the personalization BRIR and device optimization parameters and modifies the configuration file so that this information cannot be used for playback.

[0127] Subsequently, the user terminal 10 determines whether the user has requested that playback be stopped (step S407). If the user has not requested that playback be stopped (step S407; No), the user terminal 10 continues the process of acquiring the sound source from the service server 200 in order to continue playback.

[0128] On the other hand, if the user requests that playback be stopped (step S407; Yes), the user terminal 10 stops playing the sound source (step S408).

[0129] (2. Variant) The information processing system 1 described above may be implemented in various different forms other than the embodiment described above. Therefore, the following describes modifications of the embodiment.

[0130] [2-1. Types of Information Processing Systems] In this embodiment, a one-time URL is given as an example of an address for obtaining the personalized BRIR and device optimization parameters, but the invention is not limited to this example, and any method can be used as long as the second application can obtain data from the cloud server 100. Furthermore, after providing the personalized BRIR to the user terminal 10 via the one-time URL, the cloud server 100 may delete the provided personalized BRIR or retain it for a certain period of time.

[0131] In this embodiment, an example was shown in which the cloud server 100 generates the personalized BRIR. However, the personalized BRIR may be generated by the user terminal 10 instead of the cloud server 100. In this case, the cloud server 100 only needs to hold the personalized BRIR uploaded from the user terminal 10 and issue a retrieval address when requested.

[0132] In this embodiment, the cloud server 100 is assumed to be installed on a cloud network, but it is not limited to this example. The cloud server 100 may be installed on a network such as a LAN (Local Area Network) as long as it can communicate with the user terminal 10.

[0133] The cloud server 100 may, when generating a personalized BRIR, obtain the user's identification information, associate the identification information with the personalized BRIR, and store the personalized BRIR. In this case, the cloud server 100 can provide the personalized BRIR to the second application without having to receive an upload of the personalized BRIR from the first application each time it starts up.

[0134] In this embodiment, the cloud server 100 is described as a single server, but the cloud server 100 may be composed of multiple server devices. For example, the cloud server 100 may be divided into a generation server that generates personalized BRIRs and a provision server that issues addresses for obtaining personalized BRIRs and provides personalized BRIRs.

[0135] In this embodiment, an example is shown in which the first application and the second application are installed on the user terminal 10. However, the first application and the second application may be applications installed on separate devices. For example, the user terminal 10 may only retain the functions of the first application and control the second application, which is installed on another device such as a smart speaker, to perform actions such as playing sound sources.

[0136] [2-2. Methods of playing back sound sources] If the cloud server 100 does not retain the user's personalized BRIR or device optimization parameters, it may send the average BRIR of multiple users or standard parameters that are not dependent on a specific device to the user terminal 10.

[0137] This point will be explained using Figure 10. Figure 10 is a conceptual diagram showing how the head-related transfer function is used in a modified example.

[0138] As shown in Figure 10, when a sound source is played in the second application, for example, two modes, Pattern 1 and Pattern 2, are possible. Pattern 1 represents a case where personalized BRIR and device optimization parameters are unavailable, such as when the device cannot be recognized. Specifically, Pattern 1 is operated using a combination 70 of streaming data, a service application (playback application), a library, and averaged BRIR and standard parameters. On the other hand, Pattern 2 represents a case where the device can be recognized and device-specific parameters exist. Specifically, Pattern 2 is operated using a combination 80 of streaming data, a service application, a library, and personalized BRIR and device optimization parameters.

[0139] [2-3. Using Parameters] The user terminal 10 may not acquire device optimization parameters each time playback is performed, but may acquire device optimization parameters corresponding to multiple devices in advance. In this case, the user terminal 10 can identify the optimization parameters for the connected device based on the device's identifier and perform playback using the identified parameters. Alternatively, the user terminal 10 may, for example, present the user with a list of owned device parameters and allow the user to select parameters. This allows even a user who only owns Passive headphones to perform playback using their personalized BRIR and device optimization parameters.

[0140] In this embodiment, the user terminal 10 (second application) does not obtain device optimization parameters for devices such as passive headphones. However, the user terminal 10 may also obtain device optimization parameters for devices that do not have communication functions, such as passive headphones. In this case, the user manually selects the name of the device, etc., in the first application. The list of device names, etc., is provided to the user terminal 10 from the cloud server 100. The user terminal 10 then obtains an acquisition address from the cloud server 100 that corresponds to the device optimization parameters of the device selected by the user.

[0141] The user terminal 10 then provides the acquired acquisition address to the second application. This allows the second application to acquire the acquisition address for device optimization parameters related to passive headphones, etc. In this case, step S305 shown in Figure 8 branches to "Yes," so the user can enjoy music playback using personalized BRIR and device optimization parameters even with passive headphones. The user terminal 10 may, depending on the user's situation, appropriately perform music playback using various functions and variables, such as music playback using only personalized BRIR (standard parameters instead of device optimization parameters), or music playback using only averaged BRIR.

[0142] When the cloud server 100 generates a personalized BRIR from a personalized HRTF, it may convolve different RIRs (for example, an RIR suited to the user's indoor environment) depending on the user's location and circumstances. This allows the cloud server 100 to provide the user with a personalized BRIR that is more tailored to the user's situation. In this case, instead of the cloud server 100 generating the personalized BRIR, the user terminal 10, which has acquired multiple RIRs, may identify the appropriate RIR for its environment and perform the convolution with the personalized HRTF.

[0143] [2-4. Appearance of the equipment] In this embodiment, the headphones 50 are shown to connect to the user terminal 10 using Bluetooth. However, devices such as the headphones 50 may connect using various communication standards other than Bluetooth.

[0144] (3. Other Embodiments) The processes described in each embodiment above may be carried out in various other forms besides those described above.

[0145] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above document and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0146] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.

[0147] Furthermore, the embodiments and modifications described above can be combined as appropriate, provided that the processing content is not inconsistent.

[0148] Furthermore, the effects described herein are merely illustrative and not limiting; other effects may also occur.

[0149] (4. Effects of the information processing device related to this disclosure) As described above, the information processing device (user terminal 10 in the embodiment) according to this disclosure comprises an execution unit (execution unit 163 in the embodiment) and a provision unit (provision unit 164 in the embodiment). The execution unit performs the function of associating a head transfer function (personalized HRTF or personalized BRIR in the embodiment) corresponding to a user with an identifier that identifies the device used by the user. The provision unit provides the head transfer function and the identifier associated with the head transfer function to the recipient to whom the head transfer function corresponding to the user is provided.

[0150] Thus, the information processing device relating to this disclosure identifies the devices currently connected in the environment in which the head-level transfer function is to be used. As a result, the information processing device can recognize when an inappropriate device is connected during playback, and thus can appropriately utilize the head-level transfer function.

[0151] Furthermore, the providing unit provides the head-related transfer function to the recipient by sending a one-time URL (URL) to the recipient for obtaining the head-related transfer function. This allows the information processing device to provide the head-related transfer function even to recipients with OS or other constraints.

[0152] Furthermore, the providing unit provides the recipient with an identifier and device-specific variables to be used with the head transfer function. This allows the information processing device to perform optimal playback according to the device.

[0153] Furthermore, the providing unit provides variables to the recipient by sending a one-time URL to the recipient for the recipient to retrieve the variables. This allows the information processing device to provide variables such as device optimization parameters even to recipients with OS or other constraints.

[0154] Furthermore, the providing unit provides variables to the recipient when communication between the information processing device and the device is established. This prevents the information processing device from applying the acquired variables to devices that are unsuitable for them when music is played, thus preventing inappropriate playback.

[0155] Furthermore, the information processing device according to this disclosure includes an acquisition unit (acquisition unit 166 in the embodiment), a determination unit (determination unit 167 in the embodiment), and a setting unit (setting unit 168 in the embodiment). The acquisition unit acquires a head transfer function corresponding to a user and an identifier associated with the head transfer function. The determination unit determines whether the identifier associated with the head transfer function matches an identifier that identifies the equipment used by the user. The setting unit sets the head transfer function to be enabled when the identifier associated with the head transfer function matches the identifier that identifies the equipment used by the user.

[0156] Thus, the information processing device according to this disclosure determines whether the device associated with the head-level transfer function at the time the head-level transfer function is acquired matches the device that is actually connected, and sets the activation of the head-level transfer function based on the result. This prevents the information processing device from applying the head-level transfer function to an inappropriate device during playback.

[0157] Furthermore, the acquisition unit acquires the head-related transfer function via a one-time URL for acquiring the head-related transfer function. This allows the information processing device to acquire the head-related transfer function even when there are constraints such as those imposed by the operating system.

[0158] Furthermore, the acquisition unit acquires variables specific to the device used when the head transfer function is used, along with the identifier. This allows the information processing device to perform optimal playback according to the device.

[0159] Furthermore, the acquisition unit acquires variables via a one-time URL for obtaining them. This allows the information processing device to acquire variables even when there are constraints such as those imposed by the operating system.

[0160] Furthermore, the determination unit determines that a device with established communication with the information processing device is a device used by the user. The setting unit sets the variable to be enabled when the identifier associated with the head-level transfer function matches the identifier that identifies the device used by the user. This allows the information processing device to determine during playback whether a device different from the one associated with the acquired head-level transfer function is connected, thus preventing the variable from being applied to an inappropriate device.

[0161] Furthermore, the settings unit is configured to not activate a head-level transfer function or variable if the identifier associated with the head-level transfer function does not match the identifier used to identify the device the user is using. This prevents the information processing device from using variables or other elements unsuitable for the device.

[0162] (5. Hardware Configuration) Information devices such as the user terminal 10, headphones 50, cloud server 100, and service server 200 according to each embodiment described above are realized by a computer 1000 with a configuration such as that shown in Figure 11. The following explanation will use the user terminal 10 according to the embodiment as an example. Figure 11 is a hardware configuration diagram showing an example of a computer 1000 that realizes the functions of the user terminal 10. The computer 1000 has a CPU 1100, RAM 1200, ROM (Read Only Memory) 1300, HDD (Hard Disk Drive) 1400, communication interface 1500, and input / output interface 1600. The various parts of the computer 1000 are connected by a bus 1050.

[0163] The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400, and controls various parts. For example, the CPU 1100 loads the programs stored in the ROM 1300 or HDD 1400 into the RAM 1200 and executes processing corresponding to various programs.

[0164] ROM1300 stores boot programs such as the BIOS (Basic Input Output System) executed by CPU1100 when computer 1000 starts up, as well as programs that depend on the computer 1000's hardware.

[0165] HDD1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU1100 and data used by such programs. Specifically, HDD1400 is a recording medium that records an information processing program related to this disclosure, which is an example of program data 1450.

[0166] The communication interface 1500 is an interface for the computer 1000 to connect to an external network 1550 (e.g., the Internet). For example, the CPU 1100 can receive data from other devices or transmit data it generates to other devices via the communication interface 1500.

[0167] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from input devices such as a keyboard or mouse via the input / output interface 1600. The CPU 1100 also transmits data to output devices such as a display, speaker, or printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading programs recorded on a predetermined recording medium (media). Examples of media include optical recording media such as DVDs (Digital Versatile Discs) and PDs (Phase Change Rewritable Disks), magneto-optical recording media such as MOs (Magneto-Optical Disks), tape media, magnetic recording media, or semiconductor memory.

[0168] For example, when the computer 1000 functions as a user terminal 10 according to the embodiment, the CPU 1100 of the computer 1000 realizes functions such as the control unit 16 by executing an information processing program loaded on the RAM 1200. The HDD 1400 stores the information processing program according to this disclosure and the data in the storage unit 15. The CPU 1100 reads and executes the program data 1450 from the HDD 1400, but as another example, these programs may be obtained from other devices via an external network 1550.

[0169] Furthermore, this technology can also be configured as follows. (1) An execution unit that performs a correspondence between a user-specific head transfer function and an identifier that identifies the equipment used by that user, A providing unit that provides the head transfer function and the identifier associated with the head transfer function to a recipient to whom the head transfer function corresponding to the user is provided. Equipped with an information processing device. (2) The aforementioned supply unit is, The aforementioned recipient provides the aforementioned head-related transfer function to the recipient by sending a one-time URL to the recipient for obtaining the head-related transfer function. The information processing device described in (1) above. (3) The aforementioned supply unit is, The provider is provided with the aforementioned identifier and the variables corresponding to the device when used together with the head-related transfer function. The information processing device described in (1) or (2) above. (4) The aforementioned supply unit is, The aforementioned provider provides the variable to the provider by sending the provider a one-time URL to obtain the variable. The information processing device described in (3) above. (5) The aforementioned supply unit is, When communication between the information processing device and the device is established, the variable is provided to the recipient. The information processing apparatus described in (3) or (4) above. (6) Computers The system performs a mapping between the user's head-level transfer function and an identifier that identifies the device used by that user. To the recipient to whom a head transfer function corresponding to the aforementioned user is provided, the head transfer function and the identifier associated with the head transfer function are provided. Information processing methods. (7) Computers, An execution unit that performs a correspondence between a user-specific head transfer function and an identifier that identifies the equipment used by that user, A providing unit that provides the head transfer function and the identifier associated with the head transfer function to a recipient to whom the head transfer function corresponding to the user is provided. An information processing program designed to function as such. (8) An acquisition unit that acquires a head transfer function corresponding to the user and an identifier associated with said head transfer function, A determination unit that determines whether an identifier associated with the head transfer function matches an identifier that identifies the device used by the user, A setting unit that sets the head-related transfer function to be activated when the identifier associated with the head-related transfer function matches the identifier that identifies the device used by the user. Equipped with an information processing device. (9) The acquisition unit is, The head-related transfer function is obtained via a one-time URL for obtaining the head-related transfer function. The information processing device described in (8) above. (10) The acquisition unit is, Along with the identifier, obtain the device-specific variables used in conjunction with the head-related transfer function. The information processing apparatus described in (8) or (9) above. (11) The acquisition unit is, The variable is obtained via a one-time URL for obtaining the aforementioned variable. The information processing device described in (10) above. (12) The determination unit, The device with which communication has been established with the aforementioned information processing device is determined to be the device used by the user. The setting unit is, The variable is set to be enabled when the identifier associated with the head transfer function matches the identifier that identifies the device used by the user. The information processing apparatus described in (10) or (11) above. (13) The setting unit is, If the identifier associated with the head-level transfer function does not match the identifier that identifies the device used by the user, the head-level transfer function or the variable is set not to be enabled. An information processing device as described in any of (10) to (12) above. (14) Computers Obtain the head transfer function corresponding to the user and the identifier associated with that head transfer function. Determine whether the identifier associated with the head-level transfer function matches the identifier that identifies the device used by the user. The system is configured to activate the head-related transfer function if the identifier associated with the head-related transfer function matches the identifier that identifies the device used by the user. Information processing methods. (15) Computers, An acquisition unit that acquires a head transfer function corresponding to the user and an identifier associated with said head transfer function, A determination unit that determines whether an identifier associated with the head transfer function matches an identifier that identifies the device used by the user, A setting unit that sets the head-related transfer function to be activated when the identifier associated with the head-related transfer function matches the identifier that identifies the device used by the user. An information processing program designed to function as such. [Explanation of symbols]

[0170] 1. Information Processing System 10 User terminals 11 Communications Department 12 Input section 13 Display section 14 Detection unit 15 Storage section 151 BRIR Table 152 Parameter Table 16 Control Unit 161 First Application Control Unit 162 Generation part 163 Execution Department 164 Provision Department 165 Second Application Control Unit 166 Acquisition Department 167 Judgment Department 168 Settings Section 169 Playback Department 50 headphones 100 Cloud Servers 200 service servers

Claims

1. Obtain the user-specific head transfer function, The head transfer function corresponding to the user is sent to the server. A first acquisition address corresponding to the head transfer function corresponding to the user is obtained from the server. For an application that is provided with a head transfer function corresponding to the user, the application is provided with the first acquisition address for obtaining the head transfer function from the server. Information processing methods.

2. Obtain information about the audio playback device connected to the user terminal, The system transmits information about the audio playback device connected to the user terminal to the server. A second acquisition address corresponding to the device parameters of the audio playback device connected to the user terminal is obtained from the server. The application is provided with the second acquisition address for obtaining device parameters of the audio playback device connected to the user terminal from the server. The information processing method according to claim 1.

3. The first acquisition address is: The address for the application to access the server where the head transfer function corresponding to the user is stored is The second acquisition address is: The address for the application to access the server where the device parameters corresponding to the audio playback device connected to the user terminal are stored is: The information processing method according to claim 2.

4. The head transfer function corresponding to the user is: Downloaded from the server via the first acquisition address, The device parameters of the audio playback device connected to the user terminal are: Downloaded from the server via the second acquisition address described above, The information processing method according to claim 3.

5. When communication between the audio playback device and the user terminal is established, the device parameters are provided to the application. The information processing method according to claim 2.

6. The information processing method is: The server includes issuing the first acquisition address corresponding to the user's head transfer function, The information processing method according to claim 1.

7. The information processing method is: The server includes identifying the device parameters corresponding to the sound playback device and issuing the second acquisition address corresponding to the device parameters, The information processing method according to claim 2.

8. Obtain an image including the user's ear, The head transfer function of the user corresponding to the image including the user's ear is received. The information processing method according to claim 1.

9. The user’s head transfer function is estimated using a learned model. The information processing method according to claim 1.

10. The head-related transfer function is associated with an identifier that identifies an audio playback device connected to the user terminal, so as to activate the head-related transfer function when the identifier associated with the head-related transfer function matches the identifier that identifies an audio playback device connected to the user terminal. The information processing method according to claim 2.

11. The association between the head-related transfer function corresponding to the user and the identifier identifying the audio playback device connected to the user terminal is performed such that the device parameter corresponding to the audio playback device is activated when the identifier associated with the head-related transfer function matches the identifier identifying the audio playback device connected to the user terminal. The information processing method according to claim 2.

12. The identifier associated with the head transfer function is provided to the application via the first acquisition address. The information processing method according to claim 10.

13. The first acquisition address and the second acquisition address are different acquisition addresses. The information processing method according to claim 2.

14. A computer, Obtain the user-specific head transfer function, The head transfer function corresponding to the user is sent to the server. A first acquisition address corresponding to the head transfer function corresponding to the user is obtained from the server. For an application that is provided with a head transfer function corresponding to the user, the application is provided with the first acquisition address for obtaining the head transfer function from the server. An information processing program that executes a process.

15. A generation unit that acquires a head transfer function corresponding to the user, A first acquisition unit transmits a head transfer function corresponding to the user to the server and obtains a first acquisition address corresponding to the head transfer function corresponding to the user from the server. A first providing unit provides the first acquisition address for an application to which a head transfer function corresponding to the user is provided, so that the application can obtain the head transfer function from the server. An information processing system equipped with the following features.

16. A second acquisition unit that acquires information about an audio playback device connected to a user terminal and transmits the information about the audio playback device connected to the user terminal to the server, A second providing unit obtains a second acquisition address from the server that corresponds to the device parameters of the audio playback device connected to the user terminal, and provides the application with the second acquisition address for obtaining the device parameters of the audio playback device connected to the user terminal from the server. The information processing system according to claim 15, comprising:

17. A head-related transfer function corresponding to the user and information from an audio playback device connected to the user terminal are received. Based on the information of the audio playback device connected to the user terminal, the device parameters corresponding to the audio playback device connected to the user terminal are identified. A first acquisition address corresponding to the head transfer function corresponding to the user and a second acquisition address corresponding to the device parameters corresponding to the audio playback device connected to the user terminal are generated. A control unit transmits a first acquisition address and a second acquisition address to the user terminal so that an application on the user terminal can access them to obtain a head-related transfer function corresponding to the user and the device parameters corresponding to the audio playback equipment connected to the user terminal. An information processing server equipped with the following features.

Images