Information processing device, information processing method, and information processing program
The information processing device addresses the challenge of utilizing head transfer functions across multiple applications and audio equipment by associating these functions with device identifiers, ensuring optimal sound localization and realism.
Patent Information
- Application Number
- JP2020562388
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2018-12-28
- Filing Date
- 2019-12-26
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2039-12-26
AI Technical Summary
Existing technologies struggle to flexibly utilize head transfer functions calculated for individual users across multiple applications and varying audio equipment, leading to suboptimal sound localization and realism.
An information processing device that associates a head transfer function with a device identifier, enabling the flexible use of personalized head transfer functions across multiple applications and ensuring compatibility with specific audio equipment by matching identifiers and adjusting settings accordingly.
This solution allows for improved sound localization and realism by ensuring that personalized head transfer functions are used appropriately across different applications and audio equipment, enhancing the overall audio experience.
Smart Images

Figure 0007661698000001 
Figure 0007661698000002 
Figure 0007661698000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program, and more particularly, to the use of a head-related transfer function. [Background technology]
[0002] A technology is being used to reproduce a three-dimensional sound image in headphones, etc., by using a head-related transfer function, which mathematically represents how sound reaches the ears from the sound source.
[0003] Since head-related transfer functions vary greatly from person to person, it is desirable to use head-related transfer functions generated for each individual when using them. For example, a technology is known in which a three-dimensional digital model of the head (hereinafter, referred to as a "3D model") is generated based on an image of the user's auricle, and the head-related transfer function of the user is calculated from the generated 3D model. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] U.S. Pat. No. 9,544,706 Summary of the Invention [Problem to be solved by the invention]
[0005] According to the conventional technology, a head-related transfer function calculated individually for each user can be used for information processing, thereby improving the sense of positioning of a sound image.
[0006] However, in the above conventional technology, it is not always possible to appropriately use the head-related transfer function calculated for each user. For example, a user may wish to flexibly use the head-related transfer function, such as applying his / her own head-related transfer function to multiple applications installed on a smartphone, not limited to a single application (such as a music playback application). In addition, the head-related transfer function can provide a more realistic feeling and a more accurate sense of localization if it is adjusted according to the actual usage situation or the audio equipment used by the user. However, the conventional technology only calculates the head-related transfer function for each user, and does not perform processing such as allowing the user to flexibly use the head-related transfer function or change the usage mode of the head-related transfer function according to the situation.
[0007] Therefore, the present disclosure proposes an information processing device, an information processing method, and an information processing program that can appropriately utilize the head-related transfer function. [Means for solving the problem]
[0008] In order to solve the above problem, one form of an information processing device according to the present disclosure includes an execution unit that performs correspondence between a head-related transfer function corresponding to a user and an identifier that identifies an apparatus used by the user, and a provision unit that provides the head-related transfer function and the identifier associated with the head-related transfer function to a destination to which the head-related transfer function corresponding to the user is provided.
[0009] In addition, in order to solve the above problem, an information processing device of one form according to the present disclosure includes an acquisition unit that acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function, a determination unit that determines whether the identifier associated with the head-related transfer function matches an identifier identifying an equipment used by the user, and a setting unit that sets the head-related transfer function to be enabled when the identifier associated with the head-related transfer function matches an identifier identifying an equipment used by the user. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram illustrating an information processing system according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a conceptual diagram showing an overall flow of information processing according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating a configuration example of a user terminal according to the embodiment. [Figure 4] FIG. 11 is a diagram showing an example of a BRIR table according to the embodiment. [Diagram 5] FIG. 4 is a diagram illustrating an example of a parameter table according to the embodiment. [Figure 6] 1 is a flowchart (1) showing a procedure of information processing according to the embodiment. [Figure 7] 11 is a flowchart (2) showing the procedure of information processing according to the embodiment. [Figure 8] 11 is a flowchart (3) showing the procedure of information processing according to the embodiment. [Figure 9] 11 is a flowchart (4) showing the procedure of information processing according to the embodiment. [Figure 10] 13 is a conceptual diagram showing a usage manner of a head related transfer function according to a modified example. FIG. [Figure 11] FIG. 2 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and duplicated descriptions will be omitted.
[0012] The present disclosure will be described in the following order. 1. Embodiment 1-1. Configuration of information processing system according to embodiment and example of information processing 1-2. Configuration of the information processing device according to the embodiment 1-3. Information Processing Procedure According to the Embodiment 2. Variations 2-1. Information Processing System 2-2. How the sound source is played 2-3. Using parameters 2-4.Apparatus type 3. Other embodiments 4. Effects of the information processing device according to the present disclosure 5. Hardware Configuration
[0013] (1. EMBODIMENT) [1-1. Configuration of information processing system according to embodiment and example of information processing] First, a configuration of an information processing system 1 according to the present disclosure and an overview of information processing executed by the information processing system 1 will be described with reference to Figs. 1 and 2. Fig. 1 is a diagram illustrating the information processing system 1 according to the embodiment of the present disclosure. Information processing according to the embodiment of the present disclosure is realized by the information processing system 1 illustrated in Fig. 1. As illustrated in Fig. 1, the information processing system 1 includes a user terminal 10, headphones 50, a cloud server 100, and a service server 200. The devices included in the information processing system 1 communicate with each other using a wired or wireless network (not illustrated). Note that the number of devices constituting the information processing system 1 is not limited to that illustrated.
[0014] The user terminal 10 is an example of an information processing device according to the present disclosure, and is an information processing terminal that executes information processing using a head-related transfer function (hereinafter, may be referred to as HRTF (Head-Related Transfer Function)). The user terminal 10 is realized, for example, by a smartphone having a photographing function.
[0015] The headphones 50 are an example of an audio device used by a user. For example, the headphones 50 have a communication function such as Bluetooth (registered trademark) and establish wireless communication with the user terminal 10. The headphones 50 output audio and the like transmitted from the user terminal 10 in accordance with a user operation.
[0016] The cloud server 100 calculates an HRTF (head related transfer function) corresponding to each user, and provides the calculated HRTF to the user terminal 10. The cloud server 100 acquires an image of the user's ear from the user terminal 10 via the network, and calculates the HRTF of the user based on the acquired image.
[0017] The service server 200 is a server device that provides sound sources such as music to the user terminal 10. For example, the service server 200 provides streaming sound sources, etc. to the user terminal 10 via a network in accordance with the control of a music playback application, etc. installed in the user terminal 10.
[0018] As described above, the user terminal 10 executes information processing using HRTF. HRTF represents, as a transfer function, a change in sound caused by surrounding objects including the shape of the human auricle (ear shell) and head. In general, measurement data for determining HRTF is obtained by measuring a measurement acoustic signal using a microphone attached inside the human auricle or a dummy head microphone.
[0019] For example, HRTFs used in technologies such as 3D audio are often calculated using measurement data acquired by a dummy head microphone or the average value of measurement data acquired from a large number of people. However, since HRTFs vary greatly from person to person, it is desirable to use the user's own HRTF in order to achieve a more effective audio production effect. In other words, by replacing the general HRTF with the user's own HRTF, a more realistic audio experience can be provided to the user.
[0020] One example of a method for calculating a user's personal HRTF is to calculate the user's HRTF from an image capturing the shape of the user's ear. For example, the cloud server 100 acquires an image including the shape of the user's ear captured by the user terminal 10, and calculates the user's personal HRTF based on the acquired image. The cloud server 100 then transmits the calculated HRTF to the user terminal 10. This allows the user terminal 10 to play back sounds in which 3D sound is reproduced using the user's personal HRTF, or play back videos with a sense of realism.
[0021] However, there are some problems in implementing the above method. For example, the user terminal 10 runs applications (hereinafter simply referred to as "apps") that have functions for transmitting and managing HRTFs, as well as apps developed by various businesses, such as apps for playing music and apps for playing videos. In this case, for example, due to restrictions of the OS (Operating System), HRTF data may not be exchanged between the app that manages the HRTFs and the app for playing music.
[0022] Even if HRTF data can be exchanged, it may not be used appropriately. For example, HRTF can be calculated regardless of the audio device (headphones 50, etc.) actually used by the user, but in order to achieve a more effective audio effect, it is desirable to use HRTF in combination with variables (parameters) such as an output value that matches the impedance of the device and a delay time based on the shape of the output section of the device. However, when a user uses a music playback app, it is difficult for the cloud server 100 or an app that manages HRTF to control the use of the app due to OS restrictions. For this reason, there is a risk that HRTF will be used in a manner not intended by the cloud server 100 or the app that manages HRTF.
[0023] As described above, there are various problems with respect to HRTF in terms of using HRTF flexibly across multiple apps and using HRTF appropriately according to the user's environment and device status. The user terminal 10 according to the embodiment solves the above problems by the information processing of the present disclosure described below. Below, an overview of the information processing according to the present disclosure will be described along with the flow using FIG. 1 and FIG. 2.
[0024] 1, a first application 20 and a second application 30 are installed on the user terminal 10. The first application 20 is, for example, an application provided by a business operator that manages the cloud server 100. The first application 20 has functions of taking an image including the user's ear, transmitting the taken image to the cloud server 100, and managing the HRTF transmitted from the cloud server 100.
[0025] In the information processing according to the embodiment, first, the first application 20 captures an image including the user's ear in accordance with a user's operation, and acquires the image including the ear (step S1). Next, the first application 20 transmits the image including the ear to the cloud server 100 (step S2). Note that the first application 20 may detect an image of the user's ear included in the image and cut out the range of the detected image of the ear from the image as a preprocessing for transmitting the image to the cloud server 100.
[0026] The cloud server 100 acquires the image transmitted from the user terminal 10. Then, the cloud server 100 calculates the HRTF of the user from the image (step S3). Various methods may be adopted for the cloud server 100 to calculate the HRTF. For example, when a two-dimensional image including an image of an ear is input, the cloud server 100 may calculate the HRTF using a model trained to output an HRTF corresponding to the ear. Alternatively, the cloud server 100 may generate a 3D model of the user's head from the two-dimensional image including an image of the ear, and calculate the HRTF from the generated 3D model. In the following description, the HRTF calculated according to an individual user may be referred to as a personalized HRTF (personal HRTF) and may be distinguished from a general HRTF.
[0027] The cloud server 100 may convolve the calculated personalized HRTF with an RIR (Room Impulse Response) to generate a BRIR (Binaural Room Impulse Response). In the following description, the BRIR generated for an individual user may be referred to as a personalized BRIR to be distinguished from a general BRIR. In addition, the data used when playing music on the user terminal 10 may actually be a BRIR rather than an HRTF, but in the following description, the two may be interpreted interchangeably. For example, a description such as "transmitting the generated BRIR" includes a situation in which the calculated HRTF is transmitted. In addition, a description such as "playing using the BRIR" includes a situation in which the HRTF is used for playback.
[0028] Thereafter, the cloud server 100 transmits the generated personalized BRIR to the user terminal 10 (step S4). The first application 20 acquires the personalized BRIR (step S5). In this manner, the user can acquire his / her own personalized BRIR by photographing his / her own profile and transmitting the image to the cloud server 100. Then, the first application 20 stores the received personalized BRIR in the memory area 21 (step S6).
[0029] Next, a process flow when the user terminal 10 plays back music or the like using the personalized BRIR will be described with reference to Fig. 2. Fig. 2 is a conceptual diagram showing the overall flow of information processing according to the embodiment.
[0030] The first application 20 acquires the personalized BRIR stored in the storage area 21 when the user performs an operation to start the first application 20 (step S11). The first application 20 also recognizes devices connected to the user terminal 10. In the example of Fig. 2, the first application 20 recognizes headphones 50 with which communication is established with the user terminal 10 via a wireless connection such as Bluetooth.
[0031] In this case, the first application 20 acquires information about the headphones 50, which is the connected device (step S12). For example, the first application 20 acquires an identifier for identifying the device. For example, if the device has a Bluetooth function, the identifier is a character string for identifying the device, such as a BT device name, or a unique character string for identifying each device. The identifier may also be a model name of the device uniquely assigned by the manufacturer.
[0032] The first application 20 may also acquire information on whether the connected device has a communication function. For example, if the device does not have a communication function such as Bluetooth, the device may not be able to transmit information such as an identifier. In this case, the first application 20 acquires information indicating that the device connected to the user terminal 10 is in an unrecognizable mode. Such information is distinguished, for example, by information on whether the device type is Active (has a communication function) or Passive (does not have a communication function). That is, the first application 20 acquires information on whether the connected device is Active or Passive. In the example of FIG. 2, the headphones 50 have a communication function, so the first application 20 acquires information that the headphones 50, which are the connected device, are "Active".
[0033] Next, the first application 20 associates the personalized BRIR with an identifier of the headphones 50, which is a device used by the user. The association means, for example, that since the device currently connected to the user terminal 10 is the headphones 50, the second application 30, which will be described later, assigns control information for controlling playback on a device other than the headphones 50. More specifically, the association means assigning control information for controlling a variable for optimizing a certain device (hereinafter, referred to as a "device optimization parameter") so that it is not erroneously used by another device.
[0034] Thereafter, the first application 20 transmits (uploads) the personalized BRIR and information related to the headphones 50 to the cloud server 100 (step S13). This process is performed to enable the personalized BRIR to be transferred via the cloud server 100, since data cannot be directly transferred from the first application 20 to the second application 30.
[0035] The cloud server 100 acquires information about the personalized BRIR and the headphones 50. Then, based on the identifier of the headphones 50, the cloud server 100 identifies device optimization parameters of the headphones 50 from the information held by the cloud server 100.
[0036] Furthermore, the cloud server 100 issues an acquisition address for the personalized BRIR so that the first application can acquire the personalized BRIR (step S14). For example, the acquisition address is a one-time URL (One-Time Uniform Resource Locator) for accessing the cloud server 100 and acquiring the personalized BRIR. In this manner, the cloud server 100 transfers the personalized BRIR via the acquisition address. As a result, even in a situation in which the personalized BRIR cannot be transferred from the first application 20 to a playback application (the second application 30 in the example of FIG. 2) due to restrictions of the OS or the like, the user terminal 10 can transfer the personalized BRIR to the second application 30.
[0037] The cloud server 100 also issues a one-time URL that is an address for obtaining the device optimization parameters of the headphones 50.
[0038] Then, the cloud server 100 transmits the address for acquiring the issued personalized BRIR and the address for acquiring the device optimization parameters of the headphones 50 to the first application 20 (step S15).
[0039] The first application 20 acquires an address for acquiring the personalized BRIR and an address for acquiring the device optimization parameters of the headphones 50, both of which have been transmitted from the cloud server 100 (step S16). Note that the first application 20 may associate the personalized BRIR with the identifier of the headphones 50 at the timing of step S16.
[0040] Thereafter, for example, when the second application 30 is started by a user operation, the first application 20 provides the acquired information to the second application 30 (step S17). Specifically, the first application 20 provides the second application 30 with information such as an address for acquiring the personalized BRIR, an address for acquiring device optimization parameters of the headphones 50, an identifier of the headphones 50, a model name of the headphones 50, and a device type.
[0041] The second application 30 is an application for playing audio sources and videos. For example, the second application 30 is provided to a user by the same business operator as the business operator managing the service server 200 that provides streaming audio sources. As described later, the second application 30 has processing units called a data control unit 31 and a player 34, and the data control unit 31 may be provided as a shared library by the business operator providing the first application 20. In other words, the business operator managing the service server 200 may provide only the function corresponding to the player 34 in the second application 30.
[0042] The data control unit 31 of the second application 30 is, for example, a library including an executable file for exchanging data with the first application 20 and the cloud server 100, and may be called a Server Access Library (SAL) or the like.
[0043] The data control unit 31 acquires the personalized BRIR from the cloud server 100 via the address for acquiring the personalized BRIR provided by the first application 20 (step S18). In addition, the data control unit 31 acquires device optimization parameters of the headphones 50 from the cloud server 100 via the address for acquiring the device optimization parameters provided by the first application 20.
[0044] The data control unit 31 stores the acquired personalized BRIR and the device optimization parameters of the headphones 50 in the storage area 32 (step S19).
[0045] Next, the data control unit 31 recognizes the devices connected to the user terminal 10. Specifically, the data control unit 31 recognizes the headphones 50 with which communication is established with the user terminal 10 (step S20).
[0046] Then, the data control unit 31 determines whether the identifier of the device associated with the personalized BRIR by the first application 20 matches the identifier that identifies the device that the user is currently trying to use. Specifically, the data control unit 31 determines whether the identifier of the device associated with the HRTF by the first application 20 in step S12 matches the identifier of the device connected at the time of step S20. In the example of Fig. 2, since both device identifiers indicate the headphones 50, the data control unit 31 determines that the two match.
[0047] In this case, the data control unit 31 updates the configuration file 33 that holds the settings for playback of the second application 30. Specifically, the data control unit 31 writes to the configuration file 33 that the acquired personalized BRIR and device optimization parameters are to be used (enabled) in the playback process.
[0048] On the other hand, if the identifier of the device associated with the personalized BRIR by the first application 20 does not match the identifier that identifies the device that the user currently intends to use, the data control unit 31 writes the acquired personalized BRIR and device optimization parameters so as not to be activated.
[0049] That is, the data control unit 31 compares the identifier (such as a BT device name) passed from the first application 20 with the identifier of the currently connected headphones 50, and determines the personalized BRIR and device optimization parameters to be used for playing the sound source. Then, the data control unit 31 updates the setting file 33 according to the determined contents (step S21).
[0050] In this way, if the device actually used (headphones 50) has changed, the data control unit 31 restricts the use of the personalized BRIR and device optimization parameters provided by the cloud server 100. That is, by including a step of determining a device identifier in the second application 30 that actually performs playback, the data control unit 31 can prevent inappropriate playback from being performed when music is played back due to the application of device optimization parameters of a different device.
[0051] Thereafter, when the user desires to play music, the second application 30 executes the function of the player 34. The player 34 is a processing unit that plays music and videos based on a sound source such as a music file and information set in the setting file 33.
[0052] The player 34 reads the setting file 33 and recognizes that the personalized BRIR is to be used for playback and that the device optimization parameters of the headphones 50 are to be used (step S22).
[0053] Next, the player 34 acquires the personalized BRIR and device optimization parameters from the memory area 32 based on the information set in the setting file 33 (step S23).
[0054] Furthermore, the player 34 accesses the service server 200 that provides streaming sound sources and the like, and acquires the sound sources (step S24).
[0055] Then, the player 34 plays the sound source while convolving the personalized BRIR and device optimization parameters into the sound source. This allows the player 34 to play the sound using a transfer function that matches the shape of the user's individual ear and parameters that are optimized for the playback environment, such as the headphones 50.
[0056] As described above, the user terminal 10, which is an example of an information processing device according to the present disclosure, executes association between a personalized BRIR (or personalized HRTF) corresponding to a user and an identifier that identifies a device used by the user. Then, the user terminal 10 provides the personalized BRIR and the identifier associated with the personalized BRIR to the second application 30, which is the destination to which the personalized BRIR corresponding to the user is provided.
[0057] That is, the user terminal 10 provides not only the personalized BRIR but also the identifier of a device connected in the environment in which the personalized BRIR is used. In this way, the user terminal 10 provides the playback environment (such as the second application 30) with information about what device the user is using to use the personalized BRIR, thereby enabling playback optimized for the user's environment.
[0058] The user terminal 10 also acquires a personalized BRIR corresponding to the user and an identifier associated with the personalized BRIR, and determines whether the identifier associated with the personalized BRIR matches an identifier identifying a device used by the user. If the identifier associated with the personalized BRIR matches an identifier identifying a device used by the user, the user terminal 10 sets the personalized BRIR to be enabled.
[0059] In this way, the user terminal 10, by identifying the currently connected device in the environment in which the personalized BRIR is to be used, determines whether or not to use the personalized BRIR and device optimization parameters provided by the cloud server 100. This allows the user terminal 10 to prevent an inappropriate personalized BRIR from being used during playback, or to prevent different device optimization parameters from being erroneously applied. As a result, the user terminal 10 can perform playback optimized for the user's environment.
[0060] The overall flow of information processing according to the present disclosure has been outlined above. The configuration of the user terminal 10 will be described with reference to Fig. 3 and subsequent figures, and various types of processing will be described in detail in sequence.
[0061] [1-2. Configuration of the information processing device according to the embodiment] A configuration of a user terminal 10, which is an example of an information processing device according to the present disclosure, will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of a configuration of a user terminal 10 according to an embodiment of the present disclosure. As shown in Fig. 3, the user terminal 10 has a communication unit 11, an input unit 12, a display unit 13, a detection unit 14, a storage unit 15, and a control unit 16.
[0062] The communication unit 11 is realized by, for example, a network interface card (NIC) etc. The communication unit 11 is connected to a network N (such as the Internet) by wire or wirelessly, and transmits and receives information to and from the cloud server 100, the service server 200, the headphones 50, etc. via the network N.
[0063] The input unit 12 is an input device that accepts various operations from a user. For example, the input unit 12 is realized by operation keys or the like provided on the user terminal 10. The display unit 13 is a display device for displaying various information. For example, the display unit 13 is realized by a liquid crystal display or the like. Note that, when a touch panel is adopted in the user terminal 10, a part of the input unit 12 and the display unit 13 are integrated together.
[0064] The detection unit 14 is a collective term for various sensors, and detects various information related to the user terminal 10. Specifically, the detection unit 14 detects user operations on the user terminal 10, location information of the location of the user terminal 10, information related to devices connected to the user terminal 10, the environment of the user terminal 10, and the like.
[0065] The detection unit 14 also has a lens and an image sensor for capturing images, as an example of a sensor. That is, the detection unit 14 functions as a camera when, for example, a user activates an application that operates a capturing function.
[0066] The storage unit 15 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 15 stores various data used in information processing.
[0067] 3, the storage unit 15 includes data tables such as a BRIR table 151 and a parameter table 152. The BRIR table 151 corresponds to, for example, the storage area 21 shown in FIG 2. The parameter table 152 corresponds to, for example, the storage area 32 shown in FIG 2.
[0068] The BRIR table 121 stores information about the personalized BRIR generated by the cloud server 100. Fig. 4 shows an example of the BRIR table 151 according to an embodiment of the present disclosure. Fig. 4 is a diagram showing an example of the BRIR table 151 according to the embodiment. In the example shown in Fig. 4, the BRIR table 151 has items such as "personalized BRIR data" and "generation date and time".
[0069] "Personalized BRIR data" refers to the data of the personalized BRIR generated by the cloud server 100. In Fig. 4, the personalized BRIR data is conceptually described as "A01", but in reality, a specific numerical value or the like indicating the personalized BRIR is stored in that item.
[0070] The "generation date and time" indicates the date and time when the personalized BRIR data was generated. When the user terminal 10 acquires a personalized BRIR multiple times, the user terminal 10 may store only the latest personalized BRIR in the BRIR table 151, or may store multiple personalized BRIRs in the BRIR table 151.
[0071] Next, the parameter table 122 will be described. The parameter table 122 stores information regarding parameters used when playing back a sound source or video. FIG. 5 shows an example of the parameter table 152 according to an embodiment of the present disclosure. FIG. 5 is a diagram showing an example of the parameter table 152 according to the embodiment. In the example shown in FIG. 5, the parameter table 152 has items such as "setting ID", "personalized BRIR data", "device optimization parameters", and "acquisition date and time".
[0072] "Setting ID" indicates identification information for identifying a setting indicating that a personalized BRIR is associated with a device optimization parameter. "Personalized BRIR data" corresponds to the same item shown in FIG. 4. "Device optimization parameters" indicates data of device optimization parameters acquired from cloud server 100. In FIG. 5, device optimization parameters are conceptually described as "C01", but in reality, specific numerical values or the like indicating the device optimization parameters are stored in the corresponding item.
[0073] The "acquisition date and time" indicates the date and time when the personalized BRIR and device optimization parameters were acquired from the cloud server 100. When the user terminal 10 acquires the personalized BRIR and device optimization parameters multiple times, it may store only the latest personalized BRIR and device optimization parameters in the parameter table 152, or may store multiple personalized BRIRs and device optimization parameters in the BRIR table 151.
[0074] Returning to Fig. 3, the explanation will be continued. The control unit 16 is realized, for example, by a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), or the like executing a program (for example, an information processing program according to the present disclosure) stored inside the user terminal 10 using a random access memory (RAM) or the like as a working area. The control unit 16 is a controller, and may be realized, for example, by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).
[0075] As shown in FIG. 3, the control unit 16 has a first application control unit 161 and a second application control unit 165, and realizes or executes functions and actions of information processing described below. The first application control unit 161 includes a generation unit 162, an execution unit 163, and a provision unit 164. The second application control unit 165 includes an acquisition unit 166, a determination unit 167, a setting unit 168, and a reproduction unit 169. For example, the acquisition unit 166, the determination unit 167, and the setting unit 168 correspond to the data control unit 31 shown in FIG. 2. The reproduction unit 169 corresponds to the player 34 shown in FIG. 2. Note that the internal configuration of the control unit 16 is not limited to the configuration shown in FIG. 3, and may be another configuration as long as it performs information processing described later.
[0076] The generation unit 162 controls the processing related to the generation of the HRTF and the personalized BRIR. Specifically, the generation unit 162 controls the processing related to capturing an image of the user's profile including the ears. The generation unit 162 also controls the processing of transmitting an image obtained by capturing an image to the cloud server 100, and the processing of acquiring the personalized BRIR generated by the cloud server 100.
[0077] The generation unit 162 appropriately stores the image obtained by shooting and the acquired personalized BRIR in the storage unit 15. Note that the generation unit 162 may acquire an image captured by, for example, an external camera and transmit the acquired image to the cloud server 100, instead of transmitting an image captured by the user terminal 10 to the cloud server 100.
[0078] Note that, when a personalized HRTF or personalized BRIR that has already been generated for the user is stored in the cloud server 100, the generation unit 162 may control only the process of acquiring the personalized HRTF or personalized BRIR, without transmitting the image to the cloud server 100. In other words, the process of acquiring the personalized HRTF or personalized BRIR by the generation unit 162 is not limited to a specific method.
[0079] The execution unit 163 executes association between the personalized HRTF or personalized BRIR corresponding to the user and an identifier that identifies the device used by the user.
[0080] For example, when the user starts the first application, the execution unit 163 acquires the personalized BRIR stored in the BRIR table 151. Furthermore, the execution unit 163 acquires an identifier for identifying the headphones 50 connected at the time the first application is started from the headphones 50. Then, the execution unit 163 associates the personalized BRIR with the identifier of the headphones 50, and uploads the personalized BRIR to the cloud server 100 together with the associated information.
[0081] After that, the execution unit 163 acquires the personalized BRIR and the one-time URL for acquiring the headphones 50 issued by the cloud server 100. Note that the execution unit 163 may associate the personalized BRIR with the identifier of the headphones 50 at the time of acquiring the one-time URL for acquisition.
[0082] The providing unit 164 provides the personalized BRIR and an identifier associated with the personalized BRIR to a destination to which the personalized BRIR corresponding to the user is to be provided. The destination is, for example, an app (a second app in the embodiment) different from the first app that is installed in the user terminal 10. Note that the destination is not limited to the second app, and may be another external device (for example, another information processing terminal capable of mutual communication with the user terminal 10), etc.
[0083] The providing unit 164 provides the personalized BRIR to the destination by transmitting a one-time URL for the destination to acquire the personalized BRIR. In other words, the providing unit 164 provides the personalized BRIR to the destination via the one-time URL. In this way, the providing unit 164 can provide the personalized BRIR even to a second application that cannot directly receive and transmit the personalized BRIR due to, for example, OS restrictions.
[0084] Furthermore, the providing unit 164 may provide, together with the identifier, variables (device optimization parameters) according to the device when used together with the personalized BRIR to the recipient.
[0085] The providing unit 164 provides the device optimization parameters to the providing destination by transmitting a one-time URL for the providing destination to acquire the device optimization parameters. That is, the providing unit 164 provides the device optimization parameters to the providing destination via a one-time URL, similar to the personalized BRIR. In this way, the providing unit 164 can provide the device optimization parameters to the second application that cannot be directly handed over due to, for example, OS restrictions.
[0086] The providing unit 164 may provide the device optimization parameters to the destination when communication is established between the user terminal 10, the information processing device, and the headphones 50. That is, for example, when communication with the headphones 50 is disconnected at the timing when the providing unit 164 is to provide the device optimization parameters to the second application, the providing unit 164 may not provide the device optimization parameters to the second application. This allows the providing unit 164 to prevent a discrepancy from occurring between the device that the user is to use and the passed optimization parameters.
[0087] The acquiring unit 166 acquires a personalized BRIR corresponding to a user and an identifier associated with the personalized BRIR.
[0088] For example, the acquisition unit 166 acquires the personalized BRIR from the cloud server 100 via the one-time URL provided by the provision unit 164. Specifically, the acquisition unit 166 acquires the personalized BRIR by accessing the access destination indicated by the one-time URL and making a request to the cloud server 100 to acquire the personalized BRIR.
[0089] Furthermore, the acquisition unit 166 may acquire device optimization parameters according to the device when used together with the personalized BRIR, together with the device identifier.
[0090] For example, the acquisition unit 166 acquires the device optimization parameters from the cloud server 100 via the one-time URL provided by the provision unit 164. Specifically, the acquisition unit 166 acquires the device optimization parameters by accessing the access destination indicated by the one-time URL and making an acquisition request for the device optimization parameters to the cloud server 100.
[0091] The acquiring unit 166 appropriately stores the acquired information in the storage unit 15. For example, the acquiring unit 166 stores the acquired personalized BRIR and device optimization parameters in the parameter table 152 in association with each other.
[0092] The determination unit 167 determines whether the identifier associated with the personalized BRIR matches an identifier that identifies the device used by the user.
[0093] Specifically, the determination unit 167 determines whether an identifier such as a BT device name associated with the personalized BRIR provided by the provision unit 164 matches an identifier such as a BT device name of the equipment currently being used by the user.
[0094] The determination unit 167 determines that a device that has established communication with the user terminal 10 is a device used by the user. For example, the determination unit 167 can identify a device that has established communication with the user terminal 10 by detecting a device connected to the user terminal 10 using a function (library, etc.) of the OS.
[0095] Note that, when the determination unit 167 cannot detect the device currently used by the user or cannot obtain the device identifier, the determination unit 167 may determine that the identifier associated with the personalized BRIR does not match the identifier identifying the device used by the user. For example, when the device currently used by the user is passive and does not have a function for transmitting an identifier, the determination unit 167 determines that the identifier associated with the personalized BRIR does not match the device identifier.
[0096] The setting unit 168 sets the personalized BRIR to be enabled when an identifier associated with the personalized BRIR matches an identifier that identifies a device used by the user. Note that the device used by the user refers to a device or the like that has established communication with the user terminal 10 at the time when the personalized BRIR is to be used, such as when playing back a sound source.
[0097] For example, when an identifier associated with the personalized BRIR matches an identifier that identifies the device used by the user, the setting unit 168 writes to the setting file a message indicating that the personalized BRIR obtained from the cloud server 100 is available for use. This enables the playback unit 169, which will be described later, to perform playback using the personalized BRIR stored in the parameter table 152.
[0098] In addition, the setting unit 168 may set the personalized BRIR or device optimization parameters not to be enabled if the identifier associated with the personalized BRIR does not match the identifier that identifies the device used by the user.
[0099] This enables the setting unit 168 to prevent situations that could degrade the user experience, such as when personalized BRIR or device optimization parameters are incorrectly used in an environment where the playback conditions are unknown, resulting in non-optimal sound source playback.
[0100] The setting unit 168 may set neither the personalized BRIR nor the device optimization parameter to be enabled, or may set the personalized BRIR to be enabled but the device optimization parameter to be disabled. When the setting unit 168 sets the personalized BRIR to be disabled, it writes into the setting file an average BRIR averaged over multiple users to be used in playing back a sound source, rather than the personalized BRIR. When the setting unit 168 sets the device optimization parameter to be disabled, it writes into the setting file an average BRIR averaged over multiple users to be used in playing back a sound source, rather than the device optimization parameter.
[0101] The playback unit 169 plays audio sources and videos. When playing back, the playback unit 169 reads the setting file and identifies the BRIR and parameters to be used for the playback. The playback unit 169 then acquires the personalized BRIR and device optimization parameters written in the setting file from the parameter table 152 and plays back the audio sources and videos.
[0102] For example, the reproducing unit 169 accesses the service server 200, acquires streaming data, and reproduces the acquired streaming data. Note that the reproducing unit 169 may reproduce not only streaming data but also audio sources and videos stored in the storage unit 15.
[0103] [1-3. Information Processing Procedure According to the Embodiment] Next, the procedure of information processing according to the first embodiment will be described with reference to Fig. 6 to Fig. 9. The procedure of processing until the user terminal 10 acquires the personalized BRIR will be described in Fig. 6. Fig. 6 is a flowchart (1) showing the procedure of information processing according to the embodiment.
[0104] 6, the user terminal 10 acquires an image of the user's ear through a photographing process or the like (step S101). Subsequently, the user terminal 10 transmits the ear image to the cloud server 100 (step S102).
[0105] After that, the user terminal 10 acquires the personalized BRIR generated based on the ear image (step S103), and stores the acquired personalized BRIR in the storage unit 15 (BRIR table 151) (step S104).
[0106] Next, a process procedure in which the user terminal 10 provides the second application with a personalized BRIR will be described with reference to Fig. 7. Fig. 7 is a flowchart (2) showing the procedure of information processing according to the embodiment.
[0107] 7, the user terminal 10 determines whether or not the activation of the first application is detected (Step S201). If the activation of the first application is not detected (Step S201; No), the user terminal 10 waits until the activation is detected.
[0108] On the other hand, when the start of the first application is detected (step S201; Yes), the user terminal 10 acquires information about the device connected to the user terminal 10 (for example, the identifier of the headphones 50, etc.) (step S202).
[0109] Thereafter, the user terminal 10 transmits the personalized BRIR stored in the BRIR table 151 to the cloud server 100 (step S203). Next, the user terminal 10 acquires an address for acquiring the personalized BRIR, which has been issued by the cloud server 100 (step S204).
[0110] Furthermore, the user terminal 10 determines whether or not an address for acquiring device optimization parameters has been acquired (step S205). If an address for acquiring device optimization parameters has been acquired (step S205; Yes), the user terminal 10 associates the device identifier with the personalized BRIR (step S206).
[0111] On the other hand, if the address for acquiring device optimization parameters has not been acquired (step S205; No), the user terminal 10 does not need to associate the device identifier with the personalized BRIR. If the address for acquiring device optimization parameters has not been acquired, it means, for example, that the device is passive and the identifier could not be acquired in step S202, or that the cloud server 100 does not hold the optimization parameters of the device.
[0112] Then, the user terminal 10 provides the information such as the acquisition address acquired from the cloud server 100 to the second application (step S207).
[0113] Next, a process procedure for the user terminal 10 to set a personalized BRIR will be described with reference to Fig. 8. Fig. 8 is a flowchart (3) showing the procedure of information processing according to the embodiment.
[0114] 8, the user terminal 10 determines whether or not the activation of the second application is detected (Step S301). If the activation of the second application is not detected (Step S301; No), the user terminal 10 waits until the activation is detected.
[0115] On the other hand, when the start of the second application is detected (step S301; Yes), the user terminal 10 acquires information provided from the first application (step S302).
[0116] Thereafter, the user terminal 10 uses the provided retrieval address to retrieve the personalized BRIR from the cloud server 100 (step S303). Next, the user terminal 10 stores the retrieved personalized BRIR in the storage unit 15 (parameter table 152) (step S304).
[0117] The user terminal 10 also determines whether or not an address for acquiring device optimization parameters has been acquired from the first application (step S305). If an address for acquiring device optimization parameters has been acquired (step S305; Yes), the user terminal 10 acquires the device optimization parameters from the cloud server 100 using the acquisition address (step S306). The user terminal 10 stores the acquired device optimization parameters in the storage unit 15 (parameter table 152) in association with the personalized BRIR (step S307).
[0118] Furthermore, the user terminal 10 acquires information on the currently connected device (step S308). Then, the user terminal 10 determines whether the identifier of the device acquired in step S308 matches the identifier associated with the personalized BRIR (step S309).
[0119] If the device identifier acquired in step S308 matches the identifier associated with the personalized BRIR (step S309; Yes), the user terminal 10 registers the use of the personalized BRIR and device optimization parameters in the setting file. In other words, the user terminal 10 activates the personalized BRIR and device optimization parameters (step S310).
[0120] On the other hand, if the user terminal 10 does not acquire an address for acquiring device optimization parameters from the first application (step S305; No) or if the device identifier acquired in step S308 does not match the identifier associated with the personalized BRIR (step S309; No), the user terminal 10 registers in the setting file that the personalized BRIR and device optimization parameters will not be used. In other words, the user terminal 10 sets the personalized BRIR and device optimization parameters not to be enabled (step S311).
[0121] Note that the user terminal 10 may set only the device optimization parameters not to be enabled, rather than setting neither the personalized BRIR nor the device optimization parameters to be enabled in step S311. For example, the user terminal 10 may allow the user to use only the personalized BRIR when the device is passive, etc.
[0122] Next, a procedure of a process in which the user terminal 10 performs playback using the personalized BRIR will be described with reference to Fig. 9. Fig. 9 is a flowchart (4) showing the procedure of information processing according to the embodiment.
[0123] The user terminal 10 determines whether or not activation of a player of the second application has been detected (step S401). Note that activation of a player may be interpreted as, for example, the user performing an operation to play a sound source in the second application.
[0124] If the activation of the player is not detected (step S401; No), the user terminal 10 waits until the activation is detected. On the other hand, if the activation of the player is detected (step S401; Yes), the user terminal 10 reads the setting file (step S402).
[0125] Next, the user terminal 10 acquires the sound source from the service server 200 (step S403). Then, the user terminal 10 plays the sound source while convolving, for example, a personalized BRIR or device optimization parameters into the sound source based on the setting file (step S404).
[0126] During playback of the sound source, the user terminal 10 determines whether the connected device has been changed (step S405). If the connected device has been changed (step S405; Yes), that is, if the headphones used by the user have been changed or communication has been disconnected, the setting file is changed (step S406). For example, the user terminal 10 cancels the activation of the personalized BRIR and device optimization parameters, and changes the setting file so that this information cannot be used for playback.
[0127] After that, the user terminal 10 judges whether or not the user has requested to stop the playback (step S407). If the user has not requested to stop the playback (step S407; No), the user terminal 10 continues the process of acquiring the sound source from the service server 200 in order to continue the playback.
[0128] On the other hand, if the user requests to stop the playback (step S407; Yes), the user terminal 10 stops the playback of the sound source (step S408).
[0129] (2. Modifications) The above-described information processing system 1 may be implemented in various different forms other than the above-described embodiment. Therefore, modifications of the embodiment will be described below.
[0130] [2-1. Information Processing System] In the embodiment, a one-time URL has been given as an example of an address for acquiring the personalized BRIR and device optimization parameters, but this is not limiting and any method may be used as long as it enables the second application to acquire data from the cloud server 100. Furthermore, after providing the personalized BRIR to the user terminal 10 via the one-time URL, the cloud server 100 may delete the provided personalized BRIR or may retain it for a certain period of time.
[0131] In the embodiment, an example has been shown in which the cloud server 100 generates the personalized BRIR. However, the personalized BRIR may be generated by the user terminal 10 instead of the cloud server 100. In this case, the cloud server 100 holds the personalized BRIR uploaded from the user terminal 10, and only needs to perform a process of issuing an acquisition address when requested.
[0132] In the embodiment, it is assumed that the cloud server 100 is installed on a cloud network, but this is not limited to the example, and the cloud server 100 may be installed on a network such as a LAN (Local Area Network) as long as it is capable of communicating with the user terminal 10.
[0133] When generating the personalized BRIR, the cloud server 100 may acquire the user's identification information, associate the identification information with the personalized BRIR, and store the personalized BRIR. In this case, the cloud server 100 can provide the personalized BRIR to the second application without receiving an upload of the personalized BRIR from the first application every time the second application is started.
[0134] In the embodiment, the cloud server 100 has been described as a single server, but the cloud server 100 may be composed of multiple server devices. For example, the cloud server 100 may be divided into a generating server that generates a personalized BRIR and a providing server that issues an address for obtaining the personalized BRIR and provides the personalized BRIR.
[0135] In the embodiment, an example in which the first application and the second application are installed in the user terminal 10 has been described, but the first application and the second application may be applications installed in different devices. For example, the user terminal 10 may hold only the function of the first application and control the second application installed in a different device such as a smart speaker to play back a sound source.
[0136] [2-2. How the sound source is played] When the cloud server 100 does not hold a personalized BRIR or device optimization parameters for a user, it may transmit to the user terminal 10 an average BRIR for multiple users or standard parameters that are not dependent on a specific device.
[0137] This point will be described with reference to Fig. 10. Fig. 10 is a conceptual diagram showing a usage mode of a head-related transfer function according to a modified example.
[0138] As shown in FIG. 10, when a sound source is played back in the second application, for example, there are two possible modes, pattern 1 and pattern 2. Pattern 1 indicates a case where a personalized BRIR or device optimization parameters cannot be used, such as when a device cannot be recognized. Specifically, pattern 1 is operated by a combination 70 of streaming data, a service application (a playback application), a library, an averaged BRIR, and standard parameters. On the other hand, pattern 2 indicates a case where a device can be recognized and parameters corresponding to the device exist. Specifically, pattern 2 is operated by a combination 80 of streaming data, a service application, a library, a personalized BRIR, and device optimization parameters.
[0139] [2-3. Using parameters] The user terminal 10 may not acquire device optimization parameters every time playback is performed, but may acquire device optimization parameters corresponding to a plurality of devices in advance. In this case, the user terminal 10 can identify the optimization parameters of a connected device based on the identifier of the device, and perform playback or the like using the identified parameters. The user terminal 10 may also present a list of device parameters owned by the user, for example, and allow the user to select a parameter. In this way, even if a user only owns passive headphones, for example, playback can be performed using the user's personalized BRIR and device optimization parameters.
[0140] In the embodiment, an example has been shown in which the user terminal 10 (second application) does not acquire device optimization parameters for, for example, passive headphones. However, the user terminal 10 may also acquire device optimization parameters for devices that do not have a communication function, such as passive headphones. In this case, the user manually selects the name, etc. of the device in the first application. Note that a list of the names, etc. of the devices is provided to the user terminal 10 from the cloud server 100. Then, the user terminal 10 acquires from the cloud server 100 an acquisition address corresponding to the device optimization parameters of the device selected by the user.
[0141] Then, the user terminal 10 provides the acquired acquisition address to the second application. As a result, the second application can acquire an acquisition address for device optimization parameters related to Passive headphones or the like. In this case, step S305 shown in FIG. 8 branches to "Yes," so the user can enjoy music playback using the personalized BRIR and device optimization parameters even with Passive headphones. Note that the user terminal 10 may appropriately execute music playback that combines various functions and variables, such as music playback using only the personalized BRIR (standard parameters, not device optimization parameters) or music playback using only the averaged BRIR, in addition to music playback using the personalized BRIR and device optimization parameters, depending on the user's situation.
[0142] When generating a personalized BRIR from the personalized HRTF, the cloud server 100 may convolute a different RIR (e.g., an RIR suited to the user's indoor environment) depending on, for example, the user's location or situation. This allows the cloud server 100 to provide the user with a personalized BRIR that is more suited to the user's situation. In this case, instead of the cloud server 100 generating a personalized BRIR, the user terminal 10 itself, which has acquired multiple RIRs, may identify an RIR suited to the environment and convolve it with the personalized HRTF.
[0143] [2-4. Equipment aspects] In the embodiment, an example has been shown in which the headphones 50 are connected to the user terminal 10 using Bluetooth. However, devices such as the headphones 50 may be connected using various communication standards other than Bluetooth.
[0144] (3. Other embodiments) The processing according to each of the above-described embodiments may be implemented in various different forms other than the above-described embodiments.
[0145] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.
[0146] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.
[0147] Furthermore, the above-described embodiments and modifications can be appropriately combined as long as the processing contents are not contradictory.
[0148] Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.
[0149] (4. Effects of the information processing device according to the present disclosure) As described above, the information processing device (user terminal 10 in the embodiment) according to the present disclosure includes an execution unit (execution unit 163 in the embodiment) and a provision unit (providing unit 164 in the embodiment). The execution unit executes association between a head-related transfer function corresponding to a user (personalized HRTF or personalized BRIR in the embodiment) and an identifier that identifies a device used by the user. The provision unit provides the head-related transfer function and the identifier associated with the head-related transfer function to a destination to which the head-related transfer function corresponding to the user is provided.
[0150] In this way, the information processing device according to the present disclosure identifies the currently connected device in the environment in which the head-related transfer function is to be used. As a result, the information processing device can recognize that an inappropriate device is connected during playback, and can appropriately use the head-related transfer function.
[0151] The providing unit also provides the head-related transfer function to the destination by transmitting a one-time URL for the destination to acquire the head-related transfer function. This allows the information processing device to provide the head-related transfer function to a destination that has restrictions such as an OS.
[0152] The providing unit also provides the destination with a variable according to the device when used together with the head-related transfer function, together with the identifier, thereby enabling the information processing device to perform optimal playback according to the device.
[0153] The providing unit also provides the variables to the destination by transmitting a one-time URL for the destination to acquire the variables, thereby enabling the information processing device to provide variables such as device optimization parameters to a destination that has restrictions such as an OS.
[0154] In addition, the providing unit provides the variables to the destination when communication between the information processing device and the device is established. This allows the information processing device to prevent the variables from being applied to a device that is not suitable for the acquired variables when playing music, thereby preventing inappropriate playback.
[0155] Moreover, the information processing device according to the present disclosure includes an acquisition unit (acquisition unit 166 in the embodiment), a determination unit (determination unit 167 in the embodiment), and a setting unit (setting unit 168 in the embodiment). The acquisition unit acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function. The determination unit determines whether the identifier associated with the head-related transfer function matches an identifier identifying a device used by the user. The setting unit sets the head-related transfer function to be enabled when the identifier associated with the head-related transfer function matches an identifier identifying a device used by the user.
[0156] In this way, the information processing device according to the present disclosure determines whether the device associated with the head-related transfer function at the time of acquiring the head-related transfer function matches the device actually connected, and sets the head-related transfer function to be enabled based on the result. This allows the information processing device to prevent the head-related transfer function from being applied to an inappropriate device during playback.
[0157] In addition, the acquisition unit acquires the head-related transfer function via a one-time URL for acquiring the head-related transfer function. This allows the information processing device to acquire the head-related transfer function even when there are restrictions on the OS, etc.
[0158] The acquisition unit also acquires, together with the identifier, a parameter according to the device used together with the head-related transfer function, thereby enabling the information processing device to perform optimal playback according to the device.
[0159] The acquisition unit also acquires the variables via a one-time URL for acquiring the variables, which allows the information processing device to acquire the variables even when there are restrictions on the OS or the like.
[0160] The determination unit determines that the device that has established communication with the information processing device is the device used by the user. The setting unit sets the variable to be enabled when an identifier associated with the head-related transfer function matches an identifier that identifies the device used by the user. This allows the information processing device to determine whether or not a device other than the device associated with the acquired head-related transfer function is connected during playback, thereby preventing the variable from being applied to an inappropriate device.
[0161] In addition, when an identifier associated with the head-related transfer function does not match an identifier for identifying a device used by the user, the setting unit sets the head-related transfer function or the variable not to be enabled. This allows the information processing device to prevent variables, etc., that are not suitable for the device from being used.
[0162] (5. Hardware Configuration) Information devices such as the user terminal 10, headphones 50, cloud server 100, and service server 200 according to the above-described embodiments are realized by a computer 1000 having a configuration as shown in FIG. 11, for example. The user terminal 10 according to the embodiments will be described below as an example. FIG. 11 is a hardware configuration diagram showing an example of a computer 1000 that realizes the functions of the user terminal 10. The computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. Each unit of the computer 1000 is connected by a bus 1050.
[0163] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processes corresponding to the various programs.
[0164] The ROM 1300 stores boot programs such as a basic input output system (BIOS) executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000.
[0165] HDD 1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU 1100 and data used by such programs. Specifically, HDD 1400 is a recording medium that records an information processing program according to the present disclosure, which is an example of program data 1450.
[0166] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet). For example, the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.
[0167] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 also transmits data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading a program or the like recorded on a predetermined recording medium. The medium may be, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0168] For example, when the computer 1000 functions as the user terminal 10 according to the embodiment, the CPU 1100 of the computer 1000 executes an information processing program loaded onto the RAM 1200 to realize functions of the control unit 16, etc. Also, the information processing program according to the present disclosure and data in the storage unit 15 are stored in the HDD 1400. Note that the CPU 1100 reads and executes the program data 1450 from the HDD 1400, but as another example, these programs may be obtained from other devices via an external network 1550.
[0169] The present technology can also be configured as follows. (1) An execution unit that executes association between a head related transfer function corresponding to a user and an identifier that identifies a device used by the user; a providing unit that provides a head-related transfer function corresponding to the user and the identifier associated with the head-related transfer function to a destination to which the head-related transfer function corresponding to the user is provided; An information processing device comprising: (2) The providing unit is The head related transfer function is provided to the destination by transmitting a one-time URL (One-Time URL) for the destination to acquire the head related transfer function. The information processing device according to (1). (3) The providing unit is A variable corresponding to the device when used together with the head related transfer function is provided to the providing destination together with the identifier. The information processing device according to (1) or (2). (4) The providing unit is The variable is provided to the destination by transmitting to the destination a one-time URL for the destination to acquire the variable. The information processing device according to (3). (5) The providing unit is When communication between the information processing device and the device is established, the variable is provided to the destination. The information processing device according to (3) or (4). (6) The computer Execute a correspondence between a head-related transfer function corresponding to a user and an identifier for identifying a device used by the user; Provide a destination to which a head-related transfer function corresponding to the user is provided with the head-related transfer function and the identifier associated with the head-related transfer function. Information processing methods. (7) Computer, An execution unit that executes association between a head related transfer function corresponding to a user and an identifier that identifies a device used by the user; a providing unit that provides a head-related transfer function corresponding to the user and the identifier associated with the head-related transfer function to a destination to which the head-related transfer function corresponding to the user is provided; An information processing program that functions as a (8) An acquisition unit that acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function; A determination unit that determines whether an identifier associated with the head related transfer function matches an identifier that identifies a device used by the user; a setting unit that sets the head-related transfer function to be enabled when an identifier associated with the head-related transfer function matches an identifier that identifies a device used by the user; An information processing device comprising: (9) The acquisition unit is The head-related transfer function is acquired via a one-time URL for acquiring the head-related transfer function. The information processing device according to (8). (10) The acquisition unit is Acquire a variable according to the device when used together with the head related transfer function together with the identifier. The information processing device according to (8) or (9). (11) The acquisition unit is The variable is obtained via a one-time URL for obtaining the variable. The information processing device according to (10). (12) The determination unit is determining that a device with which communication has been established with the information processing device is a device used by the user; The setting unit is When an identifier associated with the head related transfer function matches an identifier for identifying a device used by the user, the variable is set to be enabled. The information processing device according to (10) or (11). (13) The setting unit is When an identifier associated with the head-related transfer function does not match an identifier for identifying a device used by the user, the head-related transfer function or the variable is set not to be enabled. The information processing device according to any one of (10) to (12). (14) The computer Acquire a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function; determining whether an identifier associated with the head-related transfer function matches an identifier for identifying a device used by the user; When an identifier associated with the head-related transfer function matches an identifier for identifying a device used by the user, the head-related transfer function is set to be enabled. Information processing methods. (15) Computer, An acquisition unit that acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function; A determination unit that determines whether an identifier associated with the head related transfer function matches an identifier that identifies a device used by the user; a setting unit that sets the head-related transfer function to be enabled when an identifier associated with the head-related transfer function matches an identifier that identifies a device used by the user; An information processing program that functions as a [Explanation of symbols]
[0170] 1. Information Processing Systems 10 User terminal 11 Communications Department 12 Input section 13 Display section 14 Detection unit 15 Storage section 151 BRIR Table 152 Parameter Table 16 Control section 161 First application control unit 162 Generation part 163 Executive Department 164 Provision Department 165 Second application control section 166 Acquisition Department 167 Judgment Department 168 Settings 169 Playback Department 50 Headphones 100 Cloud Servers 200 Service Server
Claims
1. an execution unit that executes association between a head related transfer function corresponding to a user and an identifier that identifies a sound reproduction device used by the user; a providing unit that provides an application to which a head related transfer function corresponding to the user is provided with an acquisition address for the application to acquire the head related transfer function, thereby providing the head related transfer function and the identifier associated with the head related transfer function; An information processing device comprising:
2. The providing unit is Providing the application with variables corresponding to the sound reproduction device when used with the head-related transfer function The information processing device according to claim 1 .
3. The providing unit is The application provides the variable to the application by providing the application with the address for retrieval for the application to retrieve the variable. The information processing device according to claim 2 .
4. The providing unit is When communication between the information processing device and the sound reproducing device is established, the variable is provided to the application. The information processing device according to claim 2 .
5. The computer Execute a correspondence between a head-related transfer function corresponding to a user and an identifier for identifying a sound reproduction device used by the user; To an application to which a head related transfer function corresponding to the user is provided, an acquisition address for the application to acquire the head related transfer function is provided, thereby providing the head related transfer function and the identifier associated with the head related transfer function. Information processing methods.
6. Computer, an execution unit that executes association between a head related transfer function corresponding to a user and an identifier that identifies a sound reproduction device used by the user; a providing unit that provides an application to which a head related transfer function corresponding to the user is provided with an acquisition address for the application to acquire the head related transfer function, thereby providing the head related transfer function and the identifier associated with the head related transfer function; An information processing program that functions as a
7. Providing the application with variables corresponding to the sound reproduction device when used with the head-related transfer function The information processing method according to claim 5 , further comprising:
8. The providing unit is Providing the application with variables corresponding to the sound reproduction device when used with the head-related transfer function 7. An information processing program according to claim 6.
9. An acquisition unit that acquires an acquisition address for an application that uses a head-related transfer function corresponding to a user to acquire the head-related transfer function, and acquires the head-related transfer function corresponding to the user and an identifier associated with the head-related transfer function by accessing the acquisition address; a determination unit that determines whether an identifier associated with the head-related transfer function matches an identifier that identifies a sound reproducing device used by the user; a setting unit that sets the head-related transfer function to be enabled when an identifier associated with the head-related transfer function matches an identifier that identifies a sound reproduction device used by the user; An information processing device comprising:
10. The acquisition unit is Acquire a variable according to the sound reproduction device when used together with the head-related transfer function. The information processing device according to claim 9.
11. The acquisition unit is The variable is acquired via the acquisition address for acquiring the variable. The information processing device according to claim 10.
12. The determination unit is determining that a device with which communication has been established with the information processing device is a sound reproducing device used by the user; The setting unit is When an identifier associated with the head-related transfer function matches an identifier for identifying a sound reproducing device used by the user, the variable is set to be enabled. The information processing device according to claim 10.
13. The setting unit is When an identifier associated with the head-related transfer function does not match an identifier for identifying a device used by the user, the head-related transfer function or the variable is set not to be enabled. The information processing device according to claim 10.
14. The computer An application that uses a head-related transfer function corresponding to a user acquires an acquisition address for acquiring the head-related transfer function, and acquires a head-related transfer function corresponding to the user and an identifier associated with the head-related transfer function by accessing the acquisition address; determining whether an identifier associated with the head-related transfer function matches an identifier for identifying a sound reproducing device used by the user; When an identifier associated with the head-related transfer function matches an identifier for identifying a sound reproducing device used by the user, the head-related transfer function is set to be enabled. Information processing methods.
15. Computer, An acquisition unit that acquires an acquisition address for an application that uses a head related transfer function corresponding to a user to acquire the head related transfer function, and acquires the head related transfer function corresponding to the user and an identifier associated with the head related transfer function by accessing the acquisition address; a determination unit that determines whether an identifier associated with the head-related transfer function matches an identifier that identifies a sound reproducing device used by the user; a setting unit that sets the head-related transfer function to be enabled when an identifier associated with the head-related transfer function matches an identifier that identifies a sound reproducing device used by the user; An information processing program that functions as a
16. Acquire a variable according to the sound reproduction device when used together with the head-related transfer function. The information processing method according to claim 14, further comprising:
17. The acquisition unit is Acquire a variable according to the sound reproduction device when used together with the head-related transfer function.
16. An information processing program according to claim 15.
Citation Information
Patent Citations
Sound image localization apparatus in forward and backward direction by headphone and method therefor
JP2003153398A
Controller of localization of sound, and method of controlling localization of sound
JP2010118978A
Customized head-related transfer functions
US9544706B1