Information processing device, information processing method, and information processing program

Abstract

The invention relates to an information processing apparatus, an information processing method, and an information processing program. An information processing device according to the present disclosure is provided with: an execution unit that performs associating a head transfer function corresponding to a user with an identifier for identifying a device used by the user; and a providing unit that provides the head transfer function and the identifier associated with the head transfer function to the providing destination to which the head transfer function corresponding to the user is to be provided.

Description

[0001] This application is a divisional application of Chinese Patent Application No. 201980084879.3, titled "Information Processing Apparatus, Information Processing Method, and Information Processing Program", filed on December 26, 2019. Technical Field

[0002] The present disclosure relates to an information processing apparatus, an information processing method, and an information processing program. Specifically, the present disclosure relates to the use of a head-related transfer function. Background Art

[0003] There is a technique for three-dimensionally reproducing a sound image in a pair of headphones or the like by using a head-related transfer function that mathematically represents how the ears receive sound from a sound source.

[0004] Since the head-related transfer function varies greatly among individuals, it is preferable to use a head-related transfer function generated for each person. For example, there is a known technique for generating a three-dimensional digital model (hereinafter referred to as a "3D model") of a head region based on a captured image of a user's auricle and calculating the user's head-related transfer function according to the generated 3D model.

[0005] Citation List

[0006] Patent Literature

[0007] Patent Document 1: U.S. Patent No. 9,544,706 Summary of the Invention

[0008] Technical Problem

[0009] According to the conventional technique, since the head-related transfer function that has been calculated separately for each user can be used for information processing, the sense of localization of the sound image can be enhanced.

[0010] However, with the above-described conventional technique, it is not always possible to appropriately use the head-related transfer function calculated for each user. For example, there may be a case where a user desires to flexibly use the head-related transfer function, such as using his or her own head-related transfer function not only for a single application (such as a music playback application) but also for multiple applications installed in a smart phone. In addition, the head-related transfer function can further enhance the sense of reality or give an accurate sense of localization if adjusted according to the actual usage situation or the audio equipment used by the user. However, the conventional technique only calculates the head-related transfer function for each user and does not perform processing to change the usage pattern of the head-related transfer function according to the situation so that the user can flexibly use the head-related transfer function.

[0011] Therefore, the present disclosure provides an information processing apparatus, an information processing method, and an information processing program that can appropriately use head-related transfer function information.

[0012] Solution to the problem

[0013] To solve the above problems, an information processing apparatus includes: an execution unit that associates a head-related transfer function corresponding to a user with an identifier identifying equipment used by the user; and a providing unit that provides the head-related transfer function and the identifier associated with the head-related transfer function to a providing destination to which the head-related transfer function corresponding to the user is provided.

[0014] In addition, to solve the above problems, an information processing apparatus includes: an acquisition unit that acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function; a determination unit that determines a match between the identifier associated with the head-related transfer function and an identifier identifying equipment used by the user; and a setting unit that, when the identifier associated with the head-related transfer function and the identifier identifying equipment used by the user match, sets the head-related transfer function to enable the head-related transfer function. Brief description of the drawings

[0015] Figure 1 is a diagram illustrating an information processing system according to an embodiment of the present disclosure.

[0016] Figure 2 is a conceptual diagram illustrating an overall process of information processing according to an embodiment.

[0017] Figure 3 is a diagram illustrating a configuration example of a user terminal according to an embodiment.

[0018] Figure 4 is a diagram illustrating an example of a BRIR table according to an embodiment.

[0019] Figure 5 is a diagram illustrating an example of a parameter table according to an embodiment.

[0020] Figure 6 is a flowchart (1) illustrating a process of information processing according to an embodiment.

[0021] Figure 7 is a flowchart (2) illustrating a process of information processing according to an embodiment.

[0022] Figure 8 is a flowchart (3) illustrating a process of information processing according to an embodiment.

[0023] Figure 9 It is a flowchart (4) illustrating the process of information processing according to an embodiment.

[0024] Figure 10 It is a conceptual diagram illustrating the usage pattern of a header-related transfer function according to a modification example.

[0025] Figure 11 It is a hardware configuration diagram illustrating an example of a computer implementing the functions of an information processing apparatus. Detailed Implementation Modes

[0026] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in each embodiment, the same reference numerals are assigned to components having the same functions, and the description of the overlapping parts will be omitted.

[0027] The present disclosure will be described in the following order of items:

[0028] 1. Embodiment

[0029] 1-1. Configuration example of an information processing system and information processing according to an embodiment

[0030] 1-2. Configuration of an information processing apparatus according to an embodiment

[0031] 1-3. Process of information processing according to an embodiment

[0032] 2. Modification example

[0033] 2-1. Mode of the information processing system

[0034] 2-2. Playback mode of the sound source

[0035] 2-3. Use of parameters

[0036] 2-4. Mode of the equipment

[0037] 3. Other embodiments

[0038] 4. Effects of the information processing apparatus according to the present disclosure

[0039] 5. Hardware configuration

[0040] (1. Embodiment)

[0041] [1-1. Configuration example of an information processing system and information processing according to an embodiment]

[0042] First, with reference to Figure 1 and Figure 2 the configuration of the information processing system 1 according to the present disclosure and an overview of the information processing performed by the information processing system 1 will be described. Figure 1FIG. 0 is a diagram illustrating an information processing system 1 according to an embodiment of the present disclosure. Information processing according to an embodiment of the present disclosure is implemented by the information processing system 1 illustrated in Figure 1 as shown in Figure 1 FIG. 1. As shown in FIG. 2, the information processing system 1 includes a user terminal 10, a pair of earphones 50, a cloud server 100, and a service server 200. Each device included in the information processing system 1 performs two-way communication by using a wired or wireless network (not shown). In addition, the number of devices constituting the information processing system 1 is not limited to the number shown in the figure.

[0043] The user terminal 10 is an example of an information processing device according to the present disclosure, and is an information processing terminal that performs information processing by using a head-related transfer function (hereinafter sometimes referred to as HRTF (Head-Related Transfer Function)). The user terminal 10 is implemented by, for example, a smart phone having an image capture function.

[0044] A pair of earphones 50 is an example of audio equipment used by a user. For example, a pair of earphones 50 has a communication function such as Bluetooth (registered trademark) and establishes wireless communication with the user terminal 10. Then, a pair of earphones 50 outputs voices and the like transmitted from the user terminal 10 according to operations performed by the user.

[0045] The cloud server 100 calculates an HRTF (head-related transfer function) corresponding to each user and provides the calculated HRTF to the user terminal 10. The cloud server 100 acquires an image of the user's ear from the user terminal 10 via a network and calculates the user's HRTF based on the acquired image.

[0046] The service server 200 is a server device that provides a sound source such as music to the user terminal 10. For example, the service server 200 provides a streaming sound source and the like to the user terminal 10 via a network according to control executed by a music playback application or the like installed in the user terminal 10.

[0047] As described above, the user terminal 10 performs information processing using the HRTF. The HRTF represents a change in sound generated by peripheral objects including the shape of the human auricle (outer ear), the head region, etc. as a transfer function. Generally, measurement data for obtaining the HRTF is acquired by measuring a sound signal that is used for measurement by using a microphone worn on the auricle by a person, a virtual head-mounted microphone, or the like.

[0048] For example, the HRTF for technologies such as 3D sound is often calculated by using measurement data obtained by a virtual head-mounted microphone or the like, or by using the average value of measurement data obtained from a large number of people. However, since the HRTF varies greatly among individuals, it is preferable to use the HRTF of an individual user in order to achieve a more effective acoustic stage effect. That is, a more realistic acoustic body sensation can be provided to the user by replacing the general HRTF with the user's own HRTF.

[0049] As an example of a method for calculating the personal HRTF of a user, there is a method for calculating the HRTF of a user based on a captured image of the user's ear shape. For example, the cloud server 100 acquires an image including the shape of the user's ear captured by the user terminal 10, and calculates the personal HRTF of the user based on the acquired image. Then, the cloud server 100 sends the calculated HRTF to the user terminal 10. Therefore, the user terminal 10 can play back the sound of 3D sound reproduced by using the personal HRTF of the user, and can play back a moving image with a sense of reality.

[0050] However, there are some problems with the above method. For example, the user terminal 10 operates applications developed by various commercial operators, such as an application having a function of sending or managing the HRTF (hereinafter, simply referred to as an "application"), an application for playing back music, and an application for playing back a moving image. In this case, there may be a situation where it is impossible to send and receive HRTF data between the application for managing the HRTF and the application for music playback purposes, etc., due to, for example, operating system (OS) restrictions.

[0051] In addition, even if the HRTF data can be sent and received, there is a possibility that its operation may not be properly performed. For example, the HRTF can be calculated regardless of the audio equipment (such as a pair of headphones 50) actually used by the user; however, in order to more effectively exert the sound effect, it is preferable to use the HRTF data together with variables (parameters) such as the output value according to the impedance of the equipment or the delay time based on the shape of the output unit of the equipment. However, when the user uses an application for music playback purposes, etc., due to OS restrictions, it is difficult for the cloud server 100 and the application for managing the HRTF to control the use of the application for music playback purposes. Therefore, there may be a situation where the HRTF is used in a mode not intended by the cloud server 100 and the application for managing the HRTF.

[0052] As described above, when enabling the HRTF to be flexibly used across multiple applications or when enabling the HRTF to be appropriately used according to the user's environment or the state of the equipment, there are various problems regarding the HRTF. The user terminal 10 according to an embodiment solves the above problems by the information processing according to the present disclosure described below. Next, with reference to Figure 1 andFigure 2 The process consistently describes an overview of information processing according to the present disclosure.

[0053] As Figure 1 illustrated, a first application 20 and a second application 30 have been installed in a user terminal 10. The first application 20 is an application provided, for example, by a commercial operator who manages a cloud server 100. The first application 20 has functions of capturing an image including a user's ear, sending the captured image to the cloud server 100, and managing HRTF sent from the cloud server 100.

[0054] In the information processing according to the embodiment, first, the first application 20 captures an image including the user's ear according to an operation performed by the user and obtains an image including the ear (step S1). Subsequently, the first application 20 sends the image including the ear to the cloud server 100 (step S2). In addition, as a preprocess for sending the image to the cloud server 100, the first application 20 may also perform a process of detecting a video image of the user's ear included in the image and cropping out a region of the detected video image of the ear from the image.

[0055] The cloud server 100 obtains the image sent from the user terminal 10. Then, the cloud server 100 calculates the user's HRTF according to the image (step S3). Various methods can also be used for the method of calculating the HRTF performed by the cloud server 100. For example, if a two-dimensional image of an ear including a video image is input, the cloud server 100 may also calculate the HRTF by using a model obtained by learning to output an HRTF associated with each ear. Alternatively, the cloud server 100 may also generate a 3D model of the user's head region according to the two-dimensional image of the ear including the video image and calculate the HRTF according to the generated 3D model. In the following description, the HRTF calculated according to an individual user is referred to as a personal HRTF and is sometimes distinguished from a general HRTF.

[0056] In addition, the cloud server 100 can also generate a BRIR (Binaural Room Impulse Response) by convolving the RIR (Room Impulse Response) with the calculated personal HRTF. In the following description, the BRIR generated according to an individual user is referred to as a personal BRIR and is sometimes distinguished from a general BRIR. In addition, for example, the data actually used when playing back music on the user terminal 10 is sometimes not the HRTF but the BRIR; however, in the following description, it is assumed that the two can be replaced with each other. For example, the description of "sending the generated BRIR" includes the case of sending the calculated HRTF. In addition, it is assumed that the description of "performing playback by using the BRIR" includes the case of performing playback by using the HRTF.

[0057] Thereafter, the cloud server 100 sends the generated personal BRIR to the user terminal 10 (step S4). The first application 20 acquires the personal BRIR (step S5). In this way, the user can acquire his / her own personal BRIR by capturing the user's side and sending the image to the cloud server 100. Then, the first application 20 stores the received personal BRIR in the storage area 21 (step S6).

[0058] Next, Figure 2 the process flow executed when the user terminal 10 plays back music or the like by using the personal BRIR will be described. Figure 2 is a conceptual diagram illustrating the overall process flow of information processing according to an embodiment.

[0059] When the user performs an operation to start the first application 20 as a trigger, the first application 20 acquires the personal BRIR stored in the storage area 21 (step S11). In addition, the first application 20 identifies the equipment connected to the user terminal 10. In Figure 2 the illustrated example, the first application 20 identifies a pair of headphones 50 that has established communication with the user terminal 10 by using a wireless connection such as Bluetooth.

[0060] In this case, the first application 20 acquires information related to a pair of headphones 50 as the connected equipment (step S12). For example, the first application 20 acquires an identifier that identifies the equipment. When the equipment has, for example, a Bluetooth function, the identifier is a string such as a BT device name for identifying the equipment or a unique string for identifying an individual equipment. In addition, the identifier can also be a model name of the equipment given by the manufacturer.

[0061] In addition, the first application 20 may also obtain information indicating whether the connected device has a communication function. For example, if the device does not have a communication function such as Bluetooth, there may be a situation where the device cannot send information such as an identifier. In this case, the first application 20 obtains information related to a mode indicating that the device connected to the user terminal 10 cannot be recognized. This information is distinguished by using information indicating whether the type of the device is active (has a communication function) or passive (has no communication function). That is, the first application 20 obtains information indicating whether the connected device is active or passive. In Figure 2 In the illustrated example, since a pair of headphones 50 has a communication function, the first application 20 obtains information indicating that a pair of headphones 50 as the connected device is "active".

[0062] Then, the first application 20 associates the personal BRIR with the identifier of a pair of headphones 50 as the device used by the user. The association mentioned here indicates that since the device currently connected to the user terminal 10 is, for example, a pair of headphones 50, the second application 30 described later grants control information for controlling playback in devices other than the pair of headphones 50. More specifically, the association mentioned here indicates that control information granted for optimizing certain device variables (hereinafter referred to as "device optimization parameters") is not misused by other devices.

[0063] Thereafter, the first application 20 sends (uploads) information related to the personal BRIR or the pair of headphones 50 to the cloud server 100 (step S13). This process is performed so that the personal BRIR can be transmitted via the cloud server 100 because the data cannot be directly sent from the first application 20 to the second application 30.

[0064] The cloud server 100 obtains information related to the personal BRIR and the pair of headphones 50. Then, the cloud server 100 specifies the device optimization parameters of the pair of headphones 50 from the multiple pieces of stored information based on the identifier of the pair of headphones 50.

[0065] In addition, the cloud server 100 publishes the acquisition destination address of the personal BRIR so that the first application can obtain the personal BRIR (step S14). For example, the acquisition destination address mentioned here is a one-time uniform resource locator (one-time URL) for accessing the cloud server 100 and obtaining the personal BRIR. In this way, the cloud server 100 transmits the personal BRIR via the acquisition destination address. Therefore, even in a situation where the personal BRIR cannot be transmitted from the first application 20 to the playback destination application ( Figure 2 the second application 30 in the illustrated example) due to OS restrictions, the user terminal 10 can transmit the personal BRIR to the second application 30.

[0066] In addition, the cloud server 100 also issues a one-time URL that is the acquisition destination address of the equipment optimization parameters for a pair of headphones 50.

[0067] Then, the cloud server 100 sends the acquisition destination address of the personal BRIR and the acquisition destination address of the equipment optimization parameters for a pair of headphones 50 that it has issued to the first application 20 (step S15).

[0068] The first application 20 acquires the acquisition destination address of the personal BRIR and the acquisition destination address of the equipment optimization parameters for a pair of headphones 50 sent from the cloud server 100 (step S16). In addition, the first application 20 can also associate the personal BRIR with the identifier of a pair of headphones 50 at the timing of step S16.

[0069] Thereafter, when the second application 30 is started as a trigger, for example, by an operation performed by the user, the first application 20 provides the acquired information to the second application 30 (step S17). Specifically, the first application 20 provides the acquisition destination address of the personal BRIR, the acquisition destination address of the equipment optimization parameters for a pair of headphones 50, the identifier of a pair of headphones 50, the model name of a pair of headphones 50, information about the equipment type, etc. to the second application 30.

[0070] The second application 30 is an application for playing back a sound source or a moving image. For example, the second application 30 is provided to the user by the same commercial operator as the commercial operator of the service server 200 that manages and provides a streaming sound source. In addition, as will be described later, the second application 30 may also include processing units such as a data control unit 31 and a player 34, and the data control unit 31 may also be provided by the commercial operator that provides the first application 20 as a shared library. That is, the commercial operator that manages the service server 200 may also provide only the functions corresponding to the player 34 included in the second application 30.

[0071] The data control unit 31 included in the second application 30 is a library (Library) that includes an executable file for sending data to and receiving data from, for example, the first application 20 or the cloud server 100, and is sometimes referred to as a server access library (SAL) or the like.

[0072] The data control unit 31 acquires the personal BRIR from the cloud server 100 via the acquisition destination address of the personal BRIR provided by the first application 20 (step S18). In addition, the data control unit 31 acquires the equipment optimization parameters for a pair of headphones 50 from the cloud server 100 via the acquisition destination address of the equipment optimization parameters provided by the first application 20.

[0073] The data control unit 31 stores the acquired personal BRIR and the equipment optimization parameters of a pair of headphones 50 in the storage area 32 (step S19).

[0074] Subsequently, the data control unit 31 identifies the equipment connected to the user terminal 10. Specifically, the data control unit 31 identifies a pair of headphones 50 in which communication with the user terminal 10 has been established (step S20).

[0075] Then, the data control unit 31 determines a match between the identifier of the equipment associated with the personal BRIR through the first application 20 and the identifier of the equipment that the user will use at the current moment. Specifically, the data control unit 31 determines a match between the identifier of the equipment associated with the HRTF through the first application 20 in step S12 and the identifier of the equipment connected at the time point in step S20. In Figure 2 the illustrated example, since the two identifiers of these pieces of equipment both indicate a pair of headphones 50, the data control unit 31 determines that the two match.

[0076] In this case, the data control unit 31 updates the setting file (configuration file) 33, in which the settings for playback by the second application 30 are maintained. Specifically, the data control unit 31 writes the acquired personal BRIR and the information indicating the equipment optimization parameters used (enabled) in the playback process into the setting file 33.

[0077] In contrast, if the identifier of the equipment associated with the personal BRIR through the first application 20 does not match the identifier of the equipment that the user will use at the current moment, the data control unit 31 writes the information indicating that the acquired personal BRIR and the equipment optimization parameters are not enabled.

[0078] That is, the data control unit 31 compares the identifier (such as the BT device name) transmitted from the first application 20 with the identifier of a pair of headphones 50 that is currently connected, and determines the personal BRIR and the equipment optimization parameters for playing back the sound source. Then, the data control unit 31 updates the setting file 33 according to the determined content (step S21).

[0079] In this way, if the actually used equipment (a pair of headphones 50) is changed even after the personal BRIR and the equipment optimization parameters have been provided from the cloud server 100, the data control unit 31 restricts its use. That is, by including the step of determining the identifier of the equipment in the second application 30 that actually performs playback, the data control unit 31 can prevent inappropriate playback when playing music due to the use of equipment optimization parameters for different equipment.

[0080] Thereafter, when the user desires to play back music, the second application 30 executes the function of the player 34. The player 34 is a processing unit that plays back music or moving images based on a sound source such as a music file and based on the information set in the setting file 33.

[0081] The player 34 reads the setting file 33 and identifies that the personal BRIR is used for playback or the equipment optimization parameters for a pair of headphones 50 are used (step S22).

[0082] Subsequently, the player 34 obtains the personal BRIR and the equipment optimization parameters from the storage area 32 based on the information set in the setting file 33 (step S23).

[0083] In addition, the player 34 accesses the service server 200 that provides a streaming sound source or the like and obtains the sound source (step S24).

[0084] Then, the player 34 plays back the sound source by convolving the personal BRIR and the equipment optimization parameters with the sound source. Thus, the player 34 can perform playback using the transfer function according to the individual user's ear shape and using the parameters optimized for the playback environment such as a pair of headphones 50.

[0085] As described above, the user terminal 10, as an example of the information processing apparatus according to the present disclosure, associates the personal BRIR (or personal HRTF) corresponding to the user with the identifier identifying the equipment used by the user. Then, the user terminal 10 provides the personal BRIR and the identifier associated with the personal BRIR to the second application 30 that is the provision destination to which the personal BRIR corresponding to the user is provided.

[0086] That is, the user terminal 10 provides not only the personal BRIR but also the identifier of the equipment connected in the environment where the personal BRIR is used. In this way, the user terminal 10 can perform playback optimized for the user's environment by also providing the information indicating which equipment the user will use for the personal BRIR to the playback environment (such as the second application 30).

[0087] In addition, the user terminal 10 obtains the personal BRIR corresponding to the user and the identifier associated with the personal BRIR, and determines a match between the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user. Then, when the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user match, the user terminal 10 sets the personal BRIR to be enabled.

[0088] In this way, by identifying the equipment connected at the current moment in the environment where the personal BRIR is to be used, the user terminal 10 determines whether to use the personal BRIR and the equipment optimization parameters provided by the cloud server 100. Therefore, the user terminal 10 can prevent inappropriate personal BRIR from being used during playback, or prevent different equipment optimization parameters from being used incorrectly. As a result, the user terminal 10 can perform playback optimized for the user's environment.

[0089] As described above, an overview of the overall process of information processing according to the present disclosure has been given. In the following description with reference to Figure 3 and the subsequent drawings, the configuration and various processes of the user terminal 10 will be described in detail.

[0090] [1-2. Configuration of the information processing apparatus according to the embodiment]

[0091] Reference will be made to Figure 3 to describe the configuration of the user terminal 10 as an example of the information processing apparatus according to the present disclosure. Figure 3 is a diagram illustrating an example of the configuration of the user terminal 10 according to an embodiment of the present disclosure. As Figure 3 illustrated in, the user terminal 10 includes a communication unit 11, an input unit 12, a display unit 13, a detection unit 14, a storage unit 15, and a control unit 16.

[0092] The communication unit 11 is implemented by, for example, a network interface card (NIC) or the like. The communication unit 11 is connected in a wired or wireless manner through a network N (such as the Internet), and sends information to and receives information from the cloud server 100, the service server 200, a pair of headphones 50, etc. via the network N.

[0093] The input unit 12 is an input device that receives various operations from the user. For example, the input unit 12 is implemented by operation keys included in the user terminal 10. The display unit 13 is a display device for displaying various information. For example, the display unit 13 is implemented by a liquid crystal display or the like. In addition, if a touch panel is used for the user terminal 10, a part of the input unit 12 is integrated with the display unit 13.

[0094] The detection unit 14 is a general term for various sensors, and detects various information related to the user terminal 10. Specifically, the detection unit 14 detects operations performed by the user on the user terminal 10, location information about the location of the user terminal 10, information related to the equipment connected to the user terminal 10, the environment of the user terminal 10, etc.

[0095] In addition, as an example of the sensor, the detection unit 14 includes a lens and an image sensor for capturing images. That is, when, for example, the user starts an application for operating the image capture function, the detection unit 14 exhibits the function of a camera.

[0096] The storage unit 15 is implemented by, for example, a semiconductor storage device such as a random access memory (RAM) and a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 15 stores various data for information processing therein.

[0097] As Figure 3 illustrated, the storage unit 15 includes data tables such as a BRIR table 151 and a parameter table 152. The BRIR table 151 is associated with, for example, Figure 2 the storage area 21 illustrated. The parameter table 152 is associated with, for example, Figure 2 the storage area 32 illustrated.

[0098] The BRIR table 121 stores information related to the personal BRIR generated by the cloud server 100 therein. Figure 4 An example of the BRIR table 151 according to an embodiment of the present disclosure is illustrated. Figure 4 is a diagram illustrating an example of the BRIR table 151 according to an embodiment. In Figure 4 the illustrated example, the BRIR table 151 has entries such as "personal BRIR data", "generation date and time", and the like.

[0099] "Personal BRIR data" indicates the data of the personal BRIR generated by the cloud server 100. Figure 4 Conceptually, the personal BRIR data is illustrated as "A01"; however, in the subject entry, specific numerical values indicating the personal BRIR and the like are actually stored.

[0100] "Generation date and time" indicates the date and time when the personal BRIR data is generated. When the user terminal 10 acquires the personal BRIR more than once, the user terminal 10 may also keep only the latest personal BRIR in the BRIR table 151, or may also keep multiple personal BRIRs in the BRIR table 151.

[0101] Next, the parameter table 122 will be described. The parameter table 122 stores information related to parameters of a sound source or a moving image used during playback therein. Figure 5 An example of the parameter table 152 according to an embodiment of the present disclosure is illustrated. Figure 5 is a diagram illustrating an example of the parameter table 152 according to an embodiment. In Figure 5 the illustrated example, the parameter table 152 has entries such as "setting ID", "personal BRIR data", "equipment optimization parameters", "acquisition date and time", and the like.

[0102] The "setting ID" indicates identification information for identifying settings indicating that a personal BRIR has been associated with equipment optimization parameters. The "personal BRIR data" is associated with the same entries illustrated in Figure 4 The "equipment optimization parameters" indicate data of equipment optimization parameters obtained from the cloud server 100. Figure 5 Conceptually, the equipment optimization parameters are illustrated as "C01"; however, in reality, in the subject entry, specific numerical values indicating the equipment optimization parameters are stored, etc.

[0103] The "acquisition date and time" indicates the date and time when the personal BRIR and the equipment optimization parameters are obtained from the cloud server 100. When the user terminal 10 obtains the personal BRIR and the equipment optimization parameters more than once, the user terminal 10 can also keep the latest personal BRIR and equipment optimization parameters in the parameter table 152, or can also keep multiple personal BRIRs and equipment optimization parameters in the BRIR table 151.

[0104] A reference will be returned Figure 3 to continue the description. The control unit 16 is implemented by, for example, a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), etc. that execute a program (for example, an information processing program according to the present disclosure) stored in the user terminal 10 in a random access memory (RAM) or the like serving as a working area. In addition, the control unit 16 is a controller and can also be implemented by an integrated circuit such as a dedicated integrated circuit (ASIC), a field programmable gate array (FPGA), etc.

[0105] As Figure 3 illustrated, the control unit 16 includes a first application control unit 161 and a second application control unit 165, and implements or executes the functions or operations of the information processing described below. The first application control unit 161 includes a generation unit 162, an execution unit 163, and a provision unit 164. The second application control unit 165 includes an acquisition unit 166, a determination unit 167, a setting unit 168, and a playback unit 169. For example, the acquisition unit 166, the determination unit 167, and the setting unit 168 are associated with the Figure 2 illustrated data control unit 31. In addition, the playback unit 169 is associated with the Figure 2 illustrated player 34. In addition, the internal configuration of the control unit 16 is not limited to the configuration illustrated in Figure 3 and other configurations can be used as long as the configuration is set to execute the information processing to be described later.

[0106] The generation unit 162 controls the processes related to generating HRTFs and personal BRIRs. Specifically, the generation unit 162 controls the process related to capturing an image of the side of the user's ear. In addition, the generation unit 162 controls the process of sending the image obtained by capturing the image to the cloud server 100 or the process of obtaining the personal BRIR generated by the cloud server 100.

[0107] The generation unit 162 appropriately stores the captured image or the obtained personal BRIR in the storage unit 15. In addition, instead of sending the image captured by the user terminal 10 to the cloud server 100, the generation unit 162 can also obtain an image captured by, for example, an external camera, etc., and can also send the obtained image to the cloud server 100.

[0108] In addition, if the personal HRTF or personal BRIR that has been generated for the user is held in the cloud server 100, the generation unit 162 can also only control the process of obtaining the personal HRTF or personal BRIR, rather than sending the image to the cloud server 100. That is, the process of obtaining the personal HRTF or personal BRIR executed by the generation unit 162 is not limited to a specific method.

[0109] The execution unit 163 associates the personal HRTF or personal BRIR corresponding to the user with the identifier identifying the equipment used by the user.

[0110] For example, when, as a trigger, the user starts the first application, the execution unit 163 obtains the personal BRIR stored in the BRIR table 151. In addition, the execution unit 163 obtains the identifier identifying a pair of headphones 50 connected at the time when the first application is started from a pair of headphones 50. Then, the execution unit 163 associates the personal BRIR with the identifier of the pair of headphones 50, and uploads the personal BRIR together with the association information to the cloud server 100.

[0111] Thereafter, the execution unit 163 obtains the personal BRIR and the one-time URL for the acquisition purpose of a pair of headphones 50 issued by the cloud server 100. In addition, the execution unit 163 can also associate the personal BRIR with the identifier of the pair of headphones 50 at the time when the one-time URL for the acquisition purpose is obtained.

[0112] The providing unit 164 provides the personal BRIR and the identifier associated with the personal BRIR to the providing destination, which is provided with the personal BRIR corresponding to the user. The providing destination mentioned here is, for example, an application (the second application in this embodiment) installed in the user terminal 10 and different from the first application. In addition, the providing destination is not limited to the second application, but can also be other external equipment (for example, other information processing terminals capable of performing two-way communication with the user terminal 10), etc.

[0113] The providing unit 164 provides the personal BRIR to the providing destination by sending a one-time URL that the providing destination uses to obtain the personal BRIR. In other words, the providing unit 164 provides the personal BRIR to the providing destination via the one-time URL. Therefore, the providing unit 164 can also provide the personal BRIR to a second application that cannot directly perform transmission due to, for example, OS restrictions.

[0114] In addition, the providing unit 164 can also provide a variable (equipment optimization parameter) of the equipment that is used together with the personal BRIR to the providing destination together with an identifier.

[0115] The providing unit 164 provides the equipment optimization parameter to the providing destination by sending a one-time URL that the providing destination uses to obtain the equipment optimization parameter. That is, similar to the personal BRIR, the providing unit 164 provides the equipment optimization parameter to the providing destination via the one-time URL. Therefore, the providing unit 164 can also provide the equipment optimization parameter to a second application that cannot directly perform transmission due to, for example, OS restrictions.

[0116] In addition, in the case where communication has been established among the user terminal 10, the information processing device, and a pair of headphones 50, the providing unit 164 can also provide the equipment optimization parameter to the providing destination. That is, if the communication with the pair of headphones 50 is disconnected at the timing when the equipment optimization parameter is provided to the second application, for example, the providing unit 164 does not need to provide the equipment optimization parameter to the second application. Therefore, the providing unit 164 can prevent an inconsistency from occurring between the equipment that the user is about to use and the transmitted optimization parameter.

[0117] The obtaining unit 166 obtains the personal BRIR corresponding to the user and an identifier associated with the personal BRIR.

[0118] For example, the obtaining unit 166 obtains the personal BRIR from the cloud server 100 via the one-time URL provided by the providing unit 164. Specifically, the obtaining unit 166 obtains the personal BRIR by accessing the access destination indicated by the one-time URL and sending a request for obtaining the personal BRIR to the cloud server 100.

[0119] In addition, the obtaining unit 166 can also obtain the equipment optimization parameter of the equipment that is used together with the personal BRIR together with the identifier of the equipment.

[0120] For example, the acquisition unit 166 acquires the equipment optimization parameters from the cloud server 100 via a one-time URL provided by the provision unit 164. Specifically, the acquisition unit 166 acquires the equipment optimization parameters by accessing the access destination indicated by the one-time URL and sending a request for acquiring the equipment optimization parameters to the cloud server 100.

[0121] The acquisition unit 166 appropriately stores the acquired information in the storage unit 15. For example, the acquisition unit 166 associates the acquired personal BRIR with the equipment optimization parameters and stores the associated information in the parameter table 152.

[0122] The determination unit 167 determines a match between the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user.

[0123] Specifically, the determination unit 167 determines a match between the identifier such as the BT device name provided by the provision unit 164 and associated with the personal BRIR and the identifier such as the BT device name of the equipment used by the user at the current moment.

[0124] In addition, the determination unit 167 determines that the equipment that has established communication with the user terminal 10 is the equipment used by the user. For example, the determination unit 167 can specify the equipment that has established communication with the user terminal 10 by using the functions (libraries, etc.) of the OS and detecting the equipment connected to the user terminal 10.

[0125] In addition, if the determination unit 167 cannot detect the equipment used by the user at the current moment or cannot acquire the identifier of the equipment, it can also be determined that the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user do not match. For example, if the equipment used by the user at the current moment is passive and has no function for sending the identifier, the determination unit 167 determines that the identifier associated with the personal BRIR and the identifier of the equipment do not match.

[0126] If the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user match, the setting unit 168 sets the personal BRIR as an enabled personal BRIR. In addition, the equipment used by the user mentioned here indicates the equipment that has established communication with the user terminal 10 at the timing when the personal BRIR is to be used (such as the timing of playing back the sound source).

[0127] For example, if the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user match, the setting unit 168 writes information indicating that the personal BRIR acquired from the cloud server 100 is available into the setting file. Therefore, the playback unit 169 described later can perform playback by using the personal BRIR stored in the parameter table 152.

[0128] In addition, if the identifier associated with the personal BRIR does not match the identifier identifying the equipment used by the user, the setting unit 168 may also set the personal BRIR or the equipment optimization parameter to disable the personal BRIR or the equipment optimization parameter.

[0129] Therefore, the setting unit 168 can prevent a situation where the user experience cannot be achieved, such as a situation where the best sound source is not played back due to the incorrect use of the personal BRIR or the equipment optimization parameter in an unclear environment in the playback state.

[0130] In addition, the setting unit 168 may also set the personal BRIR and the equipment optimization parameter so that both the personal BRIR and the equipment optimization parameter are not enabled at the same time, or may also set the personal BRIR to be enabled and the equipment optimization parameter to be disabled. When the setting unit 168 sets the personal BRIR to be disabled, the setting unit 168 writes data indicating that the average BRIR obtained by averaging multiple users is used instead of the personal BRIR when playing back the sound source into the setting file. In addition, when the setting unit 168 sets the equipment optimization parameter to be disabled, the setting unit 168 writes data indicating that the standard parameters commonly used by all equipment are used instead of the equipment optimization parameter when playing back the sound source into the setting file.

[0131] The playback unit 169 plays back the sound source or the moving image. During playback, the playback unit 169 reads the setting file and specifies the BRIR and the parameters for playback. Then, the playback unit 169 obtains the personal BRIR and the equipment optimization parameter written in the setting file from the parameter table 152 and performs the playback.

[0132] For example, the playback unit 169 accesses the service server 200, obtains the streaming data, and plays back the obtained streaming data. In addition, the playback unit 169 may not only play back the streaming data, but also play back the sound source or the moving image stored in the storage unit 15.

[0133] [1-3. Flow of information processing according to the embodiment]

[0134] Next, the flow of information processing according to the first embodiment will be described with reference to Figures 6 to 9 In Figure 6 the flow of processing until the step of obtaining the personal BRIR by the user terminal 10 is performed will be described. Figure 6 is a flowchart (1) illustrating the flow of information processing according to the embodiment.

[0135] As shown in Figure 6As shown in the figure, the user terminal 10 obtains an ear image of the user through image capture processing, etc. (step S101). Subsequently, the user terminal 10 sends the ear image to the cloud server 100 (step S102).

[0136] Thereafter, the user terminal 10 obtains a personal BRIR generated based on the ear image (step S103). Then, the user terminal 10 stores the obtained personal BRIR in the storage unit 15 (BRIR table 151) (step S104).

[0137] Next, the Figure 7 process of the user terminal 10 providing the personal BRIR to the second application will be described. Figure 7 is a flowchart (2) illustrating the process of information processing according to an embodiment.

[0138] As Figure 7 shown in the figure, the user terminal 10 determines whether the start of the first application has been detected (step S201). If the start of the first application has not been detected ("No" at step S201), the user terminal 10 waits until the start is detected.

[0139] On the contrary, if the start of the first application has been detected ("Yes" at step S201), the user terminal 10 obtains information about the equipment connected to the user terminal 10 (for example, the identifier of a pair of headphones 50, etc.) (step S202).

[0140] Thereafter, the user terminal 10 sends the personal BRIR stored in the BRIR table 151 to the cloud server 100 (step S203). Subsequently, the user terminal 10 obtains the acquisition destination address of the personal BRIR published by the cloud server 100 (step S204).

[0141] In addition, the user terminal 10 determines whether the acquisition destination address of the equipment optimization parameter has been obtained (step S205). If the acquisition destination address of the equipment optimization parameter has been obtained ("Yes" at step S205), the user terminal 10 associates the identifier of the equipment with the personal BRIR (step S206).

[0142] On the contrary, if the acquisition destination address of the equipment optimization parameter has not been obtained ("No" at step S205), the user terminal 10 does not need to associate the identifier of the equipment with the personal BRIR. The situation of not obtaining the acquisition destination address of the equipment optimization parameter mentioned here is, for example, the case where the equipment is passive and thus the identifier cannot be obtained at step S202, the case where the cloud server 100 does not hold the optimization parameter of the equipment, etc.

[0143] Then, the user terminal 10 provides information such as the obtained destination address acquired from the cloud server 100 to the second application (step S207).

[0144] Next, the process of the user terminal 10 setting the personal BRIR will be described with reference to Figure 8 FIG. 3, which is a flowchart illustrating the information processing procedure according to an embodiment Figure 8 is a flowchart (3) of the information processing according to the embodiment

[0145] As Figure 8 illustrated in FIG. 3, the user terminal 10 determines whether the start of the second application has been detected (step S301). If the start of the second application has not been detected (\"No\" at step S301), the user terminal 10 waits until the start is detected

[0146] On the contrary, if the start of the second application has been detected (\"Yes\" at step S301), the user terminal 10 acquires the information provided from the first application (step S302).

[0147] Thereafter, the user terminal 10 acquires the personal BRIR from the cloud server 100 by using the provided obtained destination address (step S303). Subsequently, the user terminal 10 stores the acquired personal BRIR in the storage unit 15 (parameter table 152) (step S304).

[0148] In addition, the user terminal 10 determines whether the obtained destination address of the equipment optimization parameter has been acquired from the first application (step S305). If the obtained destination address of the equipment optimization parameter has been acquired (\"Yes\" at step S305), the user terminal 10 acquires the equipment optimization parameter from the cloud server 100 by using the obtained destination address (step S306). The user terminal 10 associates the acquired equipment optimization parameter with the personal BRIR and stores the parameter in the storage unit 15 (parameter table 152) (step S307).

[0149] In addition, the user terminal 10 acquires information about the equipment connected at the current time (step S308). Then, the user terminal 10 determines whether the identifier of the equipment acquired at step S308 matches the identifier associated with the personal BRIR (step S309).

[0150] If the identifier of the equipment acquired at step S308 matches the identifier associated with the personal BRIR (\"Yes\" at step S309), the user terminal 10 registers the information indicating the use of the personal BRIR and the equipment optimization parameter in the setting file. In other words, the user terminal 10 enables the personal BRIR and the equipment optimization parameter (step S310).

[0151] On the contrary, if the user terminal 10 fails to obtain the acquisition destination address of the equipment optimization parameters from the first application (the "No" at step S305), or if the identifier of the equipment obtained at step S308 does not match the identifier associated with the personal BRIR (the "No" at step S309), the user terminal 10 will indicate not to use the personal BRIR and the equipment optimization parameters to register in the setting file. In other words, the user terminal 10 sets the personal BRIR and the equipment optimization parameters to not enable the personal BRIR and the equipment optimization parameters (step S311).

[0152] In addition, instead of setting the personal BRIR and the equipment optimization parameters to not enable the personal BRIR and the equipment optimization parameters, the user terminal 10 can also set the personal BRIR and the equipment optimization parameters to only not enable the equipment optimization parameters at step S311. For example, if the equipment is passive, etc., the user terminal 10 can also enable the user to only use the personal BRIR.

[0153] Next, the process of the user terminal 10 performing playback by using the personal BRIR will be described with reference to Figure 9 FIG. (4) is a flowchart showing the process of information processing according to an embodiment. Figure 9 FIG. (4) is a flowchart showing the process of information processing according to an embodiment.

[0154] The user terminal 10 determines whether the start of the player included in the second application has been detected (step S401). In addition, the start of the player mentioned here can also be read as, for example, the state where the user operates the second application to play back the sound source.

[0155] If the start of the player has not been detected (the "No" at step S401), the user terminal 10 waits until the start is detected. On the contrary, if the start of the player has been detected (the "Yes" at step S401), the user terminal 10 reads the setting file (step S402).

[0156] Subsequently, the user terminal 10 obtains the sound source from the service server 200 (step S403). Then, the user terminal 10 plays back the sound source based on the setting file while convolving, for example, the personal BRIR, the equipment optimization parameters, etc. with the sound source (step S404).

[0157] During the playback of the sound source, the user terminal 10 determines whether the connected equipment has changed (step S405). If the connected equipment has changed (the "Yes" at step S405), that is, if the pair of headphones that the user is using has changed, or if the communication has been disconnected, the user terminal 10 changes the setting file (step S406). For example, the user terminal 10 cancels the state of enabling the personal BRIR and the equipment optimization parameters and changes the setting file so that this information cannot be used for playback.

[0158] Thereafter, the user terminal 10 determines whether the user has requested to stop playback (step S407). If the user has not requested to stop playback ("No" at step S407), the user terminal 10 continues the process of obtaining the sound source from the service server 200 in order to continue playback.

[0159] On the contrary, if the user has requested to stop playback ("Yes" at step S407), the user terminal 10 stops the playback of the sound source (step S408).

[0160] (2. Modification example)

[0161] The above information processing system 1 can also be implemented through various embodiments other than the above embodiments. Therefore, below, modification examples of the embodiments will be described.

[0162] [2-1. Modes of the information processing system]

[0163] In the embodiment, an example is given in which a one-time URL is used as the acquisition destination address of the personal BRIR or the equipment optimization parameter; however, the example is not limited thereto, and any method can be used as long as the second application can obtain data from the cloud server 100 therein. In addition, after the personal BRIR has been provided to the user terminal 10 via the one-time URL, the cloud server 100 can also delete the provided personal BRIR, or can also keep the provided personal BRIR for a certain period of time.

[0164] In the embodiment, an example in which the cloud server 100 generates the personal BRIR has been described. However, the personal BRIR can also be generated by the user terminal 10 instead of the cloud server 100. In this case, the cloud server 100 can also keep the personal BRIR uploaded from the user terminal 10 and, if a request is received, publish the acquisition destination address.

[0165] In the embodiment, the description has been given on the assumption that the cloud server 100 is set up in the cloud network; however, the example is not limited thereto. The cloud server 100 can also be set up in a network such as a local area network (LAN) as long as the cloud server 100 can communicate with the user terminal 10.

[0166] The cloud server 100 can also obtain identification information about the user when generating the personal BRIR, associate the identification information with the personal BRIR, and keep the personal BRIR. In this case, the cloud server 100 can provide the personal BRIR to the second application without receiving the upload of the personal BRIR from the first application every time it is started.

[0167] In the embodiment, the cloud server 100 has been described as a single server; however, the cloud server 100 may also be composed of multiple server devices. For example, the cloud server 100 may also be divided into a generation server that generates a personal BRIR and a provision server that publishes the personal BRIR to obtain a destination address or provides the personal BRIR.

[0168] In the embodiment, an example in which the first application and the second application are installed in the user terminal 10 has been described; however, the first application and the second application may also be applications installed on different devices. For example, the user terminal 10 may also only maintain the function of the first application and execute playback of a sound source by controlling the second application installed in an intelligent speaker or the like as another device.

[0169] [2-2. Playback mode of sound source]

[0170] If the cloud server 100 does not hold the personal BRIR of the user or is equipped with optimization parameters, the cloud server 100 may also send the average BRIR of multiple users or standard parameters not depending on a specific device to the user terminal 10.

[0171] Reference will be made to Figure 10 to describe this. Figure 10 is a conceptual diagram illustrating a usage pattern of a head-related transfer function according to a modified example.

[0172] As Figure 10 illustrated in, when a sound source is played back in the second application, modes such as mode 1 and mode 2 can be expected. Mode 1 indicates a situation where a personal BRIR or equipment optimization parameters cannot be used, such as a situation where the equipment cannot be recognized. Specifically, mode 1 is operated by a combination 70 of streaming data, a service application (playback destination application), a library, an average BRIR, and standard parameters. In contrast, mode 2 indicates a situation where the equipment can be recognized and there are parameters associated with the equipment. Specifically, mode 2 is operated by a combination 80 of streaming data, a service application, a library, a personal BRIR, and equipment optimization parameters.

[0173] [2-3. Use of parameters]

[0174] The user terminal 10 may also previously obtain equipment optimization parameters associated with multiple pieces of equipment instead of obtaining equipment optimization parameters at each playback. In this case, the user terminal 10 may specify the optimization parameters of the present equipment based on the identifier of the connected equipment and perform playback or the like by using the specified parameters. In addition, the user terminal 10 may also submit a list of equipment parameters owned by the user terminal 10 to the user and enable the user to select parameters. Therefore, even if the user only holds, for example, a passive earphone, the user terminal 10 can perform playback by using its own personal BRIR and equipment optimization parameters.

[0175] In addition, in the embodiment, a description has been given of an example in which the user terminal 10 (second application) does not obtain equipment optimization parameters for equipment such as a pair of passive headphones. However, the user terminal 10 can also obtain equipment optimization parameters for equipment without communication functions such as passive headphones. In this case, the user manually selects the name of the equipment and the like by using the first application. In addition, a list of the names of the equipment and the like is provided from the cloud server 100 to the user terminal 10. Then, the user terminal 10 obtains the acquisition destination address associated with the equipment optimization parameters of the equipment selected by the user from the cloud server 100.

[0176] Then, the user terminal 10 provides the obtained acquisition destination address to the second application. Therefore, the second application can obtain the acquisition destination address of the equipment optimization parameters related to passive headphones and the like. In this case, since Figure 8 the branch of the process at step S305 illustrated in [is "yes"], even in the case of passive headphones, the user can enjoy music playback using the personal BRIR or equipment optimization parameters. In addition, the user terminal 10 can also appropriately perform music playback not only by using the personal BRIR and equipment optimization parameters according to the user's situation, but also music playback combining various functions and variables, such as music playback using only the personal BRIR (standard parameters instead of equipment optimization parameters) or music playback using only the average BRIR.

[0177] When the cloud server 100 generates a personal BRIR based on the personal HRTF, the cloud server 100 can also perform convolution on different RIRs (for example, RIRs according to the user's room environment, etc.) according to, for example, the user's location or situation. Therefore, the cloud server 100 can further provide the personal BRIR to the user according to the user's situation. In this case, instead of the cloud server 100 generating the personal BRIR, the user terminal 10 itself that has obtained multiple RIRs can also specify the RIR according to the environment and perform convolution with the personal HRTF.

[0178] [2-4. Modes of Equipment]

[0179] In the embodiment, a description has been given of an example in which a pair of headphones 50 is connected to the user terminal 10 by using Bluetooth. However, the connection of equipment such as a pair of headphones 50 is not limited to Bluetooth and can also be established based on various communication standards.

[0180] (3. Other Embodiments)

[0181] The processing according to the above embodiments can also be executed by various embodiments other than the above embodiments.

[0182] In addition, in the above processing of each embodiment, all or part of the processing mentioned as being automatically performed can also be manually performed, or all or part of the processing mentioned as being manually performed can also be automatically performed using known methods. Further, unless otherwise specified, the processing flow, specific names, and information including various data or parameters indicated in the above description and drawings can be arbitrarily changed. For example, the various information illustrated in each drawing is not limited to the information illustrated in the drawing.

[0183] In addition, the components of each unit illustrated in the drawings are only for conceptually illustrating their functions and are not always physically configured as illustrated in the drawings. In other words, the specific shape of a separate or integrated device is not limited to the drawings. Specifically, all or part of the device can be configured by functionally or physically separating or integrating any of the units according to various loads or usage conditions.

[0184] In addition, each of the above-described embodiments and modification examples can be used in any suitable combination as long as the processing does not conflict with each other.

[0185] In addition, the effects described in this specification are only exemplary and not restrictive, and other effects are also possible.

[0186] (4. Effects of the information processing apparatus according to the present disclosure)

[0187] As described above, the information processing apparatus (user terminal 10 in the embodiment) according to the present disclosure includes an execution unit (execution unit 163 in the embodiment) and a providing unit (providing unit 164 in the embodiment). The execution unit associates the head-related transfer function corresponding to the user (personal HRTF or personal BRIR in the embodiment) with the identifier identifying the equipment used by the user. The providing unit provides the head-related transfer function and the identifier associated with the head-related transfer function to a providing destination that is provided with the head-related transfer function corresponding to the user.

[0188] In this way, the information processing apparatus according to the present disclosure represents the equipment connected at the current moment in the environment where the head-related transfer function is to be used. Therefore, since the information processing apparatus can identify inappropriate equipment connected during playback, etc., the head-related transfer function can be appropriately used.

[0189] In addition, the providing unit provides the head-related transfer function to the providing destination by sending a one-time URL used by the providing destination to obtain the head-related transfer function. Therefore, the information processing apparatus can also provide the head-related transfer function to a providing destination having OS restrictions, etc.

[0190] In addition, the providing unit provides variables and identifiers that match the equipment when the variables are used together with the head-related transfer function to a providing destination. Therefore, the information processing device can perform optimal playback according to the equipment.

[0191] In addition, the providing unit provides variables to the providing destination by sending a one-time URL used by the providing destination to obtain the variables. Therefore, the information processing device can also provide variables such as equipment optimization parameters to a providing destination with OS restrictions and the like.

[0192] In addition, when communication is established between the information processing device and the equipment, the providing unit provides variables to the providing destination. Therefore, the information processing device can prevent the variables from being used by equipment that is not suitable for obtaining the variables during music playback, thereby preventing inappropriate playback.

[0193] In addition, the information processing device according to the present disclosure includes an acquisition unit (acquisition unit 166 in the embodiment), a determination unit (determination unit 167 in the embodiment), and a setting unit (setting unit 168 in the embodiment). The acquisition unit acquires a head-related transfer function corresponding to the user and an identifier associated with the head-related transfer function. The determination unit determines a match between the identifier associated with the head-related transfer function and the identifier identifying the equipment used by the user. When the identifier associated with the head-related transfer function matches the identifier identifying the equipment used by the user, the setting unit sets the head-related transfer function to enable the head-related transfer function.

[0194] In this way, the information processing device according to the present disclosure determines a match between the associated equipment at the time when the head-related transfer function has been acquired and the actually connected equipment, and then sets the head-related transfer function to be enabled based on the determined result. Therefore, the information processing device can prevent the head-related transfer function from being used by inappropriate equipment during playback.

[0195] In addition, the acquisition unit acquires the head-related transfer function via a one-time URL for acquiring the head-related transfer function. Therefore, the information processing device can also acquire the head-related transfer function in the case of OS restrictions and the like.

[0196] In addition, the acquisition unit acquires variables and identifiers that match the equipment when the variables are used together with the head-related transfer function. Therefore, the information processing device can perform optimal playback according to the equipment.

[0197] In addition, the acquisition unit acquires variables via a one-time URL for acquiring the variables. Therefore, the information processing device can acquire variables even in the case of OS restrictions and the like.

[0198] In addition, the determination unit determines that the equipment for which communication with the information processing apparatus has been established is the equipment used by the user. When the identifier associated with the head-related transfer function matches the identifier identifying the equipment used by the user, the setting unit sets the variable to an enabled variable. Therefore, since the information processing apparatus can determine whether equipment different from the equipment associated with the acquired head-related transfer function is connected during playback, the information processing apparatus can prevent the use of variables for inappropriate equipment.

[0199] In addition, when the identifier associated with the head-related transfer function does not match the identifier identifying the equipment used by the user, the setting unit sets the head-related transfer function or the variable to a non-enabled head-related transfer function or variable. Therefore, the information processing apparatus can prevent the use of variables that are not suitable for the equipment.

[0200] (5. Hardware Configuration)

[0201] Information devices such as the user terminal 10, a pair of headphones 50, the cloud server 100, and the service server 200 according to the above-described embodiments are implemented by a computer 1000 having a configuration illustrated, for example, Figure 11 in the figure. Hereinafter, a description will be given by using the user terminal 10 according to the embodiment as an example. Figure 11 FIG. is a diagram illustrating the hardware configuration of a computer 1000 that implements the functions of the user terminal 10. The computer 1000 includes a CPU 1100, a RAM 1200, a read-only memory (ROM) 1300, a hard disk drive (HDD) 1400, a communication interface 1500, and an input / output interface 1600. Each unit in the computer 1000 is connected by a bus 1050.

[0202] The CPU 1100 operates based on programs stored in the ROM 1300 or the HDD 1400 and controls each unit. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processes associated with various programs.

[0203] The ROM 1300 stores therein a boot program such as a basic input / output system (BIOS) executed by the CPU 1100 when starting up the computer 1000 or programs depending on the hardware of the computer 1000.

[0204] The HDD 1400 is a computer-readable recording medium in which programs executed by the CPU 1100, data used by these programs, etc. are recorded in a non-transitory manner. Specifically, the HDD 1400 is a recording medium in which an information processing program as an example of the program data 1450 according to the present disclosure is recorded.

[0205] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet). For example, the CPU 1100 receives data from another device via the communication interface 1500 and sends the data generated by the CPU 1100 to other devices.

[0206] The input / output interface 1600 is an interface for connecting the input / output device 1650 to the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. In addition, the CPU 1100 sends data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. In addition, the input / output interface 1600 can also be used as a medium interface for reading programs and the like recorded in a predetermined one (or more) of recording media. Examples of one of the media mentioned here include optical recording media such as digital versatile discs (DVDs) and phase change rewritable discs (PDs), magneto-optical recording media such as magneto-optical discs (MOs), tape media, magnetic recording media, semiconductor memories, and the like.

[0207] For example, when the computer 1000 is used as the user terminal 10 according to the embodiment, the CPU 1100 in the computer 1000 implements the functions of the control unit 16 and the like by executing an information processing program loaded onto the RAM 1200. In addition, the HDD 1400 stores the information processing program according to the present disclosure and the data included in the storage unit 15. In addition, the CPU 1100 reads the program data 1450 from the HDD 1400; however, as another example, the CPU 1100 can also obtain these programs from other devices via the external network 1550.

[0208] In addition, the present technology can also be configured as follows.

[0209] (1) An information processing apparatus, comprising:

[0210] An execution unit that associates a head-related transfer function corresponding to a user with an identifier identifying equipment used by the user; and

[0211] A providing unit that provides the head-related transfer function and the identifier associated with the head-related transfer function to a providing destination to which the head-related transfer function corresponding to the user is provided.

[0212] (2) The information processing apparatus according to (1), wherein the providing unit provides the head-related transfer function to the providing destination by sending a one-time URL used by the providing destination to obtain the head-related transfer function to the providing destination.

[0213] (3) The information processing apparatus according to (1) or (2), wherein the providing unit provides the variable that conforms to the equipment when the variable is used with the head-related transfer function together with the identifier to the providing destination.

[0214] (4) The information processing apparatus according to (3), wherein the providing unit provides the variable to the providing destination by sending a one-time URL used by the providing destination to obtain the variable to the providing destination.

[0215] (5) The information processing apparatus according to (3) or (4), wherein when the communication between the information processing apparatus and the equipment has been established, the providing unit provides the variable to the providing destination.

[0216] (6) An information processing method for causing a computer to execute processing, including:

[0217] associating a head-related transfer function corresponding to a user with an identifier identifying the equipment used by the user; and

[0218] providing the head-related transfer function and the identifier associated with the head-related transfer function to the providing destination to which the head-related transfer function corresponding to the user is provided.

[0219] (7) An information processing program, the information processing program causing a computer to function as:

[0220] an execution unit that associates a head-related transfer function corresponding to a user with an identifier identifying the equipment used by the user; and

[0221] a providing unit that provides the head-related transfer function and the identifier associated with the head-related transfer function to the providing destination to which the head-related transfer function corresponding to the user is provided.

[0222] (8) An information processing apparatus, including:

[0223] an acquisition unit that acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function;

[0224] a determination unit that determines a match between the identifier associated with the head-related transfer function and the identifier identifying the equipment used by the user; and

[0225] A setting unit that, when an identifier associated with the head-related transfer function matches an identifier identifying the equipment used by the user, sets the head-related transfer function to enable the head-related transfer function.

[0226] (9) The information processing apparatus according to (8), wherein the acquisition unit acquires the head-related transfer function via a one-time URL for acquiring the head-related transfer function.

[0227] (10) The information processing apparatus according to (8) or (9), wherein the acquisition unit acquires a variable that conforms to the equipment when the variable is used together with the head-related transfer function, together with the identifier.

[0228] (11) The information processing apparatus according to (10), wherein the acquisition unit acquires the variable via a one-time URL for acquiring the variable.

[0229] (12) The information processing apparatus according to (10) or (11), wherein

[0230] the determination unit determines that the equipment that has established communication with the information processing apparatus is the equipment used by the user, and

[0231] when an identifier associated with the head-related transfer function matches an identifier identifying the equipment used by the user, the setting unit sets the variable to enable the variable.

[0232] (13) The information processing apparatus according to any one of (10) to (12), wherein when an identifier associated with the head-related transfer function does not match an identifier identifying the equipment used by the user, the setting unit sets the head-related transfer function or the variable to disable the head-related transfer function or the variable.

[0233] (14) An information processing method for causing a computer to execute processing, including:

[0234] Acquiring a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function;

[0235] Determining a match between an identifier associated with the head-related transfer function and an identifier identifying the equipment used by the user; and

[0236] When an identifier associated with the head-related transfer function matches an identifier identifying the equipment used by the user, setting the head-related transfer function to enable the head-related transfer function.

[0237] (15) An information processing program that causes a computer to function as:

[0238] An acquisition unit that acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function;

[0239] A determination unit that determines a match between an identifier associated with the head-related transfer function and an identifier identifying equipment used by the user; and

[0240] A setting unit that, when an identifier associated with the head-related transfer function matches an identifier identifying equipment used by the user, sets the head-related transfer function to enable the head-related transfer function.

[0241] List of reference numerals

[0242] 1 Information processing system

[0243] 10 User terminal

[0244] 11 Communication unit

[0245] 12 Input unit

[0246] 13 Display unit

[0247] 14 Detection unit

[0248] 15 Storage unit

[0249] 151 BRIR table

[0250] 152 Parameter table

[0251] 16 Control unit

[0252] 161 First application control unit

[0253] 162 Generation unit

[0254] 163 Execution unit

[0255] 164 Provision unit

[0256] 165 Second application control unit

[0257] 166 Acquisition unit

[0258] 167 Determination unit

[0259] 168 Setting unit

[0260] 169 Playback unit

[0261] 50 Headphones

[0262] 100 Cloud server

[0263] 200 Service server

Claims

1. An information processing method that causes a computer to execute a process including the following steps: Send the head-related transfer function of the user and information on the audio output device connected to the user terminal to the server; Obtain a first address corresponding to the head-related transfer function of the user and a second address corresponding to the device parameters of the audio output device connected to the user terminal from the server; And Provide the first address and the second address to a destination for providing, so that the destination for providing can obtain the head-related transfer function of the user and the device parameters of the audio output device from the server.

2. The information processing method according to claim 1, wherein The server publishes a first address corresponding to the head-related transfer function of the user.

3. The information processing method according to claim 1, wherein The server specifies the device parameters of the audio output device.

4. The information processing method according to claim 3, wherein The parameters of the audio output device are determined based on the information on the audio output device connected to the user terminal.

5. The information processing method according to claim 1, further including If communication is established between the audio output device and the user terminal, provide the device parameters of the audio output device to the destination for providing.

6. The information processing method according to claim 1, further including Obtain an ear image of the user and obtain a head-related transfer function corresponding to the ear image of the user.

7. The information processing method according to claim 5, wherein Estimate the head-related transfer function of the user by using a learned model.

8. The information processing method according to claim 1, wherein Download the head-related transfer function of the user and the device parameters of the audio output device connected to the user terminal from the server via the first address and the second address.

9. The information processing method according to claim 1, wherein The destination for providing is an application.

10. The information processing method according to claim 1, further including Associate the identifier corresponding to the head-related transfer function of the user with the identifier identifying the audio output device connected to the user terminal, and Among them, If the identifier associated with the head-related transfer function matches the identifier identifying the output device used by the user, the destination for providing sets the head-related transfer function or the device parameters to enable the head-related transfer function or the device parameters.

11. A computer program product storing a computer program, the computer program causing a computer to execute a process including the following steps: Send the head-related transfer function of the user and information on the audio output device connected to the user terminal to the server; Obtain a first address corresponding to the head-related transfer function of the user and a second address corresponding to the device parameters of the audio output device connected to the user terminal from the server; And Provide the first address and the second address to a destination for providing, so that the destination for providing can obtain the head-related transfer function of the user and the device parameters of the audio output device from the server.

12. An information processing system, including: A user terminal configured to Send the head-related transfer function of the user and information on the audio output device connected to the user terminal to the server; Obtain a first address corresponding to a head-related transfer function of a user and a second address corresponding to device parameters of an audio output device connected to a user terminal from a server; and Provide the first address and the second address to a destination for providing, to allow the destination for providing to obtain the head-related transfer function of the user and the device parameters of the audio output device from the server.

13. An information processing system, comprising: A server configured to: Obtain a head-related transfer function of a user and information of an audio output device connected to a user terminal; Detect device parameters based on the information of the audio output device connected to the user terminal; Generate a first address corresponding to the head-related transfer function of the user and a second address corresponding to the device parameters of the audio output device connected to the user terminal; and Send the first address and the second address to the user terminal, to allow a destination for providing in the user terminal to obtain the head-related transfer function of the user and the device parameters of the audio output device.

Images