Information processing device, information processing method and information processing program

Abstract

According to the present disclosure, the information processing device is provided with: an execution unit which executes the association of a head transfer function corresponding to a user with an identifier for identifying a device used by the user; and a providing unit which provides the head transfer function and the identifier associated with the head transfer function to a providing destination to which the head transfer function corresponding to the user is to be provided.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, an information processing method and an information processing program. In particular, the present disclosure relates to the use of a head-related transfer function. Background Art

[0002] There is a technology for three-dimensionally reproducing a sound image in a pair of headphones or the like by using a head-related transfer function that mathematically expresses how the ear receives sound from a sound source.

[0003] Because the head-related transfer function varies greatly between individuals, it is preferable to use a head-related transfer function generated for each person. For example, there is a known technology for generating a three-dimensional digital model (hereinafter, referred to as a "3D model") of the head region based on a captured image of the user's auricle and calculating the user's head-related transfer function based on the generated 3D model.

[0004] Reference List

[0005] Patent Literature

[0006] Patent Document 1: U.S. Patent No. 9544706 Summary of the invention

[0007] Technical issues

[0008] According to the conventional technology, since the head related transfer function that has been calculated individually for each user can be used for information processing, the sense of localization of the sound image can be enhanced.

[0009] However, with the above-mentioned conventional technology, it is not always possible to appropriately use the head-related transfer function calculated for each user. For example, there may be a case in which the user desires to flexibly use the head-related transfer function, such as using one's own head-related transfer function not only for a single application (music playback application, etc.) but also for a plurality of applications installed in a smart phone. In addition, the head-related transfer function can also enhance the sense of reality or give an accurate sense of positioning if it is adjusted according to the actual usage situation or the audio equipment used by the user, etc. However, the conventional technology only calculates the head-related transfer function for each user and does not perform a process of changing the usage mode of the head-related transfer function according to the situation so that the user can flexibly use the head-related transfer function.

[0010] Therefore, the present disclosure proposes an information processing device, an information processing method, and an information processing program that can appropriately use a head related transfer function.

[0011] Solution to the problem

[0012] In order to solve the above problem, an information processing device includes: an execution unit, which associates a head-related transfer function corresponding to a user with an identifier that identifies an equipment used by the user; and a providing unit, which provides the head-related transfer function and the identifier associated with the head-related transfer function to a providing destination to which the head-related transfer function corresponding to the user is provided.

[0013] In addition, in order to solve the above-mentioned problem, an information processing device includes: an acquisition unit, which acquires a head-related transfer function corresponding to a user and an identifier associated with the head-related transfer function; a determination unit, which determines a match between the identifier associated with the head-related transfer function and an identifier identifying the equipment used by the user; and a setting unit, which sets the head-related transfer function to enable the head-related transfer function when the identifier associated with the head-related transfer function and the identifier identifying the equipment used by the user match. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 is a diagram illustrating an information processing system according to an embodiment of the present disclosure.

[0015] Figure 2 is a conceptual diagram illustrating the overall flow of information processing according to the embodiment.

[0016] Figure 3 is a diagram illustrating a configuration example of a user terminal according to an embodiment.

[0017] Figure 4 is a diagram illustrating an example of a BRIR table according to an embodiment.

[0018] Figure 5 is a diagram illustrating an example of a parameter table according to an embodiment.

[0019] Figure 6 is a flowchart (1) illustrating the flow of information processing according to the embodiment.

[0020] Figure 7 is a flowchart (2) illustrating the flow of information processing according to the embodiment.

[0021] Figure 8 is a flowchart (3) illustrating the flow of information processing according to the embodiment.

[0022] Fig. 9 is a flowchart (4) illustrating the flow of information processing according to the embodiment.

[0023] Fig.10is a conceptual diagram illustrating a usage mode of a head related transfer function according to a modification example.

[0024] Fig.11 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing apparatus. DETAILED DESCRIPTION

[0025] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in each embodiment, the same reference numerals are assigned to components having the same functions, and descriptions of repeated parts will be omitted.

[0026] The present disclosure will be described in the following order:

[0027] 1. Example

[0028] 1-1. Configuration Example of Information Processing System and Information Processing According to Embodiment

[0029] 1-2. Configuration of information processing apparatus according to embodiment

[0030] 1-3. Flow of information processing according to the embodiment

[0031] 2. Modify the example

[0032] 2-1. Model of information processing system

[0033] 2-2. Sound source playback mode

[0034] 2-3. Use of parameters

[0035] 2-4. Equipment Mode

[0036] 3. Other embodiments

[0037] 4. Effects of the information processing device according to the present disclosure

[0038] 5. Hardware Configuration

[0039] (1. Example)

[0040] [1-1. Configuration Example of Information Processing System and Information Processing According to Embodiment]

[0041] First, refer to Figure 1 and Figure 2 A configuration of the information processing system 1 according to the present disclosure and an overview of information processing performed by the information processing system 1 are described. Figure 1 1 is a diagram illustrating an information processing system 1 according to an embodiment of the present disclosure. Figure 1 The information processing system 1 shown in FIG. Figure 1As shown in the figure, the information processing system 1 includes a user terminal 10, a pair of headphones 50, a cloud server 100 and a service server 200. Each device included in the information processing system 1 performs two-way communication by using a wired or wireless network (not shown). In addition, the number of devices constituting the information processing system 1 is not limited to the number shown in the figure.

[0042] The user terminal 10 is an example of an information processing device according to the present disclosure, and is an information processing terminal that performs information processing by using a head-related transfer function (hereinafter, sometimes referred to as HRTF (Head-Related Transfer Function)). The user terminal 10 is implemented by, for example, a smartphone having an image capture function, etc.

[0043] A pair of headphones 50 is an example of audio equipment used by the user. For example, a pair of headphones 50 has a communication function of Bluetooth (registered trademark) or the like, and establishes wireless communication with the user terminal 10. Then, the pair of headphones 50 outputs voice or the like transmitted from the user terminal 10 according to the operation performed by the user.

[0044] The cloud server 100 calculates HRTF (Head Related Transfer Function) corresponding to each user, and provides the calculated HRTF to the user terminal 10. The cloud server 100 acquires an image of the user's ear from the user terminal 10 via the network, and calculates the user's HRTF based on the acquired image.

[0045] The service server 200 is a server device that provides a sound source of music or the like to the user terminal 10. For example, the service server 200 provides a streaming sound source or the like to the user terminal 10 via a network according to control performed by a music playback application or the like installed in the user terminal 10.

[0046] As described above, the user terminal 10 performs information processing using HRTF. HRTF represents changes in sound generated by peripheral objects including a human auricle (external ear), the shape of the head area, etc. as a transfer function. Generally, measurement data for obtaining HRTF is acquired by measuring a sound signal used for measurement using a microphone worn on the auricle of a person, a virtual head-mounted microphone, etc.

[0047] For example, HRTF for technology such as 3D sound is often calculated by using measurement data acquired by a virtual head-mounted microphone or the like or by using an average value of measurement data acquired from a large number of people. However, since HRTF varies greatly between individuals, it is preferable to use the HRTF of an individual user in order to achieve a more effective acoustic stage effect. That is, an acoustic body sense with a more realistic feeling can be provided to the user by replacing the general HRTF with the user's own HRTF.

[0048] As an example of a method for calculating a user's personal HRTF, there is a method for calculating a user's HRTF based on a captured image of a user's ear shape. For example, the cloud server 100 acquires an image including a user's ear shape captured by the user terminal 10, and calculates the user's personal HRTF based on the acquired image. Then, the cloud server 100 transmits the calculated HRTF to the user terminal 10. Therefore, the user terminal 10 can play back the sound of the 3D sound reproduced by using the user's personal HRTF, and can play back moving images with realism.

[0049] However, there are some problems with the above method. For example, the user terminal 10 operates applications developed by various commercial operators, such as an application having a function of sending or managing HRTF (hereinafter, referred to as "application"), an application for playing back music, an application for playing back moving images. In this case, there may be a situation where HRTF data cannot be sent and received between the application for managing HRTF and the music playback destination application, etc., due to, for example, operating system (OS) restrictions, etc.

[0050] Furthermore, even if HRTF data can be sent and received, there is a possibility that its operation is not performed properly. For example, HRTF can be calculated regardless of the audio equipment (a pair of headphones 50, etc.) actually used by the user; however, in order to more effectively exert the sound effect, it is preferred to use HRTF data together with variables (parameters) such as the output value according to the impedance of the equipment or the delay time based on the shape of the output unit of the equipment. However, when the user uses a music playback purpose application, etc., due to OS restrictions, it is difficult for the cloud server 100 and the application that manages HRTF to control the use of the music playback purpose application. Therefore, there is a possibility that HRTF is used in a mode that is not intended by the cloud server 100 and the application that manages HRTF.

[0051] As described above, there are various problems regarding HRTF when enabling HRTF to be used flexibly across multiple applications or when enabling HRTF to be used appropriately according to the user's environment or the state of equipment. The user terminal 10 according to the embodiment solves the above problems through the information processing according to the present disclosure described below. Figure 1 and Figure 2 The process consistently describes an overview of information processing according to the present disclosure.

[0052] like Figure 1, the first application 20 and the second application 30 have been installed in the user terminal 10. The first application 20 is, for example, an application provided from a business operator that manages the cloud server 100. The first application 20 has functions of capturing an image including a user's ear, transmitting the captured image to the cloud server 100, and managing the HRTF transmitted from the cloud server 100.

[0053] In the information processing according to the embodiment, first, the first application 20 captures an image including the user's ear according to an operation performed by the user and obtains the image including the ear (step S1). Subsequently, the first application 20 sends the image including the ear to the cloud server 100 (step S2). In addition, as a preprocessing for sending the image to the cloud server 100, the first application 20 may also perform a process of detecting a video image of the user's ear included in the image and cutting out a region of the detected video image of the ear from the image.

[0054] The cloud server 100 acquires the image sent from the user terminal 10. Then, the cloud server 100 calculates the user's HRTF based on the image (step S3). Various methods can also be used for the method of calculating HRTF performed by the cloud server 100. For example, if a two-dimensional image of the ear including a video image is input, the cloud server 100 can also calculate the HRTF by using a model obtained by learning to output the HRTF associated with each ear. Alternatively, the cloud server 100 can also generate a 3D model of the user's head area based on the two-dimensional image of the ear including the video image, and calculate the HRTF based on the generated 3D model. In the following description, the HRTF calculated based on the individual user is referred to as a personal HRTF, and is sometimes distinguished from a general HRTF.

[0055] In addition, the cloud server 100 can also generate a BRIR (Binaural Room Impulse Response) by convolving an RIR (Room Impulse Response) with a calculated personal HRTF. In the following description, the BRIR generated according to an individual user is referred to as a personal BRIR, and is sometimes distinguished from a general BRIR. In addition, for example, the data used when playing back music in the user terminal 10 is actually sometimes not an HRTF but a BRIR; however, in the following description, it is assumed that the two can be replaced with each other. For example, the description of "sending the generated BRIR" includes a case where a calculated HRTF is sent. In addition, it is assumed that the description of "performing playback by using the BRIR" includes a case where playback is performed by using the HRTF.

[0056] Thereafter, the cloud server 100 sends the generated personal BRIR to the user terminal 10 (step S4). The first application 20 obtains the personal BRIR (step S5). In this way, the user can obtain his own personal BRIR by capturing the side of the user and sending the image to the cloud server 100. Then, the first application 20 stores the received personal BRIR in the storage area 21 (step S6).

[0057] Next, we will refer to Figure 2 The flow of processing performed when the user terminal 10 plays back music or the like by using a personal BRIR is described. Figure 2 is a conceptual diagram illustrating the overall flow of information processing according to the embodiment.

[0058] When the user performs an operation to start the first application 20 as a trigger, the first application 20 acquires the personal BRIR stored in the storage area 21 (step S11). In addition, the first application 20 identifies the equipment connected to the user terminal 10. Figure 2 In the illustrated example, the first application 20 identifies a pair of headphones 50 that has established communication with the user terminal 10 using a wireless connection such as Bluetooth.

[0059] In this case, the first application 20 obtains information related to a pair of headphones 50 as a connected device (step S12). For example, the first application 20 obtains an identifier that identifies the device. When the device has, for example, a Bluetooth function, the identifier is a string for identifying the device such as a BT device name or a unique string for identifying an individual device. In addition, the identifier may also be a model name of the device uniquely given by the manufacturer, etc.

[0060] In addition, the first application 20 can also obtain information indicating whether the connected equipment has a communication function. For example, if the equipment does not have a communication function such as Bluetooth, there may be a situation in which the equipment is unable to send information about an identifier, etc. In this case, the first application 20 obtains information related to a mode indicating that the equipment connected to the user terminal 10 cannot be identified. This information is distinguished by using information indicating, for example, whether the type of equipment is active (has a communication function) or passive (does not have a communication function). That is, the first application 20 obtains information indicating whether the connected equipment is active or passive. In Figure 2 In the illustrated example, because the pair of headphones 50 has a communication function, the first application 20 acquires information indicating that the pair of headphones 50 as the connected equipment is “active”.

[0061] Then, the first application 20 associates the personal BRIR with the identifier of a pair of headphones 50 as equipment used by the user. The association mentioned here indicates that because the equipment connected to the user terminal 10 at the current moment is, for example, a pair of headphones 50, the second application 30 to be described later grants control information for controlling playback in equipment other than the pair of headphones 50. More specifically, the association mentioned here indicates that variables for optimizing certain equipment (hereinafter, referred to as "equipment optimization parameters") are granted control information for control so as not to be erroneously used by other equipment.

[0062] Thereafter, the first application 20 transmits (uploads) information related to the personal BRIR or a pair of headphones 50 to the cloud server 100 (step S13). This process is performed to enable the personal BRIR to be transmitted via the cloud server 100, because data cannot be directly transmitted from the first application 20 to the second application 30.

[0063] The cloud server 100 acquires information related to the personal BRIR and the pair of headphones 50. Then, the cloud server 100 specifies equipment optimization parameters of the pair of headphones 50 from the plurality of pieces of retained information based on the identifier of the pair of headphones 50.

[0064] In addition, the cloud server 100 publishes the acquisition destination address of the personal BRIR so that the first application acquires the personal BRIR (step S14). For example, the acquisition destination address mentioned here is a one-time uniform resource locator (one-time URL) for accessing the cloud server 100 and acquiring the personal BRIR. In this way, the cloud server 100 transmits the personal BRIR via the acquisition destination address. Therefore, even if the personal BRIR cannot be transmitted from the first application 20 to the playback destination application ( Figure 2 In the case of the second application 30 in the illustrated example, the user terminal 10 may also transmit the personal BRIR to the second application 30 .

[0065] In addition, the cloud server 100 also publishes a one-time URL that serves as a destination address for obtaining equipment optimization parameters for a pair of headphones 50.

[0066] Then, the cloud server 100 sends the published acquisition destination address of the personal BRIR and the acquisition destination address of the equipment optimization parameters of the pair of headphones 50 to the first application 20 (step S15).

[0067] The first application 20 obtains the destination address of the personal BRIR and the destination address of the equipment optimization parameters of the headset 50 sent from the cloud server 100 (step S16). In addition, the first application 20 can also associate the personal BRIR with the identifier of the headset 50 at the timing of step S16.

[0068] Thereafter, when the second application 30 is started as a trigger, for example, by an operation performed by the user, the first application 20 provides the acquired information to the second application 30 (step S17). Specifically, the first application 20 provides the acquisition destination address of the personal BRIR, the acquisition destination address of the equipment optimization parameters of the pair of headphones 50, the identifier of the pair of headphones 50, the model name of the pair of headphones 50, the information on the equipment type, etc. to the second application 30.

[0069] The second application 30 is an application for playing back a sound source or a moving image. For example, the second application 30 is provided to the user from a business operator or the like that is the same as the business operator that manages the service server 200 that provides the streaming sound source. In addition, as will be described later, the second application 30 may also include processing units such as a data control unit 31 and a player 34, and the data control unit 31 may also be provided as a shared library by the business operator that provides the first application 20. That is, the business operator that manages the service server 200 may also provide only the function corresponding to the player 34 included in the second application 30.

[0070] The data control unit 31 included in the second application 30 is a library (Library) including an executable file for transmitting and receiving data to and from, for example, the first application 20 or the cloud server 100 , and is sometimes referred to as a server access library (SAL) or the like.

[0071] The data control unit 31 obtains the personal BRIR from the cloud server 100 via the acquisition destination address of the personal BRIR provided from the first application 20 (step S18). In addition, the data control unit 31 obtains the equipment optimization parameters of the pair of headphones 50 from the cloud server 100 via the acquisition destination address of the equipment optimization parameters provided from the first application 20.

[0072] The data control unit 31 stores the acquired personal BRIR and the equipment optimization parameters of the pair of headphones 50 in the storage area 32 (step S19).

[0073] Subsequently, the data control unit 31 identifies the equipment connected to the user terminal 10. Specifically, the data control unit 31 identifies a pair of headphones 50 in which communication with the user terminal 10 has been established (step S20).

[0074] Then, the data control unit 31 determines a match between the identifier of the equipment associated with the personal BRIR through the first application 20 and the identifier identifying the equipment that the user will use at the current moment. Specifically, the data control unit 31 determines a match between the identifier of the equipment associated with the HRTF through the first application 20 in step S12 and the identifier of the equipment connected at the time point in step S20. Figure 2In the illustrated example, because both identifiers of these pieces of equipment indicate a pair of headphones 50, the data control unit 31 determines that the two have matched.

[0075] In this case, the data control unit 31 updates the setting file (configuration file) 33 in which the settings when the playback is performed by the second application 30 are maintained. Specifically, the data control unit 31 writes the acquired personal BRIR and information indicating the equipment optimization parameters used (enabled) in the playback process into the setting file 33.

[0076] In contrast, if the identifier of the equipment associated with the personal BRIR through the first application 20 and the identifier identifying the equipment to be used by the user at the current moment do not match, the data control unit 31 writes information indicating that the acquired personal BRIR and equipment optimization parameters are not enabled.

[0077] That is, the data control unit 31 compares the identifier (BT device name, etc.) transmitted from the first application 20 with the identifier of the pair of headphones 50 currently connected, and determines the personal BRIR and equipment optimization parameters for playing back the sound source. Then, the data control unit 31 updates the setting file 33 according to the determined content (step S21).

[0078] In this way, if the equipment (a pair of headphones 50) actually used is changed even when the personal BRIR and equipment optimization parameters have been provided from the cloud server 100, the data control unit 31 restricts its use. That is, by including a step of determining the identifier of the equipment in the second application 30 that actually performs playback, the data control unit 31 can prevent inappropriate playback from being performed when playing back music due to the use of equipment optimization parameters of different equipment.

[0079] Thereafter, when the user desires to play back music, the second application 30 executes the function of the player 34. The player 34 is a processing unit that plays back music or moving images based on the sound source of the music file or the like and based on the information set in the setting file 33.

[0080] The player 34 reads the setting file 33 and recognizes that a personal BRIR is used for playback or equipment optimization parameters of a pair of headphones 50 are used (step S22).

[0081] Subsequently, the player 34 acquires the personal BRIR and equipment optimization parameters from the storage area 32 based on the information set in the setting file 33 (step S23).

[0082] Furthermore, the player 34 accesses the service server 200 that provides a streaming sound source or the like and acquires the sound source (step S24 ).

[0083] Then, the player 34 plays back the sound source by convolving the personal BRIR and the equipment optimization parameters with the sound source. Therefore, the player 34 can perform playback using a transfer function in accordance with the shape of the ear of an individual user and using parameters optimized for the playback environment of a pair of headphones 50 or the like.

[0084] As described above, the user terminal 10 as an example of an information processing device according to the present disclosure associates a personal BRIR (or personal HRTF) corresponding to a user with an identifier identifying equipment used by the user. Then, the user terminal 10 provides the personal BRIR and the identifier associated with the personal BRIR to the second application 30 as a providing destination to which the personal BRIR corresponding to the user is provided.

[0085] That is, the user terminal 10 provides not only the personal BRIR, but also the identifier of the equipment connected in the environment using the personal BRIR. In this way, the user terminal 10 can perform playback optimized for the user's environment by also providing information indicating which equipment the user is going to use for the personal BRIR to the playback environment (the second application 30, etc.).

[0086] In addition, the user terminal 10 obtains the personal BRIR corresponding to the user and the identifier associated with the personal BRIR, and determines a match between the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user. Then, when the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user match, the user terminal 10 sets the personal BRIR to enable the personal BRIR.

[0087] In this way, by identifying the equipment connected at the current moment in the environment where the personal BRIR is to be used, the user terminal 10 determines whether to use the personal BRIR and the equipment optimization parameters provided from the cloud server 100. Therefore, the user terminal 10 can prevent the use of an inappropriate personal BRIR at the time of playback, or prevent the use of different equipment optimization parameters by mistake. As a result, the user terminal 10 can perform playback optimized for the user's environment.

[0088] As described above, a description of the overview of the overall flow of information processing according to the present disclosure has been given. Figure 3 In the description of the following and subsequent drawings, the configuration of the user terminal 10 and various processes will be described in detail.

[0089] [1-2. Configuration of information processing device according to embodiment]

[0090] Reference Figure 3 A configuration of the user terminal 10 as an example of an information processing device according to the present disclosure is described. Figure 31 is a diagram illustrating a configuration example of a user terminal 10 according to an embodiment of the present disclosure. Figure 3 As illustrated in FIG. 1 , the user terminal 10 includes a communication unit 11 , an input unit 12 , a display unit 13 , a detection unit 14 , a storage unit 15 , and a control unit 16 .

[0091] The communication unit 11 is implemented by, for example, a network interface card (NIC), etc. The communication unit 11 is connected by wire or wirelessly through a network N (Internet, etc.), and transmits and receives information to and from the cloud server 100, the service server 200, a pair of headphones 50, etc. via the network N.

[0092] The input unit 12 is an input device for receiving various operations from the user. For example, the input unit 12 is implemented by an operation key or the like included in the user terminal 10. The display unit 13 is a display device for displaying various information. For example, the display unit 13 is implemented by a liquid crystal display or the like. In addition, if a touch panel is used for the user terminal 10, part of the input unit 12 is integrated with the display unit 13.

[0093] The detection unit 14 is a general term for various sensors, and detects various information related to the user terminal 10. Specifically, the detection unit 14 detects operations performed by the user on the user terminal 10, location information about the location of the user terminal 10, information related to equipment connected to the user terminal 10, the environment of the user terminal 10, and the like.

[0094] In addition, as an example of a sensor, the detection unit 14 includes a lens and an image sensor for capturing an image. That is, when, for example, a user starts an application for operating an image capturing function, the detection unit 14 manifests a function as a camera.

[0095] The storage unit 15 is realized by, for example, a semiconductor storage device such as a random access memory (RAM) and a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 15 stores therein various data used for information processing.

[0096] like Figure 3 As shown in FIG. 1 , the storage unit 15 includes data tables such as a BRIR table 151 and a parameter table 152. The BRIR table 151 is associated with, for example, Figure 2 The parameter table 152 is associated with the storage area 21 shown in FIG. Figure 2 The storage area 32 shown in the figure is associated.

[0097] The BRIR table 121 stores therein information related to a personal BRIR generated by the cloud server 100 . Figure 4 An example of the BRIR table 151 according to an embodiment of the present disclosure is illustrated. Figure 4is a diagram illustrating an example of a BRIR table 151 according to an embodiment. Figure 4 In the illustrated example, the BRIR table 151 has entries such as “personal BRIR data”, “creation date and time”, and the like.

[0098] “Personal BRIR data” indicates data of a personal BRIR generated by the cloud server 100 . Figure 4 The personal BRIR data is conceptually illustrated as "A01"; however, in reality, in the subject entry, a specific numerical value or the like indicating the personal BRIR is stored.

[0099] “Generation date and time” indicates the date and time when personal BRIR data is generated. When the user terminal 10 acquires personal BRIR more than once, the user terminal 10 may also maintain only the latest personal BRIR in the BRIR table 151 or may also maintain multiple personal BRIRs in the BRIR table 151.

[0100] Next, the parameter table 122 will be described. The parameter table 122 stores therein information related to parameters of a sound source or a moving image used at the time of playback. Figure 5 An example of the parameter table 152 according to an embodiment of the present disclosure is illustrated. Figure 5 is a diagram illustrating an example of the parameter table 152 according to an embodiment. Figure 5 In the illustrated example, the parameter table 152 has entries such as “setting ID”, “personal BRIR data”, “equipment optimization parameter”, “acquisition date and time”, and the like.

[0101] "Setting ID" indicates identification information for identifying a setting indicating that the personal BRIR has been associated with the equipment optimization parameter. Figure 4 The same items shown in FIG. 1 are associated with each other. “Equipment optimization parameters” indicates data of equipment optimization parameters acquired from the cloud server 100 . Figure 5 The equipment optimization parameter is conceptually illustrated as "C01"; however, in reality, in the subject entry, a specific numerical value or the like indicating the equipment optimization parameter is stored.

[0102] “Acquisition date and time” indicates the date and time when the personal BRIR and the equipment optimization parameters are acquired from the cloud server 100. When the user terminal 10 acquires the personal BRIR and the equipment optimization parameters more than once, the user terminal 10 may also maintain the latest personal BRIR and the equipment optimization parameters in the parameter table 152, or may also maintain a plurality of personal BRIRs and the equipment optimization parameters in the BRIR table 151.

[0103] Will return reference Figure 3The control unit 16 is implemented by, for example, a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), etc., which executes a program (for example, an information processing program according to the present disclosure) stored in the user terminal 10 in a random access memory (RAM) or the like as a working area. In addition, the control unit 16 is a controller and can also be implemented by, for example, an integrated circuit (such as an integrated circuit) such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc.

[0104] like Figure 3 As shown in the figure, the control unit 16 includes a first application control unit 161 and a second application control unit 165, and implements or executes the functions or operations of the information processing described below. The first application control unit 161 includes a generating unit 162, an executing unit 163, and a providing unit 164. The second application control unit 165 includes an acquiring unit 166, a determining unit 167, a setting unit 168, and a playback unit 169. For example, the acquiring unit 166, the determining unit 167, and the setting unit 168 are similar to Figure 2 In addition, the playback unit 169 is associated with the data control unit 31 shown in FIG. Figure 2 In addition, the internal configuration of the control unit 16 is not limited to Figure 3 The configuration illustrated in FIG. 1 is a configuration illustrated in FIG. 1 , and other configurations may be used as long as the configuration is set to perform information processing that will be described later.

[0105] The generation unit 162 controls the processing related to generating the HRTF and the personal BRIR. Specifically, the generation unit 162 controls the processing related to capturing an image including the side of the user's ear. In addition, the generation unit 162 controls the processing of sending the image obtained by capturing the image to the cloud server 100 or the processing of acquiring the personal BRIR generated by the cloud server 100.

[0106] The generation unit 162 appropriately stores the captured image or the acquired personal BRIR in the storage unit 15. In addition, instead of sending the image captured by the user terminal 10 to the cloud server 100, the generation unit 162 may also acquire an image captured by, for example, an external camera, and may also send the acquired image to the cloud server 100.

[0107] In addition, if a personal HRTF or personal BRIR that has been generated for a user is held in the cloud server 100, the generation unit 162 may also control only the process of acquiring the personal HRTF or personal BRIR instead of sending the image to the cloud server 100. That is, the process of acquiring the personal HRTF or personal BRIR performed by the generation unit 162 is not limited to a specific method.

[0108] The execution unit 163 associates the personal HRTF or the personal BRIR corresponding to the user with an identifier identifying the equipment used by the user.

[0109] For example, when the user starts the first application as a trigger, the execution unit 163 obtains the personal BRIR stored in the BRIR table 151. In addition, the execution unit 163 obtains an identifier identifying a pair of headphones 50 connected at the time point when the first application is started from the pair of headphones 50. Then, the execution unit 163 associates the personal BRIR with the identifier of the pair of headphones 50, and uploads the personal BRIR together with the association information to the cloud server 100.

[0110] Thereafter, the execution unit 163 acquires the personal BRIR and the acquisition destination one-time URL of the pair of headphones 50 issued by the cloud server 100. In addition, the execution unit 163 may also associate the personal BRIR with the identifier of the pair of headphones 50 at the time when the acquisition destination one-time URL is acquired.

[0111] The providing unit 164 provides the personal BRIR and the identifier associated with the personal BRIR to the providing destination, which is provided corresponding to the personal BRIR of the user. The providing destination mentioned here is, for example, an application (a second application in this embodiment) installed in the user terminal 10 and different from the first application. In addition, the providing destination is not limited to the second application, but may also be other external equipment (for example, other information processing terminals capable of performing two-way communication with the user terminal 10) and the like.

[0112] The providing unit 164 provides the personal BRIR to the providing destination by sending a one-time URL used by the providing destination to obtain the personal BRIR. In other words, the providing unit 164 provides the personal BRIR to the providing destination via the one-time URL. Therefore, the providing unit 164 can also provide the personal BRIR to the second application that cannot directly perform the transfer due to, for example, OS restrictions, etc.

[0113] Furthermore, the providing unit 164 may also provide variables (equipment optimization parameters) that conform to the equipment used with the personal BRIR to the providing destination together with the identifier.

[0114] The providing unit 164 provides the equipment optimization parameters to the providing destination by sending a one-time URL used by the providing destination to obtain the equipment optimization parameters. That is, similar to the personal BRIR, the providing unit 164 provides the equipment optimization parameters to the providing destination via the one-time URL. Therefore, the providing unit 164 can also provide the equipment optimization parameters to the second application that cannot directly perform the transfer due to, for example, OS restrictions.

[0115] In addition, in the case where communication has been established between the user terminal 10, the information processing apparatus, and the pair of headphones 50, the providing unit 164 can also provide the equipment optimization parameters to the providing destination. That is, if the communication with the pair of headphones 50 is disconnected at the timing when the equipment optimization parameters are provided to the second application, for example, the providing unit 164 does not need to provide the equipment optimization parameters to the second application. Therefore, the providing unit 164 can prevent the inconsistency from being caused between the equipment to be used by the user and the transmitted optimization parameters.

[0116] The acquisition unit 166 acquires a personal BRIR corresponding to a user and an identifier associated with the personal BRIR.

[0117] For example, the acquisition unit 166 acquires the personal BRIR from the cloud server 100 via the one-time URL provided from the providing unit 164. Specifically, the acquisition unit 166 acquires the personal BRIR by accessing the access destination indicated by the one-time URL and sending an acquisition request for the personal BRIR to the cloud server 100.

[0118] In addition, the acquisition unit 166 may also acquire equipment optimization parameters that are suitable for the equipment when used with the personal BRIR together with the identifier of the equipment.

[0119] For example, the acquisition unit 166 acquires equipment optimization parameters from the cloud server 100 via the one-time URL provided from the providing unit 164. Specifically, the acquisition unit 166 acquires equipment optimization parameters by accessing the access destination indicated by the one-time URL and sending an acquisition request for equipment optimization parameters to the cloud server 100.

[0120] The acquisition unit 166 appropriately stores the acquired information in the storage unit 15. For example, the acquisition unit 166 associates the acquired personal BRIR with the equipment optimization parameter and stores the associated information in the parameter table 152.

[0121] The determination unit 167 determines a match between an identifier associated with the personal BRIR and an identifier identifying equipment used by the user.

[0122] Specifically, the determination unit 167 determines a match between the identifier of the BT device name or the like provided from the providing unit 164 and associated with the personal BRIR and the identifier of the BT device name or the like of the equipment used by the user at the current moment.

[0123] In addition, the determination unit 167 determines that the equipment that has established communication with the user terminal 10 is the equipment used by the user. For example, the determination unit 167 can specify the equipment that has established communication with the user terminal 10 by using the function (library, etc.) of the OS and detecting the equipment connected to the user terminal 10.

[0124] In addition, if the determination unit 167 cannot detect the equipment being used by the user at the current moment or cannot obtain the identifier of the equipment, it can also be determined that the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user do not match. For example, if the equipment used by the user at the current moment is passive and does not have a function for sending an identifier, the determination unit 167 determines that the identifier associated with the personal BRIR and the identifier of the equipment do not match.

[0125] If the identifier associated with the personal BRIR matches the identifier identifying the equipment used by the user, the setting unit 168 sets the personal BRIR to enable the personal BRIR. In addition, the equipment used by the user mentioned here indicates the equipment that has established communication with the user terminal 10 at the timing (such as the timing of playing back the sound source) when the personal BRIR is to be used.

[0126] For example, if the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user match, the setting unit 168 writes information indicating that the personal BRIR acquired from the cloud server 100 is available into the setting file. Therefore, the playback unit 169, which will be described later, can perform playback using the personal BRIR stored in the parameter table 152.

[0127] In addition, if the identifier associated with the personal BRIR and the identifier identifying the equipment used by the user do not match, the setting unit 168 may also set the personal BRIR or equipment optimization parameter to not enable the personal BRIR or equipment optimization parameter.

[0128] Therefore, the setting unit 168 can prevent the occurrence of a situation in which the user cannot experience, such as a situation in which the optimal sound source is not played back due to the incorrect use of personal BRIR or equipment optimization parameters in an unclear environment of the playback state.

[0129] In addition, the setting unit 168 may also set the personal BRIR and the equipment optimization parameter to not enable both the personal BRIR and the equipment optimization parameter at the same time, or may also set the personal BRIR to enable the personal BRIR and set the equipment optimization parameter to not enable the equipment optimization parameter. When the setting unit 168 sets the personal BRIR to not enable the personal BRIR, the setting unit 168 writes data indicating that the average BRIR obtained by averaging multiple users is used instead of the personal BRIR when playing back the sound source into the setting file. In addition, when the setting unit 168 sets the equipment optimization parameter to not enable the equipment optimization parameter, the setting unit 168 writes data indicating that the standard parameters commonly used by all equipment are used instead of the equipment optimization parameter when playing back the sound source.

[0130] The playback unit 169 plays back the sound source or the moving image. At the time of playback, the playback unit 169 reads the setting file and specifies the BRIR and the parameters for playback. Then, the playback unit 169 acquires the personal BRIR and the equipment optimization parameters written in the setting file from the parameter table 152 and performs playback.

[0131] For example, the playback unit 169 accesses the service server 200, acquires streaming data, and plays back the acquired streaming data. In addition, the playback unit 169 can also play back not only the streaming data but also the sound source or moving image stored in the storage unit 15.

[0132] [1-3. Flow of information processing according to the embodiment]

[0133] Next, we will refer to Figures 6 to 9 The flow of information processing according to the first embodiment is described below. Figure 6 In the following, the flow of processing until the step of acquiring the personal BRIR is performed by the user terminal 10 will be described. Figure 6 is a flowchart (1) illustrating the flow of information processing according to the embodiment.

[0134] like Figure 6 As illustrated in FIG. 1 , the user terminal 10 acquires an ear image of a user via an image capturing process or the like (step S101 ). Subsequently, the user terminal 10 transmits the ear image to the cloud server 100 (step S102 ).

[0135] Thereafter, the user terminal 10 acquires the personal BRIR generated based on the ear image (step S103). Then, the user terminal 10 stores the acquired personal BRIR in the storage unit 15 (BRIR table 151) (step S104).

[0136] Next, we will refer to Figure 7 The flow of a process in which the user terminal 10 provides the personal BRIR to the second application is described. Figure 7 is a flowchart (2) illustrating the flow of information processing according to the embodiment.

[0137] like Figure 7 As illustrated in , the user terminal 10 determines whether the activation of the first application has been detected (step S201). If the activation of the first application has not been detected ("No" at step S201), the user terminal 10 waits until the activation is detected.

[0138] In contrast, if activation of the first application has been detected (“Yes” at step S201 ), the user terminal 10 acquires information about equipment connected to the user terminal 10 (eg, an identifier of a pair of headphones 50 , etc.) (step S202 ).

[0139] Thereafter, the user terminal 10 transmits the personal BRIR stored in the BRIR table 151 to the cloud server 100 (step S203). Subsequently, the user terminal 10 acquires the acquisition destination address of the personal BRIR issued by the cloud server 100 (step S204).

[0140] In addition, the user terminal 10 determines whether the acquisition destination address of the equipment optimization parameters has been acquired (step S205). If the acquisition destination address of the equipment optimization parameters has been acquired ("Yes" at step S205), the user terminal 10 associates the identifier of the equipment with the personal BRIR (step S206).

[0141] On the contrary, if the acquisition destination address of the equipment optimization parameters has not been acquired ("No" at step S205), the user terminal 10 does not need to associate the identifier of the equipment with the personal BRIR. The case where the acquisition destination address of the equipment optimization parameters is not acquired mentioned here is, for example, a case where the equipment is passive and therefore the identifier cannot be acquired at step S202, a case where the cloud server 100 does not hold the optimization parameters of the equipment, etc.

[0142] Then, the user terminal 10 provides information such as the acquisition destination address acquired from the cloud server 100 to the second application (step S207 ).

[0143] Next, we will refer to Figure 8 The flow of the process of setting the personal BRIR by the user terminal 10 is described. Figure 8 is a flowchart (3) illustrating the flow of information processing according to the embodiment.

[0144] like Figure 8 As illustrated in FIG, the user terminal 10 determines whether the activation of the second application has been detected (step S301). If the activation of the second application has not been detected ("No" at step S301), the user terminal 10 waits until the activation is detected.

[0145] In contrast, if activation of the second application has been detected (“YES” at step S301 ), the user terminal 10 acquires information provided from the first application (step S302 ).

[0146] Thereafter, the user terminal 10 acquires the personal BRIR from the cloud server 100 by using the provided acquisition destination address (step S303). Subsequently, the user terminal 10 stores the acquired personal BRIR in the storage unit 15 (parameter table 152) (step S304).

[0147] In addition, the user terminal 10 determines whether the acquisition destination address of the equipment optimization parameter has been acquired from the first application (step S305). If the acquisition destination address of the equipment optimization parameter has been acquired ("Yes" at step S305), the user terminal 10 acquires the equipment optimization parameter from the cloud server 100 by using the acquisition destination address (step S306). The user terminal 10 associates the acquired equipment optimization parameter with the personal BRIR and stores the parameter in the storage unit 15 (parameter table 152) (step S307).

[0148] In addition, the user terminal 10 acquires information about the equipment connected at the current moment (step S308). Then, the user terminal 10 determines whether the identifier of the equipment acquired at step S308 matches the identifier associated with the personal BRIR (step S309).

[0149] If the identifier of the equipment acquired at step S308 matches the identifier associated with the personal BRIR ("Yes" at step S309), the user terminal 10 registers information indicating the use of the personal BRIR and equipment optimization parameters into the setting file. In other words, the user terminal 10 enables the personal BRIR and equipment optimization parameters (step S310).

[0150] On the contrary, if the user terminal 10 does not obtain the acquisition destination address of the equipment optimization parameter from the first application ("No" at step S305), or if the identifier of the equipment obtained at step S308 and the identifier associated with the personal BRIR do not match ("No" at step S309), the user terminal 10 registers an instruction not to use the personal BRIR and the equipment optimization parameter into the setting file. In other words, the user terminal 10 sets the personal BRIR and the equipment optimization parameter to not enable the personal BRIR and the equipment optimization parameter (step S311).

[0151] In addition, instead of setting the personal BRIR and equipment optimization parameters to not enable the personal BRIR and equipment optimization parameters, the user terminal 10 may also set the personal BRIR and equipment optimization parameters to only not enable the equipment optimization parameters at step S311. For example, if the equipment is passive, etc., the user terminal 10 may also enable the user to use only the personal BRIR.

[0152] Next, we will refer to Fig. 9 The flow of a process in which the user terminal 10 performs playback by using the personal BRIR is described. Fig. 9 is a flowchart (4) illustrating the flow of information processing according to the embodiment.

[0153] The user terminal 10 determines whether the activation of the player included in the second application has been detected (step S401). In addition, the activation of the player mentioned here can also be read as, for example, a state in which the user operates the second application to play back the sound source.

[0154] If the activation of the player has not been detected ("No" at step S401), the user terminal 10 waits until the activation is detected. On the contrary, if the activation of the player has been detected ("Yes" at step S401), the user terminal 10 reads the setting file (step S402).

[0155] Subsequently, the user terminal 10 acquires the sound source from the service server 200 (step S403). Then, the user terminal 10 plays back the sound source based on the setting file while convolving, for example, the personal BRIR, equipment optimization parameters, etc. with the sound source (step S404).

[0156] During playback of the sound source, the user terminal 10 determines whether the connection equipment has been changed (step S405). If the connection equipment has been changed ("yes" at step S405), that is, if a pair of headphones being used by the user has been changed, or if the communication has been disconnected, the user terminal 10 changes the setting file (step S406). For example, the user terminal 10 cancels the state of enabling the personal BRIR and equipment optimization parameters and changes the setting file so that these information cannot be used for playback.

[0157] Thereafter, the user terminal 10 determines whether the user has requested to stop playback (step S407). If the user has not requested to stop playback ("No" at step S407), the user terminal 10 continues the process of acquiring the sound source from the service server 200 to continue playback.

[0158] In contrast, if the user has requested to stop playback (“Yes” at step S407 ), the user terminal 10 stops playback of the sound source (step S408 ).

[0159] (2. Modification example)

[0160] The above-described information processing system 1 can also be implemented by various embodiments other than the above-described embodiment. Therefore, below, modified examples of the embodiment will be described.

[0161] [2-1. Model of information processing system]

[0162] In the embodiment, a one-time URL is used as an example of the acquisition destination address of the personal BRIR or the equipment optimization parameter; however, the example is not limited thereto, and any method may also be used as long as a method is used in which the second application can acquire data from the cloud server 100. In addition, after the personal BRIR has been provided to the user terminal 10 via the one-time URL, the cloud server 100 may also delete the provided personal BRIR, or may also maintain the provided personal BRIR for a certain period of time.

[0163] In the embodiment, an example has been described in which the cloud server 100 generates the personal BRIR. However, the personal BRIR may also be generated by the user terminal 10 instead of the cloud server 100. In this case, the cloud server 100 may also maintain the personal BRIR uploaded from the user terminal 10, and publish the acquisition destination address if a request is received.

[0164] In the embodiment, the description has been given assuming that the cloud server 100 is set in the cloud network; however, the example is not limited thereto. The cloud server 100 may also be set in a network such as a local area network (LAN) or the like as long as the cloud server 100 can communicate with the user terminal 10.

[0165] The cloud server 100 can also obtain identification information about the user when generating the personal BRIR, associate the identification information with the personal BRIR, and maintain the personal BRIR. In this case, the cloud server 100 can provide the personal BRIR to the second application without receiving an upload of the personal BRIR from the first application at each startup.

[0166] In the embodiment, the cloud server 100 has been described as a single server; however, the cloud server 100 may also be composed of multiple server devices. For example, the cloud server 100 may also be divided into a generating server for generating a personal BRIR and a providing server for publishing an acquisition destination address of the personal BRIR or providing the personal BRIR.

[0167] In the embodiment, an example in which the first application and the second application are installed in the user terminal 10 is described; however, the first application and the second application may also be applications installed on different devices. For example, the user terminal 10 may also only maintain the function of the first application and perform playback of the sound source by controlling the second application installed in a smart speaker or the like as another device.

[0168] [2-2. Sound source playback mode]

[0169] If the cloud server 100 does not maintain the user's personal BRIR or equipment optimization parameters, the cloud server 100 may also send the average BRIR of multiple users or standard parameters that do not depend on specific equipment to the user terminal 10 .

[0170] Reference Fig.10 To describe this. Fig.10 is a conceptual diagram illustrating a usage mode of a head related transfer function according to a modification example.

[0171] like Fig.10 As illustrated in FIG. 1 , when a sound source is played back in a second application, modes such as Mode 1 and Mode 2 can be imagined. Mode 1 indicates a case where personal BRIR or equipment optimization parameters cannot be used, such as a case where equipment cannot be identified. Specifically, Mode 1 operates by a combination 70 of streaming data, service application (playback destination application), library, average BRIR, and standard parameters. In contrast, Mode 2 indicates a case where equipment can be identified and there are parameters associated with the equipment. Specifically, Mode 2 operates by a combination 80 of streaming data, service application, library, personal BRIR, and equipment optimization parameters.

[0172] [2-3. Use of parameters]

[0173] The user terminal 10 may also previously acquire equipment optimization parameters associated with a plurality of equipment, instead of acquiring the equipment optimization parameters at each playback. In this case, the user terminal 10 may specify the optimization parameters of the present equipment based on the identifier of the connected equipment, and perform playback by using the specified parameters, etc. In addition, the user terminal 10 may also submit to the user, for example, a list of equipment parameters owned by the user terminal 10, and enable the user to select the parameters. Therefore, even if the user only holds, for example, passive headphones, the user terminal 10 may perform playback by using its own personal BRIR and equipment optimization parameters.

[0174] In addition, in the embodiment, a description has been given of an example in which the user terminal 10 (second application) does not obtain equipment optimization parameters such as a passive pair of headphones. However, the user terminal 10 can also obtain equipment optimization parameters for equipment without communication functions such as passive headphones. In this case, the user manually selects the name of the equipment, etc. by using the first application. In addition, a list of the names of the equipment, etc. is provided to the user terminal 10 from the cloud server 100. Then, the user terminal 10 obtains the acquisition destination address associated with the equipment optimization parameters of the equipment selected by the user from the cloud server 100.

[0175] Then, the user terminal 10 provides the acquired acquisition destination address to the second application. Therefore, the second application can acquire the acquisition destination address of the equipment optimization parameters related to the passive headset, etc. In this case, because Figure 8The processing branch at step S305 illustrated in FIG. 1 is "Yes", so even in the case of passive headphones, the user can enjoy music playback using personal BRIR or equipment optimization parameters. In addition, the user terminal 10 can also appropriately perform music playback not only by using personal BRIR and equipment optimization parameters, but also music playback combined with various functions and variables, such as music playback using only personal BRIR (standard parameters instead of equipment optimization parameters) or music playback using only average BRIR, according to the user's situation.

[0176] When the cloud server 100 generates a personal BRIR based on the personal HRTF, the cloud server 100 may also convolve different RIRs (e.g., RIRs according to the user's room environment, etc.) according to, for example, the user's location or situation. Therefore, the cloud server 100 may further provide the user with a personal BRIR according to the user's situation. In this case, instead of the cloud server 100 generating the personal BRIR, the user terminal 10 that has acquired multiple RIRs itself may also specify the RIR according to the environment and perform convolution with the personal HRTF.

[0177] [2-4. Equipment Mode]

[0178] In the embodiment, a description has been given of an example in which a pair of headphones 50 is connected to the user terminal 10 by using Bluetooth. However, connection of equipment such as a pair of headphones 50 is not limited to Bluetooth, and connection may also be established based on various communication standards.

[0179] (3. Other embodiments)

[0180] The processing according to the above-described embodiments can also be performed by various embodiments other than the above-described embodiments.

[0181] In addition, in the above-mentioned processing in each embodiment, all or part of the processing mentioned as automatically executed can also be performed manually, or all or part of the processing mentioned as manually executed can also be automatically performed using a known method. In addition, unless otherwise specified, the process flow, specific name and information containing various data or parameters indicated in the above description and drawings can be arbitrarily changed. For example, the various information illustrated in each drawing is not limited to the information illustrated in the drawing.

[0182] In addition, the components of each unit illustrated in the drawings are only used to conceptually illustrate their functions, and are not always physically configured as illustrated in the drawings. In other words, the specific shape of the separate or integrated device is not limited to the drawings. Specifically, all or part of the device can be configured by functionally or physically separating or integrating any of the units according to various loads or usage conditions.

[0183] Furthermore, each of the above-described embodiments and modified examples may be used in any appropriate combination as long as the processes do not conflict with each other.

[0184] Furthermore, the effects described in this specification are merely exemplary and non-limiting, and other effects are possible.

[0185] (4. Effects of the information processing device according to the present disclosure)

[0186] As described above, the information processing device (user terminal 10 in the embodiment) according to the present disclosure includes an execution unit (execution unit 163 in the embodiment) and a providing unit (providing unit 164 in the embodiment). The execution unit associates a head-related transfer function corresponding to the user (personal HRTF or personal BRIR in the embodiment) with an identifier identifying the equipment used by the user. The providing unit provides the head-related transfer function and the identifier associated with the head-related transfer function to a providing destination, which is provided with the head-related transfer function corresponding to the user.

[0187] In this way, the information processing device according to the present disclosure indicates the equipment connected at the current moment in the environment where the head-related transfer function is to be used. Therefore, since the information processing device can identify inappropriate equipment connected during playback, the head-related transfer function can be used appropriately.

[0188] Furthermore, the providing unit provides the head related transfer function to the providing destination by transmitting to the providing destination a one-time URL used by the providing destination to acquire the head related transfer function. Therefore, the information processing apparatus can also provide the head related transfer function to the providing destination having OS restrictions or the like.

[0189] Furthermore, the providing unit provides the variables and the identifier that correspond to the equipment when the variables are used together with the head related transfer function to the providing destination. Therefore, the information processing apparatus can perform optimal playback according to the equipment.

[0190] Furthermore, the providing unit provides the variable to the providing destination by sending a one-time URL used by the providing destination to acquire the variable.Therefore, the information processing apparatus can also provide variables such as equipment optimization parameters to a providing destination having OS restrictions or the like.

[0191] In addition, when communication between the information processing device and the equipment has been established, the providing unit provides the variable to the providing destination. Therefore, the information processing device can prevent the variable from being used by the equipment that is not suitable for the acquired variable during music playback, thereby preventing inappropriate playback.

[0192] In addition, the information processing device according to the present disclosure includes an acquisition unit (acquisition unit 166 in the embodiment), a determination unit (determination unit 167 in the embodiment), and a setting unit (setting unit 168 in the embodiment). The acquisition unit acquires a head-related transfer function corresponding to the user and an identifier associated with the head-related transfer function. The determination unit determines a match between the identifier associated with the head-related transfer function and an identifier identifying the equipment used by the user. When the identifier associated with the head-related transfer function matches the identifier identifying the equipment used by the user, the setting unit sets the head-related transfer function to enable the head-related transfer function.

[0193] In this way, the information processing device according to the present disclosure determines the match between the associated equipment at the time point when the head-related transfer function has been acquired and the actually connected equipment, and then, based on the result of the determination, sets the head-related transfer function to be enabled. Therefore, the information processing device can prevent the head-related transfer function from being used by inappropriate equipment during playback.

[0194] Furthermore, the acquisition unit acquires the head related transfer function via a one-time URL for acquiring the head related transfer function. Therefore, the information processing apparatus can acquire the head related transfer function even in the case of OS restriction or the like.

[0195] Furthermore, the acquisition unit acquires the variable and the identifier in accordance with the equipment when the variable is used together with the head-related transfer function. Therefore, the information processing apparatus can perform optimal playback according to the equipment.

[0196] Furthermore, the acquisition unit acquires the variable via a one-time URL for acquiring the variable. Therefore, the information processing apparatus can acquire the variable even in the case of OS restrictions or the like.

[0197] In addition, the determination unit determines that the equipment that has established communication with the information processing device is the equipment used by the user. When the identifier associated with the head-related transfer function and the identifier identifying the equipment used by the user match, the setting unit sets the variable to an enabled variable. Therefore, because the information processing device can determine whether a different equipment from the equipment associated with the acquired head-related transfer function is connected at the time of playback, the information processing device can prevent the use of the variable for inappropriate equipment.

[0198] In addition, when the identifier associated with the head-related transfer function does not match the identifier identifying the equipment used by the user, the setting unit sets the head-related transfer function or variable to not enable the head-related transfer function or variable. Therefore, the information processing apparatus can prevent the use of variables that are not suitable for the equipment, etc.

[0199] (5. Hardware configuration)

[0200] According to the above-described embodiments, information devices such as a user terminal 10, a pair of headphones 50, a cloud server 100, and a service server 200 are composed of a plurality of devices having, for example, Fig.11 The present invention is implemented by a computer 1000 of the configuration illustrated in FIG. Fig.11 10 is a diagram illustrating a hardware configuration of a computer 1000 that implements the functions of a user terminal 10. The computer 1000 includes a CPU 1100, a RAM 1200, a read-only memory (ROM) 1300, a hard disk drive (HDD) 1400, a communication interface 1500, and an input / output interface 1600. The units in the computer 1000 are connected by a bus 1050.

[0201] The CPU 1100 operates based on the programs stored in the ROM 1300 or the HDD 1400 and controls each unit. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processing associated with the various programs.

[0202] The ROM 1300 stores therein a boot program of a basic input output system (BIOS) or the like executed by the CPU 1100 when the computer 1000 is activated, a program depending on the hardware of the computer 1000 , or the like.

[0203] The HDD 1400 is a computer-readable recording medium in which programs executed by the CPU 1100, data used by these programs, etc. are recorded in a non-transitory manner. Specifically, the HDD 1400 is a recording medium in which an information processing program according to the present disclosure as an example of the program data 1450 is recorded.

[0204] The communication interface 1500 is an interface for connecting an external network 1550 (eg, the Internet) by the computer 1000. For example, the CPU 1100 receives data from another device via the communication interface 1500, and transmits data generated by the CPU 1100 to other devices.

[0205] The input / output interface 1600 is an interface for connecting the input / output device 1650 to the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. In addition, the CPU 1100 sends data to an output device such as a display, a speaker, a printer, etc. via the input / output interface 1600. In addition, the input / output interface 1600 can also be used as a medium interface for reading a program recorded in a predetermined recording medium (multiple recording media). An example of one of the media mentioned here includes an optical recording medium such as a digital versatile disk (DVD) and a phase change rewritable disk (PD), a magneto-optical recording medium such as a magneto-optical disk (MO), a magnetic tape medium, a magnetic recording medium, a semiconductor memory, etc.

[0206] For example, when the computer 1000 is used as the user terminal 10 according to the embodiment, the CPU 1100 in the computer 1000 implements the functions of the control unit 16 and the like by executing the information processing program loaded on the RAM 1200. In addition, the HDD 1400 stores therein the information processing program according to the present disclosure and the data included in the storage unit 15. In addition, the CPU 1100 reads the program data 1450 from the HDD 1400; however, as another example, the CPU 1100 may also acquire these programs from other devices via the external network 1550.

[0207] Furthermore, the present technology may also be configured as follows.

[0208] (1) An information processing device comprising:

[0209] an execution unit that associates a head-related transfer function corresponding to a user with an identifier that identifies a device used by the user; and

[0210] A providing unit that provides the head related transfer function and an identifier associated with the head related transfer function to a providing destination to which the head related transfer function corresponding to the user is provided.

[0211] (2) The information processing device according to (1), wherein the providing unit provides the head related transfer function to the providing destination by transmitting to the providing destination a one-time URL used by the providing destination to acquire the head related transfer function.

[0212] (3) The information processing device according to (1) or (2), wherein the providing unit provides a variable that conforms to a setup when the variable is used with the head related transfer function to the providing destination together with the identifier.

[0213] (4) The information processing device according to (3), wherein the providing unit provides the variable to the providing destination by transmitting to the providing destination a one-time URL used by the providing destination to acquire the variable.

[0214] (5) The information processing apparatus according to (3) or (4), wherein the providing unit provides the variable to the providing destination when communication between the information processing apparatus and the equipment has been established.

[0215] (6) An information processing method for causing a computer to perform processing, comprising:

[0216] associating a head related transfer function corresponding to a user with an identifier identifying equipment used by the user; and

[0217] The head related transfer function and an identifier associated with the head related transfer function are provided to a providing destination to which the head related transfer function corresponding to the user is provided.

[0218] (7) An information processing program causing a computer to function as:

[0219] an execution unit that associates a head-related transfer function corresponding to a user with an identifier that identifies a device used by the user; and

[0220] a providing unit that provides the head related transfer function and an identifier associated with the head related transfer function to a providing destination to which the head related transfer function corresponding to the user is provided.

[0221] (8) An information processing device comprising:

[0222] an acquisition unit, the acquisition unit acquiring a head-related transfer function corresponding to the user and an identifier associated with the head-related transfer function;

[0223] a determining unit, the determining unit determining a match between an identifier associated with the head related transfer function and an identifier identifying equipment used by the user; and

[0224] A setting unit is configured to set the head related transfer function to enable the head related transfer function when an identifier associated with the head related transfer function and an identifier identifying the equipment used by the user match.

[0225] (9) The information processing device according to (8), wherein the acquisition unit acquires the head related transfer function via a one-time URL for acquiring the head related transfer function.

[0226] (10) The information processing device according to (8) or (9), wherein the acquisition unit acquires a variable that conforms to a setup when the variable is used with the head related transfer function together with the identifier.

[0227] (11) The information processing device according to (10), wherein the acquisition unit acquires the variable via a one-time URL for acquiring the variable.

[0228] (12) The information processing device according to (10) or (11), wherein:

[0229] The determining unit determines that the equipment that has established communication with the information processing device is equipment used by the user, and

[0230] The setting unit sets the variable to enable the variable when an identifier associated with the head related transfer function and an identifier identifying equipment used by the user match.

[0231] (13) An information processing device according to any one of (10) to (12), wherein, when an identifier associated with the head-related transfer function and an identifier identifying the equipment used by the user do not match, the setting unit sets the head-related transfer function or the variable to not enable the head-related transfer function or the variable.

[0232] (14) An information processing method for causing a computer to perform processing, comprising:

[0233] obtaining a head related transfer function corresponding to the user and an identifier associated with the head related transfer function;

[0234] determining a match between an identifier associated with the head related transfer function and an identifier identifying equipment used by the user; and

[0235] When an identifier associated with the head related transfer function and an identifier identifying equipment used by the user match, the head related transfer function is set to enable the head related transfer function.

[0236] (15) An information processing program causing a computer to function as:

[0237] an acquisition unit, the acquisition unit acquiring a head-related transfer function corresponding to the user and an identifier associated with the head-related transfer function;

[0238] a determining unit, the determining unit determining a match between an identifier associated with the head related transfer function and an identifier identifying equipment used by the user; and

[0239] A setting unit is configured to set the head related transfer function to enable the head related transfer function when the identifier associated with the head related transfer function matches the identifier identifying the equipment used by the user.

[0240] Reference numerals list

[0241] 1 Information Processing System

[0242] 10 User Terminal

[0243] 11 Communication unit

[0244] 12 Input Units

[0245] 13 Display unit

[0246] 14 Detection Unit

[0247] 15 Storage Unit

[0248] 151 BRIR table

[0249] 152 Parameters

[0250] 16 Control Unit

[0251] 161 First application control unit

[0252] 162 Generation Unit

[0253] 163 Execution Unit

[0254] 164 units provided

[0255] 165 Second application control unit

[0256] 166 Get Unit

[0257] 167 Determine unit

[0258] 168 Set Unit

[0259] 169 Playback Unit

[0260] 50 Headphones

[0261] 100 Cloud Servers

[0262] 200 Service Server

Claims

1. An information processing device, comprising: an execution unit, the execution unit transmitting an image of the user's ear to a cloud server, associating a binaural room impulse response corresponding to the user with an identifier identifying a device used by the user, and acquiring a one-time uniform resource locator URL from the cloud server for accessing the cloud server and acquiring the binaural room impulse response, wherein the cloud server acquires a personal head-related transfer function of the user based on the image, and generates a binaural room impulse response by convolving a room impulse response of a predetermined room environment with the head-related transfer function; as well as a providing unit, the providing unit providing a one-time URL and an identifier associated with the binaural room impulse response to a providing destination, so that the providing destination can obtain the binaural room impulse response corresponding to the user from the cloud server, The providing unit provides the equipment optimization parameters that match the equipment when the equipment optimization parameters are used with the binaural room impulse response to the providing destination together with the identifier, and the providing destination is capable of playing back the sound source by convolving the binaural room impulse response and the equipment optimization parameters with the sound source.

2. The information processing device according to claim 1, wherein: The providing unit provides the equipment optimization parameter to the providing destination by sending another one-time URL used by the providing destination to acquire the equipment optimization parameter.

3. The information processing device according to claim 1, wherein: When communication between the information processing apparatus and the equipment has been established, the providing unit provides the equipment optimization parameter to the providing destination.

4. An information processing method for causing a computer to perform processing, comprising: sending an image of the user's ear to a cloud server, associating a binaural room impulse response corresponding to the user with an identifier identifying a device used by the user; obtaining a one-time uniform resource locator URL for accessing the cloud server and obtaining binaural room impulse responses from a cloud server, wherein the cloud server obtains a personal head-related transfer function of the user based on the image, and generates a binaural room impulse response by convolving a room impulse response of a predetermined room environment with the head-related transfer function; as well as providing a one-time URL and an identifier associated with the binaural room impulse response to a provision destination, so that the provision destination can obtain the binaural room impulse response corresponding to the user from the cloud server, wherein equipment optimization parameters that match the equipment when the equipment optimization parameters are used with the binaural room impulse response are provided to the providing destination together with the identifier, and the providing destination is capable of playing back the sound source by convolving the binaural room impulse response and the equipment optimization parameters with the sound source.

5. A computer-readable storage medium storing an information processing program, the information processing program causing a computer to function as: an execution unit, the execution unit transmitting an image of the user's ear to a cloud server, associating a binaural room impulse response corresponding to the user with an identifier identifying a device used by the user, and acquiring a one-time uniform resource locator URL for accessing the cloud server and acquiring the binaural room impulse response from the cloud server, wherein the cloud server acquires a personal head-related transfer function of the user based on the image, and generates the binaural room impulse response by convolving a room impulse response of a predetermined room environment with the head-related transfer function; and a providing unit, the providing unit providing a one-time URL and an identifier associated with the binaural room impulse response to a providing destination, so that the providing destination can obtain the binaural room impulse response corresponding to the user from the cloud server, in, The providing unit provides the equipment optimization parameters that match the equipment when the equipment optimization parameters are used with the binaural room impulse response to the providing destination together with the identifier, and the providing destination is capable of playing back the sound source by convolving the binaural room impulse response and the equipment optimization parameters with the sound source.

6. An information processing device, comprising: an acquisition unit, the acquisition unit acquiring a one-time URL for accessing a cloud server and acquiring a binaural room impulse response corresponding to a user and an identifier associated with the binaural room impulse response, and acquiring the binaural room impulse response by accessing the cloud server using the one-time URL and sending an acquisition request for the binaural room impulse response to the cloud server, wherein the cloud server acquires a personal head-related transfer function of the user based on an image of the user's ear, and generates a binaural room impulse response by convolving a room impulse response of a predetermined room environment with the head-related transfer function; a determining unit, the determining unit determining a match between an identifier associated with the binaural room impulse response and an identifier identifying a device used by the user; as well as a setting unit, wherein when an identifier associated with the binaural room impulse response matches an identifier identifying a device used by the user, the setting unit sets the binaural room impulse response to enable the binaural room impulse response, The acquisition unit acquires the equipment optimization parameters that match the equipment when the equipment optimization parameters are used with the binaural room impulse response together with the identifier, so that the sound source can be played back by convolving the binaural room impulse response and the equipment optimization parameters with the sound source.

7. The information processing device according to claim 6, wherein: The acquisition unit acquires another one-time URL for accessing the cloud server and acquiring the equipment optimization parameters, and acquires the equipment optimization parameters by accessing the cloud server using the another one-time URL and sending an acquisition request for the equipment optimization parameters to the cloud server.

8. The information processing device according to claim 6, wherein: The determining unit determines that the equipment that has established communication with the information processing device is equipment used by the user, and When the identifier associated with the binaural room impulse response and the identifier identifying the equipment used by the user match, the setting unit sets the equipment optimization parameter to enable the equipment optimization parameter.

9. The information processing device according to claim 6, wherein: When the identifier associated with the binaural room impulse response and the identifier identifying the equipment used by the user do not match, the setting unit sets the binaural room impulse response or the equipment optimization parameter to not enable the binaural room impulse response or the equipment optimization parameter.

10. An information processing method for causing a computer to perform processing, comprising: Obtaining a one-time URL for accessing a cloud server and obtaining binaural room impulse responses corresponding to a user and an identifier associated with the binaural room impulse responses, and obtaining the binaural room impulse responses by accessing the cloud server using the one-time URL and sending an acquisition request for the binaural room impulse responses to the cloud server, wherein the cloud server obtains a personal head-related transfer function of the user based on an image of the user's ear, and generates a binaural room impulse response by convolving a room impulse response of a predetermined room environment with the head-related transfer function; determining a match between an identifier associated with the binaural room impulse response and an identifier identifying equipment used by the user; as well as setting the binaural room impulse response to enable the binaural room impulse response when an identifier associated with the binaural room impulse response and an identifier identifying a device used by the user match, Therein, equipment optimization parameters that match the equipment when the equipment optimization parameters are used with the binaural room impulse response are acquired together with the identifier, so that the sound source can be played back by convolving the binaural room impulse response and the equipment optimization parameters with the sound source.

11. A computer-readable storage medium storing an information processing program, the information processing program causing a computer to function as: an acquisition unit, the acquisition unit acquiring a one-time URL for accessing a cloud server and acquiring a binaural room impulse response corresponding to a user and an identifier associated with the binaural room impulse response, and acquiring the binaural room impulse response by accessing the cloud server using the one-time URL and sending an acquisition request for the binaural room impulse response to the cloud server, wherein the cloud server acquires a personal head-related transfer function of the user based on an image of the user's ear, and generates a binaural room impulse response by convolving a room impulse response of a predetermined room environment with the head-related transfer function; a determining unit, the determining unit determining a match between an identifier associated with the binaural room impulse response and an identifier identifying a device used by the user; as well as a setting unit, when the identifier associated with the binaural room impulse response matches the identifier identifying the equipment used by the user, setting the binaural room impulse response to enable the binaural room impulse response, The acquisition unit acquires the equipment optimization parameters that match the equipment when the equipment optimization parameters are used with the binaural room impulse response together with the identifier, so that the sound source can be played back by convolving the binaural room impulse response and the equipment optimization parameters with the sound source.

Images