Information processing device and information processing method

The information processing device efficiently manages head-related transfer function information, reducing user and processing burdens by allowing retrieval from internal or external sources and providing user interface options, ensuring seamless sound reproduction across devices.

JP7771977B2Active Publication Date: 2025-11-18SONY GROUP CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022565155
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-25
Filing Date
2021-10-28
Publication Date
2025-11-18
Estimated Expiration
2041-10-28

AI Technical Summary

Technical Problem

Existing audio signal playback devices require a cumbersome process to acquire head-related transfer function information every time a new device is used, increasing user and processing burden.

Method used

An information processing device that includes a signal acquisition unit, storage unit, determination processing unit, and user interface processing unit to manage and apply head-related transfer function information, allowing retrieval from internal storage or other devices, and providing user interface options for selecting or calculating transfer function information as needed.

Benefits of technology

Reduces the burden on users and processing devices by enabling efficient acquisition and application of personalized head-related transfer function information, allowing seamless sound reproduction across multiple devices without repeated calculations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007771977000001
    Figure 0007771977000001
  • Figure 0007771977000002
    Figure 0007771977000002
  • Figure 0007771977000003
    Figure 0007771977000003
Patent Text Reader

Abstract

This information processing device comprises: a signal acquisition unit which acquires an audio signal; a storage unit which stores head-related transfer function information corresponding to a user; a determination processing unit which determines whether the head-related transfer function information corresponding to the user is stored in another information processing device; a transfer function acquisition unit which acquires the head-related transfer function information corresponding to the user; and a function application unit which applies, to the audio signal, the head-related transfer function information corresponding to the user.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present technology relates to an information processing device and an information processing method for sound reproduction using head-related transfer function information. [Background technology]

[0002] 2. Description of the Related Art When reproducing audio output, a technique is known for reproducing sound with an increased sense of realism by localizing a sound image at a desired virtual position. For example, Patent Document 1 below discloses a technique for providing an optimal sound image localization to a user by measuring a transfer function from a speaker of a television receiver to the ears of the user (listener). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-259299 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, it is known that audio signal playback devices that are worn on the user's ears, such as headphones or earphones, can perform optimal sound playback that is more personalized for each individual user by using appropriate head-related transfer function information that corresponds to the shape of the user's ear, etc.

[0005] The acquired head-related transfer function information can be used even if the audio signal providing device (or providing unit) that generates and transmits an audio signal to the audio signal reproducing device (or audio signal reproducing unit) is different. However, in reality, there is a problem in that every time a new audio signal providing device is started to be used, an operation or process for acquiring head-related transfer function information must be performed.

[0006] The present technology has been made in view of the above circumstances, and aims to reduce the burden on a user and the processing burden on an information processing device involved in obtaining head-related transfer function information. [Means for solving the problem]

[0007] An information processing device according to the present technology includes a signal acquisition unit that acquires an audio signal, a storage unit that stores head-related transfer function information corresponding to a user, a determination processing unit that determines whether the head-related transfer function information corresponding to the user is stored in another information processing device, a transfer function acquisition unit that acquires the head-related transfer function information corresponding to the user, and a function application unit that applies the head-related transfer function information corresponding to the user to the audio signal. and a user interface processing unit capable of executing user interface processing for causing the user to experience a sound field constructed by the audio signals after the head-related transfer function information has been applied, wherein the function application unit is capable of executing a first application processing for applying the head-related transfer function information corresponding to the user to the audio signals, and a second application processing for applying standard head-related transfer function information to the audio signals, and the user interface processing unit is capable of executing a user interface processing for causing the user to experience a sound field constructed by the audio signals generated by the second application processing when the head-related transfer function information corresponding to the user is not stored in the storage unit and cannot be obtained from another information processing device, and a user interface processing for causing the user who has experienced the sound field by the second application processing to further experience a sound field constructed by the audio signals generated by the first application processing for the same content as a processing target in the second application processing. It is something. This allows, for example, even if a newly purchased information processing device (such as a television receiver or headphones) does not store head-related transfer function information (HRTF) corresponding to the user, the user's specific HRTF that has been calculated so far can be obtained from another information processing device.

[0008] The transfer function acquisition unit in the above-mentioned information processing device may acquire the head-related transfer function information corresponding to the user from the memory unit, and if the head-related transfer function information corresponding to the user is not stored in the memory unit, may acquire the head-related transfer function information corresponding to the user from the other information processing device. As a result, if the relevant head-related transfer function information is stored in the storage unit of the information processing device, there is no need to issue an acquisition request to another information processing device.

[0009] The above-mentioned information processing device may be provided with a user interface processing unit that performs user interface processing to obtain the head-related transfer function information corresponding to the user when the head-related transfer function information corresponding to the user is not stored in the memory unit and cannot be obtained from the other information processing device. For example, a process of displaying information for downloading an application for calculating head-related transfer function information to a user terminal is executed.

[0010] The user interface processing unit in the information processing device described above may execute, as the user interface processing, a process of making the user select whether or not to execute a process for obtaining the corresponding head-related transfer function information. This allows a user to express their intention to avoid the process for obtaining head-related transfer function information when the user does not want to take the time to calculate the head-related transfer function information specific to the user.

[0011] The user interface processing unit in the information processing device may execute, as the user interface processing, a process of displaying guidance information for prompting a user to install an application on a user terminal. This allows the user to install the appropriate application by following the instructions displayed.

[0012] The information processing device may further include a transmission processing unit that transmits the audio signal to a playback device. Such information processing devices include, for example, television receivers, personal computers, and tablet terminals. They are particularly suitable for information processing terminals that are likely to be shared by multiple people. The playback device is a headphone or earphone worn by the user. Headphones include those worn on the head so that they cover the ears and those worn around the neck.

[0013] The above-mentioned information processing device may include a detection unit that detects connection of the playback device, and a user interface processing unit that performs user interface processing that allows the user to select whether or not to apply the head-related transfer function information to the audio signal when the detection unit detects connection of the playback device. This makes it possible, for example, when headphones are connected to a television receiver, to display on the display unit of the television receiver a message that allows the user to select whether or not to perform surround playback using head-related transfer function information.

[0014] The function application unit in the above-mentioned information processing device may be capable of executing a first application process of applying the head-related transfer function information corresponding to the user to the audio signal, and a second application process of applying standard head-related transfer function information to the audio signal. For example, even if the user is busy and does not have time to perform operations to acquire head-related transfer function information, it is possible to output sound using standard head-related transfer function information.

[0015] The user interface processing unit in the above-mentioned information processing device may be capable of executing a user interface process that allows the user to select whether to execute the first application process or the second application process when connection of the playback device is detected. This allows the user to choose whether to experience sound reproduction to which his / her own specific head-related transfer function information is applied, or to experience sound reproduction to which head-related transfer function information common to all users is applied.

[0016] The user interface processing unit in the above-mentioned information processing device may be capable of executing user interface processing for allowing a user to experience a sound field constructed by the audio signal after the head-related transfer function information has been applied. For example, some users may not be aware that sound reproduction using head-related transfer function information is possible.

[0017] The user interface processing unit in the information processing device may be capable of executing user interface processing for performing login processing for the user. The user can be identified by performing a login operation in response to the login process.

[0018] The user interface processing unit in the above-mentioned information processing device may be capable of executing user interface processing for performing login processing for the user, and user interface processing for allowing the user to experience a sound field constructed by the audio signal generated by the second application processing when the transfer function acquisition unit is unable to acquire the head-related transfer function information corresponding to the user identified as a result of the login processing. An example of a case in which head-related transfer function information corresponding to a user identified by the login process cannot be obtained is when the user has never experienced acoustic output to which head-related transfer function information specific to that user has been applied.

[0019] The storage unit in the information processing device may store the head-related transfer function information corresponding to the user and the playback device in association with each other. This makes it possible to acquire head-related transfer function information corresponding to a user identified by a login process or the like without performing communication processing with other information processing devices.

[0020] The storage unit in the information processing device may store a plurality of combinations of the head-related transfer function information corresponding to the user and the playback device. This makes it possible to obtain head-related transfer function information corresponding to each user even when the information processing device is shared by multiple users.

[0021] The above-mentioned information processing device may be provided with a user interface processing unit capable of executing user interface processing for switching between an application state in which the head-related transfer function information is applied to the audio signal and a non-application state in which the head-related transfer function information is not applied to the audio signal. This allows the user to switch whether or not to apply head-related transfer function information depending on the content, for example.

[0022] The above-mentioned information processing device may be provided with a user interface processing unit capable of executing user interface processing for switching the head-related transfer function information corresponding to the user to the head-related transfer function information corresponding to another user. This makes it possible to apply optimal head-related transfer function information to each user when multiple users use the information processing device.

[0023] The information processing device may be a television receiver equipped with a display unit capable of displaying images. As a result, when a user who does not have head-related transfer function information stored in the television receiver uses the television receiver, a process is executed in the television receiver to obtain head-related transfer function information corresponding to the user from another information processing device such as a server device.

[0024] The above-mentioned information processing device is provided with a user interface processing unit capable of executing a user interface process for performing a login process for the user, and a user interface process for displaying information on the display unit for installing an application for calculating the head transfer function information corresponding to the user on a user terminal when the head transfer function information corresponding to the user identified as a result of the login process is not stored in the memory unit and cannot be obtained from another information processing device, and the transfer function acquisition unit may acquire the head transfer function information corresponding to the user calculated based on information transmitted from the user terminal from the other information processing device. The login process allows the user using the television receiver to be identified. This also allows head-related transfer function information corresponding to the identified user to be acquired from a storage unit or another information processing device. Furthermore, if head-related transfer function information corresponding to the identified user cannot be acquired, the system guides the user to use a camera application for acquiring the shape of the user's ears, for example, so that head-related transfer function information corresponding to the user can be calculated.

[0025] An information processing method executed by an information processing device according to the present technology includes a process of acquiring an audio signal, a process of storing head-related transfer function information corresponding to a user, a process of determining whether the head-related transfer function information corresponding to the user is stored in another information processing device, a process of acquiring the head-related transfer function information corresponding to the user, and a process of applying the head-related transfer function information corresponding to the user to the audio signal. a user interface process for allowing the user to experience a sound field constructed by the audio signals after the head-related transfer function information has been applied; a first application process for applying the head-related transfer function information corresponding to the user to the audio signals; a second application process for applying standard head-related transfer function information to the audio signals; a user interface process for allowing the user to experience a sound field constructed by the audio signals generated by the second application process when the head-related transfer function information corresponding to the user is not stored in a storage unit and cannot be obtained from another information processing device; and a user interface process for allowing the user, who has experienced the sound field by the second application process, to further experience a sound field constructed by the audio signals generated by the first application process for content that is the same as a processing target in the second application process. It is equipped with the following. This information processing method can also provide the same effects as the information processing device according to the present technology described above. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a diagram illustrating an example of the configuration of an audio reproduction system according to the present technology. [Figure 2] FIG. 1 illustrates an example of the functional configuration of a computer device. [Figure 3] FIG. 1 is a diagram illustrating an example of the configuration of a television receiver. [Figure 4] FIG. 1 is a diagram illustrating an example of the configuration of a neckband speaker. [Figure 5] FIG. 2 is a diagram illustrating a connection state between a television receiver and a relay device. [Figure 6] FIG. 10 is a diagram illustrating an example of a setting start screen. [Figure 7] FIG. 10 is a diagram illustrating an example of a connection instruction screen. [Figure 8] FIG. 10 is a diagram showing an example of a playback device connection instruction screen. [Figure 9] FIG. 10 is a diagram illustrating a state in which the neckband speaker and the relay device are paired. [Figure 10] FIG. 10 is a diagram illustrating an example of an initial setting completion notification screen. [Figure 11] FIG. 10 is a diagram illustrating an example of an optimization selection screen. [Figure 12] FIG. 10 is a diagram illustrating an example of a setting completion screen. [Figure 13] FIG. 10 is a diagram showing an example of an optimization procedure screen. [Figure 14]FIG. 10 is a diagram illustrating an example of an account selection screen. [Figure 15] FIG. 10 is a diagram illustrating an example of a code input screen. [Figure 16] FIG. 10 is a diagram illustrating an example of an identification completion notification screen. [Figure 17] FIG. 10 is a diagram illustrating an example of a sign-in screen. [Figure 18] FIG. 10 is a diagram illustrating an example of a sign-in information input screen. [Figure 19] FIG. 10 is a diagram illustrating an example of an account creation screen. [Figure 20] FIG. 10 is a diagram illustrating an example of a download screen. [Figure 21] FIG. 10 is a diagram illustrating an example of a completion screen. [Figure 22] 10 is a flowchart illustrating an example of an initial setting process. [Figure 23] 10 is a flowchart illustrating an example of a flow for acquiring head-related transfer function information. [Figure 24] 10 is a flowchart illustrating an example of a flow for applying head-related transfer function information. [Figure 25] FIG. 10 is a diagram illustrating another configuration example of a neckband speaker. DETAILED DESCRIPTION OF THE INVENTION

[0027] Hereinafter, with reference to the accompanying drawings, embodiments according to the present technology will be described in the following order. <1. System configuration> <2. Functional configuration of computer equipment> 3. Configuration of a Television Receiver <4. Neckband speaker configuration> <5. UI processing> <6. Flowchart> <6-1. Initial setting flow> <6-2. Head-related Transfer Function (HRTF) Acquisition Flow> <6-3. Head-Related Transfer Function (HRTF) Application Flow> <7. Variations> <8. Summary> <9. This Technology>

[0028] <1. System configuration> The configuration of a sound reproduction system 2 having a television receiver 1 as an information processing device of the present technology will be described with reference to FIG. The sound reproduction system 2 includes a television receiver 1, a first reproduction device 3, a communication network 4, a server device 5, a smartphone 6, and a second reproduction device 7.

[0029] Note that the configuration shown in FIG. 1 is an example, and the sound reproduction system 2 may be configured to include only the television receiver 1, the first reproduction device 3, the communication network 4, and the server device 5, or may include an information processing device other than the television receiver 1 and the smartphone 6, or may include an audio signal reproduction device (such as headphones or earphones) other than the first reproduction device 3 and the second reproduction device 7.

[0030] The television receiver 1 is an example of an information processing device in this embodiment, and is an information processing device that performs processing to generate an audio signal by applying (convoluting) head-related transfer function information HRTF to the audio signal and transmit the generated audio signal to an audio signal playback device.

[0031] The first playback device 3 is a device that plays back audio signals, and is, for example, an earphone, a headphone, or a neckband speaker. In the following example, a neckband speaker 3A will be taken as an example of the first playback device 3. The neckband speaker 3A outputs sound by receiving and playing back an audio signal to which the head-related transfer function information HRTF has been applied from the television receiver 1. In the following description, the audio signal before the head-related transfer function information HRTF has been applied will be referred to as the "uncorrected audio signal SA," and the audio signal after the head-related transfer function information HRTF has been applied will be referred to as the "corrected audio signal SB."

[0032] The audio signal reproducing device may have both the function as an information processing device and the function as the first reproducing device 3. For example, earphones or headphones serving as the audio signal reproducing device may have a generating unit that outputs an audio signal generated by applying (convoluting) head-related transfer function information HRTF, and a reproducing unit that receives the generated audio signal and performs a reproducing process.

[0033] The communication network 4 is not particularly limited in configuration, and in addition to the Internet, examples of the network that can be considered include an intranet, an extranet, a LAN (Local Area Network), a CATV (Community Antenna Television) communication network, a virtual private network, a telephone line network, a mobile communication network, and a satellite communication network. Furthermore, various examples of transmission media are conceivable for constituting all or part of the communication network 4. For example, wired media such as IEEE (Institute of Electrical and Electronics Engineers) 1394, USB (Universal Serial Bus), power line carriers, and telephone lines, as well as wireless media such as infrared media such as IrDA (Infrared Data Association), Bluetooth (registered trademark), 802.11 wireless, mobile phone networks, satellite circuits, and terrestrial digital networks, are available.

[0034] The server device 5 is an information processing device other than the television receiver 1, and is a device that provides various functions and information. Specifically, the server device 5 is capable of providing functions such as storing and managing head-related transfer function information HRTF for each user, and login functions.

[0035] The server device 5 is also capable of executing a process of acquiring head-related transfer function information HRTF corresponding to a user identified by the login process from a database and transmitting the information to the television receiver 1 or the smartphone 6. The head-related transfer function information HRTF managed by the server device 5 may be the head-related transfer function itself or may be a coefficient used in the head-related transfer function. These are collectively called head-related transfer function information HRTF.

[0036] Like the television receiver 1, the smartphone 6 is an information processing device that performs processing to transmit a corrected audio signal SB generated by applying head-related transfer function information HRTF to the uncorrected audio signal SA to a second playback device 7 as an audio signal playback device. In the following description, the smartphone 6 is an example of a user terminal used by a user, which will be described later. That is, the smartphone 6 is a terminal that transmits the corrected audio signal SB to the second playback device 7, and is also a user terminal that the user operates to realize various processes, which will be described later. Of course, devices other than the smartphone 6, such as a personal computer (PC) or a tablet, may be used as the user terminal.

[0037] The second playback device 7 is a device that plays back audio signals, and is, for example, an earphone, a headphone, a neckband speaker, etc. In the following example, a wireless earphone 7A will be taken as an example of the second playback device 7. The wireless earphone 7A receives the corrected audio signal SB from the smartphone 6 and reproduces it to output sound.

[0038] In the following explanation, we will use as an example a case where user A, who has already experienced sound reproduction using smartphone 6 and wireless earphones 7A and applied head-related transfer function information HRTF corresponding to him / her, starts using television receiver 1 and neckband speaker 3A. That is, the server device 5 stores user information such as a user ID (Identification) that identifies user A, along with images of both ears of user A taken using the smartphone 6 and information on head-related transfer functions (HRTFs) calculated from the images. It is noted that while the user information and head-related transfer function information HRTF are stored in the server device 5, the ear images do not necessarily have to be stored in the server device 5. In the following description, user A will be simply referred to as "user."

[0039] <2. Functional configuration of computer equipment> The functional configuration of the television receiver 1, the server device 5, and the computer device serving as the smartphone 6 will be described with reference to FIG.

[0040] 2, a CPU 71 of the computer device executes various processes in accordance with programs stored in a ROM 72 or a nonvolatile memory unit 74 such as an EEPROM (Electrically Erasable Programmable Read-Only Memory), or programs loaded from a storage unit 79 to a RAM 73. The RAM 73 also stores data necessary for the CPU 71 to execute various processes, as appropriate. The CPU 71, ROM 72, RAM 73, and nonvolatile memory unit 74 are interconnected via a bus 83. The bus 83 is also connected to an input / output interface 75.

[0041] The input / output interface 75 is connected to an input unit 76 that includes an operator and an operation device. For example, the input unit 76 may be various types of operators or operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, or a remote controller. An operation by the user is detected by the input unit 76, and a signal corresponding to the input operation is interpreted by the CPU 71.

[0042] Furthermore, the input / output interface 75 is connected integrally or separately to a display unit 77 made up of an LCD or organic EL panel or the like, and an audio output unit 78 made up of a speaker or the like. The display unit 77 is a display unit that displays various information, and is configured, for example, by a display device provided in the housing of the computer device, or a separate display device connected to the computer device. The display unit 77 displays images for various image processing, moving images to be processed, etc. on the display screen based on instructions from the CPU 71. Furthermore, the display unit 77 displays various operation menus, icons, messages, etc., that is, GUI (Graphical User Interface), based on instructions from the CPU 71.

[0043] The input / output interface 75 may be connected to a storage unit 79 configured with a hard disk or solid-state memory, or a communication unit 80 configured with a modem or the like.

[0044] The communication unit 80 performs communication processing via a transmission path such as the Internet, and communication with various devices via wired / wireless communication, bus communication, and the like.

[0045] A drive 81 is also connected to the input / output interface 75 as required, and a removable storage medium 82 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory is appropriately mounted thereon. Drive 81 allows data files such as image files and various computer programs to be read from removable storage medium 82. The read data files are stored in storage unit 79, and images and sounds contained in the data files are output on display unit 77 and audio output unit 78. Computer programs and the like read from removable storage medium 82 are installed in storage unit 79 as needed.

[0046] In this computer device, for example, software for the processing of this embodiment can be installed via network communication by the communication unit 80 or via a removable storage medium 82. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, etc.

[0047] The CPU 71 performs processing operations based on various programs, whereby the television receiver 1, the server device 5, and the smartphone 6 perform necessary information processing and communication processing. The information processing device constituting the television receiver 1, the server device 5, and the smartphone 6 is not limited to being configured as a single computer device as shown in Fig. 2, but may be configured as a system of multiple computer devices. The multiple computer devices may be systemized using a LAN or the like, or may be located in a remote location via a VPN or the like using the Internet or the like. The multiple information processing devices may include an information processing device as a server group (cloud) available through a cloud computing service.

[0048] Furthermore, the neckband speaker 3A as the first playback device 3 and the wireless earphone 7A as the second playback device 7 may each have a functional block as a computer device as shown in FIG. The neckband speaker 3A and the wireless earphone 7A do not need to have all of the functional configurations shown in Fig. 2, and may have only some of them. The same applies to the television receiver 1, the server device 5, and the smartphone 6.

[0049] 3. Configuration of a Television Receiver An example of the configuration of the television receiver 1 will be described with reference to FIG. The television receiver 1 includes a control unit 8 (CPU 71), a storage unit 9 (storage unit 79), a communication unit 10 (communication unit 80), and a speaker device 11 (audio output unit 78).

[0050] The CPU 71 of the television receiver 1 as a computer device shown in FIG. 2 operates based on a program, and the control unit 8 has various functions. Specifically, the control unit 8 functions as a detection unit 21, a user interface processing unit 22, a determination processing unit 23, a transfer function acquisition unit 24, a signal acquisition unit 25, a function application unit 26, and a transmission processing unit 27.

[0051] The detection unit 21 performs processing to detect that an audio signal reproducing device such as the neckband speaker 3A is connected to the television receiver 1. Specifically, the connection detection is performed based on short-distance wireless communication or wired communication performed by the communication unit 10. Alternatively, the detection unit 21 may detect that the neckband speaker 3A has come close to the television receiver 1.

[0052] The user interface processing unit 22 performs various user interface processes for generating a corrected audio signal SB to which the head-related transfer function information HRTF has been applied. In the following description, the user interface will be referred to as UI (User Interface).

[0053] The UI processing unit 22 is capable of executing processing for the user to log in. In order for the user to enjoy optimal sound output using the neckband speaker 3A, it is important to determine what type of head-related transfer function information HRTF to apply to the uncorrected audio signal SA to generate the corrected audio signal SB. The UI processing unit 22 identifies the user through the user's login operation, and thereby obtains information for acquiring head-related transfer function information HRTF corresponding to the user.

[0054] The UI processing for logging in may be, for example, a process of presenting an interface for inputting a user ID and password, or a process of displaying information (such as two-dimensional code information) for displaying a web page for performing login operations on a user terminal such as a smartphone used by the user.

[0055] In addition, the UI processing unit 22 is capable of executing UI processing that allows the user to select whether or not to perform correction using head-related transfer function information HRTF on the uncorrected audio signal SA, and UI processing that allows the user to select what type of head-related transfer function information HRTF to apply.

[0056] The user can select not to perform correction using head-related transfer function information HRTF via the UI provided by the UI processing unit 22. Furthermore, when not only head-related transfer function information HRTF corresponding to a specified user but also standard head-related transfer function information HRTF effective for many users is stored in the storage unit 9 as head-related transfer function information HRTF, the UI processing unit 22 may be capable of executing UI processing that allows selection of whether to apply the head-related transfer function information HRTF corresponding to the user or the standard head-related transfer function information HRTF. This UI processing may be executed in response to the detection unit 21 detecting connection of a neckband speaker 3A or the like.

[0057] Furthermore, if the head-related transfer function information HRTF corresponding to the user is not stored in the memory unit 9 and cannot be obtained from the server device 5, a UI process can be executed to perform a process for calculating the head-related transfer function information HRTF corresponding to the user. Specifically, it is possible to execute a process of indicating a procedure for calculating head-related transfer function information HRTF corresponding to the user, a process of allowing the user to select whether or not to perform an operation for obtaining head-related transfer function information HRTF corresponding to the user according to the procedure, etc. Furthermore, it may be possible to execute a process of displaying a two-dimensional code for installing an application for photographing the user's ear, etc.

[0058] Note that there may be users who have never experienced acoustic output to which head-related transfer function information HRTF has been applied. For such users, the UI processing unit 22 may be capable of executing UI processing for a demo experience. For example, the UI processing unit 22 executes processing such as displaying a demo screen for allowing the user to experience acoustic output to which standard head-related transfer function information HRTF has been applied, and processing for presenting guidance for actually obtaining head-related transfer function information HRTF corresponding to the user after the demo experience has ended.

[0059] The UI processing for such a demo experience may be executable in response to the detection unit 21 detecting the connection of the neckband speaker 3A or the like. In other words, the processing may be realized by the detection unit 21 and the UI processing unit 22 working together.

[0060] Such a demo experience may be executed, for example, when head-related transfer function information HRTF corresponding to a user identified by the login process cannot be acquired.

[0061] Depending on the content displayed on the television receiver 1, it may be preferable to play back the uncorrected audio signal SA rather than the corrected audio signal SB to which the head-related transfer function information HRTF has been applied. To accommodate such content, the UI processing unit 22 may perform UI processing for switching between a state in which sound is output based on the corrected audio signal SB to which the head-related transfer function information HRTF has been applied and a state in which sound is output using the uncorrected audio signal SA. The UI processing unit 22 may also perform UI processing for allowing the user to select whether or not to apply the head-related transfer function information HRTF. This allows the user to appropriately select whether or not to perform correction that applies the head-related transfer function information HRTF.

[0062] The television receiver 1 may be used not only by one person but also by multiple people such as a family. Accordingly, when an audio signal playback device such as a neckband speaker 3A is connected to the television receiver 1, the UI processing unit 22 may be capable of executing UI processing for selecting which head-related transfer function information HRTF to use from among the head-related transfer function information HRTFs of multiple users stored in the storage unit 9, or UI processing for selecting whether or not to apply the head-related transfer function information HRTF at all. Such processing can be realized by, for example, the detection unit 21 and the UI processing unit 22 working together.

[0063] Furthermore, a notification process may be executed to notify the user which head-related transfer function information HRTF is used for the correction that corresponds to the user. In response to the notification process of the UI processing unit 22, the user can perform an operation such as selecting head-related transfer function information HRTF so that the corrected audio signal SB is generated using the head-related transfer function information HRTF that corresponds to the user. The UI processing for such notifications may be, for example, a notification process using audio, a notification process that displays text information on a screen, or a notification process that uses a user terminal used by the user to make a notification.

[0064] In addition, the UI processing unit 22 may be capable of executing UI processing for newly registering a user, UI processing for registering the first playback device 3, and UI processing for linking the registered user with the first playback device 3. Furthermore, the UI processing unit 22 may be capable of executing UI processing for linking the television receiver 1 with a user terminal used by the user. Furthermore, the UI processing unit 22 may be capable of executing UI processing to display a list of users registered in the television receiver 1. The users displayed in the user list include users whose head-related transfer function information HRTF information is stored in the storage unit 9, users whose head-related transfer function information HRTF information is stored in the server device 5 but not in the storage unit 9 of the television receiver 1, users whose head-related transfer function information HRTF has not been calculated, and unregistered users who have not been registered (for example, users treated as guests).

[0065] The determination processing unit 23 performs processing to determine whether or not head-related transfer function information HRTF corresponding to the user is stored in the storage unit 9. The determination processing unit 23 also performs processing to determine whether or not head-related transfer function information HRTF corresponding to the user is stored in the server device 5, which is another information processing device. The transfer function acquisition unit 24 is notified of the result of the determination as to whether or not head-related transfer function information HRTF corresponding to the user is stored in the storage unit 9 .

[0066] The determination processing unit 23 can specify the user who is the target of the determination processing by various methods. For example, the above-described determination process may be performed on a user selected by the user on a UI screen provided by the UI processing unit 22. This determines whether or not head-related transfer function information HRTF corresponding to the selected user is stored in the storage unit 9.

[0067] Alternatively, when the detection unit 21 detects the connection of the neckband speaker 3A, the above determination process may be performed on the user who last used the neckband speaker 3A.

[0068] In addition, if the television receiver 1 is equipped with a camera function, image processing may be performed using images captured using the camera function to identify the user who is about to use the television receiver 1, and the above-mentioned judgment process may be performed on that user.

[0069] Furthermore, information for identifying a user may be received from a neckband speaker 3A connected to the television receiver 1, and the above determination process may be performed on that user.

[0070] Alternatively, information linking audio signal playback devices with the users who use them may be stored in the memory unit 9, and the detection unit 21 may identify the audio signal playback devices detected to identify the linked users, thereby performing the above-mentioned determination process.

[0071] The transfer function acquisition unit 24 acquires head-related transfer function information HRTF corresponding to the user based on the determination result of the determination processing unit 23. Specifically, if head-related transfer function information HRTF corresponding to the user is stored in the storage unit 9, the transfer function acquisition unit 24 acquires the head-related transfer function information HRTF from the storage unit 9. On the other hand, if head-related transfer function information HRTF corresponding to the user is not stored in the storage unit 9, the transfer function acquisition unit 24 transmits information identifying the user to the server device 5, which serves as another information processing device, to acquire the head-related transfer function information HRTF corresponding to the user from the server device 5. Note that if the determination processing unit 23 determines that head-related transfer function information HRTF corresponding to the user is not stored in either the storage unit 9 or the server device 5, the transfer function acquisition unit 24 does not acquire the head-related transfer function information HRTF corresponding to the user.

[0072] The transfer function acquisition unit 24 may have the determination processing function of the determination processing unit 23. For example, instead of the determination processing unit 23 determining whether or not head-related transfer function information HRTF is stored in the storage unit 9, the transfer function acquisition unit 24 may attempt to acquire head-related transfer function information HRTF from the storage unit 9, and if the acquisition is unsuccessful, determine that the head-related transfer function information HRTF is not stored in the storage unit 9. Then, if the transfer function acquisition unit 24 is unable to acquire the head-related transfer function information HRTF from the storage unit 9, it may acquire the head-related transfer function information HRTF from the server device 5. Furthermore, if the transfer function acquisition unit 24 is unable to acquire the head-related transfer function information HRTF from the server device 5, it may determine that the head-related transfer function information HRTF is not stored in the server device 5.

[0073] If the transfer function acquisition unit 24 is unable to acquire head-related transfer function information HRTF corresponding to the user from either the storage unit 9 or the server device 5, it notifies the UI processing unit 22 of this fact. Upon receiving this notification, the UI processing unit 22 executes UI processing to newly calculate head-related transfer function information HRTF corresponding to the user.

[0074] The signal acquisition unit 25 acquires the pre-correction audio signal SA from the RAM 73, the removable storage medium 82, the communication unit 10, etc., and passes it to the speaker device 11, the communication unit 10, and the function application unit .

[0075] That is, when sound is output from the television receiver 1 without applying the head-related transfer function information HRTF, the acquired uncorrected audio signal SA is transmitted to the speaker device 11. Furthermore, when sound is output from the neckband speaker 3A without applying the head-related transfer function information HRTF, the uncorrected audio signal SA is transmitted to the neckband speaker 3A via the communication unit 10.

[0076] On the other hand, when head-related transfer function information HRTF is to be applied, the acquired uncorrected audio signal SA is transmitted to the function application unit 26 .

[0077] The function application unit 26 applies head-related transfer function information HRTF to the uncorrected audio signal SA to generate a corrected audio signal SB. The applied head-related transfer function information HRTF may be one that corresponds to the user as a listener, or may be a standard one. In the following description, the process of applying head-related transfer function information HRTF corresponding to the user will be referred to as the "first application process," and the process of applying standard head-related transfer function information HRTF will be referred to as the "second application process."

[0078] As described above, the transmission processing unit 27 performs processing to transmit the uncorrected audio signal SA, the corrected audio signal SB to which head-related transfer function information HRTF corresponding to the user has been applied, the corrected audio signal SB to which standard head-related transfer function information HRTF has been applied, etc. to the neckband speaker 3A. To this end, the transmission processing unit 27 controls the communication unit 10.

[0079] That is, the transmission processing unit 27 is capable of transmitting, to the neckband speaker 3A, a corrected audio signal SB to which head-related transfer function information HRTF corresponding to the user identified by the judgment processing unit 23 has been applied.

[0080] The storage unit 9 functions as the storage unit 79 in the television receiver 1 as a computer device. The storage unit 9 stores head-related transfer function information HRTF corresponding to the user used in the first application process, standard head-related transfer function information HRTF, and the like. User information and the like may also be stored in the storage unit 9. In this case, the user information that can identify a user may be associated with the head-related transfer function information HRTF and stored so that the head-related transfer function information HRTF corresponding to each user can be identified.

[0081] Furthermore, in addition to the user and the head-related transfer function information HRTF, information on an audio signal reproducing device such as the neckband speaker 3A may be associated and stored. Such information may be stored as a plurality of data corresponding to a plurality of users, or as a single data corresponding to a single user who uses the television receiver 1.

[0082] The communication unit 10 functions as a communication unit 80 in the television receiver 1 as a computer device. The communication unit 10 is capable of performing transmission and reception processes in various communication modes. For example, the communication unit 10 may be capable of transmitting the uncorrected audio signal SA and the corrected audio signal SB directly to the neckband speaker 3A using wired communication or wireless communication (such as Bluetooth).

[0083] The communication unit 10 may also be capable of transmitting the uncorrected audio signal SA and the corrected audio signal SB to the neckband speaker 3A via a relay device HU connected by a wired optical cable. The communication between the relay device HU and the neckband speaker 3A may be wireless or wired. The relay device HU may be paired with the neckband speaker 3A to enable wireless communication with the neckband speaker 3A.

[0084] The communication unit 10 may also be capable of transmitting the compressed uncorrected audio signal SA and the corrected audio signal SB to the neckband speaker 3A.

[0085] The corrected audio signal SB transmitted by the communication unit 10 is the signal to which head-related transfer function information HRTF has been applied by the television receiver 1. That is, the signal is processed into information for two channels to match the number of output channels of the neckband speaker 3A and transmitted from the communication unit 10. This reduces the amount of communication traffic compared to transmitting multi-channel audio signals of three or more channels from the communication unit 10 to the neckband speaker 3A, and is therefore suitable for wireless communication.

[0086] Furthermore, since the neckband speaker 3A does not need to perform processing to apply the head-related transfer function information HRTF, the neckband speaker 3A does not need to be equipped with a high-performance arithmetic processing unit. This makes it possible to prevent the neckband speaker 3A from becoming larger and more expensive. It also makes it possible to prevent malfunctions and discomfort when worn caused by heat generated by installing a high-performance arithmetic processing unit in the neckband speaker 3A.

[0087] The speaker device 11 functions as an audio output unit 78 in the television receiver 1 serving as a computer device. The speaker device 11 functions as an audio signal reproducing section when an audio signal is output from the television receiver 1 without being transmitted to the neckband speaker 3A.

[0088] <4. Neckband speaker configuration> An example of the configuration of the neckband speaker 3A will be described with reference to Fig. 4. It should be noted that the neckband speaker 3A does not need to have all of the components shown in Fig. 4.

[0089] The neckband speaker 3A includes a control unit 31, a storage unit 32, a communication unit 33, and an output unit .

[0090] The control unit 31 is capable of executing various processes such as processes required for reproducing audio signals, and is configured by a CPU 71 in a computer device.

[0091] The storage unit 32 stores various types of information and functions as a storage unit 79 in the neckband speaker 3A as a computer device. The stored information includes, for example, information for identifying the neckband speaker 3A, such as a serial number, model number information, and manufacturer information, and information for identifying the listener, such as a user ID. The storage unit 32 may also be used as a buffer memory or cache memory for audio signals received from the television receiver 1.

[0092] The user information stored in the storage unit 32 may be for one person or for multiple people.

[0093] The output unit 34 outputs an audio signal under the control of the control unit 31. The output unit 34 functions as an audio output unit 78 in the neckband speaker 3A as a computer device.

[0094] The control unit 31 functions as, for example, an identification information acquisition unit 41, a user information acquisition unit 42, a playback processing unit 43, a reception processing unit 44, and a transmission processing unit 45.

[0095] The identification information acquisition unit 41 performs processing to acquire, from the storage unit 32, identification information and the like that can identify the neckband speaker 3A.

[0096] The user information acquisition unit 42 performs processing to acquire, from the storage unit 32, information that can identify the user who is using the neckband speaker 3A.

[0097] The reproduction processing unit 43 receives the encoded audio signal from the communication unit 33, decodes it, and outputs it to the output unit 34, thereby reproducing the audio signal.

[0098] The reception processing unit 44 performs processing for receiving compressed data of the uncorrected audio signal SA and the corrected audio signal SB from the television receiver 1. The received data is stored in the storage unit 32 as needed.

[0099] The transmission processing unit 45 performs processing to transmit the above-mentioned various information stored in the storage unit 32 to other devices such as the television receiver 1.

[0100] In addition to the above, the control unit 31 can also execute UI processing for registering user information, various notification processing, etc. The control unit 31 can also execute processing related to pairing between the neckband speaker 3A and the television receiver 1.

[0101] <5. UI processing> The following describes screens displayed on the display unit D of the television receiver 1 by processing executed by the UI processing unit 22 of the television receiver 1, screens displayed on the display unit Ds of the smartphone 6 operated by the user, and the like.

[0102] First, in response to connecting the relay device HU to the television receiver 1 with a wired optical cable as shown in Fig. 5, a setting start screen 91 as shown in Fig. 6 is displayed on the display unit D of the television receiver 1. This makes it possible to start the initial setting process for outputting sound from the television receiver 1 through the neckband speaker 3A.

[0103] The setting start screen 91 has a start button 91a for starting the setting and a hold button 91b for holding the setting without starting it immediately.

[0104] When the hold button 91b is selected, the initial setting process ends without displaying any of the screens described below.

[0105] When the start button 91a is selected, a connection instruction screen 92 as shown in FIG.

[0106] The connection instruction screen 92 is a screen for prompting the user to connect the relay device HU to the television receiver 1. The connection instruction screen 92 has a Next button 92a arranged thereon.

[0107] A user who has connected a relay device HU or a user who has already connected a relay device HU can proceed with the initial setting process by selecting the Next button 92a.

[0108] After the Next button 92a is selected with the relay device HU connected to the television receiver 1, a playback device connection instruction screen 93 such as that shown in FIG.

[0109] The playback device connection instruction screen 93 is a screen for instructing pairing of the neckband speaker 3A as an audio signal playback device with the relay device HU. The pairing of the neckband speaker 3A with the relay device HU is performed automatically, for example, by turning on the power of the neckband speaker 3A.

[0110] When the user follows the instructions on the display unit D to pair the neckband speaker 3A with the relay device HU (see FIG. 9), an initial setting completion notification screen 94 as shown in FIG. 10 is automatically displayed on the display unit D of the television receiver 1.

[0111] The initial setting completion notification screen 94 has options such as a button for selecting whether or not to experience 3D surround playback to which head-related transfer function information HRTF is applied. In the example shown in FIG. 10, an initial setup completion notification screen 94 has a demo experience button 94a and a non-demo experience button 94b arranged thereon.

[0112] When the non-demo experience button 94b is selected, the following screens are not displayed. Alternatively, in this case, a screen for prompting the user to log in or a screen for selecting head-related transfer function information HRTF may be displayed.

[0113] When the demo experience button 94a is selected, a demo experience video is displayed on the display unit D of the television receiver 1, and sound is output from the neckband speaker 3A. The sound output at this time is based on the corrected audio signal SB, which is obtained by applying standard head-related transfer function information HRTF to the uncorrected audio signal SA.

[0114] After the demo experience video has been displayed, an optimization selection screen 95 such as that shown in FIG. 11 is displayed on the display unit D of the television receiver 1.

[0115] The optimization selection screen 95 has an optimization execution button 95a and an optimization non-execution button 95b arranged thereon. The optimization execution button 95a is an option selected when performing optimal settings specific to the user who will be using the newly connected neckband speaker 3A. The optimization non-execution button 95b is an option selected when such personal optimization is not to be performed.

[0116] When the optimization non-execution button 95b is selected, a setting completion screen 96 is displayed as shown in Fig. 12. A completion button 96a is arranged on the setting completion screen 96, and the user can return to the screen display before the setting, such as the viewing screen, by selecting the completion button 96a.

[0117] When the optimization execution button 95a on the optimization selection screen 95 is selected, an optimization procedure screen 97 as shown in FIG. The optimization procedure screen 97 displays a guidance code 97a, which is a two-dimensional code for guiding the user to a website for performing a personal optimization operation, and an activation code 97b for identifying the television receiver 1. The website to which the user is guided is, for example, a web page managed by the server device 5.

[0118] Alternatively, the guide code 97a may be used to install application software for performing optimization operations. In this case, the user can easily start or install a specific application by operating the smartphone 6 and reading the guide code 97a.

[0119] If the user information managed by the server device 5 is already stored in the storage unit 9 of the television receiver 1, an account selection screen 98 as shown in FIG.

[0120] The account selection screen 98 has account options 98a and 98b for selecting an account, and another account option 98c for selecting another account that is not displayed. The account options 98a and 98b can be displayed in various ways, such as by email address, account name, or user name.

[0121] When the user photographs the guidance code 97a on the optimization procedure screen 97 with the smartphone 6 and moves to the website, for example, a code input screen 99 as shown in FIG. 15 is displayed on the display unit Ds (screen) of the smartphone 6.

[0122] An input field 99a for inputting an activation code and a Next button 99b are arranged on the code input screen 99. When the user inputs the character string displayed in the activation code 97b on the optimization procedure screen 97 shown in FIG. 13 into the input field 99a and selects the Next button 99b, the activation code is transmitted to the server device 5.

[0123] The server device 5 identifies the television receiver 1 that the user is using based on the activation code received from the smartphone 6.

[0124] The server device 5 notifies the smartphone 6 that the information specifying the television receiver 1 has been received. In response to receiving the notification, the display unit Ds of the smartphone 6 displays an identification completion notification screen 100 as shown in FIG.

[0125] Next, a sign-in screen 101 as shown in FIG. This sign-in is for the purpose of utilizing various services provided by the server device 5. One of the various services provided by the server device 5 is a service for calculating and managing the head-related transfer function information HRTF described above.

[0126] The sign-in screen 101 is a screen for signing in by various methods in order to use the services provided by the server device 5. In the following description, the service for head-related transfer function information HRTF provided by the server device 5 will be referred to as an "HRTF service," and an account for using the HRTF service will be referred to as an "HRTF service account." In addition, other services provided by information processing devices other than the server device 5, such as accounts for various SNS (Social Network Service), will be referred to as "other services." An account for using other services will be referred to as "account for other services."

[0127] The sign-in screen 101 has various selection buttons for selecting a sign-in method, including a first selection button 101a for signing in with an account for the HRTF service and a second selection button 101b for signing in with an account for another service.

[0128] Furthermore, the sign-in screen 101 also includes an account creation button 101c for creating an account for the HRTF service for users who do not have such an account.

[0129] After the first selection button 101a or the second selection button 101b is selected, a sign-in information input screen 102 as shown in FIG.

[0130] A sign-in information input field 102a for inputting sign-in information for other services and a sign-in button 102b are arranged on the sign-in information input screen 102. In addition to these, a create button for creating an account for other services and the like may also be arranged on the sign-in information input screen 102.

[0131] When the account creation button 101c on the sign-in screen 101 is selected, or when an account for another service is signed in on the sign-in information input screen 102, an account creation screen 103 such as that shown in FIG. 19 is displayed on the display unit Ds of the smartphone 6.

[0132] The account creation screen 103 is a screen for creating an account for the HRTF service. The account creation screen 103 has an input field 103a for inputting various types of user information, a create button, and the like.

[0133] It should be noted that a sign-up screen for the HRTF service may be displayed for users who have already created an account for the HRTF service. When a user signs up for the HRTF service, the server device 5 determines whether or not head-related transfer function information HRTF corresponding to the user who signed up has been acquired. If the information has not been acquired, i.e., if the head-related transfer function information HRTF corresponding to the user is not stored in the database managed by the server device 5, the server device 5 proceeds to a process for calculating head-related transfer function information HRTF corresponding to the user.

[0134] The process of acquiring head-related transfer function information HRTF corresponding to the user may involve, for example, taking an image of the user's ear using the smartphone 6, estimating the shape of the ear, calculating the head-related transfer function information HRTF, and uploading the calculation results to the server device 5. The ear shape estimation process and the calculation process of the head-related transfer function information HRTF may be performed by either the smartphone 6 or the server device 5. As described above, the server device 5 may be configured to store an image of the ear.

[0135] On the other hand, if head-related transfer function information HRTF corresponding to the user is stored in the database managed by the server device 5, the process proceeds to downloading the head-related transfer function information HRTF corresponding to the user to the television receiver 1. Similarly, after taking an image of the user's ear and calculating the head-related transfer function information HRTF, the process proceeds to downloading the head-related transfer function information HRTF corresponding to the user to the television receiver 1.

[0136] In the download process, a download screen 104 as shown in FIG. The download screen 104 includes a progress bar and the like.

[0137] When the download is complete, a completion screen 105 is displayed as shown in Fig. 21. The completion screen 105 has a demo experience button 105a and a non-demo experience button 105b arranged thereon, similar to the initial setup completion notification screen 94 (see Fig. 10).

[0138] When the user selects the demo experience button 105a, the user can experience the sound output to which the optimal head-related transfer function information HRTF corresponding to the user is applied. This allows a comparison between the case where standard head-related transfer function information HRTF is applied and the case where head-related transfer function information HRTF corresponding to the user is applied. In particular, by making the content that can be experienced when the demo experience button 94a on the initial setting completion notification screen 94 is pressed the same as the content that can be experienced when the demo experience button 94a on the completion screen 105 is pressed, the difference between the two can be more clearly grasped.

[0139] Furthermore, the server device 5 transmits user information (such as a user ID and account information) to the television receiver 1. This allows the television receiver 1 to obtain information for identifying the user currently using the television receiver 1. The server device 5 manages the identified television receiver 1 in association with the user information.

[0140] Returning to the explanation of FIG. When account options 98a and 98b are selected on the account selection screen 98 shown in FIG. 14, the television receiver 1 determines whether head-related transfer function information HRTF associated with the selected account is stored in the memory unit 9 or the server device 5.

[0141] If the desired head-related transfer function information HRTF is stored in the storage unit 9 of the television receiver 1, the head-related transfer function information HRTF corresponding to the user is obtained from the storage unit 9 of the television receiver 1 and applied, thereby preparing for 3D surround playback.

[0142] On the other hand, if the information is not stored in the television receiver 1 but is stored in the server device 5, a process is performed in which the head-related transfer function information HRTF corresponding to the user is downloaded from the server device 5 to the television receiver 1 while performing UI processing to display the respective screens shown in Figures 20 and 21.

[0143] If the head-related transfer function information HRTF corresponding to the user is not stored in either the memory unit 9 of the television receiver 1 or the server device 5, a new head-related transfer function information HRTF corresponding to the user is calculated by taking an image of the ear using the smartphone 6, and the image is downloaded to the television receiver 1.

[0144] By performing UI processing to display the various screens described above, for example, when a user uses the television receiver 1 for the first time, head-related transfer function information HRTF corresponding to the user can be downloaded to the television receiver 1. This allows the user to experience 3D surround playback that applies the head-related transfer function information HRTF that is optimal for the user.

[0145] <6. Flowchart> The flow of each process executed by the television receiver 1, the smartphone 6, and the server device 5 will be described with reference to the attached flowcharts. Note that each process shown in each diagram is a process executed by the CPU 71 of the television receiver 1, the smartphone 6, or the computer device serving as the server device 5.

[0146] <6-1. Initial setting flow> The flow of the initial setting process executed by each device when the user first associates the television receiver 1 with the neckband speaker 3A will be described with reference to FIG.

[0147] In step S101, the television receiver 1 detects whether the neckband speaker 3A is connected.

[0148] Next, in step S102, the television receiver 1 presents information for identifying the television receiver. For example, the television receiver 1 displays on the display unit D the activation code 97b on the optimization procedure screen 97 illustrated in FIG.

[0149] By inputting the displayed activation code 97b into the smartphone 6, the code information is provided to the smartphone 6. When the television receiver 1 and the smartphone 6 are connected, code information such as the activation code or serial information for identifying the television receiver 1 may be transmitted from the television receiver 1 to the smartphone 6.

[0150] After acquiring the code information, the smartphone 6 performs a process of accepting a login operation, etc. in step S201. This process is a process of accepting an input operation by the user on, for example, a sign-in screen 101 shown in Fig. 17, a sign-in information input screen 102 shown in Fig. 18, an account creation screen 103 shown in Fig. 19, etc.

[0151] By performing these reception processes, login information is transmitted from the smartphone 6 to the server device 5.

[0152] After receiving the login information, the server device 5 performs a login process in step S301. Result information of the login process is sent to the smartphone 6. The smartphone 6 performs a process such as displaying a menu screen for the HRTF service according to the result of the login process (step S202).

[0153] The server device 5 may acquire from the smartphone 6 code information, serial information, or the like for identifying the television receiver 1 together with the login information.

[0154] In step S302, the server device 5 performs processing to link the television receiver 1 with the user's account information based on the received information.

[0155] On the other hand, in step S103, the television receiver 1 acquires information for identifying the neckband speaker 3A from the neckband speaker 3A.

[0156] Next, in step S104, the television receiver 1 performs a process of generating profile information about the user. The profile information includes the neckband speaker 3A and user information. The user information may be information input by the user using the television receiver 1, or may be user information associated with the television receiver 1 in the association process executed by the server device 5 in step S302, which is acquired from the server device 5, or user information input by the user as a result of a login operation on the smartphone 6, which is acquired from the smartphone 6.

[0157] The television receiver 1 may transmit information about the neckband speaker 3A identified in step S103 to the server device 5. In this case, in the process of step S302 of the server device 5, a process may be performed to link not only the information identifying the television receiver 1 and the user's account information, but also the information identifying the neckband speaker 3A.

[0158] <6-2. Head-related Transfer Function (HRTF) Acquisition Flow> The process executed by the television receiver 1 to acquire head-related transfer function information HRTF corresponding to the user will be described with reference to FIG.

[0159] In step S401, the television receiver 1 determines whether or not head-related transfer function information HRTF for the user is stored in the storage unit 9. If it is determined that the information is not stored, the television receiver 1 performs processing to request the server device 5 to acquire head-related transfer function information HRTF corresponding to the user in step S402.

[0160] If the corresponding head-related transfer function information HRTF is managed in the server device 5, the head-related transfer function information HRTF is transmitted from the server device 5. If the corresponding head-related transfer function information HRTF is not managed, a notification is sent to the television receiver 1 indicating that the head-related transfer function information HRTF is not stored in the server device 5.

[0161] In step S403, the television receiver 1 determines whether or not head-related transfer function information HRTF corresponding to the user has been acquired.

[0162] If it is determined that the information has not been acquired, the television receiver 1 executes various processes to calculate the user's head-related transfer function information HRTF in step S404. For example, the television receiver 1 executes a process to display on the display unit D a two-dimensional code for installing a software application for photographing the ear. Note that various processes for calculating the user's head-related transfer function information HRTF may be executed in the smartphone 6, or may be executed by the television receiver 1 and the smartphone 6 working together. Furthermore, a UI process may be executed to allow the user to select whether or not to calculate head-related transfer function information HRTF corresponding to the user.

[0163] In step S405, the television receiver 1 performs a process of downloading head-related transfer function information HRTF corresponding to the user.

[0164] Next, in step S406, the television receiver 1 performs a process of applying the head-related transfer function information HRTF to the uncorrected audio signal SA to generate a corrected audio signal SB. This allows the user to enjoy the sound output based on the corrected audio signal SB to which the head-related transfer function information HRTF corresponding to the user has been applied.

[0165] <6-3. Head-Related Transfer Function (HRTF) Application Flow> The television receiver 1 performs a process of determining whether or not to apply head-related transfer function information HRTF based on various audio signals. This will be specifically described with reference to FIG.

[0166] In step S501, the television receiver 1 determines whether the audio signal of the content being reproduced is multi-channel or two-channel stereo. The audio signal to be determined is the pre-correction audio signal SA.

[0167] If it is determined that the audio signal is multi-channel, the television receiver 1 determines in step S502 whether or not the 3D surround setting is enabled. The 3D surround setting may be set by the user as appropriate. In other words, the UI processing unit 22 may execute UI processing that can switch the 3D surround setting ON / OFF, thereby enabling the user to switch the 3D surround setting. Alternatively, the 3D surround setting may be set automatically based on information about the audio signal before correction or the content being played.

[0168] If it is determined that the 3D surround setting is enabled, in step S503, the television receiver 1 generates a corrected audio signal SB converted to two stereo channels by downmixing processing using head-related transfer function information HRTF corresponding to the user.

[0169] In step S504, the television receiver 1 transmits the corrected audio signal SB to the neckband speaker 3A, thereby enabling the user to experience optimal 3D surround using the neckband speaker 3A.

[0170] If it is determined in step S502 that 3D surround is not enabled, i.e., if it is determined that the audio signal of the playback content is multi-channel but 3D surround is not enabled, the television receiver 1 performs downmixing processing in step S505 to convert it to two stereo channels.

[0171] Then, in step S504, the television receiver 1 transmits the stereo two-channel audio signal to the neckband speaker 3A.

[0172] If it is determined in step S501 that the audio signal of the content to be reproduced is two-channel stereo, the television receiver 1 determines in step S506 whether or not the 3D surround setting is enabled.

[0173] If it is determined that the 3D surround setting is enabled, the television receiver 1 generates an uncorrected audio signal SA that has been converted into multi-channels by upmixing processing in step S507.

[0174] Next, in step S503, the television receiver 1 performs downmix processing using the head-related transfer function information HRTF to generate a corrected audio signal SB, and in step S504 transmits the corrected audio signal SB to the neckband speaker 3A.

[0175] If it is determined in step S506 that 3D surround is not enabled, i.e., if it is determined that the audio signal of the playback content is stereo 2-channel and 3D surround is not enabled, the television receiver 1 transmits the stereo 2-channel audio signal as is to the neckband speaker 3A in step S504.

[0176] In this way, the television receiver 1 performs appropriate processing on the audio signal based on the audio signal of the playback content and the 3D surround setting, and transmits the processed audio signal to the neckband speaker 3A, thereby enabling the user to enjoy optimal sound output.

[0177] <7. Variations> In the above example, the neckband speaker 3A is used by one user, but here, a case where multiple users use one neckband speaker 3A will be described. An example of the configuration of the neckband speaker 3A in this case will be described with reference to Fig. 25. Note that the description of the same configuration as that shown in Fig. 4 will be omitted as appropriate.

[0178] The neckband speaker 3A according to this modification is configured to manage profile information for multiple users. Specifically, the neckband speaker 3A includes a control unit 31, a storage unit 32, a communication unit 33, and an output unit .

[0179] The control unit 31 functions as an identification information acquisition unit 41, a playback processing unit 43, a reception processing unit 44, a transmission processing unit 45, a profile information management unit 46, a user interface processing unit (UI processing unit) 47, and a switching processing unit 48.

[0180] The profile information management unit 46 is capable of managing a plurality of pieces of profile information. Each piece of profile information includes information for identifying a user.

[0181] When a user wearing the neckband speaker 3A is identified, the profile information management unit 46 may be capable of transmitting profile information corresponding to the user to the television receiver 1. As a result, the television receiver 1 generates a corrected audio signal SB to which the head-related transfer function information HRTF corresponding to the user has been applied.

[0182] The user may be identified, for example, according to a selection made by the user, according to the manner in which the user wears the neckband speaker 3A, or by analyzing the voiceprint of the user who wears the neckband speaker 3A. Various other methods are also possible.

[0183] The profile information management unit 46 is capable of performing processes such as registration and deletion of profile information.

[0184] The UI processing unit 47 performs, for example, a process of detecting a user operation on an operator for selecting profile information, a sound output process for notifying the user of the selected profile information, etc. Furthermore, if the neckband speaker 3A is equipped with a small display unit, the notification process may be performed using the display unit.

[0185] The switching processing unit 48 switches the profile information, so that the profile information is switched every time the user wearing the device changes, and the switched profile information is transmitted to the television receiver 1 by the profile information management unit 46. In the television receiver 1, appropriate head-related transfer function information HRTF can be selected based on the profile information received from the neckband speaker 3A, and the corrected audio signal SB can be generated.

[0186] Other modifications will be described. In the above example, one user has one piece of head-related transfer function information HRTF, but a plurality of pieces of HRTF may be used. For example, various audio signal playback devices may have different characteristics, so if one user uses multiple audio signal playback devices, head-related transfer function information HRTF may be generated and managed for each audio signal playback device.

[0187] Also, different head-related transfer function information HRTFs may be generated depending on the number and positions of virtual sound sources. This allows multiple types of head-related transfer function information HRTFs corresponding to one user to be managed, and enables the user to experience sound output to which the appropriate head-related transfer function information HRTF is applied depending on the content being played.

[0188] Furthermore, the television receiver 1 may manage audio signal playback devices in association with users. That is, the television receiver 1 may detect that the connected audio signal playback device has been changed, infer that the user has changed, and switch the head-related transfer function information HRTF to be applied to the uncorrected audio signal SA to one corresponding to the new user.

[0189] The television receiver 1 may perform a process of notifying a user of which head-related transfer function information HRTF is currently being applied. This notification process may also be performed by an audio signal playback device such as a neckband speaker 3A instead of the television receiver 1.

[0190] <8. Summary> As described above, the television receiver 1 as an information processing device includes a signal acquisition unit 25 that acquires an audio signal, a memory unit 9 that stores head-related transfer function information HRTF corresponding to a user, a determination processing unit 23 that determines whether head-related transfer function information HRTF corresponding to the user is stored in the memory unit 9, a transfer function acquisition unit 24 that acquires head-related transfer function information HRTF corresponding to the user, and a function application unit 26 that applies the head-related transfer function information HRTF corresponding to the user to an audio signal (uncorrected audio signal SA). Furthermore, if head-related transfer function information HRTF corresponding to the user is not stored in the storage unit 9, the transfer function acquisition unit 24 acquires head-related transfer function information HRTF corresponding to the user from another information processing device (for example, the server device 5). This allows, for example, even if a newly purchased information processing device (such as a television receiver 1 or headphones) does not store head-related transfer function information HRTF corresponding to the user, the user-specific head-related transfer function information HRTF calculated up to that point can be acquired from another information processing device. Therefore, it is not necessary to newly calculate (generate) user-specific head-related transfer function information HRTF, thereby reducing the processing load. Also, for the user, it is possible to quickly experience optimal acoustic output using already calculated head-related transfer function information HRTF, improving convenience. An audio signal reproducing device such as the neckband speaker 3A can function as such an information processing device. That is, the neckband speaker 3A may include a signal acquiring unit 25 that acquires an uncorrected audio signal SA, a storage unit 32 that stores head-related transfer function information HRTF, a determination processing unit 23, a transfer function acquiring unit 24, and a function applying unit 26. As a result, the corrected audio signal SB is generated from the uncorrected audio signal SA within the neckband speaker 3A, thereby reducing the processing load on the television receiver 1 for generating the corrected audio signal SB. In particular, when a single television receiver 1 generates respective corrected audio signals SB corresponding to multiple users, an increase in the processing load on the television receiver 1 may become a problem, but this configuration makes it possible to avoid such a problem.

[0191] The transfer function acquisition unit 24 in the television receiver 1 acquires head-related transfer function information HRTF corresponding to the user from the memory unit 9, and may acquire head-related transfer function information HRTF corresponding to the user from another information processing device (server device 5) if the head-related transfer function information HRTF corresponding to the user is not stored in the memory unit 9. As a result, if the corresponding head-related transfer function information HRTF is stored in the storage unit 9 of the television receiver 1, there is no need to issue an acquisition request to another information processing device. This makes it possible to reduce the amount of communication traffic and the processing load on other information processing devices.

[0192] The television receiver 1 may also include a user interface processing unit 22 that performs user interface processing (UI processing) to obtain head-related transfer function information HRTF corresponding to the user when the head-related transfer function information HRTF corresponding to the user is not stored in the memory unit 9 and cannot be obtained from another information processing device (server device 5). For example, a process of displaying information for downloading an application for calculating head-related transfer function information HRTF to a user terminal (smartphone 6) is executed. This allows the user to smoothly perform operations to acquire head-related transfer function information HRTF. Also, by having the user perform operations according to the display, the user can be made to perform appropriate operations, reducing the possibility of performing incorrect operations. An audio signal reproducing device such as the neckband speaker 3A can function as such an information processing device.

[0193] As the user interface processing, the user interface processing unit 22 in the television receiver 1 may execute processing to allow the user to select whether or not to execute processing to obtain corresponding head-related transfer function information HRTF. For example, the user can select the hold button 91b in Fig. 6 or the optimization non-execution button 95b in Fig. 11 to choose not to execute processing to obtain corresponding head-related transfer function information HRTF. This allows a user to express their intention to avoid the process for obtaining head-related transfer function information HRTF when they do not want to take the time to calculate the head-related transfer function information HRTF specific to the user. Therefore, since processing that the user feels is unnecessary does not need to be executed, convenience for the user can be improved.

[0194] The user interface processing unit 22 in the television receiver 1 may execute, as the user interface processing, a process of displaying guidance information (such as a two-dimensional code or link information of a web page) for installing an application on a user terminal (smartphone 6). This allows the user to install the appropriate application by following the instructions displayed. This can eliminate the need to search for an application, improving user convenience, and can also prevent the user from giving up on experiencing sound output to which head-related transfer function information HRTF is applied because they are unable to find an appropriate application.

[0195] The television receiver 1 may include a transmission processing unit 27 that transmits an audio signal to a playback device (audio signal playback device). Such information processing devices are, for example, television receivers 1, personal computers, tablet terminals, etc. They are particularly suitable for information processing terminals that are likely to be shared by multiple people. The playback devices are headphones or earphones worn by users. Headphones include those worn on the head so as to cover the ears and those worn around the neck. Even if the head-related transfer function information HRTF corresponding to a user is not stored in an information processing device such as a television receiver 1, the user-specific head-related transfer function information HRTF calculated up to that point can be obtained from another information processing device such as the television receiver 1.

[0196] The television receiver 1 may include a detection unit 21 that detects connection of a playback device (audio signal playback device), and a user interface processing unit 22 that performs user interface processing that allows the user to select whether or not to apply head-related transfer function information HRTF to the audio signal when the detection unit 21 detects connection of a playback device. This makes it possible, for example, when headphones (neckband speakers 3A) are connected to the television receiver 1, to display on the display unit D of the television receiver 1 a message that allows the user to select whether or not to perform surround playback using head-related transfer function information HRTF. Therefore, for example, when playing content such as music that is better suited to surround playback, it is possible to select sound playback based on the user's own head-related transfer function information HRTF, and when playing content such as news that does not require surround playback, it is also possible to select sound playback without using the head-related transfer function information HRTF. When sound reproduction without using head-related transfer function information HRTF is selected, the processing load on the information processing device can be reduced.

[0197] The function application unit 26 in the television receiver 1 may be capable of performing a first application process that applies head-related transfer function information HRTF corresponding to a user to an audio signal, and a second application process that applies standard head-related transfer function information HRTF to an audio signal. For example, even if the user is busy and does not have time to perform operations to acquire head-related transfer function information HRTF, it is possible to output sound using standard head-related transfer function information HRTF. This makes it possible to reproduce sound with a certain degree of three-dimensional sound effect even if it is not possible to obtain user-specific head-related transfer function information HRTF. Also, although some users find the operations required to obtain user-specific head-related transfer function information HRTF cumbersome, by allowing them to experience sound reproduction that applies standard head-related transfer function information HRTF, it is possible to give the user an opportunity to reconsider their desire to experience optimal sound reproduction based on their own head-related transfer function information HRTF.

[0198] The user interface processing unit 22 in the television receiver 1 may be capable of executing a user interface process that allows the user to select whether to execute the first application process or the second application process when connection of a playback device (audio signal playback device) is detected. Specifically, the first process can be executed by selecting the optimization execution button 95a in FIG. 11, and the second process can be executed by selecting the demo experience button 94a in FIG. This allows the user to choose whether to experience sound reproduction that applies their own unique head-related transfer function information HRTF, or sound reproduction that applies head-related transfer function information HRTF that is common to all users. Therefore, it becomes possible to select whether or not to execute the process for calculating head-related transfer function information HRTF taking into consideration the user's own schedule, or whether or not to calculate personal head-related transfer function information HRTF taking into consideration the user's interest in surround playback.

[0199] The user interface processing unit 22 in the television receiver 1 may be capable of executing user interface processing to allow the user to experience a sound field constructed by the audio signal (corrected audio signal SB) after the head-related transfer function information HRTF has been applied. For example, some users may not be aware that sound reproduction using head-related transfer function information (HRTF) is possible. To inform such users that sound reproduction using head-related transfer function information HRTF is possible, a user interface process is executed to allow the user to experience the sound field constructed by the audio signal after the head-related transfer function information HRTF has been applied, thereby making the user aware of this and giving them an opportunity to perform operations to obtain the head-related transfer function information HRTF.

[0200] The user interface processing unit 22 in the television receiver 1 may be capable of executing user interface processing for performing login processing for a user. The user can be identified by performing a login operation in response to the login process. This makes it possible to acquire head-related transfer function information HRTF specific to the identified user, and to provide an optimal acoustic output for the user.

[0201] The user interface processing unit 22 in the television receiver 1 may be capable of executing user interface processing for performing login processing for a user, and user interface processing for allowing the user to experience a sound field constructed by the audio signal (corrected audio signal SB) generated by the second application processing when the transfer function acquisition unit 24 is unable to acquire head-related transfer function information HRTF corresponding to the user identified as a result of the login processing. An example of a case in which head-related transfer function information HRTF corresponding to a user identified by the login process cannot be obtained is when the user has never experienced acoustic output to which head-related transfer function information HRTF specific to that user has been applied. In such a case, by executing a process that allows the user to experience the acoustic output to which the head-related transfer function information HRTF is applied, the user can be made aware of the appeal of the acoustic output to which the head-related transfer function information HRTF is applied.

[0202] The storage unit 9 in the television receiver 1 may store the head-related transfer function information HRTF corresponding to the user in association with a playback device (audio signal playback device). This makes it possible to acquire head-related transfer function information HRTF corresponding to a user identified by login processing or the like, without performing communication processing with other information processing devices (for example, the server device 5). Therefore, it is possible to provide an optimal sound output to the user who has logged in. Furthermore, even if the information processing device does not have a communication function, it is possible to provide an optimal sound output to the user.

[0203] The storage unit 9 in the television receiver 1 may store a plurality of combinations of head-related transfer function information HRTF corresponding to each user and a playback device (audio signal playback device). This makes it possible to acquire head-related transfer function information HRTF corresponding to each user even when the information processing device is shared by multiple users. Therefore, it is possible to provide an optimum sound output for each user.

[0204] The television receiver 1 may include a user interface processing unit capable of executing user interface processing for switching between an application state in which head-related transfer function information HRTF is applied to an audio signal and a non-application state in which head-related transfer function information HRTF is not applied to an audio signal. That is, the user interface processing unit 22 may be capable of executing user interface processing for switching whether to transmit the uncorrected audio signal SA or the corrected audio signal SB to a playback device. This allows the user to switch whether or not to apply head-related transfer function information HRTF depending on the content, for example. Therefore, it is possible to provide an optimal sound output according to need. Furthermore, when the state is switched to a non-application state in which head-related transfer function information HRTF is not applied, the processing load on the information processing device is reduced.

[0205] The above-mentioned information processing device may be provided with a user interface processing unit capable of executing user interface processing for switching the head-related transfer function information corresponding to the user to the head-related transfer function information corresponding to another user. This makes it possible to apply optimal head-related transfer function information to each user when multiple users use the information processing device. Therefore, each user can experience optimal sound output.

[0206] The information processing device described above may be a television receiver 1 equipped with a display unit capable of displaying images. As a result, when a user who does not have head-related transfer function information HRTF stored in the television receiver 1 uses the television receiver 1, a process is executed in the television receiver 1 to obtain head-related transfer function information HRTF corresponding to the user from another information processing device such as the server device 5. This allows the television receiver 1 to use user-specific head-related transfer function information HRTF that has already been calculated using the smartphone 6 or the like. Therefore, for a user whose head-related transfer function information HRTF has already been calculated, it is not necessary to perform the calculation process of the head-related transfer function information HRTF again, thereby reducing the processing load on the television receiver 1.

[0207] The television receiver 1 may be provided with a user interface processing unit 22 that is capable of performing a user interface process for performing a login process for a user, and a user interface process for displaying on the display unit D information for installing an application for calculating head related transfer function information HRTF corresponding to the user on a user terminal (e.g., smartphone 6) when head related transfer function information HRTF corresponding to the user identified as a result of the login process is not stored in the memory unit 9 and cannot be obtained from another information processing device (e.g., server device 5). Furthermore, the transfer function acquisition unit 24 may acquire, from another information processing device, head-related transfer function information HRTF corresponding to the user, which is calculated based on information transmitted from the user terminal. The login process makes it possible to identify the user using the television receiver 1. This also makes it possible to acquire head-related transfer function information HRTF corresponding to the identified user from the storage unit 9 or another information processing device. Furthermore, if head-related transfer function information HRTF corresponding to the identified user cannot be acquired, the system guides the user to use a camera application for acquiring the shape of the user's ears, for example, so that head-related transfer function information HRTF corresponding to the user can be calculated. This allows the user to enjoy an audio output to which the corresponding head-related transfer function information HRTF has been applied.

[0208] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0209] <9. This Technology> (1) a signal acquisition unit that acquires an audio signal; a storage unit that stores head-related transfer function information corresponding to a user; a determination processing unit that determines whether the head-related transfer function information corresponding to the user is stored in another information processing device; a transfer function acquisition unit that acquires the head-related transfer function information corresponding to the user; a function application unit that applies the head-related transfer function information corresponding to the user to the audio signal. Information processing device. (2) The transfer function acquisition unit The head-related transfer function information corresponding to the user is acquired from the storage unit, and when the head-related transfer function information corresponding to the user is not stored in the storage unit, the head-related transfer function information corresponding to the user is acquired from the other information processing device. The information processing device according to (2) above. (3) a user interface processing unit that performs user interface processing to obtain the head-related transfer function information corresponding to the user when the head-related transfer function information corresponding to the user is not stored in the storage unit and cannot be obtained from the other information processing device; The information processing device according to (2) above. (4) The user interface processing unit executes, as the user interface processing, a process of making the user select whether or not to execute a process for obtaining the corresponding head-related transfer function information. The information processing device according to (3) above. (5) The user interface processing unit executes, as the user interface processing, a process of displaying guidance information for prompting a user to install an application on a user terminal. The information processing device according to any one of (3) to (4) above. (6) a transmission processing unit for transmitting the audio signal to a playback device; An information processing device according to any one of (1) to (4) above. (7) a detection unit that detects connection of the playback device; a user interface processing unit that performs user interface processing to allow a user to select whether or not to apply the head-related transfer function information to the audio signal when the detection unit detects connection of the playback device. The information processing device according to (6) above. (8) The function application unit is capable of executing a first application process of applying the head-related transfer function information corresponding to the user to the audio signal, and a second application process of applying standard head-related transfer function information to the audio signal. The information processing device according to (7) above. (9) The user interface processing unit is capable of executing a user interface process for allowing a user to select whether to execute the first application process or the second application process when a connection of the playback device is detected. The information processing device according to (8) above. (10) The user interface processing unit is capable of executing user interface processing for allowing the user to experience a sound field constructed by the audio signal after the head-related transfer function information has been applied. An information processing device according to any one of (7) to (9) above. (11) The user interface processing unit is capable of executing a user interface process for performing a login process for the user. An information processing device according to any one of (7) to (10) above. (12) The user interface processing unit A user interface process for performing a login process for the user, and a user interface process for allowing the user to experience a sound field constructed by the audio signal generated by the second application process when the transfer function acquisition unit cannot acquire the head-related transfer function information corresponding to the user identified as a result of the login process. The information processing device according to (9) above. (13) The storage unit stores the head-related transfer function information corresponding to the user and the playback device in association with each other. An information processing device according to any one of (6) to (12) above. (14) The storage unit stores a plurality of combinations of the head-related transfer function information corresponding to the user and the playback device. The information processing device according to (13) above. (15) a user interface processing unit that is capable of executing user interface processing for switching between an application state in which the head-related transfer function information is applied to the audio signal and a non-application state in which the head-related transfer function information is not applied to the audio signal. An information processing device according to any one of (1) to (14) above. (16) a user interface processing unit capable of executing user interface processing for switching the head-related transfer function information corresponding to the user to the head-related transfer function information corresponding to another user; An information processing device according to any one of (1) to (15) above. (17) It is a television receiver equipped with a display unit capable of displaying images. An information processing device according to any one of (1) to (16) above. (18) a user interface processing unit capable of executing a user interface process for performing a login process for the user, and a user interface process for displaying, on the display unit, information for installing, in a user terminal, an application for calculating the head-related transfer function information corresponding to the user when the head-related transfer function information corresponding to the user identified as a result of the login process is not stored in the storage unit and cannot be obtained from another information processing device, The transfer function acquisition unit acquires, from the other information processing device, the head-related transfer function information corresponding to the user calculated based on information transmitted from the user terminal. The information processing device according to any one of (17) above. (19) obtaining an audio signal; A process of storing head-related transfer function information corresponding to a user; a process of determining whether the head-related transfer function information corresponding to the user is stored in another information processing device; A process of acquiring the head-related transfer function information corresponding to the user; applying the head-related transfer function information corresponding to the user to the audio signal; An information processing method executed by an information processing device. [Explanation of symbols]

[0210] 1. Television receiver 3A Neckband Speaker (Playback Device) 5. Server device (other information processing device) 6. Smartphone (user device) 9 Storage section 21 Detection unit 22 User interface processing section (UI processing section) 23 Judgment processing unit 24 Transfer function acquisition section 25 Signal acquisition unit 26 Function application part 27 Transmission processing unit HRTF Head-related Transfer Function information Pre-SA correction audio signal SB corrected audio signal

Claims

1. a signal acquisition unit that acquires an audio signal; a storage unit that stores head-related transfer function information corresponding to a user; a determination processing unit that determines whether the head-related transfer function information corresponding to the user is stored in another information processing device; a transfer function acquisition unit that acquires the head-related transfer function information corresponding to the user; a function application unit that applies the head-related transfer function information corresponding to the user to the audio signal; a user interface processing unit capable of executing user interface processing for experiencing a sound field constructed by the audio signal after the head-related transfer function information has been applied, the function application unit is capable of executing a first application process of applying the head-related transfer function information corresponding to the user to the audio signal, and a second application process of applying standard head-related transfer function information to the audio signal, The user interface processing unit is capable of executing a user interface process for making the user experience a sound field constructed by the audio signals generated by the second application process when the head-related transfer function information corresponding to the user is not stored in the storage unit and cannot be acquired from another information processing device, and a user interface process for making the user, who has experienced the sound field by the second application process, further experience a sound field constructed by the audio signals generated by the first application process for the same content as a processing target in the second application process. Information processing device.

2. The transfer function acquisition unit The head-related transfer function information corresponding to the user is acquired from the storage unit, and when the head-related transfer function information corresponding to the user is not stored in the storage unit, the head-related transfer function information corresponding to the user is acquired from the other information processing device. The information processing device according to claim 1 .

3. The user interface processing unit performs user interface processing to obtain the head-related transfer function information corresponding to the user when the head-related transfer function information corresponding to the user is not stored in the storage unit and cannot be obtained from the other information processing device. The information processing device according to claim 2 .

4. The user interface processing unit executes, as the user interface processing, a process of making the user select whether or not to execute a process for obtaining the corresponding head-related transfer function information. The information processing device according to claim 3 .

5. The user interface processing unit executes, as the user interface processing, a process of displaying guidance information for prompting a user to install an application on a user terminal. The information processing device according to claim 3 .

6. a transmission processing unit for transmitting the audio signal to a playback device; The information processing device according to claim 1 .

7. a detection unit that detects connection of the playback device, The user interface processing unit performs user interface processing to allow a user to select whether or not to apply the head-related transfer function information to the audio signal when the detection unit detects connection of the playback device. The information processing device according to claim 6 .

8. The user interface processing unit is capable of executing a user interface process for allowing a user to select whether to execute the first application process or the second application process when a connection of the playback device is detected. The information processing device according to claim 6 .

9. The user interface processing unit is capable of executing a user interface process for performing a login process for the user. The information processing device according to claim 7 .

10. the user interface processing unit is capable of executing user interface processing for performing login processing for the user, The user interface processing related to the second application processing is executed when the transfer function acquisition unit is unable to acquire the head-related transfer function information corresponding to the user identified as a result of the login processing. The information processing device according to claim 1 .

11. The storage unit stores the head-related transfer function information corresponding to the user and the playback device in association with each other. The information processing device according to claim 6 .

12. The storage unit stores a plurality of combinations of the head-related transfer function information corresponding to the user and the playback device. The information processing device according to claim 11.

13. The user interface processing unit is capable of executing user interface processing for switching between an application state in which the head-related transfer function information is applied to the audio signal and a non-application state in which the head-related transfer function information is not applied to the audio signal. The information processing device according to claim 1 .

14. The user interface processing unit is capable of executing user interface processing for switching the head-related transfer function information corresponding to the user to the head-related transfer function information corresponding to another user. The information processing device according to claim 1 .

15. It is a television receiver equipped with a display unit capable of displaying images. The information processing device according to claim 1 .

16. The user interface processing unit is capable of executing a user interface process for performing a login process for a user, and a user interface process for displaying information on the display unit for installing an application for calculating the head transfer function information corresponding to the user on a user terminal when the head transfer function information corresponding to the user identified as a result of the login process is not stored in the memory unit and cannot be obtained from another information processing device; The transfer function acquisition unit acquires, from the other information processing device, the head-related transfer function information corresponding to the user calculated based on the information transmitted from the user terminal. The information processing device according to claim 15.

17. obtaining an audio signal; A process of storing head-related transfer function information corresponding to a user; a process of determining whether the head-related transfer function information corresponding to the user is stored in another information processing device; A process of acquiring the head-related transfer function information corresponding to the user; applying the head-related transfer function information corresponding to the user to the audio signal; a user interface process for experiencing a sound field constructed by the audio signal after the head-related transfer function information has been applied; a first application process of applying the head-related transfer function information corresponding to the user to the audio signal; a second application process for applying the standard head-related transfer function information to the audio signal; a user interface process for allowing the user to experience a sound field constructed by the audio signal generated by the second application process when the head-related transfer function information corresponding to the user is not stored in a storage unit and cannot be acquired from another information processing device; and a user interface process for allowing the user who has experienced the sound field by the second application process to further experience a sound field constructed by the audio signal generated by the first application process for the same content as the processing target in the second application process; An information processing method executed by an information processing device.

Citation Information

Patent Citations

  • Head-related transfer function generation device, head-related transfer function generation method, and audio signal processing device

    JP2011259299A

  • Global HRTF repository

    US20200257548A1

  • Information processing device, information processing method, and information processing program

    WO2020138257A1

  • Acoustic signal processing device, acoustic signal processing system, acoustic signal processing method, and program

    WO2020195084A1