Information processing method, information processing device, and program

The information processing device facilitates accurate measurement of head-related transfer functions by guiding user head orientation and controlling the measurement process, addressing the challenges of equipment scale and noise interference.

JP7845402B2Active Publication Date: 2026-04-14SONY GROUP CORP
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
SONY GROUP CORP
Filing Date
2024-05-09
Publication Date
2026-04-14

Smart Images

  • Figure 0007845402000001
    Figure 0007845402000001
  • Figure 0007845402000002
    Figure 0007845402000002
  • Figure 0007845402000003
    Figure 0007845402000003
Patent Text Reader

Abstract

To provide an information processing method which allows a user to accurately measure a head transfer characteristic of the user himself / herself.SOLUTION: There is provided an information processing method including a step in which an information processing device controls a user interface regarding measurement of a head transfer function of the user. In the information processing method, as control of the user interface, the information processing device controls output of guide information for guiding a direction of the head of the user to a designated direction.SELECTED DRAWING: Figure 9
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0005]

[0001] The present disclosure relates to an information processing method, an information processing apparatus, and a program.

Background Art

[0002] In recent years, the Head-Related Transfer Function (HRTF) that indicates the sound transmission characteristics from a sound source to both ears has been attracting attention. Also, a method for efficiently measuring the head-related transfer function has been proposed. For example, Patent Document 1 discloses a technique for reducing the measurement time of the head-related transfer function and reducing the burden on the subject.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the measurement method disclosed in Patent Document 1 requires large-scale measurement equipment, so it is difficult for general users to easily measure their own head transfer characteristics.

Means for Solving the Problems

[0005] According to the present disclosure, there is provided an information processing method including controlling a user interface related to measurement of a user's head-related transfer function by an information processing apparatus. process The information processing device includes: controlling a display unit to display a first guide object for guiding the orientation of the user's head along with an image of the user, and a second guide object for controlling the measurement process of the head transfer function; changing the shape of the first guide object to guide the orientation of the user's head in a specified direction; recognizing whether an image of a part of the user's body is contained within the second guide object; and controlling the measurement process of the user's head transfer function based on the recognition that a part of the user's body is contained within the second guide object. An information processing method is provided.

[0006] Also, according to the present disclosure, there is provided an information processing apparatus including an interface control unit that controls a user interface related to measurement of a user's head-related transfer function, of wherein the interface control unit The display unit is controlled to display, along with the user's image, a first guide object for guiding the orientation of the user's head, and a second guide object for controlling the measurement process of the head transfer function; the shape of the first guide object is changed to guide the orientation of the user's head in a specified direction; the system recognizes whether an image of a part of the user's body is contained within the second guide object; and the system controls the measurement process of the user's head transfer function based on the recognition that a part of the user's body is contained within the second guide object. An information processing apparatus is provided.

[0007] Furthermore, according to this disclosure, the computer is an interface control unit that controls a user interface related to the measurement of the user's head transfer function. A program for causing an information processing device to function, The interface control unit, The display unit is controlled to display, along with the user's image, a first guide object for guiding the orientation of the user's head, and a second guide object for controlling the measurement process of the head transfer function; the shape of the first guide object is changed to guide the orientation of the user's head in a specified direction; the system recognizes whether an image of a part of the user's body is contained within the second guide object; and the system controls the measurement process of the user's head transfer function based on the recognition that a part of the user's body is contained within the second guide object. A program will be provided. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of a user interface and guide information according to one embodiment of the present disclosure. [Figure 2] This is a block diagram showing an example of the functional configuration of the information processing device according to the same embodiment. [Figure 3] This figure shows a specific example of interface control according to the same embodiment. [Figure 4] This figure shows a specific example of interface control according to the same embodiment. [Figure 5] This figure shows a specific example of interface control according to the same embodiment. [Figure 6] This figure shows a specific example of interface control according to the same embodiment. [Figure 7] This figure illustrates the personal optimization of multi-channel head-related transfer functions using the information processing device according to the present embodiment. [Figure 8] This figure shows an example of a user interface corresponding to the multi-channel measurement mode according to the same embodiment. [Figure 9] This flowchart shows the control flow by the interface control unit according to the same embodiment. [Figure 10] This figure shows an example of a hardware configuration according to one embodiment of the present disclosure. [Figure 11] This diagram illustrates the general measurement of head-related transfer functions using a dummy head microphone. [Modes for carrying out the invention]

[0009] While referring to the accompanying drawings below, preferred embodiments of the present disclosure will be described in detail. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions are omitted.

[0010] The description will be made in the following order. 1. Embodiment 1.1. Overview 1.2. Functional configuration example of information processing apparatus 10 1.3. Specific example of control 1.4. Control flow 2. Hardware configuration example 3. Summary

[0011] <1. Embodiment> <<1.1. Overview>> First, an overview of an embodiment of the present disclosure will be described. As described above, in recent years, the head-related transfer function that mathematically represents the sound transmission characteristics from a sound source to both ears has attracted attention. According to the head-related transfer function, for example, it is possible to stereoscopically represent sound images on a sound output device such as headphones.

[0012] The head-related transfer function is generally measured using a dummy head microphone. Here, referring to FIG. 11, a general measurement of the head-related transfer function using a dummy head microphone will be described.

[0013] In the measurement of a general head-related transfer function, first, as shown on the left side in the figure, a speaker 30 and a dummy head microphone 40 are installed in a reference sound field RSF to be reproduced on headphones 50.

[0014] Next, a measurement signal is reproduced from the speaker 30, and as shown in the center of the figure, the head-related transfer functions of the left ear and the right ear are obtained by microphones provided at both ear positions of the dummy head microphone 40.

[0015] Next, as shown on the right side of the diagram, the head-related transfer functions of the left and right ears are convolved onto the audio signal to be reproduced (source signal) to generate signals for the left and right ears. By playing the signals generated as described above through headphones 50, the sound image can be represented three-dimensionally.

[0016] The above describes the measurement of head-related transfer functions using a dummy head microphone. On the other hand, in recent years, it has been known that using head-related transfer functions measured for each user can further enhance the effect of three-dimensional representation of the sound image as described above.

[0017] However, measuring head-related characteristics (HPCs) requires large-scale measurement equipment such as anechoic chambers, listening rooms, and large speakers. Therefore, it has been difficult for ordinary users to easily measure their own HPCs.

[0018] Furthermore, accurately measuring an effective head-related transfer function requires clearly defining the relative position between the sound source outputting the measurement signal and the user's ears. However, users lacking specialized knowledge may find it difficult to determine the appropriate position and posture for measuring their own head-related transfer function.

[0019] The technical concept relating to this disclosure was conceived with the above points in mind, and enables users to measure their own head transfer characteristics with high accuracy. To this end, an information processing device 10 according to one embodiment of this disclosure includes an interface control unit 140 that controls a user interface related to the measurement of the user's head transfer function. Furthermore, one of the features of the interface control unit 140 according to one embodiment of this disclosure is that it controls the output of guide information that guides the orientation of the user's head in a specified direction.

[0020] Figure 1 shows an example of a user interface and guide information according to this embodiment. Figure 1 shows an example of user interface control when user U measures their own head-related transfer function using the information processing device 10 according to this embodiment. Note that Figure 1 shows an example where the information processing device 10 according to this embodiment is a smartphone.

[0021] First, as shown on the left side of Figure 1, user U attaches microphones 20L and 20R to their left and right ears, respectively, and activates the user interface according to this embodiment by operating the information processing device 10. In the center of Figure 1, an example of a GUI (Graphical User Interface) that the interface control unit 140 displays on the display unit 110 based on the user U's operation is shown. Thus, the user interface according to this embodiment may include a GUI.

[0022] In this embodiment, the interface control unit 140 is characterized by outputting guide information that directs the orientation of the user U's head in a specified direction. Here, the specified direction may be a direction suitable for measuring the head-related transfer function. For example, if it is desired to output a measurement signal from the front of the user U and measure the user U's head-related transfer function, the specified direction may be the direction in which the audio output unit 170, which outputs a measurement signal related to the measurement of the head-related transfer function, is located, with the user U as the starting point. That is, the specified direction in this embodiment may be set, for example, so that the user U and the audio output unit 170 are facing each other.

[0023] The interface control unit 140 according to this embodiment guides the orientation of the user U's head in the specified direction as described above, thereby fixing the user's posture at a position suitable for measuring the head-transfer function, and enabling highly accurate measurement of the head-transfer function.

[0024] Here, an example of guide information controlled by the interface control unit 140 according to this embodiment will be described. The guide information according to this embodiment includes, for example, various types of visual information. The interface control unit 140 according to this embodiment may display a guide object on the display unit 110 that guides the direction of the user U's head in a specified direction.

[0025] Furthermore, the interface control unit 140 according to this embodiment may display the image of the user U captured by the imaging unit 120 on the display unit 110 in real time and superimpose a guide object onto the image.

[0026] For example, in the case shown in Figure 1, the interface control unit 140 displays a frame object FF with a head shape corresponding to the specified direction, and a message guiding the user to align the position of the face being photographed with the frame object FF, as guide information on the display unit 110.

[0027] According to the control by the interface control unit 140 in this embodiment, user U can easily align the position of their face UF with the frame object FF while checking their own image, and can assume a posture suitable for measuring the head transfer function without having to consciously think about it.

[0028] Furthermore, the interface control unit 140 according to this embodiment may control the output of start notification information indicating the start of head transfer function measurement based on the recognition unit 150's determination that the orientation of user U's head substantially coincides with the specified direction. In this case, the recognition unit 150 may determine, for example, that the orientation of user U's head substantially coincides with the specified direction based on the fact that user U's face UF in the captured image is contained within the frame object FF.

[0029] On the right side of Figure 1, an example of start notification information is shown, in which the interface control unit 140 outputs a system utterance SO1 indicating the start of measurement to the voice output unit 170, and also displays a message indicating the start of measurement on the display unit 110.

[0030] According to the start notification information described above, it is possible to guide user U to fix their head when starting the measurement, making it possible to measure the head-related transfer function with high accuracy.

[0031] Furthermore, the interface control unit 140 according to this embodiment may control the start and interruption of the head-transfer function measurement process. For example, based on the recognition unit 150's determination that the orientation of user U's head substantially matches a specified direction, the interface control unit 140 according to this embodiment may cause the signal processing unit 160, described later, to start the head-transfer function measurement process.

[0032] Furthermore, for example, if the recognition unit 150 determines that the orientation of the user U's head no longer substantially coincides with the specified direction after the interface control unit 140 has started the head transfer function measurement process to the signal processing unit 160 but before the measurement process is completed, the interface control unit 140 may interrupt the measurement process to the signal processing unit 160.

[0033] According to the above-described function of the interface control unit 140 in this embodiment, if the orientation of the user U's head deviates from the specified direction during measurement, that is, if the user U's posture becomes unsuitable for measuring the head-transfer function, the signal processing unit 160 can interrupt the measurement process, thereby maintaining the accuracy of the acquired head-transfer function.

[0034] Furthermore, the interface control unit 140 can also perform the above-described control based on the noise level around the user U. For example, in this embodiment, the interface control unit 140 may control the signal processing unit 160 so that it does not start the head-related transfer function measurement process if the noise level measured by the recognition unit 150 exceeds a threshold.

[0035] Furthermore, for example, if the interface control unit 140 according to this embodiment detects that the noise level has exceeded a threshold after instructing the signal processing unit 160 to start the head-transfer function measurement process, it may interrupt the measurement process in the signal processing unit 160.

[0036] According to the control by the interface control unit 140 in this embodiment, it is possible to prevent the acquisition of low-accuracy head-related transfer functions in environments with high noise levels.

[0037] Furthermore, the interface control unit 140 according to this embodiment may, for example, display noise information NI related to the noise level measured by the recognition unit 150 on the display unit 110, as shown in Figure 1. In the example shown in Figure 1, the interface control unit 140 displays the noise information NI as a meter and presents the current noise level and the noise level range (hatched area in the figure) in which measurement is permitted to the user U.

[0038] The display described above allows user U to understand whether the noise level in the surrounding environment is suitable for measuring the head-related transfer function. For example, if the noise level is high, it can be guided to move to a location with a lower noise level.

[0039] The above describes the overview of the user interface controlled by the interface control unit 140 according to this embodiment. According to the control by the interface control unit 140 according to this embodiment, the user can easily and accurately measure their own head transfer characteristics by guiding the user to a posture suitable for measurement.

[0040] <<1.2. Example of Functional Configuration of Information Processing Device 10>> Next, an example of the functional configuration of the information processing device 10 according to this embodiment will be described. The information processing device 10 according to this embodiment may be, for example, a mobile device such as a smartphone or a tablet.

[0041] Figure 2 is a block diagram showing an example of the functional configuration of the information processing device 10 according to this embodiment. As shown in Figure 2, the information processing device 10 according to this embodiment includes a display unit 110, an imaging unit 120, a sensor unit 130, an interface control unit 140, a recognition unit 150, a signal processing unit 160, and an audio output unit 170.

[0042] (Display section 110) In this embodiment, the display unit 110 displays a GUI related to the measurement of the head transfer function based on control by the interface control unit 140.

[0043] For this purpose, the display unit 110 according to this embodiment includes a display device that presents visual information. Examples of such display devices include a liquid crystal display (LCD), an organic light-emitting diode (OLED), and a touch panel.

[0044] (Photography Department 120) The imaging unit 120 according to this embodiment has a function to capture, for example, images of the user. For this purpose, the imaging unit 120 according to this embodiment is equipped with an imaging device capable of capturing images. The above images include not only still images but also moving images.

[0045] (Sensor unit 130) The sensor unit 130 according to this embodiment has the function of collecting various sensor information related to the information processing device 10 and the surrounding environment. The sensor information collected by the sensor unit 130 is used for various recognition processes by the recognition unit 150. The sensor unit 130 according to this embodiment includes, for example, a gyro sensor, an acceleration sensor, a geomagnetic sensor, a microphone, and the like.

[0046] (Interface control unit 140) The interface control unit 140 according to this embodiment has the function of controlling the user interface related to the measurement of the user's head transfer function. As described above, one of the features of the interface control unit 140 according to this embodiment is that it controls the output of guide information that guides the orientation of the user's head in a specified direction.

[0047] (Recognition unit 150) The recognition unit 150 in this embodiment performs various recognition processes based on images captured by the imaging unit 120 and sensor information collected by the sensor unit 130. For example, the recognition unit 150 in this embodiment recognizes the orientation of the user's head. The recognition unit 150 may recognize the orientation of the user's head based on images captured by the imaging unit 120.

[0048] Furthermore, as described above, the recognition unit 150 can also determine, for example, that the orientation of the user's head substantially matches a specified direction based on the fact that the user's face in the captured image is contained within the frame object.

[0049] Furthermore, for example, if the microphone 20 worn by the user is equipped with a gyro sensor or the like, the recognition unit 150 may recognize the orientation of the user's head based on the sensor information acquired from the microphone 20.

[0050] Furthermore, the recognition unit 150 according to this embodiment has the function of measuring the noise level in the surrounding environment based on the sound information collected by the sensor unit.

[0051] (Signal processing unit 160) In this embodiment, the signal processing unit 160 starts the head-related transfer function measurement process based on control by the interface control unit 140. For example, the signal processing unit 160 in this embodiment may output a measurement signal to the audio output unit 170 based on a measurement start instruction input from the interface control unit 140.

[0052] Furthermore, the signal processing unit 160 according to this embodiment receives head-related transfer functions acquired by microphones 20L and 20R worn by the user, and performs convolution processing based on these head-related transfer functions to generate audio signals for the left and right ears. The signal processing unit 160 according to this embodiment can generate audio signals using known convolution techniques. For example, the signal processing unit 160 according to this embodiment may use techniques such as those disclosed in Japanese Patent Application Publication No. 2014-060691 filed by the applicant of this disclosure.

[0053] (Audio output unit 170) The audio output unit 170 according to this embodiment outputs audio based on control by the interface control unit 140 and the signal processing unit 160. For example, the audio output unit 170 according to this embodiment may output guide information or start notification information based on control by the interface control unit 140. Alternatively, for example, the audio output unit 170 according to this embodiment may output a measurement signal based on control by the signal processing unit 160.

[0054] The above describes an example of the functional configuration of the information processing device 10 according to this embodiment. Note that the above configuration described using Figure 2 is merely an example, and the functional configuration of the information processing device 10 according to this embodiment is not limited to this example. For example, the information processing device 10 according to this embodiment may be implemented as a server and control a mobile terminal equipped with a display unit, a camera unit, an audio output unit, etc., via a network. Alternatively, the information processing device 10 according to this embodiment may be implemented as a microphone worn by the user and control the mobile terminal via a network. The functional configuration of the information processing device 10 according to this embodiment can be flexibly modified according to specifications and operation.

[0055] <<1.3. Specific Examples of Control>> Next, the control by the interface control unit 140 according to this embodiment will be explained in more detail with reference to Figures 3 to 6, including specific examples. Figures 3 to 6 are diagrams showing specific examples of interface control according to this embodiment.

[0056] For example, Figure 1 describes a case in which the interface control unit 140 according to this embodiment displays a frame object of head shape as guide information on the display unit 110, but the guide information according to this embodiment is not limited to this example. The guide object according to this embodiment may be, for example, a wearable object attached to the head.

[0057] In the example shown in Figure 3, the interface control unit 140 according to this embodiment displays a head-shaped frame object FF as well as a glasses-shaped wearable object AO on the display unit 110.

[0058] By displaying such a wearable object AO on the display unit 110, it is possible to further enhance the guidance effect on the user's head orientation compared to the case where only the frame object FF is displayed.

[0059] In this case, the interface control unit 140 according to this embodiment may, based on the recognition unit 150's recognition that the user U's face FF is contained within the frame object FF and that the user's left eye LE and right eye RE are in their assumed positions within the wearable object AO, initiate the head transfer function measurement process in the signal processing unit 160. The above control by the interface control unit 140 according to this embodiment allows the user U to assume a posture more suitable for measurement, enabling the measurement of a highly accurate head transfer function.

[0060] Furthermore, the wearable object AO according to this embodiment is not limited to the eyeglasses shape shown in Figure 3, but may have various shapes such as a hat, headphones, or headband.

[0061] Furthermore, although Figure 1 illustrates the case where the interface control unit 140 outputs system speech to the voice output unit 170 as start notification information, the start notification information according to this embodiment is not limited to this example. The start notification information according to this embodiment may be, for example, a jingle J, a flash of light from the imaging unit 120, a message, an image, a symbol, etc., as shown in Figure 3. In addition, the user U may start measuring the head-related transfer function by touching a measurement button displayed on the display unit 110.

[0062] Furthermore, the specified direction according to this embodiment is not necessarily limited to the direction in which the audio output unit 170 is located with the user's head as the starting point. The specified direction according to this embodiment may be set as appropriate in order to measure the head-related transfer function at any ear position.

[0063] For example, in the example shown in Figure 4, the interface control unit 140 displays a frame object FF on the display unit 110 that guides the user U to face sideways. Thus, the interface control unit 140 according to this embodiment can also display a frame object FF with a head shape corresponding to a specified direction on the display unit 110. With the above functions of the interface control unit 140 according to this embodiment, it becomes possible to guide the orientation of the user's head in various specified directions and measure head transfer functions corresponding to various ear positions.

[0064] Furthermore, the guide information according to this embodiment may also be audio information. For example, the interface control unit 140 according to this embodiment may output audio to the audio output unit 170 that guides the user's head direction in a specified direction.

[0065] Figure 5 shows an example in which the interface control unit 140 instructs the signal processing unit 160 to start measuring the head-related transfer function based on the recognition unit 150's recognition of the user U's smile. In this embodiment, the recognition unit 150 can also recognize the direction of the user's head by recognizing a smile.

[0066] In this case, the interface control unit 140 may output system speech SO2, such as "Look at the screen and smile," to the audio output unit 170 as guide information. In this way, the interface control unit 140 according to this embodiment can effectively guide the user's head in a specified direction by outputting guide information as visual or audio information.

[0067] Furthermore, the above describes a case in which the user adjusts the orientation of their head while taking a picture of themselves with the imaging unit 120 (a so-called IN camera) that the information processing device 10 has on the surface of the display unit 110. However, the user's image capture and head orientation adjustment may be performed by a collaborator.

[0068] Figure 6 shows an example in which collaborator C adjusts the orientation of user U's head while photographing user U using the imaging unit 120 (so-called OUT camera) located on the back side of the information processing device 10.

[0069] Thus, the information processing device 10 according to this embodiment can accommodate photography by collaborators, and can accurately measure the head-related transfer function even when the user U himself cannot see the display unit 110 due to factors such as a specified direction.

[0070] Furthermore, in this case, the interface control unit 140 according to this embodiment may select an audio output unit 170 that outputs a measurement signal based on the position of the imaging unit 120 selected by an operator such as user U or collaborator C via the user interface.

[0071] For example, if user U activates the imaging unit 120 located on the display unit 110 side, the interface control unit 140 may instruct the signal processing unit 160 to output a measurement signal to the audio output unit 170, which is also located on the display unit 110 side.

[0072] On the other hand, as shown in Figure 6, if collaborator C activates the imaging unit 120 located on the back of the information processing device 10, the interface control unit 140 may instruct the signal processing unit 160 to output a measurement signal to the audio output unit 170, which is also located on the back of the information processing device 10.

[0073] According to the control by the interface control unit 140 in this embodiment, a path is secured through which the measurement signal output from the audio output unit 170 is directly transmitted to the microphone 20 worn by the user U, thereby enabling the measurement of a highly accurate head-related transfer function.

[0074] The above describes an example of interface control according to this embodiment with specific examples. Note that the interface control unit 140 according to this embodiment may have multiple user interfaces corresponding to measurement modes of head-related transfer functions, in addition to the user interfaces shown in Figures 1, 3 to 6. In this case, the interface control unit 140 according to this embodiment can control the switching of user interfaces based on the selected measurement mode of the head-related transfer function.

[0075] The above measurement mode may be set, for example, according to the number of measurement channels. That is, the interface control unit 140 according to this embodiment can provide the user with a user interface according to the number of measurement channels.

[0076] Figure 7 illustrates the personal optimization of multi-channel head-related transfer functions using the information processing device 10 according to this embodiment. For example, when performing personal optimization of a 5-channel head-related transfer function, user U is required to move the information processing device 10 to five positions P1 to P5 corresponding to the 5 channels, as shown on the left side of the figure, and measure the head-related transfer function at each position. Note that positions P1 to P5 may be relative positions with respect to the front of user U's head.

[0077] In this embodiment, the interface control unit 140 displays a user interface on the display unit 110 that guides the user's head orientation so that the head-related transfer function can be accurately measured at positions P1 to P5. According to the user interface controlled by the interface control unit 140 in this embodiment, as shown on the right side of the figure, it is possible to reproduce a virtual sound field including five sound images SI1 to SI5 corresponding to positions P1 to P1, thereby realizing a richer three-dimensional representation of sound.

[0078] Figure 8 shows an example of a user interface corresponding to the multi-channel measurement mode according to this embodiment. The interface control unit 140 according to this embodiment displays, for example, targets T1 to T5 corresponding to each channel and a marker M indicating the orientation of the user's head recognized by the recognition unit 150 on the display unit 110 in real time, as shown in the figure.

[0079] Here, as shown on the left side of the figure, if the user's head orientation deviates from the specified direction, i.e., from targets T1 to T5, the interface control unit 140 may guide the user's head orientation by outputting system utterance SO3 as guide information.

[0080] On the other hand, as shown on the left side of the figure, when the orientation of the user's head approximately matches that of targets T1 to T5, the interface control unit 140 outputs system utterance SO4 as start notification information to inform the user that the measurement process has started and to guide them to maintain their posture. The interface control unit 140 in this embodiment may repeat the above control until the measurement process is completed for all targets T.

[0081] The personal optimization of multi-channel head-related transfer functions according to this embodiment has been described above. As shown above, the information processing device 10 according to this embodiment makes it possible for a user to easily and accurately measure their own head-related transfer characteristics, regardless of the number of channels.

[0082] <<1.4. Control Flow>> Next, the control flow by the interface control unit 140 according to this embodiment will be described in detail. Figure 9 is a flowchart showing the control flow by the interface control unit 140 according to this embodiment.

[0083] Referring to Figure 9, the interface control unit 140 first activates the user interface and the imaging unit 120 based on user input (S1101).

[0084] Next, the interface control unit 140 causes the display unit 110 and the audio output unit 170 to output guide information (S1102).

[0085] Next, the recognition unit 150 determines whether or not the orientation of the user's head is approximately in line with the specified direction (S1103). The recognition unit 150 repeatedly executes the determination process in step S1103 until it determines that the orientation of the user's head is approximately in line with the specified direction.

[0086] On the other hand, if the recognition unit 150 determines that the orientation of the user's head is approximately the same as the specified direction (S1103: YES), it determines whether the noise level in the surrounding environment is below a threshold (S1104).

[0087] If the noise level in the surrounding environment exceeds a threshold (S1104: NO), the recognition unit 150 may return to step S1103.

[0088] On the other hand, if the recognition unit 150 determines that the noise level in the surrounding environment is below a threshold (S1104: YES), the interface control unit 140 instructs the signal processing unit 160 to start the head-related transfer function measurement process (S1105).

[0089] Next, the recognition unit 150 determines again whether or not the orientation of the user's head is approximately in line with the specified direction (S1106).

[0090] If it is detected that the orientation of the user's head does not substantially match the specified direction, that is, that the orientation of the user's head deviates from the specified direction (S1106: NO), the interface control unit 140 instructs the signal processing unit 160 to stop the head-transfer function measurement process (S1109).

[0091] Furthermore, the recognition unit 150 determines whether or not the noise level in the surrounding environment is below a threshold (S1107).

[0092] If it is detected that the noise level in the surrounding environment exceeds a threshold (S1107: NO), the interface control unit 140 instructs the signal processing unit 160 to stop the measurement process of the head-related transfer function (S1109).

[0093] On the other hand, if the noise level in the surrounding environment is below a threshold (S1107: YES), the interface control unit 140 determines whether or not the measurement process of the head-related transfer function has been completed (S1108).

[0094] If the measurement process of the head-related transfer function is not yet complete (S1108: NO), the information processing device 10 returns to step S1106 and repeatedly performs the subsequent determination.

[0095] <2. Hardware Configuration Example> Next, an example of the hardware configuration of an information processing device 10 according to one embodiment of the present disclosure will be described. Figure 10 is a block diagram showing an example of the hardware configuration of an information processing device 10 according to one embodiment of the present disclosure. Referring to Figure 10, the information processing device 10 includes, for example, a processor 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, an output device 879, a storage device 880, a drive 881, a connection port 882, and a communication device 883. Note that the hardware configuration shown here is just an example, and some of the components may be omitted. Furthermore, it may also include components other than those shown here.

[0096] (Processor 871) The processor 871 functions, for example, as an arithmetic processing unit or a control unit, and controls the overall operation or part thereof of each component based on various programs recorded in the ROM 872, RAM 873, storage 880, or removable recording medium 901.

[0097] (ROM872, RAM873) ROM872 is a means for storing programs loaded into processor 871 and data used for calculations. RAM873 temporarily or permanently stores, for example, programs loaded into processor 871 and various parameters that change as needed when executing those programs.

[0098] (Host bus 874, bridge 875, external bus 876, interface 877) The processor 871, ROM 872, and RAM 873 are interconnected, for example, via a host bus 874 capable of high-speed data transmission. On the other hand, the host bus 874 is connected to an external bus 876, which has a relatively low data transmission speed, via a bridge 875. The external bus 876 is also connected to various components via an interface 877.

[0099] (Input device 878) The input device 878 may include, for example, a mouse, keyboard, touch panel, buttons, switches, and levers. Furthermore, a remote controller (hereinafter referred to as a remote control) capable of transmitting control signals using infrared or other radio waves may also be used as the input device 878. Additionally, the input device 878 may include audio input devices such as microphones.

[0100] (Output device 879) The output device 879 is, for example, a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL; an audio output device such as a speaker or headphones; a printer, mobile phone, or facsimile, or any other device capable of visually or audibly notifying the user of acquired information. Furthermore, the output device 879 according to this disclosure includes various vibration devices capable of outputting tactile stimuli.

[0101] (Storage 880) Storage 880 is a device for storing various types of data. Examples of storage 880 include magnetic storage devices such as hard disk drives (HDDs), semiconductor storage devices, optical storage devices, or magneto-optical storage devices.

[0102] (Drive 881) The drive 881 is a device that reads information recorded on a removable recording medium 901, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, or writes information to the removable recording medium 901.

[0103] (Removable recording medium 901) The removable recording medium 901 may be, for example, DVD media, Blu-ray® media, HD DVD media, or various semiconductor storage media. Of course, the removable recording medium 901 may also be, for example, an IC card equipped with a contactless IC chip, or an electronic device.

[0104] (Connection port 882) Connection port 882 is a port for connecting external devices 902, such as a USB (Universal Serial Bus) port, IEEE1394 port, SCSI (Small Computer System Interface), RS-232C port, or optical audio terminal.

[0105] (External connection device 902) External connected devices 902 include, for example, a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder.

[0106] (Communication device 883) The communication device 883 is a communication device for connecting to a network, and is, for example, a communication card for wired or wireless LAN, Bluetooth®, or WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication.

[0107] <3. Summary> As described above, the information processing device 10 according to one embodiment of the present disclosure includes an interface control unit 140 that controls a user interface related to the measurement of the user's head transfer function. Furthermore, one of the features of the interface control unit 140 according to one embodiment of the present disclosure is that it controls the output of guide information that guides the orientation of the user's head in a specified direction. With this configuration, it becomes possible for the user to measure their own head transfer characteristics with high accuracy.

[0108] While preferred embodiments of the present disclosure have been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear to any person with ordinary skill in the art of the present disclosure that various modifications or alterations may be conceived within the scope of the technical idea set forth in the claims, and these will naturally also fall within the technical scope of the present disclosure.

[0109] Furthermore, the effects described herein are merely descriptive or illustrative and not limiting. In other words, the technology relating to this disclosure may produce other effects that will be apparent to those skilled in the art from the description herein, in addition to or in lieu of the effects described herein.

[0110] Furthermore, it is possible to create a program that enables the CPU, ROM, RAM, and other hardware built into the computer to perform functions equivalent to those of the information processing device 10, and a non-transient recording medium readable by the computer, on which such a program is recorded, can also be provided.

[0111] Furthermore, each step in the processing of the information processing device 10 described herein does not necessarily have to be processed chronologically in the order shown in the flowchart. For example, each step in the processing of the information processing device 10 may be processed in an order different from the order shown in the flowchart, or may be processed in parallel.

[0112] Furthermore, the following configurations also fall within the technical scope of this disclosure. (1) Interface control unit that controls the user interface related to the measurement of the user's head transfer function. Equipped with, The interface control unit controls the output of guide information that directs the user's head orientation in a specified direction. Information processing device. (2) The aforementioned guide information includes visual information, The interface control unit causes the display unit to display a guide object that guides the user's head direction in the specified direction. The information processing device described in (1) above. (3) The information processing apparatus according to (2), wherein the interface control unit displays the captured image of the user on the display unit in real time and superimposes the guide object onto the image of the user. (4) The information processing device according to (2), wherein the guide object includes a frame object having a head shape corresponding to the specified direction. (5) The information processing apparatus according to (3) or (4), wherein the guide object includes a wearable object that is attached to the head. (6) The aforementioned guide information includes audio information, The interface control unit causes the audio output unit to output audio that guides the user's head in the specified direction. An information processing device as described in any one of (1) to (5) above. (7) The information processing apparatus according to any one of (1) to (6), wherein the specified direction includes the direction in which the audio output unit that outputs a measurement signal related to the measurement of the head-related transfer function is located, with the user's head as the starting point. (8) The information processing device according to any one of (1) to (5), wherein the interface control unit controls the output of start notification information indicating the start of measurement of the head transfer function, based on the determination that the orientation of the user's head substantially coincides with the specified direction. (9) The interface control unit controls the switching of the user interface based on the measurement mode of the head transfer function, as described in any one of (1) to (8) above. (10) The measurement mode is set according to the number of measurement channels, as described in (9) above. (11) The information processing device according to any one of (1) to (10), wherein the interface control unit causes a mobile terminal equipped with an audio output unit that outputs a measurement signal related to the measurement of the head-related transfer function to output the guide information. (12) The mobile terminal comprises at least two imaging units and at least two audio output units, The interface control unit selects the audio output unit that outputs the measurement signal based on the position of the imaging unit selected by the operator via the user interface. The information processing device described in (11) above. (13) The information processing apparatus according to any one of (1) to (12), wherein the interface control unit starts the measurement process of the head transfer function based on the determination that the orientation of the user's head substantially coincides with the specified direction. (14) The information processing apparatus according to (13), wherein the interface control unit interrupts the measurement process based on the determination that the orientation of the user's head no longer substantially coincides with the specified direction between the start of the measurement process of the head transfer function and the completion of the measurement process. (15) The information processing apparatus according to (13) or (14), wherein the interface control unit controls the measurement process so that it is not started if the measured noise level exceeds a threshold. (16) The information processing apparatus according to (15), wherein the interface control unit interrupts the measurement process if it detects that the noise level has exceeded a threshold after starting the measurement process of the head transfer function. (17) The interface control unit controls the output of noise information relating to the measured noise level, as described in (15) or (16). (18) An information processing device according to any one of (1) to (17), further comprising a recognition unit for recognizing the orientation of the user's head. (19) The processor controls a user interface related to the measurement of the user's head transfer function, Controlling the user interface further includes controlling the output of guide information that directs the user's head orientation in a specified direction. Information processing methods. (20) Computers, It includes an interface control unit that controls the user interface related to the measurement of the user's head transfer function, The interface control unit controls the output of guide information that directs the user's head orientation in a specified direction. A program to enable the device to function as an information processing device. (twenty one) An information processing method comprising an information processing device controlling a user interface related to the measurement of a user's head transfer function, As part of the control of the user interface, the information processing device controls the output of guide information that directs the user's head in a specified direction. Information processing methods. (twenty two) The aforementioned guide information includes visual information, The information processing device displays a guide object on its display unit that guides the user's head in the specified direction. The information processing method described in (21) above. (twenty three) As control of the user interface, the information processing device displays the captured image of the user on the display unit in real time and superimposes the guide object onto the image of the user. The information processing method described in (22) above. (twenty four) The information processing method according to (22) above, wherein the guide object includes a frame object having a head shape corresponding to the specified direction. (twenty five) The information processing method according to (23) or (24) above, wherein the guide object includes a wearable object that is attached to the head. (26) The information processing method according to (23) above, further comprising the information processing device recognizing whether an image of a predetermined portion of the user's head is contained within the guide object. (27) The information processing method according to (26) above, further comprising the information processing device further displaying other guide objects on the display unit. (28) The information processing method according to (27) above, further comprising the information processing device recognizing whether an image of a portion of a predetermined part of the user's head is contained within the other guide object. (29) The aforementioned guide information includes audio information, As control of the user interface, the information processing device causes the audio output unit to output audio that guides the user's head direction in the specified direction. The information processing method described in any one of (21) to (28) above. (30) The information processing method according to any one of (21) to (29) above, wherein the specified direction includes the direction in which the audio output unit that outputs a measurement signal related to the measurement of the head transfer function is located, with the user's head as the starting point. (31) The information processing method according to any one of (21) to (28) above, wherein the information processing device determines that the orientation of the user's head substantially coincides with the specified direction, and controls the output of start notification information indicating the start of measurement of the head transfer function. (32) The information processing method according to any one of (21) to (31) above, wherein the information processing device controls the switching of the user interface based on the measurement mode of the head transfer function. (33) The measurement mode is set according to the information processing method described in (32) above. (34) The information processing method according to any one of (21) to (33) above, wherein the information processing device causes the information processing device to output the guide information to a mobile terminal equipped with an audio output unit that outputs a measurement signal related to the measurement of the head-related transfer function. (35) The mobile terminal comprises at least two imaging units and at least two audio output units, The information processing device selects the audio output unit that outputs the measurement signal based on the position of the imaging unit selected by the operator via the user interface. The information processing method described in (34) above. (36) The information processing method according to any one of (21) to (35) above, wherein the information processing device determines that the orientation of the user's head substantially coincides with the specified direction, and starts the measurement process of the head transfer function. (37) The aforementioned information processing device If, after initiating the measurement process of the head transfer function, and before the measurement process is completed, it is determined that the orientation of the user's head no longer substantially coincides with the specified direction, Interrupt the aforementioned measurement process. The information processing method described in (36) above. (38) The information processing method according to (36) or (37) above, wherein if the measured noise level exceeds a threshold, the information processing device controls itself so that the measurement process is not started. (39) The information processing method according to (38) above, wherein if the information processing device detects that the noise level has exceeded a threshold after starting the measurement process of the head transfer function, the measurement process is interrupted. (40) The information processing method according to (38) or (39) above, wherein the information processing device controls the output of noise information relating to the measured noise level. (41) The information processing method according to any one of (21) to (40) above, further comprising the information processing device recognizing the orientation of the user's head. [Explanation of symbols]

[0113] 10 Information Processing Devices 110 Display section 120 Photography Department 130 Sensor section 140 Interface Control Unit 150 Recognition part 160 Signal Processing Unit 170 Audio output section 20 Microphones

Claims

1. An information processing method comprising an information processing device controlling a user interface related to the measurement process of a user's head transfer function, The aforementioned information processing device The display unit is controlled to display, along with the user's image, a first guide object for guiding the orientation of the user's head, and a second guide object for controlling the measurement process of the head transfer function. In order to guide the orientation of the user's head in a specified direction, the shape of the first guide object is changed to a shape corresponding to the specified direction, Recognizing whether an image of a part of the user's body is contained within the second guide object, If a recognition result is obtained indicating that a part of the user's body is contained within the second guide object, the output of start notification information indicating the start of the measurement of the head transfer function is controlled based on the recognition result, and the measurement process of the user's head transfer function is started. If a recognition result is obtained indicating that a part of the user's body is not contained within the second guide object, the measurement process of the user's head transfer function will be interrupted based on that recognition result. Includes, The first guide object and the second guide object are user interfaces used in the measurement process of the user's head transfer function. The aforementioned start notification information is at least one of the following: system utterance, message, jingle, light, message, image, or symbol. Information processing methods.

2. The system measures the noise level around the user and outputs the measurement result of the noise level relative to a threshold to the user. If the measured noise level exceeds the threshold, control is provided so that the measurement process is not started. If, after starting the measurement process of the head-related transfer function, it is detected that the noise level exceeds the threshold, the measurement process is interrupted. Further including, The information processing method according to claim 1.

3. The information processing device includes displaying the captured image of the user on the display unit in real time and superimposing the second guide object onto the image of the user. The information processing method according to claim 1 or 2.

4. The information processing method according to claim 3, wherein the information processing device includes recognizing whether the image of the user's head is contained within the second guide object.

5. The information processing device further includes outputting a sound to the sound output unit that guides the user's head orientation in the specified direction. The information processing method according to any one of claims 1 to 4.

6. The information processing method according to any one of claims 1 to 4, wherein the specified direction includes the direction in which the audio output unit that outputs a measurement signal related to the measurement of the head transfer function is located, with the user's head as the starting point.

7. If, based on the recognition of whether a part of the user's body is located within the second guide object, it is determined that the orientation of the user's head substantially coincides with the specified direction, the display of the start notification information is controlled and the measurement process of the head transfer function is started. The information processing method according to any one of claims 1 to 6.

8. The information processing method according to any one of claims 1 to 7, further comprising the information processing device controlling the switching of the user interface based on the measurement mode of the head transfer function.

9. The information processing method according to claim 8, wherein the measurement mode is set according to the number of measurement channels.

10. The information processing method according to any one of claims 1 to 4, wherein the information processing device controls a mobile terminal equipped with an audio output unit that outputs a measurement signal related to the measurement of the head-related transfer function.

11. The aforementioned information processing device If, after initiating the measurement process of the head transfer function, and before the measurement process is completed, it is determined that the orientation of the user's head no longer substantially coincides with the specified direction, Further including interrupting the measurement process, The information processing method according to claim 7.

12. It includes an interface control unit that controls the user interface related to the measurement process of the user's head transfer function, The interface control unit, The display unit is controlled to display, along with the user's image, a first guide object for guiding the orientation of the user's head, and a second guide object for controlling the measurement process of the head transfer function. In order to guide the orientation of the user's head in a specified direction, the shape of the first guide object is changed to a shape corresponding to the specified direction. The system recognizes whether an image of a part of the user's body is contained within the second guide object. If a recognition result is obtained indicating that a part of the user's body is contained within the second guide object, the output of start notification information indicating the start of the measurement of the head transfer function is controlled based on the recognition result, and the measurement process of the user's head transfer function is started. If a recognition result is obtained indicating that a part of the user's body is not contained within the second guide object, the measurement process of the user's head transfer function is interrupted based on the recognition result. The first guide object and the second guide object are user interfaces used in the measurement process of the user's head transfer function. The aforementioned start notification information is at least one of the following: system utterance, message, jingle, light, message, image, or symbol. Information processing device.

13. Computers, A program for causing an information processing device to function as an information processing device equipped with an interface control unit that controls a user interface related to the measurement of the user's head transfer function, The interface control unit, The display unit is controlled to display, along with the user's image, a first guide object for guiding the orientation of the user's head, and a second guide object for controlling the measurement process of the head transfer function. In order to guide the orientation of the user's head in a specified direction, the shape of the first guide object is changed to a shape corresponding to the specified direction. The system recognizes whether an image of a part of the user's body is contained within the second guide object. If a recognition result is obtained indicating that a part of the user's body is contained within the second guide object, the output of start notification information indicating the start of the measurement of the head transfer function is controlled based on the recognition result, and the measurement process of the user's head transfer function is started. If a recognition result is obtained indicating that a part of the user's body is not contained within the second guide object, the measurement process of the user's head transfer function is interrupted based on the recognition result. The first guide object and the second guide object are user interfaces used in the measurement process of the user's head transfer function. The aforementioned start notification information is at least one of the following: system utterance, message, jingle, light, message, image, or symbol. program.

Citation Information

Patent Citations

  • Photoelectric pulse wave type pulse measuring instrument

    JP2003169780A

  • Head transfer function measurement instrument

    JP2007251248A

  • Information processor and control method for information processor

    JP2015087695A

  • Information processing device and log-in control method

    JP2017091059A

  • Determining individualized head-related transfer functions

    US20120183161A1