Information processing apparatus, information processing method, and program

Abstract

The present invention provides an information processing apparatus including a control unit that dynamically controls output of information related to at least one operation area in which an identified operation object is located based on a position of the identified operation object, the information processing apparatus causing the control unit to control execution of a function of an apparatus corresponding to the operation area in which the identified operation object is located when the identified operation object is located in the operation area, the operation area being an area that is not visible to a user. The present invention also provides an information processing method in which a processor dynamically controls output of information related to at least one operation area in which an identified operation object is located based on a position of the identified operation object, and controls execution of a function of an apparatus corresponding to the operation area in which the identified operation object is located when the identified operation object is located in the operation area, the operation area being an area that is not visible to a user.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program. BACKGROUND

[0002] In recent years, a technology for causing an apparatus to output a sound to inform a user of information about a region has been developed. For example, in Patent Literature 1, a technology for guiding a user by informing the user of region information to be used as a movement path of the user using a sound wave emitted from a sound source apparatus is disclosed.

[0003] LIST OF CITATIONS

[0004] PATENT LITERATURE

[0005] Patent Literature 1: Japanese Patent Publication No. 2000-285378 SUMMARY

[0006] TECHNICAL PROBLEM

[0007] Meanwhile, in a case where a user performs an operation on an apparatus in a region in which the user cannot visually recognize, a situation in which the user cannot confirm whether an intended part in the region correctly performs an operation can occur. However, in the technology described in Patent Literature 1, a case where a user performs an operation on an apparatus in a region in which the user cannot visually recognize is not considered.

[0008] SOLUTION TO PROBLEM

[0009] According to the present disclosure, there is provided an information processing apparatus including a control unit that dynamically controls output of information associated with at least one operation region in which an identified operation object is located, based on a position of the identified operation object, wherein, in a case where the identified operation object is located in an operation region, the control unit controls execution of an apparatus function corresponding to the operation region in which the identified operation object is located, and the operation region includes a region that cannot be visually recognized by a user.

[0010] Further, according to the present disclosure, there is provided an information processing method including allowing a processor to dynamically control output of information associated with at least one operation region in which an identified operation object is located, based on a position of the identified operation object, and allowing the processor to control execution of an apparatus function corresponding to the operation region in which the identified operation object is located, in a case where the identified operation object is located in an operation region, wherein the operation region includes a region that cannot be visually recognized by a user.

[0011] In addition, according to the present disclosure, a program is provided for causing a computer to be used as an information processing device, the information processing device including a control unit that dynamically controls the output of information associated with at least one operation area where the identified operation object is located based on the position of the identified operation object, the control unit being configured to control the execution of a device function corresponding to the operation area where the identified operation object is located when the identified operation object is located in the operation area, and the operation area includes an area that cannot be visually identified by the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] [ Figure 1 ] is a diagram describing an overview of an information processing terminal according to the present disclosure.

[0013] [ Figure 2 ] is a diagram describing a functional configuration example of the information processing terminal 10 according to an embodiment of the present disclosure.

[0014] [ Figure 3 ] depicts a diagram describing an example of notification sound output control based on gesture type performed by the control unit 130 according to an embodiment.

[0015] [ Figure 4 ] depicts a diagram describing an example of notification sound output control based on the number of fingers of a user, performed by the control unit 130 according to an embodiment.

[0016] [ Figure 5 ] is a diagram describing an example of notification sound output control based on the moving direction of the operation object performed by the control unit 130 according to the embodiment.

[0017] [ Figure 6 ] depicts a diagram describing an example of notification sound output control based on the moving direction of an operation object performed by the control unit 130 according to the embodiment.

[0018] [ Figure 7 ] depicts a diagram describing an example of notification sound output control based on the moving direction of an operation object performed by the control unit 130 according to the embodiment.

[0019] [ Figure 8 ] depicts diagrams describing an example of changes in pitch and density of a notification sound output from a single sound source according to the present embodiment.

[0020] [ Figure 9 ] depicts a diagram describing an example of notification sound output control based on comparison of a movement distance of an operation object with a predetermined threshold value, performed by the control unit 130 according to the embodiment.

[0021] [ Figure 10FIG. 1 is a diagram depicting an example of an operation area according to an embodiment.

[0022] [ Figure 11 ] depicts a diagram depicting an example of notification sound output control performed by the control unit 130 according to an embodiment corresponding to an operation area in which an operation object is located.

[0023] [ Figure 12 ] depicts a diagram depicting an example of notification sound output control performed by the control unit 130 according to an embodiment in a case where it is predicted that an operation object is to be moved outside an operation area.

[0024] [ Figure 13 ] is a diagram depicting an example of notification sound output control performed by the control unit 130 according to an embodiment corresponding to each operation area.

[0025] [ Figure 14 ] is a diagram depicting an example of output sound volume control of notification sound performed by the control unit 130 according to an embodiment corresponding to each operation area.

[0026] [ Figure 15 ] depicts a diagram depicting a positional relationship between an operation object and a plurality of operation areas according to an embodiment and output control based on the positional relationship.

[0027] [ Figure 16 ] depicts a diagram depicting an example of notification sound output control associated with a reference area performed by the control unit 130 according to an embodiment.

[0028] [ Figure 17 ] depicts a diagram depicting an example of notification sound output control associated with a reference area whose position is optionally determined performed by the control unit 130 according to an embodiment.

[0029] [ Figure 18 ] is a diagram depicting an example in a case where an operation area exists in a space according to an embodiment.

[0030] [ Figure 19 ] depicts a diagram depicting an example in a case where a distance between an operation object and an information processing terminal 10 is indicated as an identification state, and execution control of a function associated with the information processing terminal 10 is performed by the control unit 130 according to an embodiment based on the distance.

[0031] [ Figure 20 ] depicts a diagram depicting an example in a case where an operation area exists in a space performed by the control unit 130 according to an embodiment.

[0032] [ Figure 21FIG. 1 is a diagram that describes an example of an operation flow of notification sound output control based on a comparison of a moving distance of an operation object and a predetermined threshold value and performed by the control unit 130 according to an embodiment.

[0033] [ Figure 22 FIG. 2 is a diagram that describes an example of an operation flow of notification sound output control based on a gesture type and performed by the control unit 130 according to an embodiment.

[0034] [ Figure 23 FIG. 3 is a diagram that describes an example of an operation flow of notification sound output control corresponding to an operation area and performed by the control unit 130 according to an embodiment.

[0035] [ Figure 24 FIG. 4 is a block diagram that shows an example of a hardware configuration of the information processing terminal 10 according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0036] Hereinafter, a preferred embodiment of the present disclosure will be described in detail with reference to the accompanying drawings. Note that in the present specification and the drawings, constituent elements having substantially the same function are denoted with the same reference signs, and therefore repetitive description thereof will be omitted.

[0037] Note that the description will be made in the following order.

[0038] 1. SUMMARY

[0039] 2. EMBODIMENT

[0040] 2.1. Example of functional configuration

[0041] 2.2. Specific examples

[0042] 2.2.1. Specific example 1

[0043] 2.2.2. Specific example 2

[0044] 2.2.3. Specific example 3

[0045] 2.2.4. Specific example 4

[0046] 2.2.5. Specific example 5

[0047] 2.2.6. Specific example 6

[0048] 3. OPERATION EXAMPLE

[0049] 4. Example of hardware configuration

[0050] 5. SUMMARY

[0051] <1. SUMMARY>

[0052] First, an outline of the present disclosure will be described below. In recent years, a technology for causing an information processing terminal such as a headphone, an earphone, or the like that is worn on a user's ear and outputs sound to execute a predetermined function by allowing the user to directly operate the information processing terminal has been developed. Such a technology makes it possible to execute a music playback processing, a music playback stop processing, or the like based on, for example, a touch operation to the information processing terminal, and enables further user-friendly operation that does not require any other device.

[0053] Further, for such an information processing terminal including a proximity sensor, a technology of causing a function corresponding to a predetermined gesture performed by a user's hand in a real space in which the proximity sensor can detect to be executed based on the gesture has also been developed. This technology makes it possible to execute a processing for volume control or the like based on, for example, a change in distance from the user's hand to the terminal in the real space, and thus enables further user-friendly operation that does not require any other device even for a headphone-type device for which it is difficult for the user to perform a direct touch operation.

[0054] However, for the operation for the terminal according to the above-described technology, the following situation can occur as described below.

[0055] First, an operation of a headphone or an earphone worn by a user can be performed at a portion that the user cannot visually recognize, such as a portion on a side surface (a housing surface) of a headphone. Therefore, the user cannot confirm whether a gesture that the user is performing is performed as intended by the user. Therefore, in a case where the terminal recognizes a gesture type different from a gesture type that the user wants, the situation can occur that the user notices that a different gesture type has been recognized at a stage where a function different from a function that the user wants has been executed.

[0056] Further, in a region where the user cannot visually recognize, the user cannot grasp which operation-performable portion the user's hand is located. Therefore, the situation can occur that the user cannot perform an intended operation. For example, when the user performs a sliding operation in a predetermined direction on a housing surface having a touch panel in a headphone, the situation can occur that, in a case where the user starts the sliding operation from an edge of the housing surface, an operation that is far enough cannot be performed. Further, in a case where an operation is performed based on a gesture in a space, the user U is not in contact with the terminal, and thus it is more difficult for the user to grasp a position where a gesture is performed in the space.

[0057] The technical idea of the present disclosure is generated in view of the above points, and the present disclosure aims to enable a user to confirm success / failure of each operation in a region where the user cannot visually recognize, and to perform more types of operations.

[0058] Here, reference will be made to Figure 1An overview of the information processing terminal 10 according to the present disclosure is described. Figure 1 is a diagram that describes an overview of the information processing terminal according to the present disclosure. Figure 1 The information processing terminal 10 is shown as being used as a headset and being worn by the user U.

[0059] In a case where a predetermined gesture operation of the hand H of the user U as an operation object is recognized in the operable region on the housing surface of the information processing terminal 10, the information processing terminal 10 executes a function corresponding to the recognized operation. Here, the information processing terminal 10 can notify information about the function corresponding to the gesture operation based on the recognition state about the operation object that is performing the predetermined gesture operation. Here, in a case where the information processing terminal 10 is a headset or an earphone, the information processing terminal 10 can notify the information about the function corresponding to the gesture operation by means of the output of sound. Figure 1 In the example shown, the notification of the information can be executed by means of the output of sound.

[0060] Further, the information processing terminal 10 can also recognize the position at which the hand H of the user U is present in the operation region and output information corresponding to the operation region in which the hand H of the user U is present. Here, in a case where the information processing terminal 10 is a headset or an earphone, the information processing terminal 10 can output the information corresponding to the operation region in which the hand H of the user U is present by means of the output of sound. Figure 1 In the example shown, the output of the information can be executed by means of the output of sound. Note that, in the present specification, hereinafter, an example in which the information processing terminal 10 is a headset or an earphone will be described.

[0061] <2. Embodiment>

[0062] "2.1 Function Configuration Example"

[0063] Subsequently, an example of the function configuration of the information processing terminal 10 according to the present embodiment will be described. Figure 2 is a diagram that describes an example of the function configuration of the information processing terminal 10 according to the present embodiment. The information processing terminal 10 includes an input unit 110, a recognition unit 120, a control unit 130, an output unit 140, a storage unit 150, and a communication unit 160.

[0064] (Input unit 110)

[0065] The input unit 110 receives various information. The input unit 110 receives, for example, an operation input from a user. The input unit 110 can include, for example, a touch panel on a housing surface to receive a touch operation from a user. The input unit 110 can detect contact of an operation object with the touch panel. Further, the input unit 110 can include a proximity sensor to detect an operation object located in a real space. Hereinafter, the region in which the input unit 110 can detect an operation object for operation will also be referred to as an operation region.

[0066] Here, the input unit 110 can include a microphone for capturing an external sound. An external sound signal captured by the microphone of the input unit 110 can be used for external sound canceling processing. Information received by the input unit 110 is transmitted to the recognition unit 120.

[0067] (The recognition unit 120)

[0068] The recognition unit 120 performs various recognition processes based on information transmitted from the input unit 110. The recognition unit 120 recognizes that a predetermined operation is being performed. Further, the recognition unit 120 has a gesture recognition function. The recognition unit 120 can recognize a slide on a touch pad or an execution of a gesture in a real space detectable by a proximity sensor based on a detection result of the touch pad or the proximity sensor. A recognition result of the recognition unit 120 is transmitted to the control unit 130 as a recognition state.

[0069] (The control unit 130)

[0070] The control unit 130 performs control on each constituent element of the information processing terminal 10.

[0071] Further, based on the recognition state about an operation object on which a gesture is performed in an operation area, the control unit 130 can dynamically control output of notification information about a function corresponding to the gesture. Here, as described above, the recognition state about the operation object is a recognition result that has already been recognized by the recognition unit 120. The control unit 130 controls output of the notification information according to various states included in the recognition state. Further, here, the notification information is information associated with a gesture being performed. The information associated with the gesture being performed is, for example, information that enables the user U to understand a type of the gesture that has already been recognized by the recognition unit 120. Further, the notification information is, for example, a notification sound.

[0072] In the present specification, hereinafter, an example in which the notification information is a notification sound will be described, but of course, the notification information can be represented by information other than sound information. Other examples of the notification information include vibration information and the like. The configuration in which the control unit 130 controls output of the notification information based on the recognition state enables the user U to confirm whether a gesture has been recognized as intended by the user U in an area in which the user U cannot visually recognize.

[0073] Further, the control unit 130 can control output of notification information associated with the operation region in which the operation object is located, on the basis of the position of the operation object indicated by the recognition state. Here, examples of the notification information associated with the operation region include information indicating whether or not the operation object is located in the operation region, information indicating in which operation region the operation object is located in the case where there are a plurality of operation regions, and the like. Note that, as described above, in the following description, it will be described that the notification information associated with the operation region is an example of notification sound associated with the operation region. The control unit 130 controls execution of a function corresponding to the operation region in which the operation object is located. Here, examples of the function include an output sound volume control function, a music forward function, a music backward function, and the like. The control unit 130 controls the configuration of the output of the information associated with the operation region in which the operation object is located so that the user U can confirm whether or not the operation is to be executed at a place where the user U wants.

[0074] For the notification sound output control by the control unit 130, specific examples will be described later.

[0075] (Output unit 140)

[0076] The output unit 140 outputs various information in accordance with the control of the control unit 130. The output unit 140, for example, causes a driver unit to output a sound. Examples of the sound output by the output unit 140 include the above-described notification sound. Further, the output unit 140 performs a predetermined function in accordance with the control of the control unit 130. Further, the output unit 140 can include an actuator to output notification information by means of vibration.

[0077] (Storage unit 150)

[0078] The storage unit 150 stores various information on the operation of the information processing terminal 10. The storage unit 150 can store, for example, sound source information to be used as a notification sound.

[0079] (Communication unit 160)

[0080] The communication unit 160 performs information communication with another device. For example, the communication unit 160 receives sound information from another device. The sound information that has been received by the communication unit 160 is output to the user U by the output unit 140 via the control unit 130, for example. Further, examples of the other device include a music player, a smart phone, and the like.

[0081] [2.2 Specific Examples]

[0082] Subsequently, specific examples of the notification sound output control performed by the information processing terminal 10 according to the present embodiment will be described.

[0083] [2.2.1. Specific Example 1]

[0084] First, the control unit 130 can dynamically control the output of the notification sound based on the gesture type of the gesture being performed by the operation object and indicated by the recognition state. Here, the gesture type refers to a type determined based on, for example, how the operation object moves in the operation area. In the case of a headset equipped with a touchpad, examples of the gesture type include horizontal direction sliding movement of the operation object on the touchpad, circle drawing movement of the operation object on the touchpad (such as movement while drawing a circle), and the like. The gesture type recognized by the recognition unit 120 is notified to the user U as the notification sound, so that the user U can confirm whether the gesture currently being performed is recognized by the information processing terminal 10 as a gesture intended by the user U. Furthermore, in the case where there is a function associated with the information processing terminal 10 and executed as a function corresponding to the gesture type, the user U can also confirm whether the gesture corresponding to the function intended by the user U is recognized.

[0085] In the following description, reference will be made to Figure 3 An example of the notification sound output control based on the gesture type performed by the control unit 130 according to the present embodiment will be described. Figure 3 A diagram describing an example of the notification sound output control based on the gesture type performed by the control unit 130 according to the present embodiment will be depicted. Figure 3 An information processing terminal 10 used as a headset and worn by a user U is shown.

[0086] In the left side area of Figure 3 , the user U's hand H as the operation object moves in the horizontal direction on the touchpad (flick movement). The recognition state indicates that the user U's hand H moves in the horizontal direction, and thus the control unit 130 causes the output unit 140 to output a notification sound corresponding to the horizontal direction movement.

[0087] In the right side area of Figure 3 , the user U's hand H is moving, as rotating on the touchpad. The recognition state indicates that the user U's hand H moves while drawing a circle, and thus the control unit 130 causes the output unit 140 to output a notification sound corresponding to the rotation movement. Here, the notification sound output from the output unit 140 is different from the notification sound output in the case of the left side area of Figure 3 .

[0088] In the right side area of Figure 3In the illustrated example, the case where the notification sound is output based on the type of the gesture being performed has been described, and in addition thereto, the control unit 130 can control the output of the notification sound based on the number of fingers of the hand H of the user U performing the gesture. This configuration makes it possible to output the notification sound corresponding to each number of fingers even when the user U is performing a similar gesture, thereby making it possible for the user U to confirm whether the gesture corresponding to the number of fingers intended by the user U is recognized.

[0089] In addition to the above, the control unit 130 can also output the notification sound based on the moving speed of the operation object performing the gesture. This configuration makes it possible to confirm the degree of change in the set value and perform a more detailed operation. Furthermore, in a case where the control unit 130 is unable to recognize the type of the gesture being performed, the control unit 130 can cause the notification sound corresponding to the preliminary operation of the gesture to be output until the recognition of the type becomes possible, and at the stage where the type recognition has been successfully performed, the control unit 130 can output the notification sound based on the type of the gesture being performed.

[0090] In the following description, an example of the notification sound output control based on the number of fingers of the user performed by the control unit 130 according to the present embodiment will be described with reference to Figure 4 Figure 4 A diagram describing an example of the notification sound output control based on the number of fingers of the user performed by the control unit 130 according to the present embodiment will be depicted. Figure 4 An information processing terminal 10 that serves as a headset worn by a user U is shown.

[0091] In the left side region of Figure 4 , one finger of the hand H of the user U moves in the horizontal direction (flick movement) on the touch panel. Here, the recognition state indicates that a gesture using one finger is being performed, and therefore the control unit 130 causes the output unit 140 to output a notification sound corresponding to such horizontal direction movement.

[0092] In the right side region of Figure 4 , two fingers of the hand H of the user U move in the horizontal direction on the touch panel. Here, the recognition state indicates that a gesture using two fingers is being performed, and therefore the control unit 130 causes the output unit 140 to output a notification sound corresponding to such horizontal direction movement. Here, the notification sound output from the output unit 140 is different from the notification sound output in the case of the left side region of Figure 4 .

[0093] ​In this way, the output notification sound is changed based on the type of gesture being performed and the number of fingers performing the gesture. Note that the control unit 130 can output the notification sound only in a case where the number of fingers of the user U serving as the operation object indicated by the recognition state is a predetermined number. For example, in the case of the example shown in FIG. 11, the control unit 130 can output the notification sound only in a case where the gesture using two fingers is being performed (i.e., when, for example, two fingers are in contact with the touch panel consecutively). This configuration enables the user U to grasp the number of fingers recognized more clearly. Figure 4

[0094] Here, when the operation object moves across the operation region, the control unit 130 can dynamically control the output of the notification sound based on the moving direction of the operation object indicated by the recognition state. Specifically, the control unit 130 can change the output characteristics of the notification sound based on the moving direction of the operation object indicated by the recognition state. The output characteristics of the notification sound here, for example, correspond to the frequency, pitch, density, volume, and the like of the notification sound. The configuration of outputting the notification sound based on the moving direction of the operation object enables the user U to confirm whether the operation object is moving as intended by the user U.

[0095] Here, an example of the notification sound output control based on the moving direction of the operation object performed by the control unit 130 according to the present embodiment will be described with reference to Figure 5 to Figure 7 Figure 5 to Figure 7 is a diagram describing an example of the notification sound output control based on the moving direction of the operation object performed by the control unit 130 according to the present embodiment.

[0096] Figure 5 A graph G1 indicating a change in the notification sound based on the moving direction of the operation object is shown. As shown in the graph G1, for example, the pitch of the notification sound can gradually increase as the operation object moves to the right, and the pitch of the notification sound can gradually decrease as the operation object moves to the left. Further, as shown in the graph G1, for example, the density of the sound output as the notification sound can gradually increase as the operation object moves upward, and the density of the sound output as the notification sound can gradually decrease as the operation object moves downward. Further, in a case where the operation region is indicated by the region PR, the pitch and density of the notification sound can be determined based on the position of the operation object in the region PR. The control unit 130 can output the notification sound in a manner following the movement of the operation object.

[0097] Figure 6 and Figure 7 An information processing terminal 10 serving as a headphone and worn by the user U is shown. Here, as shown in Figure 6 ​​As shown, in a case where the recognition unit 120 has recognized that the operation object is moving from the left side to the right side of the touch panel (i.e., from the rear side to the front side), the control unit 130 gradually raises the pitch of the notification sound. Further, as shown, in a case where the recognition unit 120 has recognized that the operation object is moving from the bottom side to the top side of the touch panel, the control unit 130 gradually increases the density of the notification sound. Figure 7 As shown, in a case where the recognition unit 120 has recognized that the operation object is moving from the left side to the right side of the touch panel (i.e., from the rear side to the front side), the control unit 130 gradually raises the pitch of the notification sound. Further, as shown, in a case where the recognition unit 120 has recognized that the operation object is moving from the bottom side to the top side of the touch panel, the control unit 130 gradually increases the density of the notification sound.

[0098] Meanwhile, the frequency and the volume of the notification sound can be determined based on the moving direction of the operation object. Specifically, in a case where the notification sound includes a single sound source, the pitch and the density of the notification sound can be determined based on the moving direction of the operation object. This notification sound including a single sound source is output so that the user U can more easily grasp the change in the notification sound. For example, the number of repetitions output by the single sound source is changed at the time of changing the predetermined set value so that the user U can further specifically grasp how the set value changes.

[0099] Here, an example of the change in the pitch and the density of the notification sound output from the single sound source according to the present embodiment will be described with reference to Figure 8 Figure 8 A diagram describing an example of the change in the pitch and the density of the notification sound output from the single sound source according to the present embodiment is depicted. Figure 8 Graphs G2 to G4 are shown. The graph G2 shows a state in which the single sound source is repeated. Further, compared to the graph G2, the graph G3 shows a state in which the single sound source is repeated in a manner that the density of the repeated single sound source is high. Further, compared to the graphs G2 and G3, the graph G4 shows a state in which the pitch of the single sound source is lowered.

[0100] [2.2.2. Specific Example 2]

[0101] Meanwhile, there is a device configured to allow a function to be executed in a case where the operation object has moved by a predetermined distance, and as an example of such a device, there is a smartphone configured to allow a slide operation on a touch panel by a predetermined distance on a lock screen to unlock. Similarly, in the information processing terminal 10 according to the present embodiment as well, the control unit 130 can dynamically control the output of the notification sound based on a comparison of the moving distance of the operation object with a predetermined threshold value. Specifically, the control unit 130 can dynamically control the output of the notification sound based on a difference between the moving distance of the operation object and the predetermined threshold value. Here, the moving distance of the operation object is the moving distance of the operation object in the operation region, and the predetermined threshold value can be a value preliminarily determined.

[0102] Here, an example of the change in the pitch and the density of the notification sound output from the single sound source according to the present embodiment will be described with reference to Figure 9 ​An example of the notification sound output control based on the comparison of the moving distance of the operation object with the predetermined threshold value performed by the control unit 130 according to the present embodiment will be described. Figure 9 A diagram describing an example of the notification sound output control based on the comparison of the moving distance of the operation object with the predetermined threshold value performed by the control unit 130 according to the present embodiment is depicted. Figure 9 A graph G5 indicating that the operation object is moved by a distance equal to or greater than a predetermined distance, and a graph G6 indicating the pitch of the notification sound corresponding to the moving distance shown in the graph G5 are shown. Further, Figure 9 A graph G7 indicating that the movement of the operation object has stopped before the operation object is moved by a distance equal to or greater than a predetermined distance, and a graph G8 indicating the pitch of the notification sound corresponding to the moving distance shown in the graph G7 are shown.

[0103] In each of the graphs G5 and G7, the horizontal axis corresponds to time, and the vertical axis corresponds to the position with respect to the reference, i.e., the initial position of the operation object. Further, in each of the graphs G6 and G8, the horizontal axis corresponds to time, and the vertical axis corresponds to the pitch of the notification sound. As shown in the graphs G5 and G7, the pitch of the notification sound is gradually raised with the movement of the operation object, and even after the moving distance exceeds the predetermined threshold value, similarly, the pitch of the notification sound can be raised. Note that, in the case where the moving distance of the operation object exceeds the predetermined threshold value, a function associated with the information processing terminal 10 can be executed.

[0104] On the other hand, as shown in the graphs G6 and G8, although the pitch of the notification sound is gradually raised with the movement of the operation object, the operation is ended before the moving distance exceeds the prescribed threshold value. In this case, as shown in the graph G8, the change in the pitch of the notification sound can be switched from upward change to downward change. Here, the pitch of the notification sound can be substantially the same as the pitch of the notification sound at the start of the operation of the operation object. Note that, since the moving distance of the operation object does not exceed the predetermined threshold value, the control unit 130 does not execute the above-described similar function.

[0105] By comparing the graph G6 and the graph G8, it can be found that the change manner of the pitch of the notification sound differs depending on whether the moving distance of the operation object exceeds the predetermined threshold value. Therefore, this distinction enables the user U to intuitively grasp whether the corresponding function is successfully executed. Note that, in the case where the moving distance of the operation object exceeds the predetermined threshold value, the function associated with the information processing terminal 10 can be executed. Figure 9 The notification sound output control described in the [2.2.2. Specific Example 2] is merely an example, and the present disclosure is not limited to this example.

[0106] [2.2.3. Specific Example 3]

[0107] Further, the control unit 130 can control the sound output associated with the operation region in which the operation object is located, based on the position of the operation object indicated by the recognition state. That is, the control unit 130 can give feedback to the user U about the position of the operation object, based on the position of the operation object indicated by the recognition state. For example, in the case where there are a plurality of operation regions, the control unit 130 can control the sound output based on which operation region the operation object is located in.

[0108] Here, an example of the operation region according to the present embodiment will be described with reference to Figure 10 FIG. 1. Figure 10 is a diagram describing an example of the operation region according to the embodiment. Figure 10 An information processing terminal 10 functioning as a headphone and worn by a user U, and two kinds of operation regions, i.e., an operable region OR and a non-operable region NOR, provided on a touch panel of the information processing terminal 10 are shown. Here, the operable region OR is a circular region operable by an operation object and visually unrecognizable by the user U. In Figure 10 , there are a plurality of operable regions OR, and in the case where an operation of the operation object is performed in any of the operable regions OR, the control unit 130 can control execution of a function associated with the information processing terminal 10 and corresponding to the operable region OR. On the other hand, the non-operable region NOR is a region in which the operation object cannot perform any operation. Of course, the arrangement and shape of each operable region OR and each non-operable region NOR are not limited to this illustrated example.

[0109] As described above, there can be a plurality of independent operation regions. In this case, the control unit 130 can control output of a sound corresponding to the operation region in which the operation object is located. The sound output here can be, for example, the notification sound described above. Here, an example of the output control of the notification sound corresponding to the operation region in which the operation object is located, performed by the control unit 130 according to the present embodiment will be described with reference to Figure 11 . Figure 11 is a diagram describing an example of the output control of the notification sound corresponding to the operation region in which the operation object is located, performed by the control unit 130 according to the present embodiment. Figure 11 An information processing terminal 10 functioning as a headphone and worn by a user U, and operation regions R1 to R4 are shown. Note that the operation regions R1 to R4 are regions similar to the operable regions OR shown in Figure 10 .

[0110] In Figure 11In the left side area of Figure 11 , the hand H of the user U as the operation object is located in the operation area R1. The recognition state indicates that the hand H of the user U is located in the operation area R1, and the control unit 130 causes the output unit 140 to output a notification sound corresponding to the operation area R1. Here, the notification sound output from the output unit 140 is different from the notification sound output in the case of Figure 11 , the right side of . In this way, in the case where a plurality of operation areas exist, the user U is able to grasp in which operation area the operation object is located without performing visual confirmation.

[0111] Meanwhile, the user U is unable to visually recognize the operation area, and thus the operation object can be unintentionally moved outside the operation area. Therefore, in a case where it is predicted from the recognition state that the operation object is to be moved outside the operation area, the control unit 130 can cause a notification sound to be output to notify the predicted movement outside the operation area.

[0112] Here, an example of the notification sound output control in a case where it is predicted by the control unit 130 according to the present embodiment that the operation object is to be moved outside the operation area will be described with reference to Figure 12 . Figure 12 A diagram describing an example of the notification sound output control in a case where it is predicted by the control unit 130 according to the present embodiment that the operation object is to be moved outside the operation area will be described. Figure 12 An information processing terminal 10 serving as a headset and worn by a user U, and operation areas R1 to R4 are shown.

[0113] In the left side area of Figure 12 , the hand H of the user U as the operation object is located in the operation area R1, as in the left side area of Figure 11 . Here, the control unit 130 causes the output unit 140 to output a notification sound corresponding to the operation area R1. In the right side area of Figure 12 , the hand H of the user U as the operation object is located in the operation area R2 and is in a state of moving from the operation area R2 to the outside. In this state, a notification sound for notifying that the operation object is predicted to be moved from the operation area R2 to the outside is output. In the right side area of Figure 12The notification sound output in the case where the right side region of the operation region OR1 is the region where the operation object is to be moved outside the operation region OR1 can be a warning sound for notifying the outside of the operation region of a warning about the predicted movement of the operation object. In this way, even in the case where the operation object is to be moved outside the operation region, the user U is able to correct the position of the operation object. Note that, regardless of the moving direction of the operation object, in the case where the operation object is located at a position inside the outer edge of the operation region and adjacent to the outer edge, this case can be regarded as the case where the operation object is predicted to be moved outside the operation region.

[0114] [2.2.4. Specific Example 4]

[0115] Thus far, an example of notification sound output control in the case where the notification sound output control is associated with only one operation region has been described. However, the control unit 130 can perform notification sound output control associated with a plurality of operation regions. Specifically, the control unit 130 can output notification sounds corresponding to respective operation regions based on the positional relationship between the operation object and the respective operation regions. For example, the control unit 130 can determine the volume, pitch, frequency, and the like of each notification sound to be output and corresponding to the respective operation regions based on the positional relationship between the operation object and the operation regions. The volume, pitch, frequency, and the like of each notification sound can be determined based on, for example, the distance to the respective operation regions. Furthermore, the control unit 130 can control the output of the notification sounds in such a way as to guide to a predetermined operation region.

[0116] Here, an example of output control of notification sounds corresponding to respective operation regions performed by the control unit 130 according to the present embodiment will be described with reference to Figure 13 Figure 13 is a diagram that describes an example of output control of notification sounds corresponding to respective operation regions performed by the control unit 130 according to the present embodiment. Figure 13 An information processing terminal 10 serving as a headphone and worn by a user U, and operable regions OR1 and OR2 are shown.

[0117] The control unit 130 causes notification sounds corresponding to the respective operable regions OR1 and OR2 to be output such that the shorter the distance from the operation object to the respective operable regions OR1 and OR2, the greater the volume of the notification sounds corresponding to the respective operable regions OR1 and OR2. In the example of Figure 13 In the example of, the position at which the hand H of the user U is in contact with the touch panel is a position closer to the operable region OR2 than to the operation region OR1. Therefore, the control unit 130 causes the notification sound corresponding to the operable region OR2 to be output at a volume greater than the volume of the notification sound corresponding to the operable region OR1.

[0118] ​This configuration that outputs the notification sound associated with the plurality of operation regions based on the positional relationship between the operation object and each of the operation regions enables the user U to grasp the relative positional relationship between the operation object and the plurality of operation regions.

[0119] Note that in a case where the operation region includes a real space and the input unit 110 detects the operation object by using a proximity sensor, the control unit 130 can cause the notification sound corresponding to such an operation region to be output based on the distance in the real space between the operation object and the operation region.

[0120] Here, an example of the output sound volume control of the notification sound corresponding to each operation region performed by the control unit 130 according to the present embodiment will be described with reference to Figure 14 Figure 14 is a diagram that describes an example of the output sound volume control of the notification sound corresponding to each operation region performed by the control unit 130 according to the present embodiment. Figure 14 has a horizontal axis corresponding to a position and a vertical axis corresponding to a volume, and illustrates a graph BG including boundary points LP and RP that are boundaries between the operation region and another region, respectively. The boundary points LP and RP are boundary points located at the boundaries of the operation regions having different from each other, and a region between the boundary points LP and RP is not included in the operation region. Further, an intermediate point M is located at a midpoint, and the distance from this midpoint to the boundary points LP and RP is equal.

[0121] In a case where the operation object is located between the boundary points LP and RP, the graph BG indicates a volume LB of the notification sound corresponding to the boundary point LP and a volume RB of the notification sound corresponding to the boundary point RP. As illustrated in the graph BG, the control unit 130 causes the notification sound to be output such that the closer the position of the operation object to each boundary point, the larger the volume of the corresponding one notification sound. Note that the sum of the volume LB of the notification sound corresponding to the boundary point LP and the volume RB of the notification sound corresponding to the boundary point RP is constant, so that the user U easily recognizes the change in the volume of each notification sound. In a case where the operation object is located at the intermediate point M, the volume of each notification sound is half of the maximum value.

[0122] This configuration that simultaneously changes the volumes of the plurality of notification sounds corresponding to the distance between the operation object and the plurality of operation regions enables the user U to intuitively recognize the position of the operation object.

[0123] Meanwhile, the control unit 130 can cause the information notified by the notification sound to change based on the positional relationship between the operation object and the set of the plurality of operation regions. For example, in a case where the operation object is located in a region between any of the plurality of operation regions, the control unit 130 can output, for example,​Figure 14 On the other hand, for example, in a case where the operation object is located in a region outside the regions in which the plurality of operation regions exist, the control unit 130 can output a notification sound for notifying that the operation object is located in a region outside the regions in which the plurality of operation regions exist, because it is preferable to move the hand H of the user U into the region in which the plurality of operation regions exist.

[0124] Here, the position relationship between the operation object and the plurality of operation regions and the output control associated with the position relationship according to the present embodiment will be described with reference to Figure 15 Figure 15 A diagram illustrating an example of describing the position relationship between the operation object and the plurality of operation regions according to the present embodiment is depicted. Figure 15 The hand H of the user U and the operable regions OR1 and OR2 are illustrated.

[0125] In the left region of Figure 15 , the hand H of the user U is located between the operable regions OR1 and OR2, and therefore the control unit 130 outputs the notification sounds corresponding to the respective operation regions based on the position relationship between the operation object and the respective operation regions. In the middle region of Figure 15 , the hand H of the user U is located within the operable region OR1, and therefore the control unit 130 outputs only the notification sound corresponding to the operable region OR1. In the right region of Figure 15 , the hand H of the user U is located outside the operation executable regions OR1 and OR2, and therefore the control unit 130 generates a notification sound notifying that the operation object is located outside the operable regions OR1 and OR2, which is different from the notification sound output when the operation object is located at the position illustrated in the left region of Figure 15 .

[0126] This configuration of varying the output notification sound based on the position relationship between the operation object and the plurality of operation regions enables the user U to perform the operation of the terminal more comfortably.

[0127] Note that the control unit 130 can notify the user U by sound only in a case where the operation object is located outside the operable regions OR1 and OR2. This configuration enables the user U to be warned further certainly in a case where the operation object has been located mostly outside the plurality of operation regions and in any other similar case. In addition, in a case where the information processing terminal 10 is a head-mounted display (HMD), the above-described notification can be applied thereto as a further specific warning.

[0128] [2.2.5. Specific Example 5]

[0129] ​Meanwhile, enabling the user U to grasp the configuration of the area (or point) that becomes the reference when the user U performs an operation using the operation object in an area in which the user U cannot visually recognize makes it possible to improve operability. For example, when the user U becomes unable to grasp the position of the hand H of the user U, the user is able to grasp the position of the hand H again by returning the position of the hand H to the area serving as the reference. Therefore, in a case in which it is recognized that the operation object is located in the reference area that is the reference for the operation of the operation object, the control unit 130 can control the output of the notification sound corresponding to the reference area.

[0130] Here, an example of the notification sound output control associated with the reference area performed by the control unit 130 according to the present embodiment will be described with reference to Figure 16 Figure 16 A diagram describing an example of the notification sound output control associated with the reference area performed by the control unit 130 according to the present embodiment will be depicted. Figure 16 An information processing terminal 10 that serves as a headset and is worn by a user U and a reference area SR are shown. In Figure 16 The reference area SR is an area that is determined in advance and is suitable as an operation start area.

[0131] In the left side area of Figure 16 , the hand H of the user U that is the operation object moves in the horizontal direction (flick movement) on the touch panel. The hand H of the user U is located outside the reference area SR. Here, since the hand H of the user U is not located in the reference area, the control unit 130 does not output any notification sound.

[0132] On the other hand, in the right side area of Figure 16 , the hand H of the user U is located in the reference area SR. The recognition state indicates that the hand H of the user U is located in the reference area SR, and the control unit 130 causes the notification sound corresponding to the reference area SR to be output.

[0133] This configuration of the control unit 130 causing the notification sound corresponding to the reference area SR to be output makes it possible to start an operation from the point that becomes the reference, and thereby enables more accurate operation to be implemented.

[0134] Note that in the example shown in Figure 16 , the control unit 130 does not output any notification sound in a case in which the operation object is not located in the reference area SR, whereas the control unit 130 can output the notification sound in a manner that guides to the reference area SR. For example, in a case in which a sliding operation in a predetermined direction is continuously performed, adopting a configuration in which the operation object returns to the reference area SR after performing a sliding operation in the predetermined direction once and then performs a sliding operation in the same direction again makes it possible to avoid a case in which the operation object deviates from the operation area and any other similar cases, thereby enabling the operation to be performed more deterministically. Note that the notification sound can be output in a manner that guides to the reference area SR by, for example,​Figure 16 The illustrated method realizes guidance of the notification sound to the reference region SR. Furthermore, the size of the reference region SR is not limited to the size as Figure 13 to Figure 15 illustrated.

[0135] Meanwhile, in the example illustrated in Figure 16 , the reference region SR exists in a portion determined in advance. However, in this regard, for a user U having a habit of performing an operation in a biased portion in the operation region only, the use of the reference region SR does not necessarily promote the operation. Therefore, the user U can determine a portion to which the reference region SR is to be set. Specifically, for such a reference region SR, a portion located in the operation region and in which the user U first starts an operation can be determined as the reference region SR. This configuration makes it possible to realize a more comfortable operation that is suitable for the operation habit of each user U.

[0136] Note that the "portion in which the user U first starts an operation" refers to, for example, a portion in which an operation object for performing one function is first located in the operation region, and the like. Alternatively, the "portion in which the user U first starts an operation" can be, for example, a portion in which an operation object is first located in the operation region when a plurality of operations are continuously performed. The definition of the "portion in which the user U first starts an operation" is not limited to the above-described example.

[0137] Here, an example of the notification sound output control associated with the reference region whose position is optionally determined, which is performed by the control unit 130 according to the present embodiment, will be described with reference to Figure 16 . Figure 17 A diagram that describes an example of the notification sound output control associated with the reference region whose position is optionally determined, which is performed by the control unit 130 according to the present embodiment, is depicted. Figure 17 An information processing terminal 10 that is used as a headphone and is worn by a user U is illustrated.

[0138] In the left side region of Figure 17 , a hand H of the user U as an operation object first comes into contact with the touch panel. At this time, there is no reference region SR. Here, the control unit 130 determines a portion with which the hand H of the user U first comes into contact as the reference region SR.

[0139] On the other hand, in the right side region of Figure 17 , a reference region SR determined by the control unit 130 is illustrated. Here, the control unit 130 causes a notification sound corresponding to the reference region SR to be output because it is indicated by the recognition state that the hand H of the user U is located in the reference region SR.

[0140] This configuration of the control unit 130 that determines the reference region SR when the user U starts an operation using the operation region makes it possible to realize a comfortable operation that is suitable for the habit of each user U.

[0141] [2.2.6. Specific Example 6]

[0142] Thus far, specific examples in which the information processing terminal 10 is a headset and one or more operation regions exist on the touch panel have been mainly described, but as described above, the information processing terminal 10 can be a headset. The headset serving as the information processing terminal 10 can include a touch sensor or a proximity sensor as the input unit 110. For a headset whose size is smaller than a headset, a case in which operation by the touch panel is difficult sometimes occurs, and thus operation within a space by the proximity sensor can be appropriate. In the following description, an example in which the headset includes a proximity sensor as the input unit 110 will be described. The in-space position of the operation object is recognized by the proximity sensor.

[0143] Figure 17 is a diagram that describes an example of a case in which an operation region exists in a space according to the present embodiment. Figure 18 The information processing terminal 10 serving as a headset and operation regions AR1 to AR4 existing in a space are illustrated.

[0144] As illustrated in Figure 18 , the operation regions AR1 to AR4 exist in a three-dimensional space, rather than on a touch panel. In a case in which an operation object exists in any one of the operation regions AR1 to AR4, the control unit 130 can control the output of the notification sound. Furthermore, based on the recognition state regarding the operation object performing a gesture in any one of the operation regions AR1 to AR4, the control unit 130 can dynamically control the output of the notification information associated with a function corresponding to the gesture.

[0145] In addition, in a case in which an operation region exists in a space, the distance between the operation object and the information processing terminal 10 can be detected by a proximity sensor. Therefore, in a case in which the distance between the operation object and the information processing terminal 10 is indicated as a recognition state, the control unit 130 can perform notification sound output control based on the distance.

[0146] Figure 18 is a diagram that describes an example of a case in which the distance between the operation object and the information processing terminal 10 is indicated as a recognition state, and execution control of a function associated with the information processing terminal 10 is performed by the control unit 130 according to the present embodiment based on the distance. Figure 19 The information processing terminal 10 serving as a headset and the hand H of the user U are illustrated.

[0147] As illustrated in the left region of Figure 19 , the hand H of the user U and the information processing terminal 10 are apart from each other by a distance D3. As illustrated in the right region of Figure 19the right region of FIG. 12, in a case where the recognition state indicates that the hand H of the user U has approached a position at which the distance D4 apart from the information processing terminal 10, that is, in a case where the recognition state indicates that the hand H of the user U is performing a gesture of approaching the information processing terminal 10, the control unit 130 performs the notification sound output control based on the distance change from the distance D3 to the distance D4. In Figure 19 In the example of FIG. 12, when the distance between the hand H of the user U and the information processing terminal 10 has changed from the distance D3 to the distance D4, the control unit 130 makes the volume of the notification sound output from the information processing terminal 10 louder.

[0148] In addition to this, the control unit 130 can control the output of the notification sound based on whether the operation object is located in the operation region. Specifically, the control unit 130 can control the output of the notification sound based on whether the operation object is located in the space that the input unit 110 can detect.

[0149] Here, an example of a case where the operation region is located in the space will be described with reference to Figure 19 by the control unit 130 according to the present embodiment. Figure 20 The information processing terminal 10 serving as earphones and the operation region existing in the space are shown.

[0150] In the left region of FIG. 13, the hand H of the user U as the operation object is located outside the space as the operation region. The recognition state indicates that the hand H of the user U is located outside the space as the operation region, and thus the control unit 130 does not output any notification sound. Figure 20 On the other hand, the hand H of the user U is located inside the space as the operation region. The recognition state indicates that the hand H of the user U is located inside the space as the operation region, and thus the control unit 130 causes the notification sound corresponding to the reference region SR to be output.

[0151] This configuration makes it possible to confirm whether the operation object is located inside the space as the operation region, thereby enabling the user U to grasp the operation region existing in the space that the user U cannot visually recognize.

[0152] Thus far, specific examples of the notification sound output control by the control unit 130 have been described. In the above description, an example in which the information processing terminal 10 is head-mounted earphones or earphones has been described, but the present disclosure is not limited to such an example. The information processing terminal 10 can be, for example, a touch panel for a vehicle. It is difficult for a driver to visually recognize the touch panel used in various operations while driving a car. At this time, with the information processing terminal 10 mounted on the back of the handle, the driver is notified of information by the notification sound and / or vibration, so that the driver can perform various operations.

[0153]

[0154] ​In addition, the information processing terminal 10 may be an autonomous vehicle, etc. The configuration in which the autonomous mobile body appropriately provides feedback through notification sounds and / or vibrations while the user U performs gesture operations on the autonomous mobile body enables the user U to enjoy the interaction with the autonomous mobile body to a greater extent. In addition, the above technology can also be applied to devices that provide virtual reality (VR) content. When using such VR content, the user U is often in a situation where the controller cannot be visually recognized, etc. Therefore, the above technology enables the user U to perform operations more accurately while listening to the notification sounds associated with the operation of the controller.

[0155] <3. Operation Example>

[0156] Then, reference will be made to Figure 20 and Figure 21 The operation flow of notification sound output control performed by the control unit 130 according to the present embodiment will be described.

[0157] First, refer to Figure 23 An example of the operation flow of the notification sound output control based on the comparison of the moving distance of the operation object with the predetermined threshold value, which is performed by the control unit 130 according to the present embodiment, will be described. Figure 21 First, the input unit 110 detects an operating object, and the recognition unit 120 recognizes the position of the detected operating object (S101). Next, the control unit 130 changes the pitch or frequency of the notification sound according to the movement distance of the operating object based on the position of the operating object recognized in step S101 (S102).

[0158] Next, if the movement distance of the operating object based on the position of the operating object identified in step S101 exceeds a predetermined threshold value (S103: Yes), the control unit 130 increases the frequency of the notification sound (S104), and the information processing terminal 10 ends the operation. On the other hand, if the movement distance of the operating object based on the position of the operating object identified in step S101 does not exceed the predetermined threshold value (S103: No) and the operation of the operating object has not yet ended (S105: No), the process returns to step S101.

[0159] On the contrary, when the moving distance of the operating object based on the position of the operating object identified in step S101 does not exceed the predetermined threshold (S103: No) and the operation of the operating object is ended (S105: Yes), the control unit 130 reduces the frequency of the notification sound (S106), and the information processing terminal 10 ends the operation.

[0160] Then, reference will be made to Figure 21 An example of the operation flow of notification sound output control based on gesture type performed by the control unit 130 according to the present embodiment is described. Figure 22, first, the control unit 130 performs preprocessing in a recognition process for recognizing an operation object (S201). Next, in a case where the operation object is located within the operation region (S202: YES), the control unit 130 starts receiving a gesture (S203).

[0161] Next, in a case where the preliminary operation of the gesture is not recognized by the recognition unit 120 (S204: NO), the flow returns to step S202. In contrast, in a case where the preliminary operation of the gesture has been recognized (S204: YES) and it has been recognized that a gesture is being made subsequently after the preliminary operation of the gesture (S205: YES), the control unit 130 controls output of the notification sound recognized in step S205 (S206), and the information processing terminal 10 ends the operation.

[0162] In contrast, in a case where the preliminary operation of the gesture has been recognized by the recognition unit 120 (S204: YES) and it has not been recognized that a gesture is being made subsequently after the preliminary operation of the gesture (S205: NO), the control unit 130 ends receiving the gesture (S207), and the information processing terminal 10 returns to step S201.

[0163] Next, an example of an operation flow of output control of a notification sound corresponding to an operation region performed by the control unit 130 according to the present embodiment will be described with reference to Figure 22 Figure 23 First, in a case where the operation object exists in the operation region (S301: YES), the control unit 130 causes the notification sound corresponding to the operation region to be output (S302), and the control unit 130 ends the operation.

[0164] In contrast, in a case where the operation object does not exist in any operation region (S301: NO) and there are a plurality of operation regions (S303: YES), the control unit 130 causes the pitch or frequency of the notification sound to change in accordance with the distance from the operation object to each operation region (S304), and the control unit 130 ends the operation. In addition, in contrast, in a case where the operation object does not exist in any operation region (S301: NO) and there is only one operation region (S303: NO), the control unit 130 causes the pitch or frequency of the notification sound to change in accordance with the distance from the operation object to the one operation region (S305), and the control unit 130 ends the operation.

[0165] <4. Hardware configuration example>

[0166] Next, a hardware configuration example of the information processing terminal 10 according to an embodiment of the present disclosure will be described. Figure 23 is a block diagram showing a hardware configuration example of the information processing terminal 10 according to an embodiment of the present disclosure. With reference to Figure 24 Figure 24 ​The information processing terminal 10 includes, for example, a processor 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, an output device 879, a storage 880, a drive 881, a connection port 882, and a communication device 883. Note that the hardware configuration shown here is merely an example, and part of the above-mentioned constituent elements can be omitted. Furthermore, one or more constituent elements other than the above-mentioned constituent elements shown here can be included.

[0167] (Processor 871)

[0168] The processor 871 functions as, for example, an arithmetic processing device or a control device, and controls all or part of the operations of the respective constituent elements on the basis of various programs recorded in the ROM 872, the RAM 873, the storage 880, or the removable recording medium 901.

[0169] (ROM 872 and RAM 873)

[0170] The ROM 872 is a device that stores programs to be read into the processor 871, data for arithmetic processing, and any other type of data. The RAM 873 temporarily or permanently stores, for example, programs to be read into the processor 871, various parameters appropriately changed at the time of executing the programs, and the like.

[0171] (Main host bus 874, bridge 875, external bus 876, and interface 877)

[0172] The processor 871, the ROM 872, and the RAM 873 are coupled to each other via the host bus 874 capable of realizing, for example, high-speed data transfer. On the other hand, the host bus 874 is coupled to the external bus 876 having, for example, a relatively low-speed data transfer capability, via the bridge 875. Furthermore, the external bus 876 is coupled to the respective constituent elements via the interface 877.

[0173] (Input device 878)

[0174] In the input device 878, for example, a mouse device, a keyboard, a touch panel, a button, a switch, a lever, and the like are used. Furthermore, as the input device 878, a remote controller (hereinafter, referred to as a remote control) capable of transmitting a control signal by using infrared rays or any other type of radio waves can be used. Furthermore, the input device 878 includes an audio input device such as a microphone.

[0175] (Output device 879)

[0176] The output device 879 is a device capable of visually or aurally notifying a user of acquired information, and includes a display device such as a cathode ray tube (CRT), an LCD, or an organic EL, an audio output device such as a speaker and a headphone, a printer, a mobile phone, a facsimile, and the like. Further, the output device 879 according to the present disclosure includes various vibration devices each capable of outputting a tactile stimulus.

[0177] (Memory 880)

[0178] The memory 880 is a device for storing various information. As the memory 880, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, and the like is used.

[0179] (Driver 881)

[0180] The driver 881 is a device for reading information recorded in or writing information into a removable recording medium 901 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0181] (Removable recording medium 901)

[0182] The removable recording medium 901 is, for example, a DVD medium, a Blu-ray (registered trademark) medium, an HD DVD medium, various semiconductor storage media, and the like. Of course, the removable recording medium 901 can be, for example, an IC card having a non-contact IC chip, an electronic device, and the like.

[0183] (Connect port 882)

[0184] The connect port 882 is a port for connecting an external connection device 902, and is, for example, a universal serial bus (USB) port, an IEEE 1394 port, a small computer system interface (SCSI), an RS-232C port, an optical audio terminal, and the like.

[0185] (External connection device 902)

[0186] The external connection device 902 is, for example, a printer, a portable music player, a digital camera, a digital video camera, an IC recorder, and the like.

[0187] (Communication device 883)

[0188] The communication device 883 is a communication device for connecting to a network, and is, for example, a communication card for wired or wireless LAN, Bluetooth (registered trademark), or wireless USB (WUSB), a router for optical communication, a router for asymmetric digital subscriber line (ADSL), a modem for various communications, and the like.

[0189] <5.SUMMARY>

[0190] As described above, the information processing terminal 10 according to the present embodiment enables the user to confirm success / failure of each operation in an area that the user cannot visually recognize, and to perform more types of operations.

[0191] Thus far, the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is apparent that a person skilled in the art can conceive various alteration examples or modification examples within the scope of the technical idea described in the claims of the present specification, and of course, it should be understood that the alteration examples and the modification examples also belong to the technical scope of the present disclosure.

[0192] Further, the effects described in the present specification are only informational or illustrative, and do not limit other effects. That is, in addition to or in place of the above effects, the technology according to the present disclosure can also bring about other effects apparent to those skilled in the art from the description of the present specification.

[0193] It should be noted that such a configuration described below also belongs to the technical scope of the present disclosure. (1)

[0195] An information processing apparatus comprising:

[0196] a control unit that dynamically controls output of information associated with at least one operation area in which the recognized operation object is located, based on a position of the recognized operation object,

[0197] wherein, in a case where the recognized operation object is located in an operation area, the control unit controls execution of an apparatus function corresponding to the operation area in which the recognized operation object is located, and

[0198] The operation area includes an area that cannot be visually recognized by the user. (2)

[0200] The information processing apparatus according to (1),

[0201] wherein the control unit dynamically controls output of a sound associated with the operation area in which the recognized operation object is located, based on the position of the recognized operation object. (3)

[0203] The information processing apparatus according to (2),

[0204] wherein the control unit dynamically controls the output of the sound further based on whether the position of the recognized operation object is in the operation area. (4)

[0206] The information processing apparatus according to (3),

[0207] wherein the control unit dynamically controls the output of the sound so that the operation object is guided to the operation region. (5)

[0209] The information processing apparatus according to any one of (2) to (4),

[0210] wherein the control unit dynamically controls the output of the sound based on a position of the recognized operation object with respect to a reference region serving as a reference for the operation of the operation object. (6)

[0212] The information processing apparatus according to (5),

[0213] wherein the control unit dynamically controls the output of the sound so that the recognized operation object is guided to the reference region. (7)

[0215] The information processing apparatus according to (5) or (6),

[0216] wherein, in a case where the position of the recognized operation object is in the reference region, the control unit dynamically controls the output of the sound so that the position of the recognized operation object is notified as being in the reference region. (8)

[0218] The information processing apparatus according to any one of (5) to (7),

[0219] wherein the control unit determines the position of the recognized operation object when the operation of the operation object is first started as the reference region. (9)

[0221] The information processing apparatus according to any one of (2) to (8),

[0222] wherein, in a case where there are a plurality of operation regions, the control unit dynamically controls the output of the sound corresponding to each operation region. (10)

[0224] The information processing apparatus according to (9),

[0225] wherein, in a case where the recognized operation object is moving, the control unit dynamically controls the output of the sound corresponding to each operation region further based on a moving direction of the recognized operation object. (11)

[0227] The information processing apparatus according to any one of (2) to (10),

[0228] wherein the control unit dynamically controls the output of the sound corresponding to each operation region further based on a positional relationship between the position of the recognized operation object and the position of each operation region. (12)

[0230] The information processing apparatus according to (11),

[0231] wherein the positional relationship with each operation region is a distance to each operation region, and the control unit dynamically controls the output of the sound corresponding to each operation region based on the distance from the recognized operation object to each operation region. (13)

[0233] The information processing apparatus according to any one of (2) to (12),

[0234] wherein the control unit dynamically controls the output of the sound so as to notify of the predicted movement of the recognized operation object in a case where it is predicted that the recognized operation object moves from inside of the operation region to outside of the operation region. (14)

[0236] The information processing apparatus according to any one of (2) to (13),

[0237] wherein the control unit dynamically controls the output of the sound further based on a spatial positional relationship between the recognized operation object and the information processing apparatus. (15)

[0239] An information processing method comprising:

[0240] allowing a processor to dynamically control output of information associated with at least one operation region in which a recognized operation object is located based on a position of the recognized operation object; and

[0241] in a case where the recognized operation object is located in an operation region, allowing the processor to control execution of a device function corresponding to the operation region in which the recognized operation object is located,

[0242] wherein the operation region includes a region that cannot be visually recognized by a user. (16)

[0244] A program for causing a computer to function as an information processing apparatus,

[0245] An information processing apparatus comprising:

[0246] a control unit that dynamically controls output of information associated with at least one operation region in which a recognized operation object is located based on a position of the recognized operation object,

[0247] In a case where the recognized operation object is located in the operation region, the control unit controls execution of a device function corresponding to the operation region in which the recognized operation object is located, and

[0248] The operation region includes a region that cannot be visually recognized by the user.

[0249] Reference mark list

[0250] 10: Information processing terminal

[0251] 110: Input unit

[0252] 120: Recognition unit

[0253] 130: Control unit

[0254] 140: Output unit

[0255] 150: Storage unit

[0256] 160: Communication unit

Claims

1. An information processing apparatus comprising: a control unit that dynamically controls output of information associated with at least one operation area in which an identified operation object is located, based on a position of the identified operation object, in a case where the identified operation object is located in an operation area, the control unit controls execution of an apparatus function corresponding to the operation area in which the identified operation object is located, wherein the operation area includes an area that cannot be visually recognized by a user, the control unit dynamically controls output of information associated with at least one operation area in which an identified operation object is located, based on an operation type of the identified operation object, a number of the identified operation objects, or a moving speed of the identified operation object, and the control unit further dynamically controls output of a first predetermined sound associated with a first operation area among the at least one operation area in which the identified operation object is located, based on a first position of the identified operation object, and controls output of a second predetermined sound associated with a second operation area among the at least one operation area in which the identified operation object is located, based on a second position of the identified operation object, the second operation area being different from the first operation area, the second predetermined sound being different from the first predetermined sound. 2.The information processing apparatus according to claim 1, wherein the control unit dynamically controls output of the sound further based on whether the position of the identified operation object is in the operation area. 3.The information processing apparatus according to claim 2, wherein the control unit dynamically controls output of the sound so as to guide the operation object to the operation area. 4.The information processing apparatus according to claim 1, wherein, the control unit dynamically controls output of the sound based on a position of the identified operation object with respect to a reference area serving as a reference for operation of the operation object. 5.The information processing apparatus according to claim 4, wherein the control unit dynamically controls output of the sound so as to guide the identified operation object to the reference area. 6.The information processing apparatus according to claim 4, wherein in a case where the position of the identified operation object is in the reference area, the control unit dynamically controls output of the sound so as to notify that the position of the identified operation object is in the reference area. 7.The information processing apparatus according to claim 4, wherein the control unit determines the position of the identified operation object when operation of the operation object is first started as the reference area. 8.The information processing apparatus according to claim 1, wherein in a case where a plurality of the operation areas exist, the control unit dynamically controls output of different sounds corresponding to each of the operation areas. 9.The information processing apparatus according to claim 8, wherein, in a case where the identified operation object is moving, the control unit dynamically controls output of the different sounds corresponding to each of the operation areas further based on a moving direction of the identified operation object.

10. The information processing apparatus according to claim 1, wherein The control unit dynamically controls output of a sound corresponding to each of the operation regions further based on a positional relationship between the position of the recognized operation object and a position of each of the operation regions.

11. The information processing apparatus according to claim 10, wherein, The positional relationship to each of the operation regions is a distance to each of the operation regions, and the control unit dynamically controls the output of the sound corresponding to each of the operation regions based on the distance from the recognized operation object to each of the operation regions.

12. The information processing apparatus according to claim 1, wherein In a case where it is predicted that the recognized operation object moves from inside of the operation region to outside of the operation region, the control unit dynamically controls the output of the sound so as to notify of the predicted movement of the recognized operation object.

13. The information processing apparatus according to claim 1, wherein The control unit dynamically controls the output of the sound further based on a spatial positional relationship between the recognized operation object and the information processing apparatus.

14. An information processing method comprising: allowing a processor to dynamically control output of information associated with at least one operation region in which a recognized operation object is located based on a position of the recognized operation object; and in a case where the recognized operation object is located in an operation region, allowing the processor to control execution of a device function corresponding to the operation region in which the recognized operation object is located, wherein the operation region includes a region that cannot be visually recognized by a user, dynamically controlling the output of the information associated with the at least one operation region in which the recognized operation object is located based on an operation type of the recognized operation object, a number of the recognized operation objects, or a moving speed of the recognized operation object, and further dynamically controlling output of a first predetermined sound associated with a first operation region of the at least one operation region in which the recognized operation object is located based on a first position of the recognized operation object, and output of a second predetermined sound associated with a second operation region of the at least one operation region in which the recognized operation object is located based on a second position of the recognized operation object, the second operation region being different from the first operation region, the second predetermined sound being different from the first predetermined sound.

15. A computer-readable storage medium storing a program that, when executed, serves to cause a computer to function as an information processing apparatus, The information processing apparatus includes: a control unit that dynamically controls output of information associated with at least one operation region in which a recognized operation object is located based on a position of the recognized operation object, in a case where the recognized operation object is located in an operation region, the control unit controls execution of a device function corresponding to the operation region in which the recognized operation object is located, and wherein the operation region includes a region that cannot be visually recognized by a user, The control unit dynamically controls output of information associated with at least one operation area in which the recognized operation object is located, based on an operation type of the recognized operation object, a number of the recognized operation objects, or a moving speed of the recognized operation object, and The control unit further dynamically controls output of a first predetermined sound associated with a first operation area among the at least one operation area in which the recognized operation object is located, based on a first position of the recognized operation object, and dynamically controls output of a second predetermined sound associated with a second operation area among the at least one operation area in which the recognized operation object is located, based on a second position of the recognized operation object, the second operation area being different from the first operation area, the second predetermined sound being different from the first predetermined sound.

Images