Information processing device, information processing method, and program

Abstract

To provide an information processing device that enables operation of a controlled device through rotating a ring worn on a finger, etc.SOLUTION: The information processing device comprises a control unit that performs processing to transmit information from a communication unit to an external device, based on a displacement operation in which the user moves a ring worn on a finger relative to the finger.SELECTED DRAWING: Figure 12

Description

Technical Field

[0001] This technology relates to an information processing apparatus, an information processing method, and a program, and particularly relates to user interface processing by a ring-shaped device worn on a finger.

Background Art

[0002] Devices that perform required information display or remotely operate electronic devices according to user operations and the like are known. The following Patent Document 1 describes a technology related to a user interface device as a wristwatch-type device.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As a device for operating an electronic device or presenting to a user, it is required to be more easily used, and to have easy operability, comfortable visibility, and the like.

[0005] Therefore, an object of the present disclosure is to propose a system using a ring-shaped device for a user interface.

Means for Solving the Problems

[0006] The information processing apparatus according to this technology includes a control unit that performs processing for causing a communication unit to transmit information based on a displacement operation in which a user moves a ring worn on a finger relative to the finger to an external device. The information based on the displacement operation performed on the ring is, for example, the detection information of the rotation amount when the ring is rotated, or the control information according to the detection information such as the rotation amount. That is, control information or detection information is transmitted to external devices such as a relay device and a controlled device according to the displacement operation such as the rotation of the ring or the movement in the direction of the finger (the direction in which the ring is inserted into and removed from the finger).

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Mode for Carrying Out the Invention

[0008] Hereinafter, the embodiments will be described in the following order. <1. Ring and System Configuration> <2. Device Configuration and Communication Processing> <3. Ring Processing> [3-1: Processing Example] [3-2: Prevention of Maloperation] [3-3: Various Notifications to the User] [3-4: Display Example in Information Display Mode] [3-5: Display Example in Device Control Mode] <4. Summary and Modification Examples>

[0009] <1. Ring and System Configuration> In the embodiment, a remote operation system including a ring-shaped information processing device worn on the user's finger, an information processing device as a relay device, and a controlled device which is an electronic device to be controlled is taken as an example. Note that the displacement operation referred to in the present disclosure is an operation in which the user relatively moves the ring worn on the finger with respect to the finger. Hereinafter, mainly the operation of rotating the ring will be described as an example of the displacement operation. However, the operation of moving the ring in the direction of inserting and removing it with respect to the finger is also included in the displacement operation.

[0010] FIG. 1 shows the ring 1. The ring 1 is formed of a ring-shaped main body 12, and a display portion 5 is formed on the outer peripheral surface side. In FIG. 1, an example is shown in which the time is displayed as "12:15" on the display portion 5.

[0011] The ring 1 is worn by the user on the finger. In the figure, the ring 1 shows a state where it is worn on the index finger of the user's left hand, but it is arbitrary which finger of which hand of the user wears it. Since the orientation of the ring 1 is required to detect the rotation direction, it is preferable to have the user wear it in accordance with the drawing or marker of the display portion 5. Alternatively, the orientation of the ring 1 may be automatically detected. For example, the orientation of the ring 1 can be determined by detecting the insertion direction with an optical sensor while capturing the gravitational acceleration with an acceleration sensor.

[0012] The ring 1 is formed of, for example, a metal material, but the material is not limited. In order to allow the user to arbitrarily rotate the ring 1 about the finger, a material that does not cause much friction is preferable. Alternatively, the inner peripheral surface side of the ring 1 may be coated with a material having an appropriate coefficient of friction. In any case, the ring 1 may have a material or structure that allows the user to rotate it moderately.

[0013] Rotating the ring 1 serves as an input for the user to perform operation control on the controlled device 100 (see FIG. 4). Considering cooperation with other devices, intuitive operations can be achieved by assigning the rotation operation of the ring 1 to operations such as volume up / down and scroll up / down. By combining operations such as the user's tap and swipe on the surface of the ring 1 and the operation of pinching the ring 1 (applying pressure), more versatile input becomes possible.

[0014] As shown in FIG. 2A, on the outer peripheral surface of the main body 12 of the ring 1, for example, a display portion 5 is provided over the entire circumference. For example, a display device such as an organic EL (Electroluminescence) display panel 5a is attached. Also, the display portion 5 may be configured such that, for example, as shown in FIG. 2B, multiple rows of LED (Light Emitting Diode) displays arranged in the circumferential direction are arranged. Furthermore, the display portion 5 may be configured such that, as shown in FIG. 2C, dot-like light emitting elements 5c (for example, LEDs) are arranged over the entire surface.

[0015] Also, the display portion 5 may be formed not on the entire outer peripheral surface of the ring 1 but on a partial region of the outer peripheral surface, for example, a region corresponding to a half circumference, or may be formed on a partial region in the width direction.

[0016] In addition to time and date, various information can be displayed on the display portion 5. For example, FIG. 3A shows an example where the counted value of the number of steps is displayed, and FIG. 3B shows an example where the remaining battery level is displayed. In addition to this, it is also assumed that biological information of the user such as heart rate, blood pressure, and body temperature is displayed. For such information display, various sensors are built into the ring 1.

[0017] These pieces of information may be drawn, for example, at a visible location for the user on the display portion 5 on the entire surface of the ring 1. For example, when worn on the left index finger as shown in FIG. 1, the area around the right side surface of the index finger is a position that is easy for the user to visually recognize. Therefore, a predetermined angular range including the right side surface of the index finger is set as the drawing area 5X in the display unit 5. The drawing area 5X is sequentially moved within the display unit 5 in accordance with the rotation of the ring 1, so that regardless of the rotation, the ring 1 itself controls the area change so as to be in a position that is easy for the user to visually recognize.

[0018] Normally, for example, the time is drawn in the drawing area 5X as shown in FIG. 1, but when rotated to the right (up), the number of steps is drawn in the drawing area 5X as shown in FIG. 3A. When further rotated to the right (up), the pulse is drawn in the drawing area 5X, and when further rotated to the right (up), the remaining battery level is drawn in the drawing area 5X as shown in FIG. 3B. When rotated to the left (down), the display returns to the pulse display. By switching the type of information content to be displayed in this way, the user can intuitively switch the display.

[0019] The setting of the drawing area 5X may be performed by detecting the user's viewing posture through initial settings or the like. For example, depending on whether the user wears the ring 1 on the finger of the left or right hand and which finger, the visible direction is different. Therefore, for example, the user puts on the ring 1 on the finger, takes a posture of looking at the display of the ring 1, and in that state, taps the visible part or the like. Thereby, the ring 1 estimates that the tap position in the current posture is the center of the drawing area 5X, and sets a predetermined direction range of the current posture as the drawing area 5X. For example, by performing such calibration at the time of wearing, the drawing area 5X corresponding to the user's viewing posture can be set.

[0020] In addition to the display of various types of information content as described above, the ring 1 functions as an operation device for the controlled device 100 as described above. FIG. 4 shows a configuration example of a remote control system.

[0021] The figure shows, for example, an air conditioner 101, a television receiver 102, and a smartphone 15. These electronic devices serve as controlled devices 100 corresponding to operations from the ring 1. In addition to those shown in the figure, for example, video devices, audio devices, communication devices, lighting devices, and various home appliances can also serve as the controlled device 100.

[0022] The ring 1 directly transmits information to the controlled device 100 according to user operations. For example, it transmits detection information of the rotation amount corresponding to the rotation operation of the ring 1 by the user, and control information including a control command corresponding to the rotation amount, etc. to the controlled device 100. In response, the controlled device 100 performs corresponding processing according to the user's intention. For the detection of the rotation amount, known gesture recognition methods using an acceleration sensor or a gyroscope, a body motion range model, and a ring motion range model can be used. Alternatively, an optical reflection reading sensor mounted inside the ring may sense the up, down, left, and right movement directions of the finger as seen from the ring. Since this corresponds to the insertion / removal movement or rotation movement direction of the ring as an operation, for the rotation direction, the rotation movement can be understood, and the integrated value of the movement amount can be detected as the rotation amount. Also, it is possible to detect the rotation amount, movement amount, etc. by performing AI learning that takes various sensor information as input and outputs the rotation amount, movement amount, etc.

[0023] Regarding the information transmission from the ring 1, devices such as the smartphone 15 may function as a relay device 110. The information based on the rotation operation of the ring 1 is transmitted to the controlled device 100 via the smartphone 15 that serves as the relay device 110. The relay device 110, for example, directly transmits the transmission information from the ring 1 to the controlled device 100, or generates control information including command information according to the transmission information from the ring 1 and transmits it to the controlled device 100. And the controlled device 100 performs corresponding processing according to the information from the relay device 110.

[0024] In such a system, for example, when considering the television receiver 102 as the controlled device 100, the user can increase / decrease the volume of the television receiver 102 or switch channels by rotating the ring 1.

[0025] If the air conditioner 101 is used as the controlled device 100, the user can increase / decrease the set temperature or adjust the air volume by rotating the ring 1.

[0026] When devices such as the smartphone 15 or the personal computer are used as the controlled device 100, they can be linked with application programs. For example, by assigning the rotation operation of the ring 1 to scroll up / down, intuitive scrolling operations can be performed on the application program. Or, during music playback, by assigning the rotation operation of the ring 1 to volume control, intuitive volume control can be achieved. Or, it is also possible to assign the rotation operation of the ring 1 to switch application programs, or assign the rotation operation of the ring 1 to tab switching on the browser. Also, for example, although a drum roll GUI (Graphical User Interface) may be used when entering numbers, by assigning the rotation of the ring 1 to rotate the drum, the user can operate intuitively. Also, moving the ring 1 in the direction of the finger (the direction of inserting and removing the finger) can be used as a horizontal selection operation for the drum roll GUI.

[0027] Also, operations other than the rotation of the ring 1 can be combined. For example, it is also possible to assign a swipe on the surface of the ring 1 to scrolling or assign a tap operation to a click operation.

[0028] In such a system, the user can perform intuitive operations by rotating the ring 1, and by combining with tapping, swiping on the surface of the ring 1, and the operation of pinching the ring 1 (applying pressure), more general and intuitive input becomes possible.

[0029] Moreover, since it involves up-and-down operations, its application range is wide. For example, it can be applied to all household appliances such as volume up / down and channel switching. It can also be applied to games. For example, in a game where a car is driven, it can also handle operations that require analog values such as the car's steering, accelerator, and brake.

[0030] Furthermore, by taking into account the rotation speed of Ring 1, it is also possible to achieve a more intuitive operation. For example, it is possible to detect rotation and rotation speed by combining a fingerprint sensor, a pulse sensor, an acceleration sensor, an angular velocity sensor, etc. It is assumed that the fingerprint sensor acquires fingerprints around the entire circumference for the first time, the acceleration sensor captures the gravitational acceleration and detects the difference therefrom, or the angular velocity sensor is used for detection.

[0031] Regarding the rotation operation of Ring 1, for example, if it is worn on the index finger, it can be rotated with the thumb. Even when worn on other fingers, it can be rotated using the other hand. However, as will be described later, in order to exclude misoperations, especially unconscious rotation operations, only rotation operations in a predetermined manner should be treated as valid operations.

[0032] When performing system operations, for example, at the first-time setting, the fingerprint sensor acquires fingerprints around the entire circumference of the finger. The user is asked to rotate it until the entire circumference can be obtained. When the touch sensor detects that the surface has been touched, the fingerprint sensor periodically reads the fingerprint, and the angle of Ring 1 is obtained from the fingerprints around the entire circumference stored in advance. Although it is conceivable that it may rotate without being touched, in that case, it is not treated as an operation.

[0033] Regarding the control inside Ring 1, for example, if it is the display control on the display unit 5, its behavior changes according to the angle, or the change amount of the angle, or the change amount of the angle per unit time. For example, the drawing content on the screen is changed.

[0034] When cooperating with other devices as a remote operation system, you may prepare a table of Keyboard Scan Codes in advance according to the amount of angle change or the amount of angle change per unit time, and send it to the device side via short-range wireless communication. For example, you can use the BT HID profile, which is a profile that enables input devices such as keyboards, mice, and game controllers to be wirelessly connected via Bluetooth (registered trademark) communication.

[0035] The existing Keyboard Scan Codes for scroll and volume control can be used to make them versatile. It is conceivable that the table can be updated via short-range wireless communication from a smartphone 15, a personal computer, or the like.

[0036] <2. Device Configuration and Communication Processing> An example of the configuration of the ring 1, the relay device 110, and the controlled device 100 will be described. FIG. 5 shows an example of the internal configuration of the ring 1.

[0037] The ring 1 has, for example, a control unit 2, a storage unit 3, a sensor unit 4, a display unit 5, a sound output unit 6, an input unit 7, a communication unit 8, a vibration unit 9, and a power supply unit 10 inside the main body 12. In the ring 1, not all of these units need to be provided. Also, a configuration part not shown in the figure may be provided.

[0038] The control unit 2 is composed of a processor such as a CPU (Central Processing Unit) provided in the ring 1, and performs processing within the ring 1. Specifically, the control unit 2 performs processing for display control and information transmission according to user operations and postures.

[0039] The memory unit 3 comprehensively represents a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile memory, etc., stores programs for the processing of the control unit 2 and necessary information, and is also used as a work area for arithmetic processing.

[0040] The sensor unit 4 indicates various sensors mounted on the ring 1. For example, an angular velocity sensor, an acceleration sensor, a direction sensor, a geomagnetic sensor, a fingerprint sensor, a touch sensor, a pressure sensor, a biological information sensor, a temperature sensor, an electrostatic sensor, etc. may be provided. Also, it may be possible to detect, by means of a barometric pressure sensor, a temperature sensor, a gas sensor, etc., the blowing of the user's breath, etc. Of course, sensors other than those exemplified may also be provided. The detection information from each sensor of the sensor unit 4 is supplied to the control unit 2. Thereby, the control unit 2 can acquire the information to be displayed on the display unit 5 and also acquire the operation information of the user.

[0041] The display unit 5 is composed of a display device provided on the outer peripheral surface of the ring 1 as described above. It can be configured as an organic EL display, an LED display, etc. The display unit 5 performs the drawing of various information in the drawing area 5X, for example, under the control of the control unit 2.

[0042] The sound output unit 6 is composed of a speaker and a power amplifier unit for driving the speaker, etc., and outputs, for example, electronic sounds and message voices in response to the instructions of the control unit 2.

[0043] The input unit 7 indicates a device for inputting, for example, sounds and images. Specifically, it is a microphone and a camera device. The voice signal and the image signal from the input unit 7 are input to the control unit 2. Thereby, the control unit 2 can perform voice analysis, image analysis, etc. to obtain the input information of the user operation. For example, the user's spoken voice, gestures, expressions, blinks, etc. can be treated as the input of the operation information. Also, a power switch, a reset switch, etc. may be provided as the input unit 7.

[0044] The communication unit 8 performs short-range wireless communication with the relay device 110 and the controlled device 100. For example, it is assumed to perform communication according to communication standards such as Bluetooth, Wi-Fi, and NFC (Near Field Communication). The communication unit 8 also functions for input of user operations. For example, the camera in the relay device 110 such as the smartphone 15 recognizes the user's gesture, and the relay device 110 is made to transmit detection information of a specific gesture. In this case, the input information can be acquired by the communication unit 8.

[0045] The vibration unit 9 is composed of a vibration device that makes the user perceive vibration. The vibration unit 9 generates vibration according to an instruction from the control unit 2. As a result, the user can perceive the vibration with the finger wearing the ring 1.

[0046] The power supply unit 10 extracts a power supply voltage for the operation of each unit from the battery 11 and supplies it to each unit.

[0047] Next, the configuration of the relay device 110 is shown in FIG. 6. For example, it is a configuration example as a smartphone 15, a personal computer, or the like.

[0048] As shown in FIG. 6, the relay device 110 includes a control unit 71, a ROM 72, a RAM 73, and a non-volatile memory unit 74. The control unit 71 is composed of a processor equipped with a CPU. The control unit 71 executes various processes according to a program stored in the ROM 52 or a program loaded from the storage unit 79 into the RAM 73. The RAM 73 also appropriately stores data and the like necessary for the control unit 71 to execute various processes.

[0049] The control unit 71, the ROM 72, the RAM 73, and the non-volatile memory unit 74 are interconnected via a bus 83. An input / output interface 75 is also connected to this bus 83.

[0050] The input / output interface 75 can be connected to an input unit 76, a display unit 77, an audio output unit 78, a storage unit 79, a communication unit 80, a drive 82, a sensor unit 84, a camera unit 85, and the like.

[0051] The input unit 76 means an input device used by a user who uses the relay device 110. Examples of the input device include a keyboard and a mouse. Of course, it is not limited to this, and for example, a touch panel or a touch pad integrally formed with the display unit 77 may also be used.

[0052] The display unit 77 is configured as a display device including a liquid crystal display panel or an organic EL display panel, and a drive circuit for these display panels. This display unit 77 may be integrated with the relay device 110 or may be a separate device. In the display unit 77, for example, in addition to screens by various application programs, screen displays for the associated operation with the ring 1 are performed.

[0053] The audio output unit 78 is composed of a speaker or a power amplifier unit for driving the speaker, etc., and performs necessary audio output.

[0054] The storage unit 79 is composed of, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive), etc., and stores various data and programs. For example, in the storage unit 79, programs for processing the relay device 110, storage of various application programs, storage of various data files, etc. are performed.

[0055] The communication unit 80 performs communication processing via a network including the Internet and communication with devices of each peripheral part. In the case of the relay device 110, the communication unit 80 executes communication with the ring 1 by short-range wireless communication and communication with the controlled device 100.

[0056] The input / output interface 75 is also connected to a drive 82 as necessary, and a removable recording medium 81 such as a memory card is mounted so that information can be written to and read from the removable recording medium 81.

[0057] The sensor unit 84 includes an angular velocity sensor, an acceleration sensor, a touch sensor, a distance measuring sensor, an illuminance sensor, and the like. The camera unit 85 includes a lens system, an image sensor, an imaging signal processing circuit, etc., and acquires imaging image data.

[0058] Subsequently, the configuration of the controlled device 100 will be described with reference to FIG. 7. The controlled device 100 includes a control unit 121, a communication unit 122, and a function unit 123.

[0059] The function unit 123 comprehensively shows a configuration for executing the functions of the controlled device 100 as specific devices. For example, in the case of an air conditioner 101, it is a configuration part for performing an air conditioning operation, and in the case of a television receiver 102, it is a configuration part for receiving and displaying a television broadcast.

[0060] The control unit 121 is composed of a processor including a CPU and controls the operation of the function unit 123. The communication unit 122 is shown as a configuration for performing short-range wireless communication with the ring 1 and the relay device 110 in this case. The control unit 121 controls the operation of the function unit 123 based on the information received by the communication unit 122.

[0061] An example of information communication among the above ring 1, relay device 110, and controlled device 100 will be described. FIG. 8 shows an example of communication processing among the ring 1, relay device 110, and controlled device 100.

[0062] The control unit 2 of the ring 1 detects the user's operation action in step S1 based on the information from the sensor unit 4 and the input unit 7. The control unit 2 mainly detects the rotation operation by the user. Note that the control unit 2 may also detect operation actions other than the rotation operation, for example, an operation of moving the ring 1 in the direction of inserting and removing it from the finger, a tap, a touch, a pinching operation, an operation of tracing the surface, an operation action such as voice, gesture, or blowing, but here an example of detecting the rotation operation will be described.

[0063] The control unit 2 of the ring 1 transmits the detected information to the relay device 110 in step S2. The transmission of the detected information here means directly transmitting the detection information by the sensor unit 4. For example, the rotation amount and rotation direction of the rotation operation are transmitted as the detection information.

[0064] When the relay device 110 receives the detected information in step S10, the control unit 71 acquires the control information corresponding to the detected information. For example, the relay device 110 has table data of control commands corresponding to the detected information in the non-volatile memory unit 74, etc., and acquires specific command information corresponding to the rotation amount and rotation direction, such as command information like "volume up" and "volume down". The information including the instruction of such control content is regarded as the control information.

[0065] The control unit 71 of the relay device 110 performs the process of transmitting the control information to the controlled device 100 in step S12. When the control unit 121 of the controlled device 100 acquires the control information in step S20, it performs the corresponding process in step S21. For example, if the controlled device 100 is a television receiver 102 and the content of the control information is "volume up", the control unit 121 will perform the corresponding process of increasing the volume on the functional unit 123.

[0066] Such an example in FIG. 8 is an example where the ring 1 transmits the detection information of the user operation to the relay device 110, the relay device 110 acquires and transmits the control information based on the detection information, and the controlled device 100 performs the corresponding process for the received control information.

[0067] Another example is shown in FIG. 9. When the control unit 2 of the ring 1 detects a user's operation action in step S1, it acquires control information corresponding to the detection information in step S5. For example, in the ring 1, the non-volatile memory in the storage unit 3 is provided with table data of control commands corresponding to the detection information, etc., and specific command information corresponding to the rotation amount and rotation direction, such as command information like "set temperature up" and "set temperature down" is acquired. Information including instructions of such control content is regarded as control information.

[0068] Then, the control unit 2 of the ring 1 transmits the control information to, for example, the relay device 110 in step S6. In the relay device 110, when the control information is received in step S15, the control unit 71 performs a process of transmitting the control information to the controlled device 100 in step S16.

[0069] As shown in the figure, the ring 1 may directly transmit control information to the controlled device 100 without going through the relay device 110.

[0070] When the control unit 121 of the controlled device 100 acquires the control information from the relay device 110 or the ring 1 in step S20, it performs corresponding processing in step S21. For example, if the controlled device 100 is the air conditioner 101 and the content of the control information is "set temperature up", the control unit 121 will perform corresponding processing to increase the set temperature for the functional unit 123.

[0071] Such an example in FIG. 9 is an example where the ring 1 acquires control information corresponding to the detection information of the user operation, and this control information is transmitted to the controlled device 100 via the relay device 110 or directly.

[0072] Although not shown in the figure, there are cases where the ring 1 transmits detection information to the relay device 110, and the relay device 110 transmits the detection information as it is to the controlled device 100, or cases where the ring 1 directly transmits the detection information to the controlled device 100. In this case, by providing the controlled device 100 side with a function of acquiring control information according to the detection information, the control unit 121 on the controlled device 100 side determines the command content according to the detection information of the rotation amount and rotation direction, and performs corresponding processing based on it.

[0073] <3. Processing of the Ring> [3-1: Example of Processing] Hereinafter, specific processing examples by the control unit 2 of the ring 1 will be described. First, in the ring 1, there are cases where various information content types such as time and biological information are displayed, and cases where it is used as an operation device for the controlled device 100. Also, in each case, there are examples where the function of controlling the controlled device 100 by rotation detection is turned on by a cooperating device, and examples where the control function for the controlled device 100 is usually turned off and turned on when the user uses the ring 1 for operation. There are also cases where the power on / off of the ring 1 itself is switched. Processing examples of the control unit 2 including the processing in each of these cases will be described.

[0074] For the sake of explanation, the operation state of displaying time, number of steps, biological information, battery remaining amount, etc. is called the "information display mode", and the operation state of performing an operation on the controlled device 100 is called the "device control mode". Also, the state where neither the processing in the information display mode nor the processing in the device control mode is performed is called the "standby mode".

[0075] FIG. 10 is a processing example in which the ring 1 is always powered on, usually in the standby mode, and the rotation detection of the ring 1 is turned on according to the situation. Turning on the rotation detection is for switching the information content type to be displayed by rotation detection in the information display mode. Also, when there is a start trigger for the device control mode, the rotation detection information is used for information transmission to the controlled device 100.

[0076] The control unit 2 of the ring 1 repeatedly executes the process of FIG. 10. First, in step S101, the control unit 2 determines whether the user has taken a visual recognition posture with respect to the ring 1. For example, based on detection information from the sensor unit 4 such as an angular velocity sensor, an acceleration sensor, an azimuth sensor, and a geomagnetic sensor, the control unit 2 determines whether the user is taking a posture of bringing the finger wearing the ring 1 close to the face.

[0077] If the visual recognition posture has not been taken, the process proceeds to step S110 to determine whether there is a device control start trigger. If neither the visual recognition posture is taken nor the device control start trigger is detected, the control unit 2 does not perform any particular display control or the like. Therefore, during the period when the user is not visually recognizing the ring 1 and the ring 1 is not used for controlling the controlled device 100, the ring 1 does not perform any display or transmission in the standby mode. This is suitable for reducing the consumption of the battery 11.

[0078] If it is determined in step S101 that the user has taken a visual recognition posture, the control unit 2 proceeds to step S102 and executes the process of the information display mode. That is, in the display unit 5, a display such as the time is executed in the range that becomes the drawing area 5X at that time. Also, the rotation angle detection is turned on. Turning on the rotation angle detection means that the rotation amount is also detected during rotation detection, and a predetermined process is performed according to the rotation amount. A detailed example of the process in the information display mode of this step S102 will be described later with reference to FIGS. 28, 30, and 32.

[0079] Also, in the case of the information display mode, the control unit 2 determines in step S103 whether a display switching operation has been performed by the user. Also, in step S104, the control unit 2 determines whether the visual recognition posture has ended. If the visual recognition posture has not ended, the process proceeds to step S102 via step S101 unless a device control start trigger is detected in step S110. That is, while the user is taking a visual recognition posture, the process of the information display mode is continued.

[0080] When the user performs a display switching operation such as a rotation operation in the information display mode, the control unit 2 proceeds from step S103 to step S105 and changes the type of information content to be displayed on the display unit 5 (drawing area 5X). For example, it switches from the time display that was being shown until then to a heart rate display or the like. For example, assuming that the drawing area 5X is a 60-degree range on the outer peripheral surface of the ring 1, each time the user performs a rotation operation exceeding 60 degrees, the type of information content to be displayed is changed.

[0081] Note that the switching operation of the information content type is not limited to a rotation operation of a predetermined rotation amount. For example, it may be by other operations such as a tap operation, an operation of moving the ring 1 in the direction of the finger (the direction of fitting on and removing from the finger), and a long-press operation.

[0082] In response to the switching of the type of information content to be displayed in step S105, the control unit 2 notifies the user of the switching by some presentation method in step S106. For example, it may cause the vibration unit 9 to execute vibration, or may cause the display unit 5 to perform a blinking display. Also, an electronic sound may be output. Thereby, the switching of the type of information content being displayed is clearly conveyed to the user.

[0083] When it is determined in step S104 that the user has ended the viewing posture in the information display mode, the control unit 2 turns off the information display on the display unit 5 in step S107. Also, at this time, the rotation angle detection is also turned off. Then, it returns to the standby mode for monitoring steps S110 and S101.

[0084] As the device control start trigger in step S110, for example, a command to use Ring 1 from an associated device as an operation device is assumed. The associated device may be the relay device 110 or the device to be controlled 100. For example, in a smartphone 15 or the like which is the relay device 110, when an application program for using Ring 1 as a remote operation device is started, a device control start trigger is transmitted to Ring 1. Alternatively, by setting the Ring corresponding mode in the device to be controlled 100, a device control start trigger may be transmitted from the device to be controlled 100 to Ring 1. Further, the control unit 2 may recognize a specific operation on Ring 1, for example, an operation such as touching with three fingers described later or a long-press operation, as a device control start trigger.

[0085] In response to the device control start trigger, the control unit 2 of Ring 1 proceeds to step S120 and performs device control mode processing. This device control mode processing will be described later with reference to FIG. 12. The control unit 2 notifies the user of the transition to the device control mode by means of presentation methods such as display, vibration, and sound. Also, the rotation angle detection is turned on. Then, as described with reference to FIGS. 8 and 9, the control unit 2 performs a process of transmitting detection information or control information corresponding to the rotation operation of Ring 1 to the relay device 110 or the device to be controlled 100.

[0086] When the device control mode is terminated by some end trigger, the control unit 2 proceeds to step S111, terminates the device control mode, and returns to the standby mode in which the monitoring of steps S110 and S101 is performed. Note that when performing step S111 to terminate the device control mode, the control unit 2 performs a process of turning off the rotation angle detection and a process of notifying the user of the termination of the device control mode by means of presentation methods such as display, vibration, and sound. In addition to executing the notification of the end of the device control mode on Ring 1, the control unit 2 may notify the relay device 110 of the end of the device control mode so that the relay device 110 can notify the user of the end.

[0087] As described above, the control unit 2 transitions from the standby mode to the information display mode based on the visual recognition posture, and also transitions to the device control mode based on the device control start trigger when in the standby mode or the information display mode. Further, when the information display mode or the device control mode ends, it returns to the standby mode.

[0088] Next, a processing example of turning on / off the power of the ring 1 and performing a control function for the controlled device 100 by a conscious operation of the user will be described with reference to FIG. 11. Note that during the power-off period, the display operation of the display unit 5, the information transmission operation, the rotation detection, the rotation angle detection, etc. are not performed, but the power supply from the power supply unit 10 to the minimum necessary parts is performed so that at least the detection of the power-on operation can be performed.

[0089] In step S130, the control unit 2 detects a power-on operation of the user, for example, in a state where the normal power is off. For example, a power switch is provided as the input unit 7, and the operation of the power switch is monitored. In particular, if no operation is detected, the control unit 2 maintains the normal power-off state.

[0090] When a predetermined power-on operation is recognized, the control unit 2 turns on the power and enters the standby mode, and performs the monitoring processes of step S131, step S132, and step S101.

[0091] In step S131, the control unit 2 monitors an intentional on-operation of the device control mode by the user. For example, the control unit 2 determines the following operation inputs based on information from the sensor unit 4, the input unit 7, etc.

[0092] · Detection of three taps on the surface of the ring 1 · Detection of applying a certain amount of force while pinching the ring 1 with two fingers · Detection of a long press on the surface of the ring 1 · Detection of an operation of shifting the ring 1 in the direction of the finger · Detection of a gesture, expression, blink, etc. in a predetermined manner · Detection of user voice such as "TV volume", "TV channel", "air conditioner temperature", "light brightness", etc.

[0093] The above is an example, and a predetermined user action is determined as an on-operation of the device control mode by the user. In addition, for example, the relay device 110 may execute detection of an intentional operation of the user, such as detection and analysis of speech sounds and gesture determination, and the relay device 110 may notify the ring 1 of the on-operation of the user.

[0094] If the on-operation of the device control mode is not detected, the control unit 2 determines whether there is a power-off trigger in step S132. The power-off trigger is generated, for example, when it is a user operation such as a power switch, or when a predetermined time has elapsed without any visual recognition or user action with respect to the ring 1.

[0095] If the power-off trigger is not detected, the control unit 2 determines whether it is a visual recognition posture in step S101. In this way, the monitoring processes of steps S131, S132, and S101 are executed as a standby mode.

[0096] When the control unit 2 detects an operation to turn on the device control mode as an intentional operation of the user in step S131, the control unit 2 proceeds to step S120 and performs the device control mode process. This device control mode process is the same as that in FIG. 10, and as will be described later with reference to FIG. 12, the control unit 2 notifies the user of the transition to the device control mode by a presentation method such as display, vibration, and sound. Then, as described in FIGS. 8 and 9, the control unit 2 performs a process of transmitting detection information or control information corresponding to the rotation operation of the ring 1 to the relay device 110 or the controlled device 100.

[0097] When the device control mode is terminated by some end trigger, the control unit 2 proceeds to step S111, terminates the device control mode, notifies the user of the termination of the device control mode by a presentation method such as display, vibration, and sound, and then returns to the standby mode for monitoring steps S131, S132, and S101.

[0098] If it is determined in step S101 that the user has taken a visual recognition posture, the control unit 2 proceeds to step S102 and executes the process of the information display mode. The processes of step S102 and subsequent steps S103 to S107 are the same as those in FIG. 10.

[0099] If the power-off trigger is detected in step S132, the control unit 2 proceeds to step S133, executes a power-off notification to the user, and turns off the power in step S134.

[0100] The processing examples in FIGS. 10 and 11 as described above are each an example. In the ring 1, necessary operations are performed while the standby mode, information display mode, and device control mode transition according to user operations, notifications from associated devices, user's line of sight, etc.

[0101] The processing example of the device control mode in step S120 in FIGS. 10 and 11 will be described with reference to FIG. 12. When transitioning to the device control mode as step S120, the control unit 2 starts the display for device control on the display unit 5 in step S200, and notifies the user of the start of the device control mode by means of display, sound, vibration, etc. Note that the control unit 2 may notify the relay device 110 of the start of the device control mode so that the relay device 110 executes the notification of the start of the device control mode to the user.

[0102] The display for device control is, for example, to end the display in the information display mode and perform a display indicating the device type and control content type of the device to be controlled 100. For example, the television receiver 102 or air conditioner 101, etc., which is the device to be controlled 100, is displayed by icons or characters, or the control content types such as volume up / down and set temperature up / down are displayed by characters or symbols.

[0103] Also in step S201, the control unit 2 turns on the rotation angle detection. That is, the detection of the rotation operation on the ring 1 and the corresponding calculations, etc. are started.

[0104] In step S202, the control unit 2 resets the cumulative angle counter of the rotation operation amount. Then, in step S203, the control unit 2 determines whether a significant rotation as an operation has been detected. For example, every time a rotation operation is detected, the rotation operation amount is counted by the cumulative angle counter. And when the value of the cumulative angle counter (the absolute value of the rotation amount α) exceeds a predetermined angle (β), it is determined that a significant rotation has been detected. Such detection of a significant rotation is continued while monitoring the end trigger of the device control mode in step S205.

[0105] When a significant rotation is detected, the control unit 2 proceeds to step S204 and performs the process of transmitting information to the relay device 110 or the controlled device 100. For example, the control unit 2 causes the communication unit 8 to transmit the detection information of the rotation amount (the detection information of the rotation amount α and the rotation direction), or the control information based on the detection information of the rotation amount, to the relay device 110 or the controlled device 100. Then, the control unit 2 resets the value of the cumulative angle counter in step S202 and monitors steps S203 and S205 again.

[0106] In step S205, the control unit 2 recognizes a predetermined operation intended by the user, such as the example of the turn-on operation of the device control mode described above, as an end trigger. Also, when a predetermined time has elapsed without the user performing a rotation operation, it may be recognized that an end trigger has occurred.

[0107] For example, the control unit 2 executes the process as shown in FIG. 12 above as the process of the device control mode. Thereby, in the processing examples of FIGS. 10 and 11, the ring 1 can function as a remote operation device for the controlled device 100.

[0108] Next, a display example in the information display mode in the processing of FIGS. 10 and 11 will be described. FIG. 13A shows an example in which the display unit 5 displays the time in the information display mode. In the lower part of FIG. 13A, the ring 1 around the finger, the display unit 5, and the drawing area 5X are schematically shown.

[0109] For example, when the ring 1 is worn on the index finger of the left hand, the range of the angle θ from the right side surface to the upper surface of the index finger is set as the drawing area 5X, and the time display is performed within this drawing area 5X. Figure 13B shows the state where the user has rotated the ring 1, and since the drawing area 5X on the display unit 5 has not changed, it is the state immediately before the drawing area 5X protrudes from the range of the angle θ. Up to this point, the time display continues.

[0110] When further rotation is performed, as shown in Figure 13C, the drawing area 5X on the display unit 5 is changed and returned to the range of the angle θ from the right side surface to the upper surface of the index finger. And the type of information content to be displayed is switched to, for example, the heart rate.

[0111] In this way, by changing the drawing area 5X on the display unit 5 according to the rotation of the ring 1 (and the display unit 5), information is always displayed at a position that is easy for the user to view, and various types of information can be viewed by rotation.

[0112] Note that in Figures 13B and 13C, an example of switching from the time display to the heart rate display is given. However, as shown in Figure 14, display control may be performed such that the heart rate display appears while the time display is maintained by rotation.

[0113] Also, as shown in Figure 15A, an indicator 21 whose visual position does not change due to the rotation of the ring 1 may be displayed. That is, by shifting the indicator 21 in the opposite direction by the amount of physical rotation of the ring 1, the indicator 21 is displayed at a fixed position as viewed by the user regardless of the rotation.

[0114] On the other hand, the display of the time, heart rate, etc. does not change the drawing position on the display unit 5 in particular. For this reason, as shown in Figure 15B, the position visible to the user changes according to the rotation of the ring 1. Then, for the user, the display information such as the time seems to be displaced with respect to the indicator 21. And when the display information exceeds the range of the indicator 21, the type of information content to be displayed is switched as shown in Figure 15C. In this way, it becomes easier for the user to recognize to what extent the rotation should be made to switch the information content type.

[0115] Next, examples of various notifications will be described. For example, when in the information display mode, the display of information such as time and heart rate itself serves as a notification to the user. However, when the device control mode is entered, during the device control mode, when the device control mode ends, etc., it is desirable to notify the user to that effect. For this reason, notifications are made in step S200 of FIG. 12, step S111 of FIGS. 10 and 11, etc.

[0116] For example, FIG. 16A shows a state where nothing is displayed in the standby mode. However, when transitioning to the device control mode, as shown in FIG. 16B, the entire display unit 5 is caused to blink for about 1 to 2 seconds. This presents to the user that the device control mode has been entered. Also, simultaneously or instead of blinking, an electronic sound may be output, a message voice such as "The TV volume has been set" may be output, or the vibration unit 9 may be caused to vibrate.

[0117] Also, during the device control mode, for example, as shown in FIG. 16C, by lighting or blinking a specific portion of the display unit 5, the user can be made to recognize that the device control mode is continuing. Also, an electronic sound may be output periodically.

[0118] When the device control mode ends, the end is also notified by causing the entire unit to blink, outputting an electronic sound or a message voice, vibrating, etc. This enables the user to recognize that the controlled device 100 has not been operated depending on the rotation of the ring 1.

[0119] [3-2: Prevention of incorrect operation] In addition to the processing examples shown in FIGS. 10, 11, and 12 above, the processing that can be adopted in the embodiments will be described. First, a processing example for preventing incorrect operations on Ring 1 will be described.

[0120] For example, when Ring 1 is worn on the index finger, the user may unconsciously touch and rotate Ring 1 with the thumb. It is desirable not to recognize such rotation as a valid operation.

[0121] First, consider incorrect operations. FIG. 17B shows a state where the thumb touches Ring 1 and rotates it. At this time, depending on the sensor unit 4 of Ring 1, such as an electrostatic sensor or a pressure sensor, as shown in FIG. 17A, since the left thumb and the left middle finger contact Ring 1, two contacts are detected on Ring 1.

[0122] FIG. 17C shows a state where the user consciously rotates Ring 1 using two fingers of the other hand. However, also at this time, as the detection information of the sensor unit 4, it is detected that the fingers are in contact with Ring 1 at two locations. That is, in the case of two contacts, it is difficult to determine whether the rotation is a conscious operation by the user.

[0123] Therefore, it is conceivable to regard an operation of three fingers by a hand other than the hand wearing Ring 1 as a valid operation. FIG. 18B shows a state where the user is rotating Ring 1 worn on the left index finger using the three fingers of the right thumb, index finger, and middle finger. In this case, as shown in FIG. 18A, as the detection information of the sensor unit 4, it is detected that the fingers are in contact with Ring 1 at three locations. Then, it can be distinguished from the case of rotating with the thumb as shown in FIG. 17B.

[0124] A processing example for preventing incorrect operations by such a method is shown in FIG. 19. FIG. 19 is a processing example of the device control mode in step S120 in FIGS. 10 and 11. Hereinafter, the same processing as the above-described processing example will be assigned the same step number, and duplicate detailed descriptions will be avoided.

[0125] When transitioning to the device control mode as step S120, the control unit 2 causes the display unit 5 to start displaying for device control in step S200, and notifies the user of the start of the device control mode by means such as display, sound, and vibration. Also, in step S201, the control unit 2 turns on the rotation angle detection, and in step S202, resets the cumulative angle counter of the rotation operation amount. The above is the same as in FIG. 12.

[0126] In step S211, the control unit 2 determines whether or not finger contact detection on the circumferential surface of the ring 1 is detected based on the detection information of the sensor unit 4. When no finger is detected, the determination in step S211 is continued while monitoring the end trigger of the device control mode in step S205.

[0127] When it is detected that a finger has touched, the control unit 2 proceeds from step S211 to step S212 and determines whether or not three or more contacts are detected on the circumferential surface of the ring. When one or two contacts are detected, the determinations in steps S211 and S212 are continued while monitoring the end trigger of the device control mode in step S205.

[0128] When three or more contacts are detected, the control unit 2 proceeds from step S212 to step S203 and determines whether or not a rotation amount significant as an operation is detected. For example, when the value of the cumulative angle counter becomes a value indicating a rotation amount for a predetermined angle, it is determined that a significant rotation is detected. If no significant rotation operation is detected, the above processes in steps S211, S212, and S203 are continued while monitoring the end trigger of the device control mode in step S205. Note that by determining three or more contacts in step S212, four or five contacts may be detected, but even in such a state, it can be estimated as a conscious operation, so there is no problem.

[0129] When three or more contacts, that is, significant rotation by an operation using three or more fingers, are detected, the control unit 2 proceeds to step S204 and performs the process of transmitting information to the relay device 110 or the controlled device 100. For example, the control unit 2 causes the communication unit 8 to transmit the detection information of the rotation amount and rotation direction, or the control information based on the detection information, to the relay device 110 or the controlled device 100. Then, the control unit 2 resets the value of the cumulative angle counter in step S202 and monitors steps S211 and S205 again.

[0130] In step S205, the control unit 2 monitors an end trigger due to a user's intentional predetermined operation, or the elapse of a predetermined time during no operation, or an end notification from an associated device. When the end trigger is recognized, the process of FIG. 19 is ended and the process proceeds to step S111 of FIG. 10 or FIG. 11.

[0131] By the above process, it is possible to prevent an incorrect operation in the device control mode. That is, it is possible to prevent the control of the controlled device 100 from being performed due to the user unconsciously rotating the ring 1.

[0132] [3-3: Various Notifications to the User] Subsequently, various examples regarding notifications to the user will be described. In the above-described processing example, regarding the device control mode, it was stated that notifications are made for the start of the device control mode, during the device control mode, and the end of the device control mode, respectively.

[0133] In the device control mode, the operating state in the controlled device 100, such as the set temperature of the air conditioner 101 or the reception channel of the television receiver 102, will be changed by the rotation operation of the ring 1. Therefore, it is appropriate for the user to clearly recognize that the ring 1 is in the device control mode or that the device control mode has ended.

[0134] Therefore, it is preferable to present the start or continuation of the device control mode, or to present which device is the controlled device 100, what type of control content it is, and so on.

[0135] For example, in FIG. 20A, when the display unit 5 of the ring 1 is formed by an array of LED displays 5b, the reference display 5bX and the relative display 5bR emit light to indicate that it is in the device control mode, and the control content type or the controlled device 100 is indicated by the position of the relative display 5bR with respect to the reference display 5bX.

[0136] Also, the amount of rotation operation can be represented by such a reference display 5bX and relative display 5bR. For example, when the ring 1 is rotated upward, the reference display 5bX changes to the lower LED display 5b so as to maintain a certain visible position, while the LED display 5b that is the relative display 5bR does not change and moves upward according to the rotation. As a result, the distance between the reference display 5bX and the relative display 5bR changes, and the amount of rotation operation is expressed. Alternatively, the number of LED displays 5b that are the relative display 5bR may increase according to the rotation operation.

[0137] Also, FIG. 20B shows an example in which when the display unit 5 is formed by an organic EL display panel 5a, the control content type of volume control and the rotation direction of volume up / down are shown. With these displays, it is easy for the user to recognize that it is in the device control mode, the controlled device 100, and the control content type and perform the rotation operation.

[0138] Note that the displays such as those in FIG. 20A and FIG. 20B should also be shifted by the same amount of rotation in the direction opposite to the rotation according to the rotation operation so that the user can always view them. Alternatively, when the rotation is stopped, the drawing area 5X may be moved to a position visible to the user.

[0139] Examples of audio notifications are shown in FIGS. 20C and 20D. For example, during the device control mode, an electronic sound is generated at regular intervals as shown in FIG. 20C. When the device control mode ends, a sound pattern that fades out as shown in FIG. 20D or a sound pattern that changes from a wide range to a low range in terms of frequency is generated. This makes it easier for the user to recognize the continuation or end of the device control mode.

[0140] Next, an example of a notification in response to a user's rotation operation in the device control mode will be described with reference to FIG. 21. FIG. 21 is an example of the processing of the device control mode in step S120 in FIGS. 10 and 11.

[0141] When transitioning to the device control mode as step S120, the control unit 2 causes the display unit 5 to start displaying for device control in step S200, and notifies the user of the start of the device control mode by means such as display, sound, and vibration. Also, in step S201, the control unit 2 turns on the rotation angle detection, and in step S202, resets the cumulative angle counter of the rotation operation amount. The above is the same as FIG. 12.

[0142] In step S220, the control unit 2 monitors whether there has been a rotation operation of the ring 1. During the period when no rotation operation is performed, the control unit 2 continues the determination in step S220 while monitoring the end trigger of the device control mode in step S205.

[0143] When it is detected that a rotation operation has been performed, the control unit 2 determines in step S221 whether the detection information by the various sensors of the sensor unit 4 can be correctly acquired. For example, it is determined whether the situation is such that correct sensing cannot be performed due to a finger being wet or the like. When it is determined that appropriate sensing cannot be performed, the control unit 2 proceeds to step S224 and performs a process of executing a notification of a sensing error. For example, an error display on the display unit 5, an error sound or an error message output by the sound output unit 6, and an error indication vibration by the vibration unit 9 are executed. Then, it proceeds to step S205.

[0144] When rotation is detected and there is no sensing error, the control unit 2 proceeds to step S223 and determines whether the operation is within the control range of the controlled device 100. For example, assume that the controlled device 100 is a television receiver 102 and the volume can be controlled from level 0 to level 30. In this case, if the current state is level 30 and a volume up operation is performed, further control is impossible. Similarly, when the volume down operation is performed when the current volume is level 0, control is also impossible.

[0145] In such a state, that is, when the operation corresponds to an operation exceeding the controllable range, the control unit 2 proceeds to step S225 and issues an error notification based on the control range. For example, it causes an error display on the display unit 5, outputs an error sound or error message by the sound output unit 6, and performs an error indication vibration by the vibration unit 9. Then it proceeds to step S205. Note that the control range does not have to be the entire controllable range of the controlled device 100. For example, even if the volume level of the television receiver 102 can be varied between "0" and "50", and the range that can be variably operated by the ring 1 is set from "20" to "30", an operation to lower below "20" will result in an error due to the control range.

[0146] If it is not particularly determined as an error in steps S221 and S223, the control unit 2 determines whether a significant rotation has been detected in step S203. If a significant rotation is detected, the control unit 2 proceeds to step S204 and performs the process of transmitting information to the relay device 110 or the controlled device 100. These steps S203 and S204 are the same as those in FIG. 12.

[0147] Also in step S205, the control unit 2 monitors an end trigger due to a user's intentional predetermined operation, or the elapse of a predetermined time with no operation, or an end notification from an associated device. When the end trigger is recognized, the control unit 71 ends the process of FIG. 21 and proceeds to step S111 of FIG. 10 or FIG. 11.

[0148] Through the above processing, when a sensing error or an error due to the control range occurs during a rotation operation in the device control mode, the user can be notified of the fact.

[0149] Next, an example of notifying an invalid rotation will be described. For example, when the processing in the information display mode is performed in step S120 of FIG. 10 or FIG. 11, the rotation angle detection is turned on as will be described later with reference to FIG. 28 or the like. Also, when the processing in the device control mode is performed in step S120, the rotation angle detection is turned on as described with reference to FIG. 12 or the like. The rotation angle detection being on here means a state in which rotation detection and rotation amount calculation are performed, and predetermined processing is performed according to the rotation amount. Even when the rotation angle detection is off, it is assumed that it is possible to simply detect that rotation has occurred. When the processing in the information display mode or the device control mode is completed, that is, when transitioning to the standby mode, it is desirable to turn off the rotation angle detection to save power.

[0150] However, for the user, they may not notice that they have entered the standby mode and may perform a rotation operation thinking that it is, for example, the device control mode. Therefore, when in the standby mode or the like, if it is detected that rotation has been performed with the rotation angle detection off, the user is notified to that effect.

[0151] FIG. 22 shows an example of the processing. In the standby mode or the like, the control unit 2 determines in step S300 whether the ring 1 has been rotated. If rotation is detected, the control unit 2 proceeds to step S303 and performs processing to notify the user that an invalid rotation has been performed by display, sound, vibration, or the like.

[0152] Note that even if rotation is not detected, the control unit 2 determines in step S301 whether the user has performed an operation to turn on the rotation angle detection consciously. In such a case, the control unit 2 determines in step S302 that the on operation has been performed. In response to this on operation determination, for example, a transition to the device control mode may be made.

[0153] Next, a processing example when changing the controlled device 100 or the type of control content in the device control mode will be described with reference to FIG. 23. For example, when the user performs a predetermined operation, the control unit 2 executes the processing of FIG. 23. For example, a reset button or the like is provided as the input unit 7, and when the user operates the reset button, the control unit 2 determines that a device / type change trigger has occurred in step S320.

[0154] Alternatively, an operation in a specific mode such as a tap operation with four fingers, a specific movement, a breath, a predetermined voice, or a user behavior that can be determined by an image may be set as a reset operation or the like, and it may be determined that a device / type change trigger has occurred.

[0155] When a device / type change trigger occurs, the control unit 2 proceeds to step S321 and enters the controlled device change mode. In this case, for example, the device currently set as the controlled device 100 is presented on the display unit 5. For example, the device types such as the air conditioner 101 and the television receiver 102 are displayed by name, device icon, or the like.

[0156] In this controlled device change mode, when the user rotates the ring 1, the displayed device type is switched, and the user may perform a confirmation operation in a state where the target device is displayed. Therefore, the control unit 2 determines whether the ring 1 has rotated in step S322. When rotation is detected, in step S323, a process of changing the display of the type of the controlled device 100 according to the rotation is performed.

[0157] In step S324, the control unit 2 monitors the user's confirmation operation. When a confirmation operation is detected, the control unit 2 sets the device currently being displayed as the new controlled device 100. Then, the control unit 2 proceeds to step S325 and transitions to the control content type change mode.

[0158] In the control content type change mode, the control unit 2 causes the display unit 5 to display one of the configurable control content types according to the determined device type of the controlled device 100. For example, if the television receiver 102 is the controlled device 100, "volume up / down", "channel up / down", "screen brightness up / down", etc. are possible control content types, and one of them is displayed.

[0159] In this control content type change mode, when the user rotates the ring 1, the displayed control content type is switched, and the user may perform a confirmation operation in a state where the target control content type is displayed. Therefore, the control unit 2 determines whether the ring 1 is rotated in step S326. When rotation is detected, in step S327, a process of changing the display of the control content type according to the rotation is performed.

[0160] In step S328, the control unit 2 monitors the user's confirmation operation. When a confirmation operation is detected, the control unit 2 sets the control content type being displayed at that time as the new control content type. Then, the control unit 2 proceeds to step S329 and performs a process of notifying the user of the set controlled device 100 and control content type, and in step S330, performs a mode transition, for example, returns to the mode immediately before the trigger was detected in step 320.

[0161] Through the above process, the user can arbitrarily set and switch the controlled device 100 and the control content type. Also, the set controlled device 100 and control content type can be confirmed by the notification in step S329.

[0162] FIG. 24A shows an example of a notification to the user. For example, among the LED displays 5b that make up the display unit 5, the controlled device 100 is represented by the emission color of the LED display 5b1 that is a specific position in terms of visibility, and the type of control content is represented by the emission color of the LED display 5b2. For example, when the emission color of the LED display 5b1 is red, the television receiver 102 is the controlled device 100, and when the emission color of the LED display 5b2 is green, it is volume up / down, etc. Also, the current volume level may be represented by the number of lit LED displays 5bZ arranged in the LED display 5b or the lit positions.

[0163] Note that in the display unit 5, the controlled device 100 and the type of control content may be displayed by characters, icons, etc. In addition to the display, a message voice such as "The volume of the TV has changed" may be output from the sound output unit 6.

[0164] FIG. 24B is an example of displaying the controlled device 100 and the type of control content on the smartphone 15 which is the relay device 110. For example, in step S329 of FIG. 23, the control unit 2 causes the relay device 110 to transmit the setting content. In response to this, the relay device 110 executes a screen display according to the information of the received setting content. Also, the relay device 110 may output a message voice such as "The volume of the TV has changed".

[0165] FIG. 24C is an example of the television receiver 102 which is the controlled device 100 displaying the setting. For example, assume that due to a setting change, the controlled device 100 becomes the television receiver 102 and the type of control content becomes volume up / down. The control unit 2 of the ring 1 transmits this information directly to the television receiver 102 or via the relay device 110 in step S329. In response to this, the television receiver 102 displays that it has become a state where it can adjust the volume with the ring 1. The television receiver 102 may also output a message voice such as "The volume can be adjusted with the ring".

[0166] So far, an example has been described in which the user selects the controlled device 100 and the control content type by the ring 1. However, it may be possible to make the selection with a relay device 110 such as the smartphone 15. For example, a selection screen as shown in FIG. 25 can be displayed by an application on the smartphone 15. For example, check boxes for selecting the controlled device 100 such as "TV", "Music", "Air conditioner", "Lighting", etc. are prepared. Furthermore, when the check box of the controlled device 100 is selected, a check box for the control content type is displayed. The figure shows an example in which the television receiver 102 is selected and volume up / down and channel up / down are displayed as the control content types. By using a relay device 110 such as the smartphone 15 in this way, it becomes possible to extremely easily select and switch the controlled device 100 and the control content type.

[0167] [3-4: Display example in the information display mode of the display unit] The information display on the display unit 5 of the ring 1 will be described. When displaying the time, heart rate, battery remaining amount, etc. in the information display mode, it is desirable to maintain good visibility for the user regardless of the rotation.

[0168] FIG. 26A shows an example in which the battery remaining amount is displayed on the display unit 5. On the right side, the ring 1 around the finger and the display unit 5 on the circumferential surface are schematically shown. Here, an example is shown in which the display unit 5 is formed not over the entire circumference of the ring 1 but in a range of about 1 / 3 of the circumference in order to make the explanation easier to understand. However, the following explanation is the same even when the display unit 5 is formed over the entire circumference. Also, in the case of FIG. 26A, a state is shown in which the drawing area 5X is located approximately at the center of the range of the display unit 5. The battery remaining amount is displayed in this drawing area 5X.

[0169] In the state shown in FIG. 26A, when the user views the ring 1, the remaining battery level is displayed at a position where it can be clearly viewed on the circumferential surface of the ring 1. When the ring 1 is rotated from this state, if the drawing area 5X in the display unit 5 is not changed, the display of the remaining battery level will become difficult to see as shown in FIG. 26B.

[0170] Therefore, when the user rotates the ring 1 upward from the state of FIG. 26A, as shown in FIG. 27A, the drawing area 5X in the display unit 5 is changed in the reverse direction. Then, the display of the remaining battery level can be viewed at substantially the same position as in FIG. 26A before rotation. Also, when the user rotates the ring 1 downward from the state of FIG. 26A, as shown in FIG. 27B, the drawing area 5X in the display unit 5 is changed in the reverse direction. Then, the display of the remaining battery level can be viewed at substantially the same position as in FIG. 26A before rotation.

[0171] That is, by changing the drawing area 5X in the direction opposite to the rotation direction, it is possible to prevent the visual position of the displayed information from changing. For the user, the display content will be easy to see regardless of the rotation operation.

[0172] An example of the control process for such a display is shown in FIG. 28. FIG. 28 is, for example, an example of the process within step S102 in FIGS. 10 and 11. Previously, an example was described in which the type of information content to be displayed is switched by rotating the ring 1 in the information display mode. Here, for example, it is assumed that the switching of the type of information content detected in step S103 in FIGS. 10 and 11 is an operation other than rotation, such as a tap operation or an operation of shifting the ring 1 in the direction of the finger. An example in which the type of information content is also switched by a rotation operation will be described later with reference to FIG. 32.

[0173] As the process of step S102 in FIGS. 10 and 11, as shown in FIG. 28, the control unit 2 performs control to execute information display on the screen in step S401. For example, according to the default display settings, the time and the like are displayed. Or, if the type of information content is switched in the process of step S105 in FIGS. 10 and 11, that information content is displayed.

[0174] In step S403 of FIG. 28, the control unit 2 turns on the rotation angle detection. If it is already on, the rotation angle detection on is continued. In step S404, the control unit 2 resets the cumulative angle counter of the rotation operation amount. Then in step S405, the control unit 2 determines whether or not it has detected contact of a finger with the circumferential surface of the ring 1.

[0175] If no finger is in contact, the process proceeds from step S405 to step S103 in FIG. 10 or FIG. 11. Although an example in which three or more fingers are used for valid operation has been given above for preventing misoperation, this is for the case of the device control mode, and in the information display mode, such a restriction may not be provided particularly. For example, operation with one finger or operation with two fingers may also be valid. This is because in the information display mode, it does not affect the misoperation of the controlled device 100.

[0176] During the period when the user's finger is touching the circumferential surface of the ring 1, the control unit 2 determines in step S406 whether or not the absolute value of the rotation amount α exceeds a predetermined rotation amount β. If |α|>β is not satisfied, the process returns to step S405. Therefore, while the user is touching the ring 1 and performing a rotation operation, the determination in step S406 is made.

[0177] When |α|>β, the control unit 2 proceeds to step S407 and shifts the display information on the display unit 5 by the rotation amount α in the direction opposite to the rotation direction for display. That is, the drawing area 5X is shifted by the rotation amount α in the direction opposite to the rotation direction. This causes the display in the states shown in FIGS. 27A and 27B to be executed. Then the control unit 2 proceeds to step S103 in FIG. 10 or FIG. 11.

[0178] By the processing of FIG. 28 above, in the information display mode, regardless of the rotation of the ring 1, the time, heart rate, battery remaining amount, etc. are displayed at a substantially fixed position visually. If the predetermined rotation amount β is set to a value corresponding to the angle of one pixel of the display unit 5, the visual position is also fixed.

[0179] Next, an example of making it easier for the user to recognize the amount of rotation will be described. FIGS. 29A and 29B show an example of displaying the indicator 21. The indicator 21 is displayed in a graduated manner at both ends of the circumferential surface of the ring 1, for example.

[0180] Note that the display mode of the indicator 21 is not limited to a graduated manner and can be considered in various ways. The indicator 21 may be displayed on the entire display unit 5 or a part thereof, but the display position (pixels to be displayed) is fixed, and the visual position changes according to the rotation of the ring 1. The specific shape, color, etc. of the indicator 21 may be anything. For example, it may be a pattern, a background image, etc.

[0181] For example, the graduated indicator 21 is visually recognized by the user as the graduations move according to the rotation of the ring 1 without changing the display position in the display unit 5. As a result, it becomes easier for the user to recognize the amount of rotation.

[0182] FIG. 30 shows an example of processing. FIG. 30 is also an example of the processing in step S102 of FIGS. 10 and 11. When the information display mode is set, the control unit 2 causes the information display layer to display information such as the time in step S410. In this example, the information display layer and the indicator UI layer are set in the display unit 5, and each is controlled separately for display.

[0183] The control unit 2 turns on the rotation angle detection in step S403, resets the cumulative angle counter in step S404, and determines the contact of a finger with the circumferential surface of the ring 1 in step S405. If no finger is in contact, the process proceeds from step S405 to step S412, the indicator UI layer is made non-displayed, and the process proceeds to step S103 of FIG. 10 or FIG. 11. Therefore, when the user simply assumes a viewing posture and looks at the display content such as the time, the indicator 21 is not displayed.

[0184] While the user's finger is touching the circumferential surface of the ring 1, the control unit 2 causes the indicator UI layer to be displayed in step S411. That is, the indicator 21 is displayed. Then, in step S406, it is determined whether the absolute value of the rotation amount α exceeds a predetermined rotation amount β.

[0185] When |α|>β, the control unit 2 proceeds to step S407A, and shifts the display information of the information display layer on the display unit 5 by the rotation amount α in the direction opposite to the rotation direction and displays it. That is, the drawing area 5X is shifted by the rotation amount α in the direction opposite to the rotation direction, and display information such as time is drawn. Thereby, the display in the state shown in FIGS. 29A and 29B is executed. At this time, the display pixels of the indicator UI layer are not shifted. Then, the control unit 2 proceeds to step S103 in FIG. 10 or FIG. 11.

[0186] Therefore, for the user, when the ring 1 is rotated, the indicator 21 moves according to the rotation, but the time, heart rate, etc. are displayed at a fixed position in terms of visual recognition. Thereby, in the information display mode, regardless of the rotation of the ring 1, the time, heart rate, battery remaining amount, etc. are displayed at a fixed position in terms of visual recognition, and the rotation operation amount can also be easily recognized by the indicator 21.

[0187] Next, an example will be described in which the information display position such as time is kept at a fixed position in terms of visual recognition even with rotation, and the type of information content displayed by the rotation is switched.

[0188] FIG. 31B shows a state in which the remaining battery amount is displayed on the display unit 5. In this case, it is assumed that the region substantially in the center within the range of the display unit 5 is the drawing area 5X. When the user rotates the ring 1 upward from this state, up to a certain rotation amount, the drawing area 5X of the remaining battery amount is shifted in the direction opposite to the rotation, so that the display position of the remaining battery amount is visually recognized as not changing. When the user further rotates the ring 1 upward beyond a certain rotation amount, the type of information content displayed as shown in FIG. 31A is switched. For example, the time is displayed.

[0189] Also, when the user rotates the ring 1 downward from the state of FIG. 31B, until a certain amount of rotation, the drawing area 5X of the battery remaining amount is shifted in the direction opposite to the rotation, so that the display position of the battery remaining amount is visually recognized as unchanged. And when the user rotates the ring 1 further downward beyond a certain amount of rotation, the type of information content displayed as shown in FIG. 31C is switched. For example, the heart rate is displayed.

[0190] An example of the process for performing such a display is shown in FIG. 32. FIG. 32 is also an example of the process in step S102 of FIGS. 10 and 11. When the information display mode is set, the control unit 2 causes the display unit 5 to execute information display such as time in the drawing area 5X in step S401.

[0191] The control unit 2 turns on the rotation angle detection in step S403, resets the cumulative angle counter in step S404, and determines in step S405 whether a finger touches the circumferential surface of the ring 1. If no finger is in contact, the process proceeds from step S405 to step S103 of FIG. 10 or FIG. 11. In this case, in step S103, a display switching operation is monitored as some operation other than the rotation operation of the ring 1.

[0192] While the user's finger is touching the circumferential surface of the ring 1, the control unit 2 determines in step S406 whether the absolute value of the rotation amount α exceeds a predetermined rotation amount β. When |α|>β, the control unit 2 proceeds to step S407A and causes the display information of the information display layer in the display unit 5 to be shifted by the rotation amount α in the direction opposite to the rotation direction and displayed. That is, the drawing area 5X is shifted by the rotation amount α in the direction opposite to the rotation direction, and the display information such as time is drawn.

[0193] Furthermore, the control unit 2 determines in step S420 whether the absolute value of the rotation amount α exceeds a second predetermined rotation amount γ. Assume that γ>β. If |α|>γ is not satisfied, the control unit 2 returns to step S405. When it is determined that |α| > γ, the control unit 2 determines that the display switching operation by the ring rotation has been performed, and proceeds to step S105 in FIGS. 10 and 11 to perform a process of changing the type of information content to be displayed.

[0194] By the above-described processing, in the information display mode, regardless of the rotation of the ring 1, the display such as the time is performed at a fixed position in terms of visual recognition, and when the ring is rotated relatively many times, the type of information content to be displayed is switched.

[0195] An example of making the rotation amount until the switching of the type of information content to be displayed easier to understand will be described. In FIG. 33A, an example is shown in which the drawing area 5X is at approximately the center of the display unit 5 and the remaining battery level is displayed. In this case, in the display unit 5, as described with reference to FIG. 30, the information display layer and the indicator UI layer are provided for display. And it is assumed that the display is switched from the state where the remaining battery level is displayed as in FIG. 33A to the state where the heart rate is displayed as in FIG. 33B.

[0196] FIGS. 34A, 34B, and 34C illustrate the display states of the information display layer L1 and the indicator UI layer L2 at the time of this display switching. Actually, the displays of the information display layer L1 and the indicator UI layer L2 overlap and are visually recognized. On the information display layer L1, the reference line 22 is displayed together with the display of the remaining battery level or the like. Since this reference line 22 is shifted in the direction opposite to the rotation together with the display of the remaining battery level or the like when the ring 1 is rotated, the position in the user's visual recognition does not change. On the other hand, on the indicator 21 in the indicator UI layer L2, a boundary line 21a is displayed at a predetermined position. Since the indicator 21 including this boundary line 21a does not change the display position (display pixel), it is visually recognized as rotating in accordance with the rotation of the ring 1.

[0197] Therefore, when the user rotates the ring 1 from the state of FIG. 34A, the displays of the information display layer L1 and the indicator UI layer L2 become as shown in FIG. 34B, and the boundary line 21a approaches the reference line 22. And when the boundary line 21a reaches the reference line 22 as shown in FIG. 34C for example, the type of information content to be displayed is switched to, for example, the heart rate.

[0198] For example, when the type of information content to be displayed is switched by a rotation operation as in FIG. 32 described above, by combining the display of the indicator 21 as in FIG. 30 described above and displaying the boundary line 21a and the reference line 22, it becomes easy for the user to know how much to rotate until the switching.

[0199] [3-5: Display Examples in Device Control Mode] Next, display examples in the device control mode will be described. Each of the various display examples illustrated below is a display example that the control unit 2 appropriately executes on the display unit 5, or a display example that the control unit 71 executes on the display unit 77 in the relay device 110.

[0200] When operating the controlled device 100, it is desirable for the user to clearly recognize the rotation direction of the ring 1. For example, it is the same as the recognition of the up direction and the down direction such as volume operation and temperature setting operation, and the rotation direction of the ring 1. Therefore, it is advisable to make the direction and the amount of rotation visible by color or numerical value during rotation.

[0201] FIG. 35A is an example showing the rotation direction by color in a specific area 5X1 in the display unit 5. The specific area 5X1 is not a specific pixel or pixel area, but a specific position in terms of the user's visual recognition. That is, the specific area 5X1 is shifted in the opposite direction according to the rotation of the ring 1 within the display unit 5 so as to appear at a fixed position to the user.

[0202] When, for example, there is no rotation in the device control mode, green is displayed in the specific area 5X1. When the user rotates it in the upward direction of the numerical value to be operated (such as volume up, set temperature up, etc.), the color of the specific area 5X1 is changed to red. When the user rotates it in the downward direction of the numerical value to be operated (such as volume down, set temperature down, etc.), the color of the specific area 5X1 is changed to blue. When the rotation is stopped, it returns to green. By indicating the rotation direction by color in this way, the control direction for the controlled device 100 can be presented to the user.

[0203] Also, as shown in FIG. 35B, a second specific area 5X2 may be provided, and the rotation angle may be displayed in the specific area 5X2 so that how much it has been rotated is displayed. Furthermore, as shown in FIG. 35C, in response to the rotation, the specific area 5X2 may be expressed by the numbers 1 to 12 of the clock from the 1 o'clock direction to the 12 o'clock direction, and thereby the rotation position can be displayed.

[0204] While displaying such a rotation direction and rotation position, when the rotation amount for changing the control value such as volume up / down is performed, that is, the rotation amount detected as a significant rotation in FIG. 12 is performed and information transmission is performed, an electronic sound or vibration may be generated to notify the user that one-step control is being performed.

[0205] Also, the rotation direction may be notified by sound. For example, when rotating in the upward direction, a sound that gradually changes to a higher frequency may be generated, and when rotating in the downward direction, a sound that gradually changes to a lower frequency may be generated.

[0206] Next, an explanation will be given on presenting the operable rotation directions. The operable rotation direction refers to the rotation direction in which a rotation operation is an effective operation within the range from the upper limit to the lower limit in the control value of the controlled device 100. For example, if the volume level of the television receiver 102 is at the lower limit value, further volume down cannot be performed. For example, rotation in the down direction becomes an ineffective operation. Therefore, the currently effective rotation direction as the current operation is to be displayed.

[0207] For example, as shown in FIG. 36A, a specific area 5X1 of the display unit 5 is used. When the up direction is red and the down direction is blue, if both the up operation and the down operation are currently effective, as shown in FIG. 36B, the display color of the specific area 5X1 is changed alternately between red (R) and blue (B). If only the up direction is effective, as shown in FIG. 36C, the display color of the specific area 5X1 is continuously set to red (R). If only the down direction is effective, as shown in FIG. 36C, the display color of the specific area 5X1 is continuously set to blue (B).

[0208] Next, an example of guiding the user regarding the rotation direction and rotation speed will be explained. When there is an appropriate rotation direction or an appropriate rotation speed is assumed as the rotation operation for the operation of the controlled device 100, the user's rotation is guided.

[0209] As shown in FIG. 37A, a specific area 5X3 is provided in the display unit 5. And in the specific area 5X3, as shown in FIG. 37B, the lighting position is changed at a predetermined speed. In this case, the direction of change of the lighting position is the guide for the rotation direction, and the speed of change of the lighting position is the guide for the rotation speed. FIG. 37B is an example of guiding rotation in the down direction. By such a guide display, the user can be made to perform an appropriate rotation operation.

[0210] Next, an example of presenting the existence of matters that can be operated or selected on the side of the controlled device 100 and the situation due to the operation will be explained. For example, assume that Ring 1 discovers that it can perform short-range wireless communication with television receiver 102 and that television receiver 102 can be a controlled device 100. In this case, in, for example, the above-described specific area 5X1 in display unit 5, a blinking blue (B) display as shown in FIG. 38A is executed. This is to notify the user that the television receiver 102 can be controlled to turn on the power, etc.

[0211] Suppose the user performs a rotation operation on Ring 1 in response to this and turns on the power of television receiver 102. In this case, specific area 5X1 is switched from blinking to a lit blue (B) as shown in FIG. 38B.

[0212] FIG. 39A shows a case where there are multiple operable contents. For example, in specific area 5X1 of display unit 5, different colors, for example, blue (B), red (R), and green (G) are sequentially switched. In this case, blue, red, and green are assumed to indicate specific selection states, respectively. This display shows a situation where, for example, switching operations among three modes in controlled device 100 can be performed by a rotation operation of Ring 1.

[0213] Suppose the user performs an operation to select the mode corresponding to blue by a rotation operation. In this case, for example, the display of specific area 5X1 is as shown in FIG. 39B. This is to keep blue lit for a long time and red and green lit for a short time, thereby presenting a state where the mode corresponding to blue is selected. It may also be as shown in FIG. 39C. The hatched lines in the figure represent a low-brightness display. That is, by repeatedly emitting blue at high brightness, red at low brightness, and green at low brightness in specific area 5X1, a state where the mode corresponding to blue is selected is presented.

[0214] Next, an example of setting the control range by rotation of Ring 1 will be described. For example, for each device type of controlled device 100, the range that can be controlled by rotation of Ring 1, the step width of change, etc. may be arbitrarily set.

[0215] FIG. 40 shows an example of a setting screen when an application corresponding to Ring 1 is launched on the smartphone 15 which is the relay device 110. For example, with respect to device types of the controlled device 100 such as a television receiver 102, an audio device, an air conditioner 101, a lighting device, etc., the horizontal axis represents the control range, and the slope represents the change width (sensitivity) of the control value corresponding to the rotation operation.

[0216] For example, regarding the volume level of the television receiver 102, when the minimum value is level 0 and the maximum value is level 50, the range that can be controlled by rotating Ring 1 can be set to be from level 15 to level 35, etc. Also, the change amount, that is, the sensitivity corresponding to the rotation of Ring 1 can be set according to the slope of the control range.

[0217] The user can adjust the control range and sensitivity by Ring 1 by performing a setting operation to change the size and shape of the blacked-out part of the figure on the screen of the smartphone 15. Regarding the rotation of Ring 1, by restricting the control range, it is possible to prevent the controlled device 100 from being unnecessarily operated by random rotation. For example, it is possible to avoid a situation where the volume level of the television receiver 102 becomes excessive by operating Ring 1 unnecessarily.

[0218] FIG. 41A and FIG. 41B are examples in which the relay device 110 and Ring 1 cooperate to set the control range and the rotation amount of Ring 1.

[0219] For example, on the smartphone 15, a screen display as shown in FIG. 41A is performed, and the user can set the control range within the volume setting range (for example, from level 0 to level 50) for volume setting of the television receiver 102. For example, it is set to be from level 20 to level 30, etc.

[0220] At this time, the user is requested to perform a one-step rotation operation on Ring 1. When the user operates Ring 1 by one step (for one level), Ring 1 notifies the rotation amount to the smartphone 15. Thereby, the smartphone 15 recognizes the rotation amount of one step and presents the rotation amount corresponding to the range from the set level 20 to level 30 as shown in FIG. 41B.

[0221] For example, by doing so, an operation of one step corresponding to the user's rotation operation is recognized on the system, and based on the rotation amount, volume up / down control can be performed. Also, the user can grasp how much the entire rotation operation amount of the control range is.

[0222] In addition, the control content types for each device type of the controlled device 100 that are assumed to be performed by the rotation operation of Ring 1 are exemplified.

[0223] In the case of the television receiver 102, there are reception channel switching, volume level adjustment, brightness adjustment, color adjustment, etc. In the case of the air conditioner 101, there are setting temperature adjustment, mode (heating, cooling, dehumidification, air supply) selection, air volume adjustment, etc. In the case of audio equipment, there are volume level adjustment, song selection, song skipping, playback speed (fast forward, rewind), etc. In the case of lighting equipment, there are lighting color selection, brightness adjustment, etc.

[0224] When the smartphone 15 is used as the controlled device 100 instead of the relay device 110, the control content types may include application selection, window transition, selection of various setting values, mode selection, volume level adjustment, etc.

[0225] Also, examples that can be controlled by the rotation operation of Ring 1 can be variously considered in device types and control content types not exemplified above.

[0226] <4. Summary and Variation Examples> According to the above embodiments, the following effects can be obtained.

[0227] In the embodiment, the ring 1 and the relay device 110 are given as examples of the information processing apparatus. The ring 1 includes a control unit 2 that performs a process of causing the communication unit 8 to transmit information based on a rotation operation performed on the ring 1 worn on the user's finger to an external device. The relay device 110 includes a control unit 71 that performs a process of causing the communication unit 80 to transmit information based on a rotation operation performed on the ring 1 worn on the user's finger to an external device. These information processing apparatuses such as the ring 1 and the relay device 110 perform a transmission process of detection information or control information based on a rotation operation on the ring 1. As a result, an environment in which the controlled device 100 is operated by operating the ring 1 worn on the user's finger can be realized.

[0228] The ring 1 which is the information processing apparatus according to the embodiment is formed by an annular main body 12 that can be worn on the user's finger. Inside the main body 12, a control unit 2, a communication unit 8, and a sensor unit 4 that detects a rotation operation are provided. That is, it is an information processing apparatus as the ring 1 that includes the control unit 2, the communication unit 8, and the sensor unit 4 inside the main body 12 and transmits detection information of rotation or control information based on the detection information in response to a rotation operation of the user. The ring 1 is configured to transmit detection information of the rotation operation of the main body 12 and control information based on the detection information of the rotation operation to an external device. That is, as the ring 1, an information processing apparatus that functions as an operation device is realized.

[0229] Although the ring 1 is configured to detect a rotation operation as a displacement operation by the user, it may be configured to detect an operation of shifting the main body 12 in the direction of the finger (the direction in which the ring 1 is inserted and removed from the finger) as a displacement operation, and transmit detection information and control information based on the operation. In that case, an operation of moving the ring 1 in the direction of fitting it onto the finger may be regarded as corresponding to a forward rotation operation, and an operation of moving the ring in the direction of removing it from the finger may be regarded as corresponding to a reverse rotation operation, and the same processing as in the case of the rotation operation in the embodiment may be performed. Furthermore, it may be configured to transmit detection information and control information corresponding to operations such as a touch operation, a tap operation, a stroking operation, a pinching operation, or a touch operation for a predetermined time on the main body unit 12 by the user. It may also be configured to transmit detection information and control information corresponding to operations such as voice input, gesture input, face expression input, or blowing input on the main body unit 12. It may also be configured to transmit detection information and control information corresponding to inputs of various combinations of these. It may also be configured to transmit detection information and control information according to the positional relationship with the relay device 110 and the positional relationship with the controlled device 100.

[0230] The relay device 110, which is an information processing device according to the embodiment, includes a control unit 71 and a communication unit 80 that can communicate with the ring 1 and the controlled device 100. That is, it is an information processing device as the relay device 110 that includes the control unit 71 and the communication unit 80 in FIG. 6 and transmits control information or detection information based on the detection information based on the information from the ring 1. By providing the relay device 110, a system can be realized in which the ring 1 causes the relay device 110 side to execute a heavy processing load.

[0231] An example was given in which the control unit 2 of the ring 1 in the embodiment recognizes a rotation operation of a predetermined mode by the user on the ring 1 as a valid operation, and performs a process of causing the communication unit 8 to transmit information to an external device according to the valid operation (see FIGS. 18 and 19). Thereby, for example, when the user accidentally touches or rotates the ring 1, the ring 1 can be prevented from transmitting detection information and control information.

[0232] Although an example in which the control unit 2 of the ring 1 performs a valid operation determination has been described, the control unit 71 in the relay device 110 may perform the valid operation. For example, by causing information for valid operation determination, such as information on the sensing location from the ring 1, to be transmitted to the relay device 110, the control unit 71 of the relay device 110 can make a determination and prevent control information and the like from being transmitted to the controlled device 100. Furthermore, information for valid operation determination is transmitted to the controlled device 100, and in the control unit 121, it is determined whether the transmitted control information is valid, and corresponding processing for the control information is performed only when it is valid.

[0233] The control unit 2 of the ring 1 in the embodiment gave an example of determining a rotation operation in a state where the ring 1 is touched with three or more fingers of a hand other than the finger on which the user wears the ring 1 as a rotation operation in a predetermined mode (see FIGS. 18 and 19). For example, it is highly likely that other fingers of the hand on which the ring 1 is worn touch, rotate, or even if it is another hand, touch the ring 1 with one or two fingers unconsciously. By recognizing such a case as a rotation operation, the controlled device 100 will perform corresponding processing against the user's will. On the other hand, when the user rotates the ring 1 with three or more fingers of a hand other than the hand on which the ring 1 is worn, it can be presumed to be a conscious operation. Therefore, by setting such a rotation operation mode as a valid operation, erroneous operations can be avoided. Note that three or more fingers is just an example. For example, various operations in a predetermined mode that are regarded as valid operations can be considered, such as rotating the ring 1 while strongly pinching it, or rotating it after tapping once.

[0234] The control unit 2 of the ring 1 in the embodiment gave an example of performing processing to cause the communication unit 8 to transmit information based on a rotation operation to an external device when the operation mode is the device control mode (see FIGS. 12, etc.). Also, the control unit 2 of the ring 1 and the control unit 71 of the relay device 110 gave an example of performing control processing to notify the user that it is in the device control mode (see step S200 in FIG. 12, etc.). The ring 1 is configured such that the operation mode becomes the device control mode by some trigger such as an instruction from the relay device 110 or a user operation, and information transmission based on a rotation operation is performed during the period of the device control mode. Thereby, it is possible to prevent control information from being transmitted to the controlled device 100 without reason due to the rotation of the ring 1 during a period when it is not in the device control mode. In addition, when the ring 1 or the relay device 110 enters the device control mode or during the device control mode, by notifying the user that it is in the device control mode, the user can recognize whether the control operation on the controlled device 100 is possible, and can appropriately perform operations using the ring 1. Note that the notification to the user includes notification by display, notification by sound, notification by vibration, and the like.

[0235] The control unit 2 of the ring 1 and the control unit 71 of the relay device 110 have been given an example of performing a control process of notifying the user of the end of the device control mode when the device control mode ends (see steps S111 etc. in FIGS. 10 and 11). When the device control mode in the ring 1 ends, by notifying the user to that effect, the user can recognize that the rotation operation for operating the controlled device 100 has become invalid, and can avoid misidentifying it as a problem such as a failure, for example.

[0236] In the embodiment, an example of performing a control process of notifying the user that control is impossible when a rotation operation that results in control beyond the limit of the variable control range in the controlled device 100 is detected during the period of the device control mode has been given (see steps S223, S225 etc. in FIG. 21). For example, when a rotation operation to further lower the volume is performed when the volume in the controlled device 100 is 0, or when the controlled device 100 cannot perform corresponding processing, the user is notified to that effect. Thereby, the user can recognize that the variable control of the controlled device 100 has reached the limit value.

[0237] In the embodiment, an example of performing a control process of notifying the user of the detection abnormality when it is determined that there is an abnormality in the detection of the rotation operation has been given (see steps S221, S224 etc. in FIG. 21). Thereby, when the device control mode in the ring 1 ends, by notifying the user to that effect, the user can recognize that the rotation operation for operating the controlled device 100 has become invalid, and can avoid misidentifying it as a problem such as a failure, for example.

[0238] In the embodiment, an example in which the controlled device 100 serving as the transmission destination of information based on the rotation operation of the ring 1 or the type of control content can be variably set is given (see FIG. 23 etc.). As the controlled device 100 corresponding to the rotation operation, for example, devices such as an air conditioner 101, a television receiver 102, and a smartphone 15 can be switched. Also, the type of control content corresponding to the rotation operation for the selected controlled device 100 can be switched. For example, in the case of the air conditioner 101, the type of control content such as the set temperature, operation mode (heating, cooling, air blowing, dehumidification), and air direction setting is switched. In the case of the television receiver 102, volume up / down, channel up / down, brightness setting, color setting, etc. are switched. By being able to perform such variable setting, the ring 1 can be widely used as an operating device for a number of devices.

[0239] In the embodiment, an example is given in which the control unit 2 performs a control process of notifying the user of the controlled device 100 or the type of control content when the setting of the controlled device 100 serving as the transmission destination of information based on the rotation operation of the ring 1 or the type of control content is changed (see step S329 in FIG. 23 etc.). By this notification, the user can operate the ring 1 while grasping the controlled device 100 currently targeted by the ring 1 and the type of control content.

[0240] The ring 1 of the embodiment includes the display unit 5 in the main body unit 12, and the control unit 2 is configured to perform control to execute information display on the display unit 5. That is, it is the process of the information display mode. Examples of the information to be displayed include biological information such as date and time, time, heart rate, and blood pressure, and battery remaining amount. Thereby, the user can visually recognize the display of various information on the ring 1.

[0241] In the embodiment, an example is given in which the control unit 2 performs control to execute information display on the display unit 5 when it detects that the user has taken a posture to visually recognize the display unit 5 (see FIGS. 10 and 11 etc.). For example, based on the detection values of an acceleration sensor, various velocity sensors, an azimuth sensor, etc., it is detected when the user assumes a posture of visually recognizing the ring 1 worn on the finger. In this case, the display unit 5 is made to execute information display. Thereby, it is possible to prevent unnecessary display when the user is not looking, which is effective from the viewpoint of reducing power consumption. It is also effective from the viewpoint of preventing the user's biometric information, etc. from being seen by others. Note that the information display mode may be started by a trigger other than the visual recognition posture. Also, the information display mode may be always set except for the device control mode.

[0242] In the ring 1 of the embodiment, an example was given in which the control unit 2 performs control to change the display position so that information display is performed within the visible range of the user on the display unit 5 in response to a rotation operation on the ring 1 (see FIGS. 27 to 34, etc.). The display position on the display unit 5 is changed so that the display information does not become invisible to the user due to the rotation of the ring 1. Thereby, the user can always confirm the display information satisfactorily.

[0243] In the embodiment, an example was given in which the control unit 2 performs control to change the type of information content to be displayed on the display unit 5 in response to a display switching operation on the ring 1 (see FIGS. 10, 11, 32, etc.). By switching the type of information content displayed on the display unit 5 of the ring 1 by user operation, the user can easily confirm various information contents.

[0244] In the embodiment, an example was given in which the control unit 2 performs control so that information of a type of information content that was not displayed on the display unit 5 is displayed in response to the rotation operation amount on the ring 1 exceeding a predetermined rotation amount (see FIG. 32). For example, for each predetermined rotation amount of the ring 1, the type of information content to be displayed is switched. Thereby, the user can confirm various information contents by a simple operation of turning the ring 1. Note that instead of switching the type of information content to be displayed, as shown in FIG. 14, new information of a new information content type may be additionally displayed.

[0245] In the embodiment, an example was given in which the control unit 2 performs control to cause the display unit 5 to display an indicator 21 whose display position within the display unit 5 does not change in response to a rotation operation on the ring 1 (see FIG. 30 and the like). That is, the indicator 21 that is not moved in terms of user visual recognition is displayed even when a rotation operation is performed on the ring 1. By using this indicator 21 as a reference and comparing it with a display whose position is fixed visually even in response to a rotation operation, the user can easily recognize the amount of rotation operation.

[0246] In the embodiment, an example was given in which the control unit 2 performs control to cause the display unit 5 to display a guide in the rotation operation direction (see FIGS. 36 and 37 and the like). When the upper limit or lower limit of the controllable range in the controlled device 100 is reached, a display for guiding the effective rotation direction is performed. Thereby, it is possible to prevent the user from performing a useless rotation operation.

[0247] The program of the embodiment is a program that causes the information processing device to execute a process of transmitting information based on a rotation operation performed on the ring 1 worn on the user's finger to an external device. For example, programs for performing processes such as those shown in FIGS. 8, 9, 10, 11, 12, 11, 19, 21, 22, 23, 28, 30, and 32 are executed by an information processing device such as a CPU or a DSP, or a device including these. With such a program, the functions of the ring 1 and the relay device 110 are realized.

[0248] Such a program can be recorded in advance in an HDD as a recording medium built in a device such as a computer device, or in a ROM in a microcomputer having a CPU. Alternatively, it can be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), Blu-ray Disc (registered trademark), magnetic disk, semiconductor memory, memory card, etc. Such a removable recording medium can be provided as so-called packaged software. In addition to installing such a program from a removable recording medium to a personal computer or the like, it can also be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0249] Also, according to such a program, it is suitable for wide provision of the information processing apparatus of the embodiment. For example, by downloading the program to a portable terminal device such as a smartphone or a tablet, an imaging device, a mobile phone, a personal computer, a game device, etc., those smartphones etc. can be made to function as the relay device 110 of the present disclosure. Also, by implementing the program on a ring-shaped device, it can be made to function as the ring 1 of the present disclosure.

[0250] Note that the effects described in this specification are merely examples and are not limiting, and there may be other effects.

[0251] Note that the present technology can also adopt the following configuration. (1) An information processing apparatus including a control unit that performs a process of transmitting information based on a displacement operation in which a ring worn on a finger is relatively moved with respect to the finger from a communication unit to an external device. Information processing apparatus. (2) The ring is formed by a main body portion that is annular and can be worn on a finger by a user. Inside the main body, a control unit, a communication unit, and a sensor unit for detecting the rotation operation are provided. The information processing apparatus according to the above (1). (3) The control unit, A communication unit capable of communicating with the ring and the controlled device, The information processing apparatus according to the above (1). (4) The control unit recognizes a displacement operation of a predetermined mode of the user with respect to the ring as a valid operation, and performs a process of transmitting information from the communication unit to an external device in response to the valid operation. The information processing apparatus according to the above (1) or (2). (5) The control unit determines the displacement operation in a state where the ring is touched by three or more fingers of a hand different from the finger on which the user wears the ring as the displacement operation of the predetermined mode. The information processing apparatus according to the above (4). (6) The control unit, When the operation mode is the device control mode, the control unit performs a process of transmitting information based on the displacement operation from the communication unit to an external device, and Performs a control process of notifying the user that the device is in the device control mode. The information processing apparatus according to any one of the above (1) to (5). (7) The control unit, When the device control mode ends, the control unit performs a control process of notifying the user of the end of the device control mode. The information processing apparatus according to the above (6). (8) The control unit, When the device control mode is in a state where the displacement operation exceeds the limit of the variable control range of the controlled device, the control unit performs a control process of notifying the user that the control is impossible. The information processing apparatus according to the above (6) or (7). (9) The control unit, When it is determined that there is an abnormality in the detection of the displacement operation, perform control processing to notify the user of the detection abnormality. The information processing apparatus according to any one of (1) to (8) above. (10) The controlled device serving as the transmission destination of the information based on the displacement operation or the type of control content can be variably set. The information processing apparatus according to any one of (1) to (9) above. (11) The control unit In response to a change in the setting of the controlled device serving as the transmission destination of the information based on the displacement operation or the type of control content, perform control processing to notify the controlled device or the type of control content. The information processing apparatus according to (10) above. (12) The main body part is provided with a display part, The control unit performs control to cause the display part to display information. The information processing apparatus according to (2) above. (13) The control unit When it is detected that the user has taken a posture to visually recognize the display part, perform control to cause the display part to display information. The information processing apparatus according to (12) above. (14) The control unit In response to the rotation operation on the ring, perform control to change the display position so that information is displayed within the visible range of the user on the display part. The information processing apparatus according to (12) or (13) above. (15) The control unit In response to the display switching operation on the ring, perform control to change the type of information content displayed on the display part. The information processing apparatus according to any one of (12) to (14) above. (16) The control unit Control is performed such that information of an information content type that was not displayed is displayed on the display unit in response to the rotation operation amount with respect to the ring exceeding a predetermined rotation amount. The information processing apparatus according to any one of (12) to (15) above. (17) The control unit Performs control to display an indicator on the display unit that does not change the display position within the display unit in response to a rotation operation with respect to the ring. The information processing apparatus according to any one of (15) or (16) above. (18) The control unit Performs control to display a guide in the rotation operation direction on the display unit. The information processing apparatus according to any one of (12) to (17) above. (19) The information processing apparatus Performs a process of transmitting information based on a displacement operation in which a ring worn on a finger is relatively moved with respect to the finger to an external device. Information processing method. (20) Causes the information processing apparatus to execute a process of transmitting information based on a displacement operation in which a ring worn on a finger is relatively moved with respect to the finger to an external device. Program.

Explanation of Signs

[0252] 1 Ring 2 Control unit 3 Storage unit 4 Sensor unit 5 Display unit 5A Specific area 5X Drawing area 6 Sound output unit 7 Input unit 8 Communication unit 9 Vibration unit 10 Power supply unit 11 Battery 12 Main body unit 15 Smartphone 21 Indicator 22 Reference line 71 Control unit 100 Controlled device 101 Air conditioner 102 Television receiver 110 Relay device

Claims

1. An information processing apparatus comprising a control unit that performs a process of causing a communication unit to transmit information based on a displacement operation for relatively moving a ring worn on a finger by a user with respect to the finger to an external device.

2. The ring is formed by a main body portion that is annular and can be worn on a finger by the user, and the main body portion is provided with the control unit, the communication unit, and a sensor unit that detects the displacement operation. The information processing apparatus according to claim 1.

3. The control unit, and a communication unit capable of communicating with the ring and a controlled device. The information processing apparatus according to claim 1.

4. The control unit recognizes a displacement operation of a predetermined mode of the user with respect to the ring as a valid operation, and performs a process of causing the communication unit to transmit information to an external device in response to the valid operation. The information processing apparatus according to claim 1.

5. The control unit determines the displacement operation in a state where the ring is touched by three or more fingers of a hand different from the finger on which the user wears the ring as the displacement operation of the predetermined mode. The information processing apparatus according to claim 4.

6. The control unit, when the operation mode is the device control mode, performs a process of causing the communication unit to transmit information based on the displacement operation to an external device, and performs a control process of notifying the user that it is the device control mode. The information processing apparatus according to claim 1.

7. The control unit, when the device control mode ends, performs a control process of notifying the user of the end of the device control mode. The information processing apparatus according to claim 6.

8. The control unit performs a control process of notifying the user that control is impossible when detecting the displacement operation that is control beyond the limit of the variable control range in the device control mode The information processing apparatus according to claim 6.

9. The control unit performs a control process of notifying the user of the detection abnormality when determining that there is an abnormality in the detection of the displacement operation The information processing apparatus according to claim 1.

10. The controlled device serving as the transmission destination of the information based on the displacement operation or the type of control content can be variably set The information processing apparatus according to claim 1.

11. The control unit performs a control process of notifying the controlled device or the type of control content when the setting of the controlled device serving as the transmission destination of the information based on the displacement operation or the type of control content is changed The information processing apparatus according to claim 10.

12. The main body part is provided with a display part The control unit performs control to cause the display part to display information The information processing apparatus according to claim 2.

13. The control unit performs control to cause the display part to display information when detecting that the user has taken a posture of visually recognizing the display part The information processing apparatus according to claim 12.

14. The control unit performs control to change the display position so that information is displayed within the visible range of the user on the display part in response to the rotation operation on the ring The information processing apparatus according to claim 12.

15. The control unit Perform control to change the type of information content to be displayed on the display unit according to a display switching operation on the ring. The information processing apparatus according to claim 12.

16. The control unit Perform control so that information of a type of information content that was not displayed on the display unit is displayed in response to the rotation operation amount on the ring exceeding a predetermined rotation amount. The information processing apparatus according to claim 12.

17. The control unit Perform control to display an indicator on the display unit that does not change the display position within the display unit in response to a rotation operation on the ring. The information processing apparatus according to claim 15.

18. The control unit Perform control to display a guide in the rotation operation direction on the display unit. The information processing apparatus according to claim 12.

19. An information processing apparatus Perform a process of transmitting information based on a displacement operation of relatively moving a ring worn on a finger by a user with respect to the finger to an external device. An information processing method.

20. Cause the information processing apparatus to execute a process of transmitting information based on a displacement operation of relatively moving a ring worn on a finger by a user with respect to the finger to an external device. A program.

Images