Information processing device, information processing method, and program
The ring-shaped information processing device addresses the limitations of existing user interface devices by allowing users to control electronic equipment through intuitive finger movements, enhancing convenience and ease of operation.
Patent Information
- Application Number
- PCT/JP2024/043186
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-11
- Filing Date
- 2024-12-06
- Publication Date
- 2025-06-19
AI Technical Summary
Existing user interface devices, such as wristwatch-type devices, lack convenience and ease of operation, particularly in providing intuitive and comfortable interfaces for interacting with electronic equipment.
A ring-shaped information processing device worn on the finger, which includes a control unit, communication unit, and sensor unit, allowing users to perform displacement operations like rotating or sliding the ring to control external devices, such as TVs or air conditioners, through detected information and control information transmission.
Enables intuitive and versatile control of electronic equipment by converting finger movements into actionable commands, enhancing user experience with improved operability and comfort.
Smart Images

Figure JP2024043186_19062025_PF_FP_ABST
Abstract
Description
INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND PROGRAM
[0001] The present technology relates to an information processing device, an information processing method, and a program and, in particular, to interface processing by a ring-shaped device worn on a finger.
[0002] Devices that display necessary information or remotely operate electronic equipment in response to user’s operations or the like have been known. PTL 1 below describes a technology relating to a user interface device serving as a wristwatch type device.
[0003] JP 2022-84589ASummary
[0004] Devices that perform operations on electronic equipment or present information to users are those that can be used more conveniently and are requested to provide easy operability, comfortable visibility, or the like.
[0005] Therefore, the present disclosure has an object of proposing a system using a ring-shaped device for a user interface.
[0006] An information processing device according to the present technology includes a control unit that performs processing to cause information based on a displacement operation to be transmitted from a communication unit to an external device, the displacement operation being performed by a user to relatively move a ring worn on a finger thereof relative to the finger. The information based on the displacement operation performed on the ring refers to, for example, the detected information of a rotational amount obtained when the ring is rotated, control information corresponding to the detected information of the rotational amount, or the like. In other words, the control information or detected information is transmitted to the external device such as a relay device and a controlled device in response to the displacement operation such as rotating the ring and sliding the ring in the direction of the finger (direction to insert or remove the ring from the finger).
[0007] Fig. 1 is an explanatory view of a ring according to an embodiment of the present technology.Fig. 2 is an explanatory view of the display unit of the ring according to the embodiment.Fig. 3 is an explanatory view of the display content of the ring according to the embodiment.Fig. 4 is an explanatory view of a control system using the ring according to the embodiment.Fig. 5 is a block diagram of the internal configuration of the ring according to the embodiment.Fig. 6 is a block diagram of the internal configuration of a relay device according to the embodiment.Fig. 7 is a block diagram of the internal configuration of a controlled device according to the embodiment.Fig. 8 is a flowchart illustrating communication processing between the devices according to the embodiment.Fig. 9 is a flowchart illustrating communication processing between the devices according to the embodiment.Fig. 10 is a flowchart of a processing example of the ring according to the embodiment.Fig. 11 is a flowchart of a processing example of the ring according to the embodiment.Fig. 12 is a flowchart of a processing example of the equipment control mode of the ring according to the embodiment.Fig. 13 is an explanatory view of a change in an information content type displayed on the ring according to the embodiment.Fig. 14 is an explanatory view of the change in the information content type displayed on the ring according to the embodiment.Fig. 15 is an explanatory view of a display including an indicator in the ring according to the embodiment.Fig. 16 is an explanatory view of a display example of the ring according to the embodiment.Fig. 17 is an explanatory view of an operation mode in which a false operation easily occurs.Fig. 18 is an explanatory view of the operation mode of a valid operation according to the embodiment.Fig. 19 is a flowchart of a processing example including false operation prevention processing according to the embodiment.Fig. 20 is an explanatory view of a presentation mode for a user according to the embodiment.Fig. 21 is a flowchart of a processing example including error notification according to the embodiment.Fig. 22 is a flowchart of a processing example in a case where rotational detection is inactive according to the embodiment.Fig. 23 is a flowchart of the change processing of a controlled device or control content type according to the embodiment.Fig. 24 is an explanatory view of a presentation mode for the user according to the embodiment.Fig. 25 is an explanatory view of a presentation mode for the user according to the embodiment.Fig. 26 is an explanatory view of the display of the ring according to the embodiment.Fig. 27 is an explanatory view of a display where a visual recognition position remains unchanged according to the embodiment.Fig. 28 is a flowchart of display control processing according to the embodiment.Fig. 29 is an explanatory view of a display including an indicator according to the embodiment.Fig. 30 is a flowchart of display control processing including an indicator according to the embodiment.Fig. 31 is an explanatory view of a change in a displayed information type content according to the embodiment.Fig. 32 is a flowchart of a processing example including a change in a display content type according to the embodiment.Fig. 33 is an explanatory view of a display example including a reference line according to the embodiment.Fig. 34 is an explanatory view of a display example including a reference line according to the embodiment.Fig. 35 is an explanatory view of the display of a rotational direction according to the embodiment.Fig. 36 is an explanatory view of a display indicating a rotational direction according to the embodiment.Fig. 37 is an explanatory view of the guide display of a rotational direction and a rotational speed according to the embodiment.Fig. 38 is an explanatory view of the display of a selectable operation according to the embodiment.Fig. 39 is an explanatory view of the display of a selectable operation according to the embodiment.Fig. 40 is an explanatory view of the display of control range settings according to the embodiment.Fig. 41 is an explanatory view of the display of control range settings according to the embodiment.
[0008] Hereinafter, an embodiment will be described in the following order. <1. Ring and System Configuration> <2. Device Configuration and Communication Processing> <3. Processing of Ring> (3-1: Processing Examples) (3-2: False Operation Prevention) (3-3: Various Notifications to User) (3-4: Display Examples in Information Display Mode) (3-5: Display Examples in Equipment Control Mode) <4. Summary and Modified Examples>
[0009] <1. Ring and System Configuration> In the embodiment, an example of a remote operation system will be provided, which includes a ring-shaped information processing device worn on a user’s finger, an information processing device serving as a relay device, and a controlled device representing electronic equipment as a control target. Note that a displacement operation in the present disclosure refers to an operation performed by a user to relatively move a ring worn on a finger thereof with respect to the finger, and the rotational operation of the ring will be mainly described as an example of the displacement operation below. However, the movement operation of the ring in a direction to insert and remove the ring from the finger is also included in the displacement operation.
[0010] Fig. 1 illustrates a ring 1. The ring 1 is formed by a ring-shaped body unit 12, and has a display unit 5 formed on its outer peripheral surface side. In Fig. 1, an example is illustrated where time is displayed on the display unit 5 as “12:15.”
[0011] The ring 1 is worn on a user’s finger. In the figure, a state is illustrated where the ring 1 is worn on the index finger of a user’s left hand, but it may be worn on any finger of either the user’s right or left hand. Since the direction of the ring 1 is needed to detect a rotational direction, a user may be instructed to wear the ring 1 in accordance with a picture or marker drawn on the display unit 5. Alternatively, the direction of the ring 1 may be automatically detected. For example, the direction of the ring 1 can be determined by, for example, detecting an inserting direction with an optical sensor while capturing gravitational acceleration with an acceleration sensor, or the like.
[0012] The ring 1 is formed of, for example, a metallic material, but its material is not limited. In order to enable the user to arbitrarily rotate the ring 1 using the finger as a pivot, the ring 1 may be formed of a material that generates minimal friction. Alternatively, the inner peripheral surface side of the ring 1 may be coated with a material having a proper friction coefficient. In any way, the ring 1 may only have a material or structure that enables the user to rotate the ring 1 moderately.
[0013] The rotation of the ring 1 serves as an input by the user for operation control with respect to a controlled device 100 (see Fig. 4). In consideration of collaboration with other devices, the assignment of the rotational operation of the ring 1 to operations such as volume up / down and scroll up / down enables an intuitive operation. The combined use of user’s tapping or swiping on the surface of the ring 1, pinching (applying pressure to) the ring 1, or the like enables a more versatile input.
[0014] As illustrated in Fig. 2A, the outer peripheral surface of the body unit 12 of the ring 1 serves as the display unit 5, covering, for example, the entire circumference. A display device such as an organic EL (Electroluminescence) display panel 5a is attached. Further, the display unit 5 may be configured to have a plurality of rows of LED (Light Emitting Diode) display devices arranged in a circumferential direction as illustrated in, for example, Fig. 2B. Moreover, the display unit 5 may be configured to have dot-shaped light-emitting elements 5c (for example, LEDs) arranged around the entire circumference as illustrated in Fig. 2C.
[0015] Further, the display unit 5 may be formed in a partial region on the outer peripheral surface, such as a region corresponding to half of the circumference rather than the entire circumference of the outer peripheral surface of the ring 1, or it may be formed in a partial region in the width direction.
[0016] On the display unit 5, various information can be displayed in addition to date and time. For example, Fig. 3A illustrates an example where a count value indicating the number of steps is displayed, and Fig. 3B illustrates an example where a remaining battery level is displayed. Besides, user’s other biometric information such as heart rate, blood pressure, and body temperature is assumed to be displayed. For such information displays, various sensors are incorporated into the ring 1.
[0017] These information items may be drawn at, for example, spots visually recognizable by the user in the display unit 5 corresponding to the entire surface of the ring 1. For example, when the ring 1 is worn on the index finger of the left hand as illustrated in Fig. 1, a spot near the right side surface of the index finger becomes a position where the user can easily visually recognize the information items. Therefore, a prescribed angle range including the right side surface of the index finger is assumed as a drawing region 5X in the display unit 5. The drawing region 5X is sequentially moved within the display unit 5 in response to the rotation of the ring 1. In this way, the ring 1 itself performs region change control so that the drawing region 5X becomes easily recognizable by the user regardless of the rotation.
[0018] Normally, time is drawn in, for example, the drawing region 5X as illustrated in Fig. 1. However, when the ring 1 is rotated right (up), the number of steps is drawn in the drawing region 5X as illustrated in Fig. 3A. When the ring 1 is further rotated right (up), a pulse is drawn in the drawing region 5X. When the ring 1 is further rotated right (up), a remaining battery level is drawing in the drawing region 5X as illustrated in Fig. 3B. When the ring 1 is rotated left (down), a pulse is displayed again. By switching between the displayed information content types as described above, the user can intuitively switch displays.
[0019] Note that the setting of the drawing region 5X may be performed by detecting a user’s visual posture during an initial setup or the like. For example, a visually recognizable direction differs depending on whether the user wears the ring 1 on the right or left hand and which finger the ring 1 is worn on. Therefore, for example, the user wears the ring 1, takes a posture to view the display of the ring 1, and taps a viewed spot of the ring 1 in the state. As a result, the ring 1 estimates a tapped position under the current posture as the center of the drawing region 5X, and sets a prescribed direction range under the current posture as the drawing region 5X. By performing such calibration, for example, when the ring 1 is worn, the drawing region 5X can be set in accordance with a user’s visual posture.
[0020] In addition to displaying various types of information contents as described above, the ring 1 also functions as an operating device for the controlled device 100 as described above. Fig. 4 illustrates a configuration example of the remote operation system.
[0021] In the figure, an air conditioner 101, TV receivers 102, smartphones 15, and the like are, for example, illustrated. These electronic equipment serve as the controlled devices 100 that respond to operations from the ring 1. Other than the equipment illustrated in the figure, video equipment, audio equipment, communication equipment, illumination equipment, various home electric equipment, or the like can, for example, serve as the controlled devices 100.
[0022] The ring 1 directly transmits information to the controlled devices 100 in response to user’s operations. The ring 1 transmits, for example, the detected information of a rotational amount corresponding to the user’s rotational operation of the ring 1, control information including a control command corresponding to the rotational amount, or the like to the controlled devices 100. Accordingly, the controlled devices 100 perform corresponding processing instructed by a user’s intention. For the detection of the rotational amount, various methods are available, including known gesture recognition methods using acceleration sensors and gyro sensors, as well as methods using the body range of motion models and the ring range of motion models. Alternatively, sensing in the vertical and horizontal movement directions of a finger when viewed from the ring may be performed by an optical reflection scanning sensor mounted inside the ring. This corresponds to the inserting and removing movement of the ring or a rotational movement direction as an operation. As a result, rotational movement can be recognized in a rotational direction, and the integrated value of a movement amount can be detected as a rotational amount. Further, through AI learning using various sensor information as inputs and rotational amounts and movement amounts as outputs, it is also possible to detect a rotational amount, movement amount, or the like.
[0023] For the transmission of information from the ring 1, equipment such as the smartphone 15 may function as a relay device 110. Information based on the rotational operation of the ring 1 is transmitted to the controlled devices 100 via the smartphone 15 serving as the relay device 110. For example, the relay device 110 directly transmits the transmission information from the ring 1 to the controlled devices 100, or generates control information including command information in response to transmission information from the ring 1 and transmits the same to the controlled devices 100. Then, the controlled devices 100 perform corresponding processing in response to the information from the relay device 110.
[0024] When considering the TV receivers 102 as the controlled devices 100 in such a system, the user can perform volume up / down, switching between channels, or the like for the TV receivers 102 through the rotational operation of the ring 1.
[0025] When considering the air conditioner 101 as the controlled device 100, the user can perform setting temperature up / down, airflow control operation, or the like through the rotational operation of the ring 1.
[0026] When considering equipment such as the smartphones 15 and personal computers as the controlled devices 100, collaboration with application programs or the like is enabled. For example, the assignment of the rotational operation of the ring 1 to scroll up / down enables an intuitive scroll operation on an application program. Alternatively, the assignment of the rotational operation of the ring 1 to a volume operation during the reproduction of music enables intuitive volume control. Alternatively, the assignment of the rotational operation of the ring 1 to switching between application programs or the assignment of the rotational operation of the ring 1 to switching between tabs on a browser is also possible. Further, for example, while there are cases where a drum roll GUI (Graphical User Interface) is used for number inputs, the assignment of the rotation of the ring 1 to the rotation of a drum enables the user to intuitively perform operations. In addition, the movement of the ring 1 in the direction of a finger (direction to insert and remove the ring 1 from the finger) may be set as a selectable operation in the lateral direction of the drum roll GUI.
[0027] Further, operations other than the rotation of the ring 1 can be used in combination. For example, it is also possible to assign swiping on the surface of the ring 1 to scrolling or assign tapping to a click operation.
[0028] In such a system, the user is enabled to perform intuitive operations through the rotation of the ring 1, and enabled to perform more versatile and intuitive inputs through the combined use of tapping or swiping on the surface of the ring 1, pinching (applying pressure to) the ring 1.
[0029] Further, the applied range is broad since the operation is performed in a vertical direction. For example, the operation is applicable to general home electric products in terms of operations such as volume up / down and switching between channels. Further, the operation is also applicable to video games. For example, in video games involving the traveling of vehicles, the operation is also capable of responding to analog-value-required operations such as steering, acceleration, and braking of the vehicles.
[0030] Moreover, it is also possible to achieve more intuitive operations in consideration of the rotational speed of the ring 1. For example, it is possible to detect the rotation or rotational speed through the combined use of a fingerprint sensor, a pulse sensor, an acceleration sensor, an angular speed sensor, or the like. It is assumed that a full circumferential fingerprint is initially acquired by the fingerprint sensor, gravitational acceleration is captured by the acceleration sensor and the rotation or rotational speed is detected on the basis of a difference from the gravitational acceleration, or the rotation or rotational speed is detected by the angular speed sensor.
[0031] For the rotational operation of the ring 1, the ring 1 can be rotated by a thumb when worn on, for example, an index finger. Even when worn on another finger, the ring 1 can be rotated using the other hand. However, as will be described later, only rotational operations in prescribed modes may be handled as valid operations in order to exclude false operations, particularly unconscious rotational operations.
[0032] When a system operation is performed, a full circumferential fingerprint of a finger is acquired by a fingerprint sensor during, for example, an initial setup. The user is instructed to rotate the finger until the full circumferential fingerprint is acquired. When a touch on the surface is detected by a touch sensor, the fingerprint sensor periodically scans a fingerprint, and then the angle of the ring 1 is calculated from the full circumferential fingerprint stored in advance. There may be a case where the ring 1 is rotated without being touched, but the case is not considered as an operation.
[0033] In the case of internal control inside the ring 1 such as display control on the display unit 5, behaviors change in accordance with the angle, the change amount of the angle, or the change amount of the angle per unit time. For example, the content drawn on the screen changes.
[0034] When collaborating with another device as the remote operation system, it may be possible to previously retain a keyboard scan code in a table in accordance with the change amount of the angle or the change amount of the angle per unit time and transmit the same to a device side through near-range wireless communication. For example, the BT HID profile or the like representing a profile to enable the wireless connection of input devices such as keyboards, mice, and video game controllers through Bluetooth (TM) can be used.
[0035] The keyboard scan code for scrolling or volume control can have versatility if it is an existing one. The update of the table is assumed to be performed via near-range wireless communication by the smartphones 15, personal computers, or the like.
[0036] <2. Device Configuration and Communication Processing> Configuration examples of the ring 1, the relay device 110, and the controlled device 100 will be described. Fig. 5 illustrates an internal configuration example of the ring 1.
[0037] The ring 1 has, for example, a control unit 2, a storage unit 3, a sensor unit 4, a display unit 5, a sound output unit 6, an input unit 7, a communication unit 8, a vibration unit 9, and a power unit 10 inside the body unit 12. Note that all of these units may not be provided in the ring 1. Further, constituting units not illustrated in the figure may be provided.
[0038] The control unit 2 is configured by a processor such as a CPU (Central Processing Unit) provided inside the ring 1, and performs processing inside the ring 1. Specifically, the control unit 2 performs processing for display control or information transmission corresponding to user’s operations or postures.
[0039] The storage unit 3 comprehensively represents a ROM (Read Only Memory), RAM (Random Access Memory), non-volatile memory, or the like, stores a program for processing the control unit 2 or required information, or is used as a work area for computation processing.
[0040] The sensor unit 4 represents various sensors mounted in the ring 1. For example, an angular speed sensor, acceleration sensor, direction sensor, geomagnetic sensor, fingerprint sensor, touch sensor, pressure sensor, biometric information sensor, temperature sensor, electrostatic sensor, and the like are assumed to be provided. Further, blowing air by the user can be detected using an air pressure sensor, temperature sensor, gas sensor, or the like. Of course, there may be cases where sensors other than the exemplified sensors are provided. Information detected by the respective sensors of the sensor unit 4 is supplied to the control unit 2. As a result, the control unit 2 can acquire information to be displayed on the display unit 5 or acquire user’s operating information.
[0041] The display unit 5 is configured by a display device provided on the outer peripheral surface of the ring 1 as described above. The display unit 5 is capable of being configured as an organic EL display, LED display device, or the like. The display unit 5 draws, on the basis of the control of the control unit 2, various information in, for example, the drawing region 5X.
[0042] The sound output unit 6 is configured by a speaker and a power amplifier unit or the like that drives the speaker, and outputs, for example, electronic sounds, message sounds, or the like in response to instructions from the control unit 2.
[0043] The input unit 7 represents a device that receives, for example, the inputs of sounds or images. Specifically, the input unit 7 represents a microphone or camera device. Sound signals or image signals through the input unit 7 are input to the control unit 2. As a result, the control unit 2 can perform sound analysis, image analysis, or the like to obtain input information of user’s operations. For example, user’s speech sounds, gestures, facial expressions, blinking, or the like can be handled as the inputs of operating information. Further, a power switch, reset switch, or the like may be provided as the input unit 7.
[0044] The communication unit 8 performs near-range wireless communication with the relay device 110 or the controlled device 100. The communication unit 8 is assumed to perform communication under communication standards such as Bluetooth, Wi-Fi, and NFC (Near field communication). The communication unit 8 also functions to user’s input operations. For example, a camera in the relay device 110 such as the smartphone 15 recognizes user’s gestures, and the relay device 110 transmits the detected information of the specific gestures. In this case, the communication unit 8 can acquire the input information.
[0045] The vibration unit 9 is configured by a vibration device that makes the user perceive vibrations. The vibration unit 9 generates vibrations in response to instructions from the control unit 2. As a result, the user is enabled to perceive vibrations with a finger thereof wearing the ring 1.
[0046] The power unit 10 extracts a power voltage for operating the respective units from a battery 11 and supplies the same to the respective units.
[0047] Next, the configuration of the relay device 110 is illustrated in Fig. 6. A configuration example of the smartphone 15, a personal computer, or the like is illustrated.
[0048] As illustrated in Fig. 6, the relay device 110 has a control unit 71, a ROM 72, a RAM 73, and a non-volatile memory unit 74. The control unit 71 is configured by a processor including a CPU. The control unit 71 performs various processing in accordance with programs stored in the ROM 52 or programs loaded into the RAM 73 from the storage unit 79. In the RAM 73, data or the like required by the control unit 71 to perform the various processing is also appropriately stored.
[0049] The control unit 71, the ROM 72, the RAM 73, and the non-volatile memory unit 74 are connected to each other via a bus 83. An input / output interface 75 is also connected to the bus 83.
[0050] An input unit 76, a display unit 77, a sound output unit 78, a storage unit 79, a communication unit 80, a drive 82, a sensor unit 84, a camera unit 85, and the like are connectable to the input / output interface 75.
[0051] The input unit 76 represents input devices used by the user to use the relay device 110. As the input devices, a keyboard and a mouse are, for example, assumed. In addition to this, a touch panel, touch pad, or the like integrally formed with the display unit 77 may be, for example, used.
[0052] The display unit 77 is configured as a display device including a liquid crystal display panel or organic EL display panel and a driving circuit for these display panels. The display unit 77 may be integrated with the relay device 110, or may be separated equipment. On the display unit 77, not only screens for cooperative operations with the ring 1 but also, for example, screens generated by various application programs are displayed.
[0053] The sound output unit 78 is configured by a speaker, power amplifier unit that drives the speaker, or the like, and outputs required sounds.
[0054] The storage unit 79 is configured by, for example, an HDD (Hard Disk Drive), SSD (Solid State Drive), or the like, and stores various data or programs. For example, in the storage unit 79, programs for performing the processing of the relay device 110, various application programs, various data files, or the like are stored.
[0055] The communication unit 80 performs communication processing via networks including the Internet, or communicates with the equipment of peripheral respective units. In the case of the relay device 110, the communication unit 80 communicates with the ring 1 or the controlled device 100 via short-range wireless communication.
[0056] A drive 82 is also connected to the input / output interface 75 as required, and a removable recording medium 81 such as a memory card is inserted into the drive 82, enabling the writing and reading of information to and from the removable recording medium 81.
[0057] The sensor unit 84 includes an angular speed sensor, acceleration sensor, touch sensor, ranging sensor, illumination sensor, or the like. The camera unit 85 includes a lens system, image sensor, imaging signal processing circuit, or the like, and acquires captured image data.
[0058] Subsequently, the configuration of the controlled device 100 will be described using Fig. 7. The controlled device 100 has a control unit 121, a communication unit 122, and a function unit 123.
[0059] The function unit 123 comprehensively represents a configuration that performs functions as specific equipment of the controlled device 100. For example, the function unit 123 represents a constituting portion that performs an air conditioning operation in the air conditioner 101, a constituting portion that performs the reception and display output of TV broadcast as the TV receiver 102, or the like.
[0060] The control unit 121 is configured by a processor including a CPU, and controls the operation of the function unit 123. The communication unit 122 is represented as a configuration that performs short-range wireless communication with the ring 1 or the relay device 110 in this case. The control unit 121 performs the operation control of the function unit 123 on the basis of information received by the communication unit 122.
[0061] An example of the information communication between the above ring 1, the relay device 110, and the controlled device 100 will described. In Fig. 8, an example of the communication processing between the ring 1, the relay device 110, and the controlled device 100 is illustrated.
[0062] In step S1, the control unit 2 of the ring 1 detects a user’s operating action on the basis of information from the sensor unit 4 or the input unit 7. The control unit 2 mainly detects a user’s rotational operation. Note that the control unit 2 may detect operating actions other than the rotational operation such as moving the ring 1 in a direction to insert or remove the ring 1 from a finger, tapping, touching, pinching, tracing the surface, producing sounds, making gestures, and blowing air. However, an example of detecting the rotational operation will be described.
[0063] In step S2, the control unit 2 of the ring 1 transmits detected information to the relay device 110. Here, the transmission of the detected information represents the transmission of the information detected by the sensor unit 4 as it is. For example, the control unit 2 transmits the rotational amount or rotational direction in the rotational operation as the detected information.
[0064] When the relay device 110 receives the detected information in step S10, the control unit 71 acquires control information corresponding to the detected information. For example, the relay device 110 is equipped with the table data or the like of a control command corresponding to the detected information in the non-volatile memory unit 74 or the like, and acquires specific command information corresponding to the rotational amount or rotational direction such as “volume up” and “volume down.” Information containing instructions on such control contents is represented as the control information.
[0065] The control unit 71 of the relay device 110 performs processing to transmit the control information to the controlled device 100 in step S12. The control unit 121 of the controlled device 100 performs corresponding processing in step S21 after acquiring the control information in step S20. For example, if the controlled device 100 is the TV receiver 102 and the content of the control information is “volume up,” the control unit 121 performs the corresponding processing to increase the volume for the function unit 123.
[0066] Such an example of Fig. 8 illustrates an example where the ring 1 transmits detected information from a user operation to the relay device 110, the relay device 110 acquires control information on the basis of the detected information and transmits the same, and the controlled device 100 performs corresponding processing in response to the received control information.
[0067] Fig. 9 illustrates another example. The control unit 2 of the ring 1 acquires control information corresponding to detected information in step S5 after detecting a user’s operating action in step S1. For example, the ring 1 is equipped with the table data or the like of a control command corresponding to the detected information in the non-volatile memory or the like of the storage unit 3, and acquires specific command information corresponding to the rotational amount or rotational direction such as “setting temperature up” and “setting temperature down.” Information containing instructions on such control contents is represented as the control information.
[0068] Then, the control unit 2 of the ring 1 transmits the control information to, for example, the relay device 110 in step S6. After the relay device 110 receives the control information in S15, the control unit 71 performs processing to transmit the control information to the controlled device 100 in step S16.
[0069] Note that the ring 1 may directly transmit the control information to the controlled device 100 by bypassing the relay device 110 as illustrated in the figure.
[0070] The control unit 121 of the controlled device 100 performs corresponding processing in step S21 after acquiring the control information from the relay device 110 or the ring 1 in step S20. For example, if the controlled device 100 is the air conditioner 101 and the content of the control information is “setting temperature up,” the control unit 121 performs corresponding processing to increase the setting temperature for the function unit 123.
[0071] Such an example of Fig. 9 illustrates an example where the ring 1 acquires control information corresponding to detected information from a user’s operation, and the control information is transmitted to the controlled device 100 via the relay device 110 or directly.
[0072] Note that although not illustrated in the figure, an example where the ring 1 transmits detected information to the relay device 110 and then the relay device 110 transmits the detected information to the controlled device 100 as it is, or an example where the ring 1 directly transmits detected information to the controlled device 100 is also assumed. In this case, the controlled device 100 is assigned a function to acquire control information corresponding to the detected information, thus enabling the control unit 121 on the side of the controlled device 100 to determine a command content corresponding to the detected information of the rotational amount or rotational direction and perform corresponding processing based on the command content.
[0073] <3. Processing of Ring> (3-1: Processing Examples) Hereinafter, specific processing examples of the control unit 2 of the ring 1 will be described. First, the ring 1 may be used to display various types of information contents such as time and biometric information, or may be used as an operating device for the controlled device 100. Further, in each case, an example where a function to control the controlled device 100 based on rotation detection is activated by collaboration equipment, or an example where a control function for the controlled device 100 is normally inactivated but activated when the user uses the ring 1 for operations is assumed. Further, a case where the ring 1 itself is switched between a power-on state and a power-off state is also assumed. Processing examples of the control unit 2 including the processing of these cases will be described.
[0074] Note that an operating state where time, the number of steps, biometric information, remaining battery level, or the like is displayed will be called an “information display mode,” while an operating state where operations for the controlled device 100 are performed will be called an “equipment control mode” for the sake of explanation. Further, a state where neither the processing of the information display mode nor the processing of the equipment control mode is performed will be called a “standby mode.”
[0075] Fig. 10 illustrates a processing example where the ring 1 is powered on at all times but normally in the standby mode and the rotation detection of the ring 1 is activated according to situations. The purpose of activating the rotation detection is to switch between information content types displayed when the rotation is detected in the information display mode. Further, when a start trigger for the equipment control mode is provided, the information of the rotation detection is used for transmitting information to the controlled device 100.
[0076] The control unit 2 of the ring 1 repeatedly performs the processing of Fig. 10. First, in step S101, the control unit 2 determines whether the user has taken a visual posture with respect to the ring 1. For example, the control unit 2 determines whether the user has taken a posture to bring a finger wearing the ring 1 near his / her face on the basis of detected information of an angular speed sensor, acceleration sensor, direction sensor, geomagnetic sensor, or the like from the sensor unit 4.
[0077] If the user has not taken the visual posture, the control unit 2 proceeds to step S110 to determine whether an equipment control start trigger has been detected. If the user has not taken the visual posture and the equipment control start trigger has not been detected, the control unit 2 particularly does not perform display control or the like. Therefore, during a period where the user has not taken the visual posture and the ring 1 is not used for controlling the controlled device 100, the ring 1 performs neither a display nor transmission as the standby mode. This is suitable for reducing the consumption of the battery 11.
[0078] When determining in step S101 that the user has taken the visual posture, the control unit 2 proceeds to step S102 to perform the processing of the information display mode. In other words, the control unit 2 causes time or the like to be displayed within the range that serves as the drawing region 5X at that time point on the display unit 5. Further, the control unit 2 activates rotational angle detection. The activation of the rotational angle detection refers to a state where a rotational amount is also detected when the rotation is detected and prescribed processing is performed in accordance with the rotational amount. Detailed processing examples of the information display mode in step S102 will be described later using Figs. 28, 30, and 32.
[0079] Further, in the case of the information display mode, the control unit 2 determines whether the user has performed a display switch operation in step S103. Further, the control unit 2 determines in step S104 whether the user has ended the visual posture. If the user has not ended the visual posture, the control unit 2 proceeds to step S102 via step S101 unless the equipment control start trigger has been detected in step S110. That is, the processing of the information display mode continues as long as the user has taken the visual posture.
[0080] When the user performs the display switch operation as a rotational operation or the like in the information display mode, the control unit 2 proceeds from step S103 to step S105 to perform switching between information content types displayed on the display unit 5 (drawing region 5X). For example, the control unit 2 switches the previous time display to a heart rate display. For example, if the drawing region 5X falls within a 60-degree range on the outer peripheral surface of the ring 1, the control unit 2 switches between the information content types displayed every time the user performs a rotational operation over 60 degrees.
[0081] Note that the operation of switching between the information content types is not limited to a rotational operation by a prescribed rotational amount. For example, other operations such as tapping, moving the ring 1 in the direction of the finger (direction to insert or remove the ring 1 from the finger), and a long press may also be performed.
[0082] In accordance with the switching between information content types displayed in step S105, the control unit 2 notifies the user of the switching through any presentation method in step S106. For example, the control unit 2 may cause the vibration unit 9 to generate vibrations, or may cause the display unit 5 to perform a blinking display. Further, the control unit 2 may cause electronic sounds to be output. In this way, the control unit 2 definitely notifies the user of the switching between information content types displayed.
[0083] When determining in step S104 that the user has ended the visual posture in the information display mode, the control unit 2 inactivates an information display on the display unit 5 in step S107. Further, the control unit 2 also inactivate the rotational angle detection at this time. Then, the control unit 2 returns to the standby mode in steps S110 and S101 to perform monitoring.
[0084] As the equipment control start trigger in step S110, a command from collaboration equipment to use the ring 1 as an operating device is, for example, assumed. The collaboration equipment may be either the relay device 110 or the controlled device 100. For example, when an application program to use the ring 1 as a remote operating device is activated in the smartphone 15 or the like serving as the relay device 110, the equipment control start trigger is transmitted to the ring 1. Alternatively, when the controlled device 100 enters a ring-ready mode, the equipment control start trigger may be transmitted from the controlled device 100 to the ring 1. Further, the control unit 2 may recognize specific operations for the ring 1 such as touching with three fingers and a long press that will be described later as the equipment control start triggers.
[0085] In accordance with the equipment control start trigger, the control unit 2 of the ring 1 proceeds to step S120 to perform equipment control mode processing. Although the equipment control mode processing will be described later using Fig. 12, the control unit 2 notifies the user of a transition to the equipment control mode through presentation methods such as displays, vibrations, and sounds. Further, the control unit 2 activates the rotational angle detection. Then, as described using Figs. 8 and 9, the control unit 2 performs processing to transmit detected information or control information corresponding to the rotational operation of the ring 1 to the relay device 110 or the controlled device 100.
[0086] When the equipment control mode ends on the basis of any end trigger, the control unit 2 proceeds to step S111 to end the equipment control mode and returns to the standby mode in steps S110 and S101 to perform monitoring. Note that in step S111 to end the equipment control mode, the control unit 2 performs processing to inactivate the rotational angle detection or processing to notify the user of the end of the equipment control mode through presentation methods such as displays, vibrations, and sounds. In addition to the notification of the end of the equipment control mode in the ring 1, the control unit 2 may also notify the relay device 110 of the end of the equipment control mode, so that the end notification to the user is performed through the relay device 110.
[0087] As described above, the control unit 2 transitions from the standby mode to the information display mode depending on the visual posture, or transitions to the equipment control mode according to the equipment control start trigger in the standby mode or the information display mode. Further, the control unit 2 returns to the standby mode when the information display mode or the equipment control mode ends.
[0088] Next, a processing example of performing powering on / off the ring 1 or a control function for the controlled device 100 on the basis of a user’s conscious operation will be described using Fig. 11. Note that the display operation, information transmission operation, rotation detection, rotational angle detection, and the like of the display unit 5 are not performed during a period where the ring 1 is powered off. However, in order to enable at least the detection of a power-on operation, the power unit 10 supplies power to minimum required portions.
[0089] In step S130, the control unit 2 normally detects a user’s power-on operation in, for example, a power-off state. For example, a power switch is provided as the input unit 7, and the control unit 2 monitors the operation of the power switch. Normally, the control unit 2 maintains the power-off state when not detecting a particular operation.
[0090] When recognizing the prescribed power-on operation, the control unit 2 enters the standby mode as a power-on state to perform monitoring processing in steps S131, S132, and S101.
[0091] In step S131, the control unit 2 monitors a user’s intentional activation operation for the equipment control mode. For example, the control unit 2 determines the following operation inputs on the basis of information from the sensor unit 4, the input unit 7, or the like.
[0092] *Detection of three taps on the surface of the ring 1 *Detection of application of some force to the ring 1 while held between two fingers *Detection of a long press on the surface of the ring 1 *Detection of sliding of the ring 1 in the direction of a finger *Detection of gestures, facial expressions, blinking, or the like in prescribed modes *Detection of sounds produced by the user such as “TV volume,” “TV channel,” “air conditioner temperature,” and “light brightness”
[0093] The above operation inputs are provided as an example. The control unit 2 determines prescribed user’s actions as user’s activation operations for the equipment control mode. Note that the relay device 110 may perform the detection of user’s intentional operations such as detection or analysis of speech sounds and determination of gestures, and notify the ring 1 of a user’s activation operation.
[0094] If the activation operation for the equipment control mode has not been detected, the control unit 2 determines in step S132 whether a power-off trigger has been detected. The power-off trigger is assumed to be generated, for example, when a user operation is performed on the power switch or the like or when a prescribed time has elapsed without any visual recognition or user actions being performed on the ring 1.
[0095] When the power-off trigger has not been detected, the control unit 2 determines in step S101 whether the user has taken a visual posture. As described above, the control unit 2 performs the monitoring processing in steps S131, S132, and S101 as the standby mode.
[0096] When detecting the user’s intentional activation operation for the equipment control mode in S131, the control unit 2 proceeds to step S120 to perform equipment control mode processing. This equipment control mode processing is the same as that illustrated in Fig. 10. As will be described later using Fig. 12, the control unit 2 notifies the user of a transition to the equipment control mode through presentation methods such as displays, vibrations, and sounds. Then, as described using Figs. 8 and 9, the control unit 2 performs processing to transmit detected information or control information corresponding to the rotational operation of the ring 1 to the relay device 110 or the controlled device 100.
[0097] When the equipment control mode ends on the basis of any end trigger, the control unit 2 proceeds to step S111 to end the equipment control mode and notifies the user of the end of the equipment control mode through presentation methods such as displays, vibrations, and sounds. Then, the control unit 2 returns to the standby mode in steps S131, S132, and S101 to perform monitoring.
[0098] When determining in step S101 that the user has taken the visual posture, the control unit 2 proceeds to step S102 to perform the processing of the information display mode. The processing of step S102 and the subsequent processing of steps S103 to S107 are the same as those illustrated in Fig. 10.
[0099] When detecting the power-off trigger in S132, the control unit 2 proceeds to step S133 to notify the user of a power-off state and powers OFF in step S134.
[0100] Each of the processing examples of Figs. 10 and 11 is provided only as an example. However, the ring 1 performs required operations as the standby mode, the information display mode, and the equipment control mode transition according to user’s operations, notifications from collaboration equipment, user’s visual lines, or the like.
[0101] A processing example of the equipment control mode in step S120 of Figs. 10 and 11 will be described using Fig. 12. When a transition to the equipment control mode is made as step S120, the control unit 2 starts a display for equipment control on the display unit 5 in step S200 and notifies the user of the start of the equipment control mode through displays, sounds, vibrations, or the like. Note that the control unit 2 may notify the relay device 110 of the start of the equipment control mode, so that the start notification of the equipment control mode to the user is performed through the relay device 110.
[0102] The display for equipment control represents, for example, a display to end the display of the information display mode and show the device type or control content type of the controlled device 100. For example, the TV receiver 102, the air conditioner 101, or the like serving as the controlled device 100 is displayed using icons, characters, or the like, and control content types such as volume up / down and setting temperature up / down are displayed as characters or symbols.
[0103] Further, the control unit 2 activates the rotational angle detection in step S201. That is, the control unit 2 starts the detection of a rotational operation on the ring 1 and corresponding computation, or the like.
[0104] In step S202, the control unit 2 resets a cumulative angle counter for rotational operation amounts. Then, in step S203, the control unit 2 determines whether significant rotation has been detected as an operation. For example, the control unit 2 counts the rotational operation amount with the cumulative angle counter every time the rotational operation is detected. Then, when the value (absolute value of a rotational amount α) of the cumulative angle counter has exceeded a prescribed angle (β), the control unit 2 detects it as the significant rotation. The control unit 2 continues such significant rotation detection while monitoring an end trigger for the equipment control mode in step S205.
[0105] When the significant rotation has been detected, the control unit 2 proceeds to step S204 to perform processing to transmit information to the relay device 110 or the controlled device 100. For example, the control unit 2 causes the detected information of a rotational amount (detected information of a rotational amount α and a rotational direction) or control information based on the detected information of the rotational amount to be transmitted from the communication unit 8 to the relay device 110 or the controlled device 100. Then, the control unit 2 resets the value of the cumulative angle counter in step S202, and performs monitoring in steps S203 and S205 again.
[0106] In step S205, the control unit 2 recognizes a user’s intentional prescribed operation like the above example of the activation operation for the equipment control mode as an end trigger. Further, the control unit 2 may also recognize the generation of the end trigger even when a prescribed time has elapsed without user’s rotational operation.
[0107] For example, the control unit 2 performs the above processing of Fig. 12 as the processing of the equipment control mode. As a result, in the processing example of Fig. 10 or 11, the ring 1 can function as a remote operating device for the controlled device 100.
[0108] Next, a display example of the information display mode in the processing of Figs. 10 and 11 will be described. Fig. 13A illustrates an example where a time display is performed on the display unit 5 in the information display mode. The lower column of Fig. 13A schematically illustrates the ring 1, the display unit 5, and the drawing region 5X around a finger.
[0109] When the ring 1 is worn on, for example, the index finger of a left hand, a θ-degree range from the right side surface to the upper surface of the index finger corresponds to the drawing region 5X. The time display is performed in the drawing region 5X. Fig. 13B illustrates a state where the user has rotated the ring 1, creating the condition just before the drawing region 5X extends beyond the θ-angle range as it remains unchanged on the display unit 5. The time display continues until this point.
[0110] When the ring 1 is further rotated, the drawing region 5X in the display unit 5 changes and returns to the θ-angle range from the right side surface to the upper surface of the index finger as illustrated in Fig. 13C. Then, the displayed information content type is switched to, for example, a heart rate.
[0111] As described above, the drawing region 5X in the display unit 5 changes according to the rotation of the ring 1 (and the display unit 5), ensuring that information is always displayed at an easily visually recognizable position for the user and enabling the user to visually recognize various information through rotation.
[0112] Note that Figs. 13B and 13C illustrate an example where the time display is switched to a heart rate display. However, it is also possible to perform display control as illustrated in Fig. 14 where the heart rate display appears while keeping the time display through its rotation.
[0113] Further, as illustrated in Fig. 15A, it is also possible to display an indicator 21 that maintains a constant visual recognition position regardless of the rotation of the ring 1. In other words, the indicator 21 is drawn to shift in the opposite direction corresponding to the physical rotation of the ring 1. As a result, the indicator 21 remains displayed at a constant position when viewed from the user regardless of rotation.
[0114] On the other hand, the drawing position of a display such as time and heart rate remains unchanged particularly on the display unit 5. Therefore, a position viewed from the user changes as the ring 1 rotates as illustrated in Fig. 15B. Afterward, display information such as time seems to displace relative to the indicator 21 for the user. When the display information exceeds the range of the indicator 21, a displayed information content type is switched as illustrated in Fig. 15C. In this way, the user can easily recognize how much the ring 1 is rotated to switch the information content type.
[0115] Next, examples of various notifications will be described. For example, when the information display mode is active, the user is notified of an information display itself such as time and heart rate. However, it is desirable to provide the user of notifications when the equipment control mode starts, when the equipment control mode is active, when the equipment control mode ends, and when similar events occur. Therefore, the notifications are performed in step S200 of Fig. 12, step S111 of Fig. 10 or 11, and the like.
[0116] For example, Fig. 16A illustrates a state where nothing is displayed in the standby mode. However, when a transition to the equipment control mode is made, the entire display unit 5 is caused to perform a blinking display for approximately one to two seconds as illustrated in Fig. 16B. In this way, the user is notified of the activation of the equipment control mode. Further, simultaneously with or instead of blinking, it is possible to produce electronic sounds, output messages sound such as “TV volume active,” or generate vibrations with the vibration unit 9.
[0117] Further, when the equipment control mode is active, a specific spot on the display unit 5 may be lighted or blinked as illustrated in, for example, Fig. 16C so that the user can recognize the continuation of the equipment control mode. Further, electronic sounds may be periodically output.
[0118] When the equipment control mode ends, the entire display unit 5 is blinked, electronic sounds or message sounds are output, vibrations are generated, or similar operations are performed to notify the user of the end. In this way, the user can recognize a state where the controlled device 100 has become non-operational according to the rotation of the ring 1.
[0119] (3-2: False Operation Prevention) In addition to the above processing examples of Figs. 10, 11, and 12, processing employable in the embodiment will be described. First, a processing example where a false operation for the ring 1 is prevented will be described.
[0120] For example, when wearing the ring 1 on an index finger, the user may unconsciously touch and rotate the ring 1 with his / her thumb, without realizing that he / she is performing an operation. It is desirable to prevent such rotation from being recognized as a valid operation.
[0121] First, a false operation is considered. Fig. 17B illustrates a state where the user touches the ring 1 with his / her thumb, causing the rotation of the ring 1. At this time, the sensor unit 4 of the ring 1 such as an electrostatic sensor and a pressure sensor detects touches at two spots on the ring 1 since the thumb and the middle finger of the left hand touch the ring 1 as illustrated in Fig. 17A.
[0122] Fig. 17C illustrates a state where the user is consciously rotating the ring 1 with two fingers of another hand. At this time, the sensor unit 4 also detects touches at two spots on the ring 1 with the fingers as detected information. That is, it is difficult to determine whether the user is consciously performing the rotation from touches at two spots.
[0123] Therefore, an operation with three fingers of another hand different from a hand wearing the ring 1 is assumed to be a valid operation. Fig. 18B illustrates a state where the user is performing a rotational operation on the ring 1 worn on the index finger of a left hand with three fingers of the thumb, index finger, and middle fingers of a right hand. In this case, as illustrated in Fig. 18A, the sensor unit 4 detects touches at three spots on the ring 1 with the fingers as detected information. As a result, this case can be distinguished from the case where the ring 1 is rotated with the thumb as illustrated in Fig. 17B.
[0124] A processing example where a false operation is prevented using such a method is illustrated in Fig. 19. Fig. 19 illustrates a processing example of the equipment control mode processing in step S120 of Figs. 10 and 11. Note that the same processing as those of the processing examples described above will be assigned the same step numbers, and their duplicated detailed descriptions will be omitted.
[0125] When a transition to the equipment control mode is made as step S120, the control unit 2 starts a display for equipment control on the display unit 5 in step S200 and notifies the user of the start of the equipment control mode through displays, sounds, vibrations, or the like. Further, the control unit 2 activates the rotational angle detection in step S201, and resets the cumulative angle counter for a rotational operation amount in step S202. The above processing is the same as that illustrated in Fig. 12.
[0126] In step S211, the control unit 2 determines whether a touch on the peripheral surface of the ring 1 with a finger has been detected on the basis of detected information from the sensor unit 4. If the finger has not been detected, the control unit 2 continues the determination of step S211 while monitoring the end trigger of the equipment control mode in step S205.
[0127] If the touch has been detected, the control unit 2 proceeds from step S211 to step S212 to determine whether touches at three or more spots on the peripheral surface of the ring have been detected. If touches at one spot or two spots have been detected, the control unit 2 continues the determination of steps S211 and S212 while monitoring the end trigger of the equipment control mode in step S205.
[0128] If the touches at three or more spots have been detected, the control unit 2 proceeds from step S212 to step S203 to determine whether a significant rotational amount has been detected as an operation. For example, when the value of the cumulative angle counter has become a value showing a prescribed angle of rotational amount, the control unit 2 detects it as the significant rotation. If the significant rotational operation has not been detected, the control unit 2 continues the above processing of steps S211, S212, and S203 while monitoring the end trigger of the equipment control mode in step S205. Note that while the touches at three or more spots in step S212 are determined as the significant rotation, there may also be cases where touches at four spots or five spots are detected. Even in such states, the detection can be estimated as a conscious operation, causing no problem.
[0129] When the touches at three or more spots, that is, the significant rotation through an operation with the three or more fingers have been detected, the control unit 2 proceeds to step S204 to perform processing to transmit information to the relay device 110 or the controlled device 100. For example, the control unit 2 causes the detected information of a rotational amount or rotational direction or control information based on the detected information to be transmitted from the communication unit 8 to the relay device 110 or the controlled device 100. Then, the control unit 2 resets the value of the cumulative angle counter in step S202, and performs monitoring in steps S211 and S205 again.
[0130] In step S205, the control unit 2 monitors an end trigger such as a user’s intentional prescribed operation, the elapse of a prescribed time without operations, and an end notification from collaboration equipment. After recognizing the end trigger, the control unit 2 ends the processing of Fig. 19 and proceeds to step S111 of Fig. 10 or 11.
[0131] Through the above processing, a false operation in the equipment control mode can be prevented. That is, the unintentional control of the controlled device 100 caused when the user unconsciously rotates the ring 1 can be prevented.
[0132] (3-3: Various Notifications to User) Subsequently, various examples relating to notifications to the user will be described. In the above processing examples, it is described that notifications are made when the equipment control mode starts, when the equipment control mode is active, and when the equipment control mode ends.
[0133] In the equipment control mode, operating states in the controlled device 100 such as the set temperature of the air conditioner 101 and the receiving channels of the TV receiver 102 are changed by the rotational operation of the ring 1. Accordingly, it is appropriate for the user to steadily recognize whether the ring 1 is in the equipment control mode or the equipment control mode has ended.
[0134] Therefore, the presentation of the start or continuation of the equipment control mode, the presentation of the corresponding controlled device 100 or a control content type, or the like may be provided.
[0135] For example, Fig. 20A illustrates an example where, when the display unit 5 of the ring 1 is formed by an array of LED display devices 5b, the illumination display of a reference display device 5bX and a relative display device 5bR indicates that the ring 1 is in the equipment control mode, and a control content type or the controlled device 100 is indicated depending on the position of the relative display device 5bR relative to the reference display device 5bX.
[0136] Further, it is also possible to indicate a rotational operation amount using the reference display device 5bX and the relative display device 5bR. For example, when the ring 1 is rotated upward, the reference display device 5bX changes to the LED display device 5b located at a lower position to maintain a constant visual recognition position, while the LED display device 5b serving as the relative display device 5bR remains unchanged and moves upward in response to the rotation. As a result, the distance between the reference display device 5bX and the relative display device 5bR changes, indicating a rotational operation amount. Alternatively, the number of the LED display devices 5b serving as the relative display devices 5bR may be increased in response to a rotational operation.
[0137] Further, Fig. 20B illustrates an example where, when the display unit 5 is formed by the organic EL display panel 5a, a control content type such as volume control and a rotational direction for volume up / down are indicated. Through these displays, the user can easily recognize whether the ring 1 is in the equipment control mode, and recognize the controlled device 100 or a control content type to perform a rotational operation.
[0138] Note that it may be advisable for such a display as Fig. 20A or 20B to be shifted in the direction opposite to rotation by the same rotational amount so that the user can visually recognize the display at all times. Alternatively, it may be advisable for the drawing region 5X to move to a position visually recognizable by the user when rotation stops.
[0139] Further, notification examples using sounds are illustrated in Figs. 20C and 20D. For example, when the equipment control mode is active, electronic sounds are produced at regular intervals as illustrated in Fig. 20C. Then, when the equipment control mode has ended, a pattern sound such as a gradually decreasing sound or a pattern sound such as a sound transitioning from a wide-range frequency to a low-range frequency as illustrated in Fig. 20D is produced. Through this, the user can easily recognize the continuation or end of the equipment control mode.
[0140] Next, an example of a notification corresponding to a user’s rotational operation in the equipment control mode will be described using Fig. 21. Fig. 21 illustrates a processing example of the equipment control mode in step S120 of Figs. 10 and 11.
[0141] When a transition to the equipment control mode is made as step S120, the control unit 2 starts a display for equipment control on the display unit 5 in step S200 and notifies the user of the start of the equipment control mode through displays, sounds, vibrations, or the like. Further, the control unit 2 activates the rotational angle detection in step S201, and resets the cumulative angle counter for a rotational operation amount in step S202. The above processing is the same as that illustrated in Fig. 12.
[0142] In step S220, the control unit 2 monitors whether the rotational operation has been performed on the ring 1. During a period where the rotational operation is not performed, the control unit 2 continues the determination of step S220 while monitoring the end trigger of the equipment control mode in step S205.
[0143] When determining that the rotational operation has been performed, the control unit 2 determines in step S221 whether detected information from various sensors of the sensor unit 4 has been acquired correctly. For example, situations where sensing cannot be performed correctly due to wet fingers or the like are determined. Then, when determining that appropriate sensing has not been performed, the control unit 2 proceeds to step S224 to perform the notification of a sensing error. For example, the control unit 2 performs operations such as displaying errors on display unit 5, outputting error sounds or error messages through the sound output unit 6, and generating vibrations indicating errors using the vibration unit 9. Then, the control unit 2 proceeds to step S205.
[0144] When the rotation has been detected and no sensing error has occurred, the control unit 2 proceeds to step S223 to determine whether the rotational operation falls within the control range of the controlled device 100. For example, it is assumed that the controlled device 100 is the TV receiver 102 and the volume is controllable from level 0 to level 30. In this case, when the volume is currently at level 30 and an attempt is made to further increase the volume, the volume cannot be controlled beyond that level. If an attempt is made to decrease the volume when the volume is currently at level 0, the volume cannot be controlled similarly.
[0145] In such a case, that is, when the operation exceeds the controllable range, the control unit 2 proceeds to step S225 to perform the notification of an error based on the control range. For example, the control unit 2 performs operations such as displaying errors on display unit 5, outputting error sounds or error messages through the sound output unit 6, and generating vibrations indicating errors using the vibration unit 9. Then, the control unit 2 proceeds to step S205. Note that the control range may not encompass the entire controllable range of the controlled device 100. For example, when the range controllable by the ring 1 is set between “20” and “30” even if the volume level of the TV receiver 102 is variable between “0” and “50,” the operation of decreasing the volume level below “20” becomes an error based on the control range.
[0146] When determining in steps S221 and S223 that errors have not particularly occurred, the control unit 2 determines in step S203 whether significant rotation has been detected. When the significant rotation has been detected, the control unit 2 proceeds to step S204 to perform processing to transmit information to the relay device 110 or the controlled device 100. Steps S203 and S204 are the same as those illustrated in Fig. 12.
[0147] In step S205, the control unit 2 monitors an end trigger such as a user’s intentional prescribed operation, the elapse of a prescribed time without operations, and an end notification from collaboration equipment. After recognizing the end trigger, the control unit 71 ends the processing of Fig. 21 and proceeds to step S111 of Fig. 10 or 11.
[0148] Through the above processing, the user can be notified of errors occurring due to sensing or the control range when the rotational operation is performed in the equipment control mode.
[0149] Next, an example of a notification of invalid rotation will be described. For example, when the processing of the information display mode is performed in step S120 of Fig. 10 or 11, the rotational angle detection is activated as will be described later in Fig. 28 or the like. Further, when the processing of the equipment control mode is performed in step S120, the rotational angle detection is also activated as described in Fig. 12 or the like. Here, the activation of the rotational angle detection refers to a state where rotational detection and rotational amount calculation are performed, and prescribed processing is performed in accordance with a rotational amount. Even if the rotational angle detection is inactive, it is possible to detect mere rotation. When the processing of the information display mode or the processing of the equipment control mode ends, that is, when a transition to the standby mode is made, it is desirable to inactivate the rotational angle detection to save power.
[0150] However, there is a possibility that the user does not recognize the transition to the standby mode and unintentionally performs a rotational operation considering the standby mode as, for example, the equipment control mode. Therefore, in the standby mode, the user is notified if rotation is detected while the rotational angle detection is inactive.
[0151] A processing example is illustrated in Fig. 22. In the standby mode or the like, the control unit 2 determines in step S300 whether the rotation of the ring 1 has been performed. When detecting the rotation, the control unit 2 then proceeds to step S303 to perform processing to notify the user of invalid rotation being performed through displays, sounds, vibrations, or the like.
[0152] Note that even if the rotation has not been detected, the control unit 2 determines in step S301 whether the user has consciously performed the operation of activating the rotational angle detection. In such a case, the control unit 2 determines in step S302 that the activation operation has been performed. In response to the determination of the activation operation, a transition to, for example, the equipment control mode may be made.
[0153] Next, a processing example of a case where the controlled device 100 or a control content type is changed in the equipment control mode will be described using Fig. 23. The control unit 2 performs the processing of Fig. 23, for example, when the user performs a prescribed operation. A reset button or the like is provided as, for example, the input unit 7, and the control unit 2 determines in step S320 that a device / type change trigger has been generated when the user operates the reset button.
[0154] Alternatively, assuming that operations in specific modes such as tapping with four fingers, specific movements, blowing air, and user’s behaviors identifiable through prescribed sounds and images are reset operations or the like, the control unit 2 may determine that the device / type change trigger has been generated.
[0155] When the device / type change trigger has been generated, the control unit 2 proceeds to step S321 to enter a controlled device change mode. In this case, a device currently serving as the controlled device 100 is presented on, for example, the display unit 5. For example, device types such as the air conditioner 101 and the TV receiver 102 are displayed using names, device icons, or the like.
[0156] In the controlled device change mode, displayed device types are switched as the user rotates the ring 1. It is advisable for the user to perform a confirmation operation while a desired device is displayed. Therefore, the control unit 2 determines the presence or absence of the rotation of the ring 1 in step S322. When detecting the rotation, the control unit 2 performs processing to change the display of the type of the controlled device 100 according to the rotation in step S323.
[0157] In step S324, the control unit 2 monitors a user’s confirmation operation. When detecting the confirmation operation, the control unit 2 recognizes the device displayed at this point as a new controlled device 100. Then, the control unit 2 proceeds to step S325 to transition to a control content type change mode.
[0158] In the control content type change mode, the control unit 2 causes one of settable control content types to be displayed on the display unit 5 according to the type of the determined controlled device 100. If the TV receiver 102 is the controlled device 100, the available control content types include “volume up / down,” “channel up / down,” “screen brightness up / down,” or the like. The control unit 2 causes one of these types to be displayed.
[0159] In the control content type change mode, displayed control content types are switched as the user rotates the ring 1, and it is advisable for the user to perform a confirmation operation while a desired control content type is displayed. Therefore, the control unit 2 determines the presence or absence of the rotation of the ring 1 in step S326. When detecting the rotation, the control unit 2 performs processing to change the display of the control content type according to the rotation in step S327.
[0160] In step S328, the control unit 2 monitors a user’s confirmation operation. When detecting the confirmation operation, the control unit 2 recognizes the control content type displayed at this point as a new control content type. Then, the control unit 2 proceeds to step S329 to perform processing to notify the user of the set controlled device 100 or the control content type, and performs a mode transition in step S330 to return to, for example, the mode immediately before the trigger was detected in step 320.
[0161] Through the above processing, the user can arbitrarily set or switch the controlled device 100 or the control content type. Further, through the notification in step S329, the user can confirm the set controlled device 100 or the control content type.
[0162] An example of a notification to the user is illustrated in Fig. 24A. For example, within the LED display device 5b constituting the display unit 5, the controlled device 100 is represented by the color of light emitted from an LED display device 5b1 located at a specific position for visual recognition, while a control content type is represented by the color of light emitted from an LED display device 5b2. For example, the TV receiver 102 serves as the controlled device 100 if the color of the light emitted from the LED display device 5b1 is red, and volume up / down is represented if the color of the light emitted from the LED display device 5b2 is green. Further, a current volume level may be represented by the number of lights emitted or the positions of emitted lights of LED display devices 5bZ arranged within the LED display device 5b.
[0163] Note that the controlled device 100 and the control content type may be displayed using characters, icons, or the like on the display unit 5. Further, besides displaying information, message sounds such as “TV volume active” may be output from the sound output unit 6.
[0164] Fig. 24B illustrates an example where the controlled device 100 and the control content type are displayed on the smartphone 15 serving as the relay device 110. For example, in step S329 of Fig. 23, the control unit 2 transmits setting contents to the relay device 110. Accordingly, the relay device 110 performs a screen display corresponding to the information of the received setting contents. Further, the relay device 110 may output message sounds such as “TV volume active.”
[0165] Fig. 24C illustrates an example where the TV receiver 102 serving as the controlled device 100 displays a setting. For example, it is assumed that the controlled device 100 has been changed to the TV receiver 102, and the control content type has been changed to volume up / down through a setting change. The control unit 2 of the ring 1 transmits the information to the TV receiver 102 directly or via the relay device 110 in step S329. Accordingly, the TV receiver 102 displays that its volume can now be adjusted using the ring 1. The TV receiver 102 may output message sounds such as “volume can be adjusted using the ring.”
[0166] The above description is an example of a case where the user selects the controlled device 100 and the control content type through the ring 1, but the user may also select the controlled device 100 and the control content type through the relay device 110 such as the smartphone 15. For example, a selection screen as illustrated in Fig. 25 is displayable through an application on the smartphone 15. Check boxes for selecting the controlled device 100 such as “TV,” “music,” “air conditioner,” and “illumination” are provided. When a check box of the controlled device 100 is selected, check boxes for control content types are further displayed. The figure illustrates an example where the TV receiver 102 has been selected, and volume up / down and channel up / down are displayed as the control content types. By using the relay device 110 such as the smartphone 15 as described above, the controlled device 100 and the control content type can be selected or switched extremely easily.
[0167] (3-4: Display Examples in Information Display Mode on Display Unit) Information displays on the display unit 5 of the ring 1 will be described. It is desirable to maintain good user’s visibility regardless of rotation when displaying time, heart rate, remaining battery level, or the like in the information display mode.
[0168] Fig. 26A illustrates an example where a remaining battery level is displayed on the display unit 5. Note that the right side schematically illustrates the ring 1 around a finger and the display unit 5 on the peripheral surface. Here, for the sake of clarity, an example is illustrated where the display unit 5 is not formed around the entire circumference of the ring 1 but covers approximately one-third of the entire circumference of the ring 1. However, the following description also applies to a case where the display unit 5 is formed around the entire circumference. Further, in the case of Fig. 26A, a state where the drawing region 5X is positioned approximately at the center of the range of the display unit 5 is illustrated. In the drawing region 5X, the remaining battery level is displayed.
[0169] In the state illustrated in Fig. 26A, the remaining battery level is displayed in a position on the peripheral surface of the ring 1 that enables favorable visual recognition when the user visually recognizes the ring 1. When the ring 1 is rotated from this state, it becomes difficult to view the display of the remaining battery level as illustrated in Fig. 26B if the drawing region 5X within the display unit 5 remains unchanged.
[0170] Therefore, when the user rotates the ring 1 upward from the state of Fig. 26A, the drawing region 5X within the display unit 5 is changed in the opposite direction as illustrated in Fig. 27A. As a result, the display of the remaining battery level can be visually recognized approximately at the same position as before the rotation as illustrated in Fig. 26A. Further, when the user rotates the ring 1 downward from the state illustrated in Fig. 26A, the drawing region 5X within the display unit 5 is changed in the opposite direction as illustrated in Fig. 27B. As a result, the display of the remaining battery level can be visually recognized approximately at the same position as before the rotation as illustrated in Fig. 26A.
[0171] That is, the drawing region 5X is changed in a direction opposite to a rotational direction, making it possible to make the position of displayed information for visual recognition remain unchanged. The display content becomes easy for the user to view regardless of the rotational operation.
[0172] A control processing example for such a display is illustrated in Fig. 28. Fig. 28 illustrates, for example, a processing example in step S102 of Fig. 10 or 11. Note that an example was previously described where the displayed information content type is switched by the rotation of the ring 1 in the information display mode. Here, it is assumed that the switching between the information content types detected in step S103 of Fig. 10 or 11 includes operations other than rotation such as tapping and sliding the ring 1 in the direction of a finger. Note that an example where the information content type is switched by a rotational operation will be described later using Fig. 32.
[0173] As the processing in step S102 of Fig. 10 or 11, the control unit 2 performs control to cause information to be displayed on the screen in step S401 as illustrated in Fig. 28. For example, time or the like is displayed as a default display setting. Alternatively, if the information content type has been switched as the processing in step S105 of Fig. 10 or 11, the information content is displayed.
[0174] In step S403 of Fig. 28, the control unit 2 activates the rotational angle detection. Note that if the rotational angle detection has already been active, the control unit 2 continues the activation of the rotational angle detection. In step S404, the control unit 2 resets the cumulative angle counter for a rotational operation amount. Then, in step S405, the control unit 2 determines whether a finger touch on the peripheral surface of the ring 1 has been detected.
[0175] If the finger touch has not been detected, the control unit 2 proceeds from step S405 to step S103 of Fig. 10 or 11. Note that an example was previously described where an operation with three or more fingers is regarded as a valid operation to prevent false operations, but this applies to the equipment control mode. In the information display mode, such a limitation is not particularly applied. For example, an operation with a thumb, an operation with two fingers, or the like may also be regarded as a valid operation. This is because false operations do not affect the controlled device 100 in the information display mode.
[0176] During a period where a user’s finger is touching the peripheral surface of the ring 1, the control unit 2 determines in step S406 whether the absolute value of a rotational amount α has exceeded a prescribed rotational amount β. If |α| > β has not been established, the control unit 2 returns to step S405. Accordingly, during a period where the user is performing a rotational operation while touching the ring 1, the control unit 2 performs the determination in step S406.
[0177] Then, when |α| > β has been established, the control unit 2 proceeds to step S407 to shift display information on the display unit 5 by the rotational amount α in a direction opposite to a rotational direction and display the same. In other words, the control unit 2 shifts the drawing region 5X by the rotational amount α in the direction opposite to the rotational direction. As a result, the control unit 2 performs the display in the state illustrated in Figs. 27A and 27B. Then, the control unit 2 proceeds to step S103 in Fig. 10 or 11.
[0178] Through the above processing of Fig. 28, time, heart rate, remaining battery level, or the like is displayed approximately at a constant position for visual recognition regardless of the rotation of the ring 1 in the information display mode. Note that if the prescribed rotational amount β is assumed to be a value corresponding to the angle of one pixel of the display unit 5, the position for visual recognition will be fixed.
[0179] Next, an example where the recognition of a rotational amount by the user is facilitated will be described. Figs. 29A and 29B illustrate an example where an indicator 21 is displayed. The indicator 21 is displayed in, for example, a scale shape at both ends of the peripheral surface of the ring 1.
[0180] Note that the display mode of the indicator 21 is not limited to a scale shape but can take various modes. The indicator 21 may be displayed over the entirety or a part of the display unit 5. However, the display position (displayed pixels) is merely fixed, and the visual recognition position changes according to the rotation of the ring 1. The indicator 21 may take any specific shape, color, or the like. For example, a pattern, background image, or the like may be taken as such.
[0181] For example, the indicator 21 in a scale shape is visually recognized by the user as if the scale moves according to the rotation of the ring 1 since the display position on the display unit 5 does not change. As a result, the user can easily recognize the rotational amount.
[0182] A processing example is illustrated in Fig. 30. Fig. 30 also illustrates a processing example in step S102 of Fig. 10 or 11. When the information display mode is active, the control unit 2 causes information such as time to be displayed on an information display layer in step S410. In this example, the information display layer and an indicator UI layer are set in the display unit 5, and each of the layers is displayed and controlled separately.
[0183] The control unit 2 activates the rotational angle detection in step S403, resets the cumulative angle counter in step S404, and determines in step S405 whether a finger touch on the peripheral surface of the ring 1 has been detected. When the finger touch has not been detected, the control unit 2 proceeds from S405 to step S412 to hide the indicator UI layer. Then, the control unit 2 proceeds to step S103 in Fig. 10 or 11. Accordingly, when the user simply takes a visual posture to view a display content such as time, the indicator 21 is not displayed.
[0184] During a period where a user’s finger is touching the peripheral surface of the ring 1, the control unit 2 performs the display of the indicator UI layer in step S411. In other words, the control unit 2 displays the indicator 21. Then, the control unit 2 determines in step S406 whether the absolute value of a rotational amount α has exceeded a prescribed rotational amount β.
[0185] When |α| > β has been established, the control unit 2 proceeds to step S407A to shift display information on the information display layer in the display unit 5 by the rotational amount α in a direction opposite to a rotational direction and display the same. In other words, the control unit 2 shifts the drawing region 5X by the rotational amount α in the direction opposite to the rotational direction, and draws the display information such as time. As a result, the control unit 2 performs the display in the state illustrated in Figs. 29A and 29B. At this time, the control unit 2 does not shift display pixels for the indicator UI layer. Then, the control unit 2 proceeds to step S103 in Fig. 10 or 11.
[0186] Accordingly, for the user, the indicator 21 moves as the ring 1 rotates, but time, heart rate, or the like is displayed at a constant position for visual recognition. As a result, in the information display mode, time, heart rate, remaining battery level, or the like is displayed at a constant position for visual recognition regardless of the rotation of the ring 1, and the rotational operation amount is easily recognized by the indicator 21.
[0187] Next, an example will be described where a displayed information content type is switched according to rotation, while the display position of information such as time is maintained at a constant position for visual recognition regardless of rotation.
[0188] Fig. 31B illustrates a state where a remaining battery level is displayed on the display unit 5. In this case, approximately the central region in the range of the display unit 5 is assumed to be the drawing region 5X. When the user rotates the ring 1 upward from this state, the drawing region 5X of the remaining battery level is shifted in the direction opposite to the rotation until the ring 1 is rotated by a certain degree of rotational amount. As a result, it is visually recognized that the display position of the remaining battery level remains unchanged. Then, when the user further rotates the ring 1 upward beyond the certain degree of rotation, the displayed information content type is switched as illustrated in Fig. 31A. For example, time is displayed.
[0189] Further, when the user rotates the ring 1 downward from the state illustrated in Fig. 31B, the drawing region 5X of the remaining battery level is shifted in the direction opposite to the rotation until the ring 1 is rotated by a certain degree of rotational amount. As a result, it is visually recognized that the display position of the remaining battery level remains unchanged. Then, when the user further rotates the ring 1 downward beyond the certain degree of rotation, the displayed information content type is switched as illustrated in Fig. 31C. For example, a heart rate is displayed.
[0190] A processing example for performing such a display is illustrated in Fig. 32. Fig. 32 also illustrates a processing example in step S102 of Fig. 10 or 11. When the information display mode is active, the control unit 2 causes information such as time to be displayed on the drawing region 5X of the display unit 5 in step S401.
[0191] The control unit 2 activates the rotational angle detection in step S403, resets the cumulative angle counter in step S404, and determines in step S405 whether a finger touch on the peripheral surface of the ring 1 has been detected. When the finger touch has not been detected, the control unit 2 proceeds from step S405 to step S103 in Fig. 10 or 11. In this case, in step S103, a display switch operation other than a rotational operation for the ring 1 is monitored as any operation.
[0192] During a period where a user’s finger is touching the peripheral surface of the ring 1, the control unit 2 determines in step S406 whether the absolute value of a rotational amount α has exceeded a prescribed rotational amount β. When |α| > β has been established, the control unit 2 proceeds to step S407A to shift display information on the information display layer in the display unit 5 by the rotational amount α in a direction opposite to a rotational direction and display the same. In other words, the control unit 2 shifts the drawing region 5X by the rotational amount α in the direction opposite to the rotational direction, and draws the display information such as time.
[0193] Moreover, in step S420, the control unit 2 determines whether the absolute value of the rotational amount α has exceeded a second prescribed rotational amount γ. Note that γ is assumed to be greater than β. When |α| > γ has not been established, the control unit 2 returns to step S405. When determining that |α| > γ has been established, the control unit 2 determines that the display switch operation has been performed through the rotation of the ring, and proceeds to step S105 of Fig. 10 or 11 to perform processing to change the displayed information content type.
[0194] Through the above processing, in the information display mode, time or like is displayed at a constant position for visual recognition regardless of the rotation of the ring 1, and the displayed information content type is switched when the ring 1 is rotated by a relatively large amount.
[0195] An example will be described where the rotational amount until the switch of the displayed information content type is more easily understood. Fig. 33A illustrates an example where the drawing region 5X is positioned approximately at the center of the display unit 5 and the remaining battery level is displayed. In this case, as described in Fig. 30, the display unit 5 is provided with the information display layer and the indicator UI layer to perform the display. Then, a state where a remaining battery level is displayed as illustrated in Fig. 33A is switched to a state where a heart rate is displayed as illustrated in Fig. 33B.
[0196] Figs. 34A, 34B, and 34C exemplify the display state of an information display layer L1 and an indicator UI layer L2 during the display switching process. In reality, the information display layer L1 and the indicator UI layer L2 are visually recognized as overlapping. On the information display layer L1, reference lines 22 are displayed together with the display of a remaining battery level or the like. The reference lines 22 are displayed to be shifted in the direction opposite to rotation together with the display of the remaining battery level when the ring 1 is rotated. Therefore, the user’s visual recognition position remains unchanged. On the other hand, on the indicator 21 in the indicator UI layer L2, a boundary line 21a is displayed at a prescribed position. The display position (display pixels) of the indicator 21 including the boundary line 21a remains unchanged. Therefore, it is visually recognized that the indicator 21 rotates according to the rotation of the ring 1.
[0197] Therefore, when the user rotates the ring 1 from the state illustrated in Fig. 34A, the information display layer L1 and the indicator UI layer L2 are displayed as illustrated in Fig. 34B, resulting in the state where the boundary line 21a approaches the reference line 22. Then, for example, when the boundary line 21a has reached the reference line 22 as illustrated in Fig. 34C, the displayed information content type is switched to, for example, a heart rate.
[0198] For example, when switching the displayed information content type through the rotational operation as illustrated in Fig. 32 described above, the display of the boundary line 21a or the reference lines 22 in combination with the display of the indicator 21 as illustrated in Fig. 30 described above makes it easy for the user to understand to what degree the ring 1 is rotated to switch the displayed information content type.
[0199] (3-5: Display Examples in Equipment Control Mode) Next, display examples in the equipment control mode will be described. The following various display examples include an example of a display that the control unit 2 causes the display unit 5 to appropriately perform or an example of a display that the control unit 71 causes the display unit 77 to perform in the relay device 110.
[0200] When operating the controlled device 100, it is desirable for the user to clearly recognize the rotational direction of the ring 1. For example, it is desirable to align the recognition of the up / down direction in operations such as volume adjustment and temperature setting with the rotational direction of the ring 1. Therefore, it is advisable to recognize the direction or rotational amount through colors, numeric values, or the like during rotation.
[0201] Fig. 35A illustrates an example where the rotational direction is represented by colors in a specific region 5X1 on the display unit 5. The specific region 5X1 does not refer to specific pixels or a specific pixel region but refers to a specific position for user’s visual recognition. In other words, the specific region 5X1 is shifted in the opposite direction within the display unit 5 according to the rotation of the ring 1, enabling the user to view the specific region 5X1 at a constant position.
[0202] For example, when the ring 1 is not rotated in the equipment control mode, green is displayed in the specific region 5X1. Then, when the ring 1 is rotated in the direction of increasing a numeric value operated by the user (such as volume up and setting temperature up), the color of the specific region 5X1 changes to red. Further, when the ring 1 is rotated in the direction of decreasing the numeric value operated by the user (such as volume down and setting temperature down), the color of the specific region 5X1 changes to blue. When the rotation is stopped, the color returns to green. The rotational direction is represented by the colors as described above, enabling the user to recognize a control direction for the controlled device 100.
[0203] Further, as illustrated in Fig. 35B, a second specific region 5X2 may be provided. In the specific region 5X2, the rotational angle may be displayed to indicate the degree to which the ring 1 has been rotated. Moreover, as illustrated in Fig. 35C, directions from the 1’ clock position to the 12’ clock position may be represented by numeric values ranging 1 to 12 of a clock in the specific region 5X2 according to the rotation, enabling the display of the rotational position.
[0204] While displaying the rotational direction or rotational position as described above, it may be advisable to rotate the ring 1 by the rotational amount to change control values for volume up / down or the like, that is, by the rotational amount detected in Fig. 12 as significant rotation, and generate the electronic sounds or vibrations during the transmission of information to notify the user of the execution of one-stage control.
[0205] Further, the rotational direction may be indicated by sounds. For example, when the ring 1 is rotated in the up direction, a sound gradually transitioning to a higher frequency may be generated. When the ring 1 is rotated in the down direction, a sound gradually transitioning to a lower frequency may be generated.
[0206] Next, the presentation of an operable rotational direction will be described. The operable rotational direction refers to a rotational direction where a rotational operation becomes valid within the range from the upper limit to the lower limit among the control values of the controlled device 100. For example, if the volume level of the TV receiver 102 is at the lower limit value, it is not possible to further decrease the volume level. For example, rotation in the down direction becomes an invalid operation. Therefore, a rotational direction currently valid as an operation is displayed.
[0207] For example, the specific region 5X1 of the display unit 5 is used as illustrated in Fig. 36A. When it is assumed that the up direction is represented by red and the down direction is represented by blue, the display color of the specific region 5X1 alternates between red (R) and blue (B) as illustrated in Fig. 36B if both up and down operations are currently valid. If only the up direction is valid, the specific region 5X1 continues to be displayed in red (R) as illustrated in Fig. 36C. If only the down direction is valid, the specific region 5X1 continues to be displayed in blue (B) as illustrated in Fig. 36C.
[0208] Next, an example will be described where the rotational direction or rotational speed is guided to the user. The rotation by the user is guided when an appropriate rotational direction or appropriate rotational speed is assumed as a rotational operation for operating the controlled device 100.
[0209] As illustrated in Fig. 37A, the display unit 5 is provided with a specific region 5X3. In the specific region 5X3, a lighted position changes at a prescribed speed as illustrated in Fig. 37B. In this case, the change direction of the lighted position represents the guide of the rotational direction, while the change speed of the lighted position represents the guide of the rotational speed. Fig. 37B illustrates an example where the rotation in the down direction is guided. Through such guide displays, the user can perform appropriate rotational operations.
[0210] Next, the existence of matters enabling operations or selection on the side of the controlled device 100 or examples of presenting situations based on operations will be described. For example, it is assumed that the ring 1 has performed short-range wireless communication with the TV receiver 102 and found the TV receiver 102 as a device that can serve as the controlled device 100. In this case, a blinking display using blue (B) is performed in, for example, the specific region 5X1 described above or the like of the display unit 5 as illustrated in Fig. 38A. This aims to notify the user that the power-on control of the TV receiver 102 is enabled.
[0211] In response to this, it is assumed that the user has performed the rotational operation of the ring 1 to power on the TV receiver 102. In this case, the display of the specific region 5X1 is switched from blinking to lighting in blue (B) as illustrated in Fig. 38B.
[0212] Fig. 39A illustrates a case where there a plurality of operable contents. For example, in the specific region 5X1 of the display unit 5, different colors such as blue (B), red (R), and green (G) are sequentially switched. In this case, each of blue, red, and green indicates a specific selection state. This display represents a situation where the switching operation of three modes in the controlled device 100 is, for example, enabled by the rotational operation of the ring 1.
[0213] It is assumed that the user has performed an operation to select a mode corresponding to blue through the rotational operation. In this case, the specific region 5X1 is, for example, displayed as illustrated in Fig. 39B. In the display, blue is lighted in a long period of time, while red and green are lighted in a short period of time. As a result, a state where the mode corresponding to blue has been selected is presented. The operation may be performed in the way as illustrated in Fig. 39C. Oblique lines in the figure represent a low-brightness display. In other words, a state where the mode corresponding to blue has been selected is presented by repeatedly emitting blue light at high brightness while emitting red light and green light at low brightness in the specific region 5X1.
[0214] Next, an example where a control range based on the rotation of the ring 1 is set will be described. For example, a range, changed step width, or the like controllable on the basis of the rotation of the ring 1 may be arbitrarily set for each device type of the controlled device 100.
[0215] Fig. 40 illustrates an example of a setting screen where an application corresponding to the ring 1 activates in the smartphone 15 serving as the relay device 110. For example, with respect to the TV receiver 102, audio equipment, air conditioner 101, illumination equipment, or the like as a device type of the controlled device 100, the horizontal axis is represented as a control range, while the inclination is indicated as the change width (sensitivity) of a control value corresponding to rotational operations.
[0216] For example, when it is assumed that the minimum value is at level 0 and the maximum value is at level 50 in regard to the volume levels of the TV receiver 102, the range controllable on the basis of the rotation of the ring 1 can be set as the range from level 15 to level 35, or the like. Further, a change amount according to the rotation of the ring 1, that is, sensitivity can be set on the basis of the inclination of the control range.
[0217] Through a setting operation on the screen of the smartphone 15 to change the size or shape of black-painted portions illustrated in the figure, the user can adjust the control range or sensitivity with the ring 1. Regarding the rotation of the ring 1, the restriction of the control range can prevent the unnecessary operation of the controlled device 100 caused by excessive rotation. For example, a situation where the volume level of the TV receiver 102 becomes excessive due to the unnecessary operation of the ring 1 can be prevented.
[0218] Figs. 41A and 41B illustrate an example where the relay device 110 and the ring 1 collaborate with each other to perform the settings of the control range and the rotational amount of the ring 1.
[0219] For example, the smartphone 15 displays a screen as illustrated in Fig. 41A, enabling the user to adjust a control range within the adjustable volume range (for example, from level 0 to level 50) as settings for the volume of the TV receiver 102, or the like. For example, the range from levels 20 to 30, or the like is set.
[0220] At this time, the user is requested to perform the rotational operation of the ring 1 by one step. After user rotates the ring 1 by one step (one level), the ring 1 notifies the smartphone 15 of the rotational amount. As a result, the smartphone 15 recognizes the rotational amount corresponding to the one step, and presents a rotational amount corresponding to the set range from level 20 to level 30 as illustrated in Fig. 41B.
[0221] For example, in the way described above, the one-step operation corresponding to the user’s rotational operation is recognized in a system, enabling the control of volume up / down using the rotational amount as a reference. Further, the user can understand the degree of the entire rotational operation amount of the control range.
[0222] Note that the control content types for each device type of the controlled device 100 assumed to be performed by the rotational operation of the ring 1 will be exemplified.
[0223] For the TV receiver 102, operations such as switching between reception channels, adjusting volume levels, adjusting brightness, and adjusting colors are available. For the air conditioner 101, operations such as adjusting setting temperatures, selecting modes (heating, cooling, dehumidification, blowing), and adjusting flow are available. For the audio equipment, operations such as adjusting volume levels, selecting music, skipping music, and playback speeds (fast-forward, fast-rewind) are available. For the illumination equipment, operations such as selecting illumination colors and adjusting brightness are available.
[0224] When the smartphone 15 is used as the controlled device 100 instead of the relay device 110, control content types may include operations such as selecting applications, transitioning between windows, selecting various setting values, selecting modes, and adjusting volume levels.
[0225] Further, various examples of control achievable through the rotational operation of the ring 1 can be considered in device types or control content types not exemplified above.
[0226] <4. Summary and Modified Examples> According to the above embodiment, the following effects can be obtained.
[0227] In the embodiment, the ring 1 or the relay device 110 is provided as an example of an information processing device. The ring 1 includes the control unit 2 that performs processing to cause information based on the rotational operation on the ring 1 worn on a user’s finger to be transmitted from the communication unit 8 to an external device. The relay device 110 includes the control unit 71 that performs processing to cause information based on a rotational operation to be transmitted from the communication unit 80 to the external device, the rotational operation being performed by a user on the ring 1 worn on the finger thereof. The information processing device serving as the ring 1 or the relay device 110 performs the transmission processing of detected information or control information on the basis of the rotational operation on the ring 1. As a result, an environment where the user operates the controlled device 100 through the operation of the ring 1 worn on the finger can be realized.
[0228] The ring 1 serving as an information processing device according to the embodiment is formed by the body unit 12 that is annular and capable of being worn on a user’s finger, and includes the control unit 2, the communication unit 8, and the sensor unit 4 that detects a rotational operation inside the body unit 12. In other words, the information processing device includes the control unit 2, the communication unit 8, and the sensor unit 4 inside the body unit 12, and serves as the ring 1 that transmits the detected information of rotation or control information based on the detected information in response to a user’s rotational operation. The ring 1 is configured to transmit the detected information of the rotational operation of the body unit 12 or control information based on the detected information of the rotational operation to an external device. That is, the information processing device that functions as an operating device is realized as the ring 1.
[0229] Note that the ring 1 detects a rotational operation as a user’s displacement operation. However, the ring 1 may detect the operation of sliding the body unit 12 in the direction of a finger (direction to insert and remove the ring 1 from the finger) as the displacement operation, and transmit detected information or control information on the basis of the operation. In this case, assuming that the operation of moving the ring 1 in the direction to wear the same on the finger corresponds to the operation of rotating the ring 1 in a forward direction and that the operation of moving the ring 1 in the direction to remove the same from the finger corresponds to the operation of rotating the ring 1 in an opposite direction, the ring 1 may perform the same operation as in the rotational operation of the embodiment. Moreover, the ring 1 may transmit detected information or control information corresponding to user’s operations to the body unit 12 such as touching, tapping, stroking, pinching, and touching within a prescribed period of time. Further, the ring 1 may transmit detected information or control information corresponding to operations to the body unit 12 such as inputting sounds, inputting gestures, inputting facial expressions, and blowing air. Further, the ring 1 may transmit detected information or control information corresponding to the inputs of various combinations of these operations. Further, the ring 1 may transmit detected information or control information corresponding to positional relationships with the relay device 110 or positional relationships with the controlled device 100.
[0230] The relay device 110 serving as an information processing device according to the embodiment includes the control unit 71 and the communication unit 80 that is capable of performing communication with the ring 1 and the controlled device 100. In other words, the information processing device includes the control unit 71 and the communication unit 80 illustrated in Fig. 6, and serves as the relay device 110 that transmits control information based on detected information or the detected information on the basis of information from the ring 1. With the provision of the relay device 110, a system can be realized where heavy processing loads for the ring 1 are performed on the side of the relay device 110.
[0231] An example was provided where the control unit 2 of the ring 1 according to the embodiment recognizes a user’s rotational operation in a prescribed mode on the ring 1 as a valid operation and performs processing to cause information to be transmitted from the communication unit 8 to an external device in response to the valid operation (see Figs. 18 and 19). As a result, when the user unconsciously touches or rotates the ring 1, the ring 1 can be prevented from transmitting detected information or control information.
[0232] Note that an example was provided where the control unit 2 of the ring 1 determines a valid operation. However, the control unit 71 of the relay device 110 may perform a valid operation. For example, by transmitting information for determining a valid operation such as sensing spot information from the ring 1 to the relay device 110, it becomes possible to perform a determination with the control unit 71 of the relay device 110 and prevent the transmission of control information or the like to the controlled device 100. Furthermore, by transmitting information for determining a valid operation to the controlled device 100, it becomes possible for the control unit 121 to determine whether the received control information is valid and perform processing corresponding to the control information only when the control information is valid.
[0233] An example was provided where the control unit 2 of the ring 1 according to the embodiment determines a rotational operation in a state where touching the ring 1 with three or more fingers of another hand that are different from a user’s finger wearing the ring 1 as a rotational operation in a prescribed mode (see Figs. 18 and 19). For example, it is highly likely that other fingers of a hand wearing the ring 1 unconsciously touch or rotate the ring 1, or that one or two fingers of another hand unconsciously touch the ring 1. If the rotational operation is recognized in such a case, the controlled device 100 performs corresponding processing against a user’s intention. On the other hand, when the user performs the rotational operation with three or more fingers of the hand different from the hand wearing the ring 1, the rotational operation can be assumed as a conscious operation. Therefore, by recognizing a rotational operation in such a mode as a valid operation, it becomes possible to prevent false operations. Note that the above example of a rotational operation with three or more fingers is just one example. For example, various operations in prescribed modes such as rotating the ring 1 while strongly pinching the same and tapping the ring 1 once and then rotating the same are considered as valid operations.
[0234] An example was provided where the control unit 2 of the ring 1 according to the embodiment performs processing to cause information based on a rotational operation to be transmitted from the communication unit 8 to an external device when the operating mode is the equipment control mode (see Fig. 12 or the like). Further, an example was provided where the control unit 2 of the ring 1 or the control unit 71 of the relay device 110 performs control processing to notify the user that the equipment control mode is active (see step S200 in Fig. 12 or the like). The ring 1 switches the operating mode to the equipment control mode in response to any trigger such as instructions from the relay device 110 and a user’s operation, and performs information transmission based on a rotational operation during the activation period of the equipment control mode. As a result, the unnecessary transmission of control information to the controlled device 100 due to the rotation of the ring 1 can be prevented during periods where the equipment control mode is not active. Further, when the equipment control mode starts or when the equipment control mode is active, the ring 1 or the relay device 110 notifies the user that the equipment control mode is active, enabling the user to recognize whether control operations for the controlled device 100 are possible and appropriately perform operations with the ring 1. Note that notifications to the user include notifications through displays, notifications through sounds, notifications through vibrations, or the like.
[0235] An example was provided where the control unit 2 of the ring 1 or the control unit 71 of the relay device 110 performs control processing to notify the user of the end of the equipment control mode when the equipment control mode ends (see step S111 or the like in Figs. 10 and 11). The user is notified of when the equipment control mode ends in the ring 1, enabling the user to recognize that rotational operations for operating the controlled device 100 become invalid and prevent the false recognition of problems such as malfunctions.
[0236] In the embodiment, an example was provided where the control unit 2 performs control processing to notify the user of uncontrollability when detecting a rotational operation corresponding to control beyond the limitation of a variable control range in the controlled device 100 during the equipment control mode (see steps S223, S225, or the like in Fig. 21). For example, the user is notified of when a rotational operation to further decrease the volume is performed but corresponding processing on the side of the controlled device 100 is not possible in a case where the volume of the controlled device 100 is at 0. As a result, the user can recognize that the variable control of the controlled device 100 has reached its limit value.
[0237] In the embodiment, an example was provided where the control unit 2 performs control processing to notify the user of abnormal detection when determining that the detection of a rotational operation is abnormal (see steps S221, S224, or the like in Fig. 21). As a result, the user is notified of when the equipment control mode in the ring 1 ends, enabling the user to recognize that rotational operations for operating the controlled device 100 become invalid and prevent the false recognition of problems such as malfunctions.
[0238] In the embodiment, an example was provided where the controlled device 100 serving as a transmission destination for information based on the rotational operation of the ring 1 or control content types are variably settable (see Fig. 23 or the like). As the controlled devices 100 corresponding to a rotational operation, devices such as the air conditioner 101, the TV receiver 102, and the smartphone 15 can be switched. Further, control content types corresponding to the rotational operation for the selected controlled device 100 can be switched. For example, for the air conditioner 101, control content types such as setting temperature, operating mode (heating, cooling, blowing, dehumidification), and wind direction are switched. For the TV receiver 102, control content types such as volume up / down, channel up / down, brightness settings, and color settings are switched. With these variable settings, the ring 1 can be universally used as an operating device for a multiplicity of devices.
[0239] In the embodiment, an example was provided where the control unit 2 performs control processing to notify the user of the controlled device 100 or a control content type in response to the change in the settings of the controlled device 100 serving as a transmission destination for information based on the rotational operation of the ring 1 or the control content type (see step S329 or the like in Fig. 23). Through this notification, the user can operate the ring 1 while understanding which controlled device 100 or control content type the ring 1 is currently targeting.
[0240] In the ring 1 according to the embodiment, the body unit 12 includes the display unit 5, and the control unit 2 performs control to cause the display unit 5 to perform an information display. In other words, the processing of the information display mode is performed. The displayed information includes, for example, date and time, time, biometric information such as heart rate and blood pressure, remaining battery level, or the like. As a result, the user can visually recognize the display of various information on the ring 1.
[0241] In the embodiment, an example was provided where the control unit 2 performs control to cause the display unit 5 to perform an information display when the user has taken a visual posture to visually recognize the display unit 5 (see Figs. 10, 11, or the like). For example, the control unit 2 detects that the user has taken a visual posture to visually recognize the ring 1 worn on a finger thereof on the basis of a detected value of an acceleration sensor, each speed sensor, a direction sensor, or the like. In this case, the control unit 2 causes the display unit 5 to perform an information display. As a result, unnecessary displays, such as those appearing when the user is not viewing, can be prevented, which is effective in terms of reducing power consumption. Further, it is also effective in terms of preventing user’s biometric information or the like from being viewed by others. Note that the information display mode may start on the basis of any trigger other than a visual posture. Further, the information display mode may be active at all times except for the equipment control mode.
[0242] In the ring 1 according to the embodiment, an example was provided where the control unit 2 performs control to change a display position so that information is displayed in a range visually recognizable by the user in the display unit 5 in response to a rotational operation on the ring 1 (see Figs. 27 to 34 or the like). The display position of the display unit 5 is changed on the basis of the rotation of the ring 1 to prevent display information from being hidden for the user. As a result, the user can favorably confirm display information at all times.
[0243] In the embodiment, an example was provided where the control unit 2 performs control to change an information content type displayed on the display unit 5 in response to a display switch operation on the ring 1 (see Figs. 10, 11, 32, or the like). The information content type displayed on the display unit 5 of the ring 1 is switched in response to a user’s operation, enabling the user to easily confirm various information contents.
[0244] In the embodiment, an example was provided where the control unit 2 performs control to display the information of a hidden information content type on the display unit 5 when a rotational operation amount for the ring 1 exceeds a prescribed rotation amount (see Fig. 32). For example, the displayed information content type is switched for every prescribed rotation amount of the ring 1. As a result, the user can confirm various information contents through a simple operation such as the rotation of the ring 1. Note that the information of a new information content type may be additionally displayed as illustrated in Fig. 14 instead of the switching of the displayed information content type.
[0245] In the embodiment, an example was provided where the control unit 2 performs control to cause the indicator 21 of which the display position within the display unit 5 remains unchanged in response to the rotational operation on the ring 1 to be displayed on the display unit 5 (see Fig. 30 or the like). That is, the indicator 21 not shifted for user’s visual recognition after the rotational operation on the ring 1 is displayed. By using the indicator 21 as a reference and making a comparison with a display where the position is fixed for visual recognition position in response to a rotational operation, the user can easily recognize a rotational operation amount.
[0246] In the embodiment, an example was provided where the control unit 2 performs control to cause the display unit 5 to display the guide of a rotational operation direction (see Figs. 36, 37, or the like). When an upper limit or lower limit has been reached within the controllable range of the controlled device 100, a display for guiding a valid rotational direction is performed. As a result, the user can be prevented from performing unnecessary rotational operations.
[0247] A program according to the embodiment is a program that causes an information processing device to perform processing to transmit information based on a rotational operation to an external device, the rotational operation being performed by the user on the ring 1 worn on a finger thereof. The program causes an information processing device such as a CPU and DSP or a device including these processors to perform, for example, the processing in Figs. 8, 9, 10, 11, 12, 11, 19, 21, 22, 23, 28, 30, and 32. Such a program can realize the functions of the ring 1 or the relay device 110.
[0248] Such a program can be recorded in advance on an HDD serving as a recording medium included in equipment such as a computer device, or on a ROM in a microcomputer having a CPU, or the like. Alternatively, the program can be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), Blu-ray Disc (TM), magnetic disk, semiconductor memory, and memory card. Such a removable recording medium can be provided as so-called package software. Further, such a program can also be downloaded from download sites via networks such as a LAN (Local Area Network) and the Internet, besides being installed into personal computers from removable recording media.
[0249] Further, such a program is suitable for widespread distribution of the information processing device according to the embodiment. For example, by downloading the program into mobile terminal devices such as smartphones and tablets, imaging devices, portable telephones, personal computers, video game machines, or the like, the smartphones or the like can function as the relay devices 110 according to the present disclosure. Further, a ring-shaped device with the program installed therein can function as the ring 1 according to the present disclosure.
[0250] Note that the effects described in the present specification are provided only for exemplification and not limited. Further, other effects may be produced.
[0251] Note that the present technology can also employ the following configurations. (1) An information processing device including: a control unit that performs processing to cause information based on a displacement operation to be transmitted from a communication unit to an external device, the displacement operation being performed by a user to relatively move a ring worn on a finger thereof relative to the finger. (2) The information processing device according to (1), wherein the ring is formed by a body unit that is annular and capable of being worn on a user’s finger, and includes the control unit, the communication unit, and a sensor unit that detects the displacement operation inside the body unit. (3) The information processing device according to (1), including: the control unit; and a communication unit that is capable of communicating with the ring and a controlled device. (4) The information processing device according to (1) or (2), wherein the control unit recognizes a user’s rotational operation in a prescribed mode on the ring as a valid operation and performs processing to cause information to be transmitted from the communication unit to an external device in response to the valid operation. (5) The information processing device according to (4), wherein the control unit determines the displacement operation, where the ring is touched with three or more fingers of another hand that are different from a user’s finger wearing the ring, as the rotational operation in the prescribed mode. (6) The information processing device according to any of (1) to (5), wherein the control unit performs processing to cause the information based on the displacement operation to be transmitted from the communication unit to an external device when an operating mode is an equipment control mode, and performs control processing to notify a user that the equipment control mode is active. (7) The information processing device according to (6), wherein the control unit performs control processing to notify a user of an end of the equipment control mode when the equipment control mode ends. (8) The information processing device according to (6) or (7), wherein the control unit performs control processing to notify a user of uncontrollability when detecting the displacement operation corresponding to control beyond limitation of a variable control range in a controlled device during the equipment control mode. (9) The information processing device according to any of (1) to (8), wherein the control unit performs control processing to notify a user of abnormal detection when determining that detection of the displacement operation is abnormal. (10) The information processing device according to any of (1) to (9), wherein a controlled device serving as a transmission destination for information based on the displacement operation or a control content type is variably settable. (11) The information processing device according to (10), wherein the control unit performs control processing to notify a controlled device or a control content type in response to a change in a setting of the controlled device serving as a transmission destination for information based on the displacement operation or the control content type. (12) The information processing device according to (2), wherein the body unit includes a display unit, and the control unit performs control to cause the display unit to perform an information display. (13) The information processing device according to (12), wherein the control unit performs control to cause the display unit to perform an information display when determining hat user has taken a visual posture to visually recognize the display unit. (14) The information processing device according to (12) or (13), wherein the control unit performs control to change a display position so that information is displayed in a user’s visually recognizable range of the display unit in response to a rotational operation on the ring. (15) The information processing device according to any of (12) to (14), wherein the control unit performs control to change an information content type displayed on the display unit in response to a display switch operation on the ring. (16) The information processing device according to any of (12) to (15), wherein the control unit performs control to display information of a hidden information content type on the display unit when a rotational operation amount for the ring exceeds a prescribed rotation amount. (17) The information processing device according to (15) or (16), wherein the control unit performs control to cause an indicator of which a display position within the display unit remains unchanged to be displayed on the display unit in response to a rotational operation on the ring. (18) The information processing device according to any of (12) to (17), wherein the control unit performs control to cause the display unit to display a guide of a rotational operation direction. (19) An information processing method including: performing, by an information processing device, processing to transmit information based on a displacement operation to an external device, the displacement operation being performed by a user to relatively move a ring worn on a finger thereof relative to the finger. (20) A program that causes an information processing device to perform processing to transmit information based on a displacement operation to an external device, the displacement operation being performed by a user to relatively move a ring worn on a finger thereof relative to the finger.
[0252] 1 Ring 2 Control unit 3 Storage unit 4 Sensor unit 5 Display unit 5A Specific region 5X Drawing region 6 Sound output unit 7 Input unit 8 Communication unit 9 Vibration unit 10 Power unit 11 Battery 12 Body unit 15 Smartphone 21 Indicator 22 Reference line 71 Control unit 100 Controlled device 101 Air conditioner 102 TV receiver 110 Relay device
Claims
1. A ring-shaped device, comprising: processing circuitry configured to: detect an interaction between one or more finger and the ring-shaped device; and control at least one of the ring-shaped device or a controlled device based upon the detected interaction between the one or more finger and the ring-shaped device.
2. The ring-shaped device according to claim 1, wherein, to control the controlled device, the processing circuitry is configured to transmit information related to the detected interaction between the one or more finger and the ring-shaped device directly to the controlled device.
3. The ring-shaped device according to claim 1, wherein, to control the controlled device, the processing circuitry is configured to transmit information related to the detected interaction between the one or more finger and the ring-shaped device to a relay device that is connected between the ring-shaped device and the controlled device.
4. The ring-shaped device according to claim 2, wherein the information transmitted directly to the controlled device includes detected information corresponding to the detected interaction between the one or more finger and the ring-shaped device or control information including a control command corresponding to the detected interaction between the one or more finger and the ring-shaped device.
5. The ring-shaped device according to claim 3, wherein the information transmitted to the relay device includes detected information corresponding to the detected interaction between the one or more finger and the ring-shaped device or control information including a control command corresponding to the detected interaction between the one or more finger and the ring-shaped device.
6. The ring-shaped device according to claim 1, further comprising a display, wherein the processing circuitry is configured to control the ring-shaped device such that a display state of display information on the display is changed based upon the detected interaction between the one or more finger and the ring-shaped device.
7. The ring-shaped device according to claim 6, wherein the processing circuitry is configured to: detect a movement of the one or more finger with respect to the ring-shaped device or of the ring-shaped device with respect to the one or more finger; and change the display state of the display by shifting the display information based on a direction of the movement of the one or more finger with respect to the ring-shaped device or of the ring-shaped device with respect to the one or more finger.
8. The ring-shaped device according to claim 7, wherein the processing circuity is configured to change the display state by shifting the display information in a direction that is opposite to the direction of the movement of the one or more finger with respect to the ring-shaped device or of the ring-shaped device with respect to the one or more finger.
9. The ring-shaped device according to claim 1, further comprising a display, wherein the processing circuitry is configured to control the ring-shaped device such that the display displays content related to the control of the controlled device.
10. The ring-shaped device according to claim 1, wherein the processing circuitry is configured to control the ring-shaped device to present a notification to a user based upon the detected interaction between the one or more finger and the ring-shaped device.
11. The ring-shaped device according to claim 10, wherein the notification includes at least one of a display, a light, a vibration, or a sound.
12. The ring-shaped device according to claim 1, wherein the detected interaction between the one or more finger and the ring-shaped device includes a rotation of the ring-shaped device about the one or more finger.
13. The ring-shaped device according to claim 1, wherein the detected interaction between one or more finger and the ring-shaped device includes a movement of the ring-shaped device in a direction of the one or more finger.
14. The ring-shaped device according to claim 1, wherein the detected interaction between the one or more finger and the ring-shaped device includes one of a pinch, a tap, a swipe, a trace, a long press, and a stroke.
15. The ring-shaped device according to claim 1, wherein the processing circuitry is configured to determine a number of the one or more finger included in the detected interaction between the one or more finger and the ring-shaped device.
16. The ring-shaped device according to claim 15, wherein the processing circuitry is configured to determine that the detected interaction between the one or more finger and the ring-shaped device is an unintentional control when the number of the one or more finger is less than three.
17. The ring-shaped device according to claim 6, wherein the display information includes a date and a time, the time, biometric information, or a remaining battery level.
18. The ring-shaped device according to claim 1, wherein the processing circuitry is configured to control the at least one of the ring-shaped device or the controlled device based upon at least one of speech, a gesture, a facial expression, a blink, or breath.
19. A system comprising: a relay device; and a ring-shaped device including processing circuitry configured to: detect an interaction between one or more finger and the ring-shaped device; control at least one of the ring-shaped device or a controlled device based upon the interaction between the one or more finger and the ring-shaped device using the relay device; and control the at least one of the ring-shaped device or the controlled device based upon the interaction between the one or more finger and the ring-shaped device without using the relay device.
20. A method comprising: detecting an interaction between one or more finger and a ring-shaped device; and controlling at least one of the ring-shaped device or a controlled device based upon the interaction between the one or more finger and the ring-shaped device.
Citation Information
Patent Citations
Display device, driving method of display device, program, and memory medium
US20150077438A1
Ring-type mobile terminal
US20160034742A1
Wearable ring device and user interface processing
US20220413609A1
Wearable device and method for detecting motion gesture of wearable device
US20230325006A1