Device and program

Abstract

To enable a mode of a device to be switched to a mode for operating another device even without always seeing a display screen of the device.SOLUTION: A first device 100 is rotatable around an attachment portion 30 in a state of being attached to the attachment portion 30. Specifically, the first device 100 is rotatable in a direction indicated by an arrow 5A in (A). With this rotation, orientation of the first device 100 changes. A CPU provided in the first device 100 shifts a mode of the first device 100 from a first mode to a second mode according to attachment of the first divice 100 in a predetermined second direction with respect to the attachment portion 30 of a user.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an apparatus and a program. [Background technology]

[0002] Patent Document 1 discloses an electronic device that also operates in cooperation with an external device that operates in cooperation with the information processing device via second driver software installed in the information processing device. Patent Document 2 discloses a process in which a first wearable terminal or a second wearable terminal detects that a user's gaze is directed toward a second wearable terminal, and an operation screen of an electronic device is displayed on the second wearable terminal. Patent document 3 discloses a process of recognizing a hand area on a camera image, extracting a search image from a search image range that is in a predetermined positional relationship with the hand area, and transmitting a search request including the search image to an image recognition server to perform the search. Patent document 4 discloses a wireless communication terminal that includes a communication means for connecting to an external device and communicating wirelessly, a detection means for detecting changes in the state of attachment to the body, and a control means for controlling the connection state of the wireless communication with the external device in response to the detected change in the state of attachment. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-156186 [Patent Document 2] Japanese Patent Application Laid-Open No. 2017-152890 [Patent Document 3] Japanese Patent Application Laid-Open No. 2016-115125 [Patent Document 4] Japanese Patent Application Laid-Open No. 2017-5292 Summary of the Invention [Problem to be solved by the invention]

[0004] To switch the mode of a device to a mode that allows the user to operate other devices, the user must switch the mode while looking at the display screen of the device, for example. An object of the present invention is to enable a user to switch the mode of a device to a mode that allows the user to operate another device without necessarily looking at the display screen of the device. [Means for solving the problem]

[0005] The invention described in claim 1 has a processor. and attached to the user's body part. A device that allows a user to operate another device through the device, the processor comprising: Detecting the orientation of the device attached to the attachment site; The device is The above and in response to the device being attached in a second orientation relative to the attachment site, changing the mode of the device to: Through the device The device causes the other device to transition to a second mode in which operation is permitted. The invention described in claim 2 is the device described in claim 1, wherein the device is rotatable around the attachment site while attached to the attachment site, and the attachment orientation of the device changes by rotating the device around the attachment site as an axis. The invention described in claim 3 is the device described in claim 1, wherein the processor transitions the mode of the device from a first mode corresponding to the first orientation to the second mode in response to a change in the orientation of the device being worn from a first orientation different from the second orientation relative to the wearing location to the second orientation. The invention described in claim 4 is the device described in claim 1, wherein the device has a rotatable part, the wearing orientation of the device changes by rotating the rotatable part, and the processor transitions the mode of the device to the second mode in response to the rotation of the rotatable part. The invention described in claim 5 is the device described in claim 1, wherein the processor returns the mode of the device from the second mode to the first mode before entering the second mode in response to the orientation of the device no longer being the second orientation. Claim 6The invention described in claim 3 is characterized in that the first mode is not a mode for operating the other device but a mode for operating the device itself, and the second mode is a mode for operating the other device via the device itself. Or 5 The device described is as follows. Claim 7 The invention described in claim 1 further includes a step of changing the display on the display of the device when the mode of the device is changed to the second mode. 1 to The device described is as follows. Claim 8 The invention described in claim 1 further includes a step of reducing the brightness of the display of the device when the processor transitions the mode of the device to the second mode. 1 to The device described is as follows. Claim 9 The invention described in claim 1 is characterized in that, when the processor transitions the mode of the device to the second mode, it displays a selectable element that was displayed on the display of the device before the transition so that it can be seen that the selectable element has become unselectable. 1 to The device described is as follows. Claim 10 The invention described in claim 1 is characterized in that, when the mode of the device is transitioned to the second mode, the processor displays a second screen that does not include selectable elements overlaid on a first screen that was displayed on the display of the device before the transition, or switches the display from the first screen to the second screen. 1 to The device described is as follows. Claim 11 The invention described in claim 1 to claim 2 is characterized in that the other device is a device worn by the user that is different from the device worn by the user. 10 The device is one described in any one of the above. Claim 12 The invention described in claim 1 is characterized in that the other device is a device worn in front of the eyeball of the user. 11 The device is described in Claim 13The invention described in claims 1 to 5 is characterized in that the device is worn on the user's arm, and the processor controls the other device based on the movement of a finger at the tip of the arm on which the device is worn. 12 The device is one described in any one of the above. The invention described in claim 14 is the device described in claim 1, wherein the second orientation is a predetermined specific orientation, and the processor transitions the mode of the device to the second mode in response to the device being attached in the predetermined specific orientation to the attachment location. Claim 15 The invention described in Attached to the user's attachment site A program executed by a computer installed in a device that allows a user to operate another device through the device, a function of detecting the orientation of the device attached to the attachment site; The device is The above In response to the device being attached to the attachment site in a first orientation, Through the device A function of transitioning the other device to a second mode in which operation is permitted. and, in front This is a program for making the computer realize the above. [Effects of the Invention]

[0006] According to the invention of claim 1, it is possible to switch the mode of the device to a mode that allows operation of another device without necessarily looking at the display screen of the device. According to the invention of claim 2, by rotating the device around the attachment site as an axis, the mode of the device can be switched to a mode in which other devices can be operated. According to the invention of claim 3, by changing the orientation of the device from a first orientation to a second orientation, the mode of the device can be transitioned from a first mode corresponding to the first orientation to a second mode. According to the invention of claim 4, the mode of the device can be shifted to the second mode by rotating a rotatable part of the device. According to the invention of claim 5, by changing the orientation of the device to a different orientation from the second orientation, the mode of the device can be returned from the second mode to the first mode that was in effect before entering the second mode. Claim 6 According to the invention, in a first mode, a device can be operated, and in a second mode, other devices can be operated via this device. Claim 7 According to the invention, it is possible to notify the user that the device mode has transitioned to the second mode. Claim 8 According to the invention, it is possible to notify the user that the device mode has transitioned to the second mode. Claim 9 According to the invention, it is possible to notify the user that a selectable element that was displayed on the display of the device has become unselectable. Claim 10 According to the invention, the screen displayed on the display of the device before the transition to the second mode can be switched to a screen that does not include selectable elements. Claim 11 According to the invention, the mode of a user's device can be switched to a mode that allows the user to operate other devices worn by the user without necessarily looking at the display screen of the device. Claim 12 According to the invention, the mode of a user's device can be switched to a mode that allows the user to operate another device worn by the user and worn in front of the user's eyeball, without necessarily looking at the display screen of the device. Claim 13 According to the invention, other devices can be controlled based on the movement of the fingers at the end of the arm on which the device is worn. According to the invention of claim 14, the mode of the device can be shifted to the second mode in response to the device being attached in a predetermined specific orientation with respect to the attachment site. Claim 15 According to the invention, the mode of the device can be switched to a mode that allows operation of another device without necessarily looking at the display screen of the device. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 illustrates an example of a processing system. [Figure 2] FIG. 10 is a diagram showing another example of the configuration of the second device. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a first device. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a second device. [Figure 5] 10(A) and 10(B) are diagrams showing the first device in a worn state. [Figure 6] FIG. 10 is a diagram showing another example of the configuration of the first device. [Figure 7] 7(A) and 7(B) are diagrams of the first device and the finger wearing the first device as viewed from the direction indicated by arrow VII in FIG. [Figure 8] 10A and 10B are diagrams showing other examples of how the first device is worn. [Figure 9] FIG. 10 is a diagram showing the movement of a user's finger. [Figure 10] 10A and 10B are diagrams showing another method for detecting finger movement. [Figure 11] 10(A) and 10(B) are diagrams showing other configuration examples of the first device. [Figure 12] FIG. 10 is a diagram showing a first device in a second embodiment. [Figure 13] FIG. 2 is a diagram showing a state of a user wearing a first device. [Figure 14] 10A and 10B are diagrams illustrating other states of the user wearing the first device. [Figure 15] FIG. 10 is a diagram illustrating detection of the movement of a user's finger in the second mode. [Figure 16] FIG. 10 is a diagram showing the state of a user's fingers. [Figure 17] FIG. 10 is a diagram showing an example of a display on a display provided in the second device. [Figure 18] FIG. 10 is a diagram showing another example of display on the second device. [Figure 19] 10A to 10C are diagrams showing an example of screen transitions on the display of the first device. [Figure 20] FIG. 10 is a diagram showing an example of a display on the first device when the first device is in the second mode. [Figure 21] FIG. 10 is a diagram showing another example of a display on the first device when the first device is in the second mode. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. [First embodiment] FIG. 1 is a diagram showing an example of a processing system 1 according to this embodiment. The processing system 1 of this embodiment is provided with a first device 100 that is worn by a user and accepts operations from the user, and a second device 200 that is connected to the first device 100 via a communication line (not shown).

[0009] The communication line connecting first device 100 and second device 200 is not particularly limited, and may be a wired communication line or a wireless communication line. In this embodiment, when the mode of first device 100 is set to a second mode (described later), the user can operate second device 200 by performing a predetermined action on first device 100. On the other hand, when first device 100 is in the first mode, the user cannot operate second device 200 even if the user performs the operation on first device 100 .

[0010] Each of the first device 100 and the second device 200 is a so-called wearable device that is worn by a user. First device 100 is, for example, a wrist-worn device such as a wristwatch. First device 100 has display 101. In this embodiment, display 101 not only displays a screen, but also has a touch panel and functions as an input device that accepts input by a user's touch operation. In other words, display 101 in this embodiment is a touch panel type display. In first device 100, display 101 displays the time, a menu screen on which icons of installed applications are arranged, and application screens that are displayed as each application is executed.

[0011] In this embodiment, a case is described in which both the first device 100 and the second device 200 are worn by a single user, but the user who wears the first device 100 and the user who wears the second device 200 may be different. Second device 200 may also be a user device that is not worn by a user but is placed away from the user, for example, a laptop computer or a television.

[0012] In this embodiment, a user can operate a second device 200, which is an example of another device, via a first device 100. The second device 200 is, for example, a so-called AR (Augmented Reality) display device that displays an image superimposed on an object in the real space visually recognized by the user. The second device 200 is, for example, a glasses-type device, and is provided with a mounted part 201 that is mounted on the user's head. The second device 200 is not limited to a glasses-type device, but may be, for example, a head-mounted device, or a contact lens-type device worn on the user's eyeball.

[0013] In this embodiment, the second device 200 is provided with a display 202 that is visible to the user. In this embodiment, the display 202 is worn in front of the user's eyes. In other words, when worn by the user, at least a portion of the second device 200 is disposed in front of the user's eyes. The display 202 is formed to be transparent, and the user views what is in front of him or her through the display 202. In other words, the user views what is behind the transparent portion through the transparent portion.

[0014] The display 202 is configured to be light-transmitting. In this case, the display 202 is see-through, and the user can view the real space RW behind the display 202 through the see-through display 202. In the second device 200, information such as text and images is displayed on the display 202. This allows the information to be overlaid on the real space RW that is located behind the display 202 and that the user views.

[0015] The second device 200 is also provided with a speaker (not shown) for outputting sound and operation buttons (not shown) for receiving instructions from the user. The second device 200 is also provided with a camera 203 that captures an image of the area in front of the user. In other words, the second device 200 is provided with a camera 203 that captures the real space RW that the user visually recognizes through the display 202. The second device 200 is also provided with a sensor (not shown) that measures information about the user, such as an electroencephalograph.

[0016] The second device 200 may be a tablet-type device as shown in FIG. 2 (a diagram showing another example of the configuration of the second device). 2, second device 200 is provided with display 202 on one side of plate-like housing 205. Second device 200 is also provided with camera 206 that captures an image behind display 202. When a user views the display 202 of the second device 200, the user views an object behind the display 202 through the display 202.

[0017] Specifically, in this second device 200, an image of an object behind the display 202 is acquired by the camera 206, and this image is displayed on the display 202. The user can see the object behind the display 202 by looking at this image displayed on the display 202 . On the display 202, other information such as text and images can be superimposed on the image captured by the camera 206. This allows information to be superimposed on the real space RW that is located behind the display 202 and that the user views.

[0018] 2, for example, by separately preparing a part for wearing (not shown), the second device 200 can be installed in front of the user's eyeballs. In other words, by separately preparing a part for wearing, the second device 200 can be worn on the user's head, and the second device 200 can be held in front of the user's face. In this embodiment, the second device 200 can be controlled via the first device 100, but the object of this control is not limited to display. The control of the second device 200 via the first device 100 may include drive control of physically moving parts, control of sound, and the like.

[0019] The first device 100 (see FIG. 1) is a multi-function device equipped with various functions. Applications can be installed on the first device 100. By selecting and running the installed applications on the first device 100, the first device 100 can perform various functions. For example, applications such as email, an address book, a calendar, a web browser, a social networking service (SNS), a map, a payment application, and a health management application can be installed in advance or optionally by the user. A device that is worn on the user's wrist like a wristwatch and that not only displays the time but can also install and run applications such as those described above is called a "smartwatch."

[0020] In this embodiment, the first device 100 and the second device 200 cooperate with each other to perform various processes. For example, information obtained by the first device 100 can be displayed on the display 202 of the second device 200. Specifically, for example, the heart rate and blood oxygen concentration can be measured using a heart rate monitor and a blood oxygen concentration monitor provided in the first device 100, and the results of this measurement can be displayed on the display 202 of the second device 200.

[0021] Specifically, when performing this process, for example, the user first performs an operation on first device 100 while looking at the display screen of first device 100 displayed on display 202 of second device 200. Specifically, the user first selects an application installed on the first device 100 while viewing the display screen of the first device 100 displayed on the display 202 of the second device 200, and then launches the application.

[0022] More specifically, in this example, the display screen of the first device 100 is displayed on the display 202 of the second device 200. While viewing this display screen of first device 100 displayed on display 202 of second device 200, the user operates first device 100 and launches an application for measurement by a heart rate monitor or a blood oxygen concentration meter. In this embodiment, for example, the user can perform operations on the first device 100 by selecting a display element from among display elements that are displayed on the display 202 of the second device 200 and appear to be floating in the air.

[0023] Note that a user's operation on a display element that appears to be floating in the air is detected by analyzing an image captured by camera 203 provided on second device 200, for example. Specifically, by analyzing this video and detecting the position of the user's finger when the user operates the display element, the user's operation on the display element that appears to be floating in the air is detected.

[0024] Furthermore, as another method for detecting an operation on a display element, for example, a method for detecting an operation on a display element by detecting a user's operation on a physical button provided on second device 200 can be cited. When information about the user's operation on the display element is acquired, a display screen corresponding to the operation identified by this information is displayed on the display 202 of the second device 200.

[0025] More specifically, for example, if the user's operation is to select an application for measurement by a heart rate monitor or a blood oxygen concentration monitor, a display screen corresponding to this application is displayed on display 202 of second device 200. As a result, the display 202 of the second device 200 displays the measurement results of the heart rate and blood acidity concentration. When the display screen of the first device 100 is displayed on the display 202 of the second device 200, the user can see the information displayed on the first device 100 without looking at the first device 100.

[0026] In addition, in this embodiment, for example, when a user makes a payment using electronic money using first device 100, second device 200 displays information about this payment. Specifically, the display 202 of the second device 200 displays information such as the payment amount, whether the payment was successful, and the remaining balance after payment.

[0027] In this embodiment, a notification that first device 100 has received an email is displayed on display 202 of second device 200. That is, the user can know that first device 100 has received an email without looking directly at first device 100. More specifically, for example, when the email notification function is turned on in the first device 100, the display 202 of the second device 200 displays a message indicating that an email has been sent to the first device 100.

[0028] More specifically, in this embodiment, for example, when a user selects a display element displayed on the display 202 of the second device 200 or an object visible through the display 202 of the second device 200, information about the selected object is sent to the first device 100, for example, by email. In this case, in this embodiment, information indicating that an email has been sent to the first device 100 is displayed on the display 202 of the second device 200. As a result, the user recognizes that the first device 100 has received an email about the display element or subject selected by the user, without having to look directly at the first device 100.

[0029] Also, in this embodiment, for example, when a user purchases a product displayed on the display 202 of the second device 200 or a product visible through the display 202 of the second device 200, information about this purchase is sent to the first device 100. In this embodiment, the user can therefore use the payment function of first device 100 to pay for the product. More specifically, the user can pay for the product using functions of the first device 100, such as NFC (Near Field Communication), QR Code (registered trademark) / barcode payment, etc.

[0030] More specifically, in this embodiment, when a user performs a purchase process for a product displayed on display 202 of second device 200 or a product visible through display 202 of second device 200, a total amount is calculated by a server (not shown). Then, information about this total amount is sent to first device 100. Then, the user uses the payment function of the first device 100 to make a payment of the amount specified by this total amount.

[0031] The user performs the purchasing process for the products displayed on the display 202 of the second device 200 or the products visible through the display 202 of the second device 200 while looking at the display 202 of the second device 200. Specifically, the user performs operations such as selecting display elements that appear to float in the air to process the purchase of a product.

[0032] In addition, in this embodiment, for example, the measurement results obtained by an electroencephalograph provided in the second device 200 can be transmitted to the first device 100, and the measurement results can be displayed on an application installed in the first device 100. Additionally, for example, information about a store selected by a user through an operation on the second device 200 can be transmitted to the first device 100, and the information about the store can be displayed on the first device 100. Specifically, for example, information about a store such as a restaurant displayed on display 202 of second device 200 or information about a store that the user is viewing through display 202 is transmitted to first device 100. Then, this store information is displayed on first device 100.

[0033] Fig. 3 is a diagram showing an example of the hardware configuration of first device 100. In Fig. 3, it is assumed that first device 100 is a wrist-worn device. The first device 100 has a control unit 111 that controls the operation of the entire device, an information storage device 112 that stores data, various communication interfaces 113 that comply with wireless communication standards, a display 101 that displays information and is composed of a liquid crystal display device, an organic EL (Electro Luminescence) display device, etc., a GPS (Global Positioning System) 114, and various sensors 115.

[0034] The control unit 111 includes a CPU 111A as an example of a processor, a ROM 111B in which firmware, BIOS, etc. are stored, and a RAM 111C used as a work area. The communication interface 113 is an interface used for communication with the second device 200 and the like. The display 101 is configured with a touch panel, which allows detection of user operations on the display 101 in this embodiment. GPS 114 receives radio waves from GPS satellites and measures the position of first device 100. Information of latitude, longitude, and altitude output from the GPS sensor provides first device 100 with information about its current position. Sensor 115 detects a user's operation on first device 100 and acquires information about the user, such as the user's blood pressure information. Sensor 115 also detects the orientation of first device 100 and the illuminance at first device 100.

[0035] Here, the program executed by CPU 111A can be provided to first device 100 in a state where it is stored on a computer-readable recording medium such as a magnetic recording medium (such as a magnetic tape or a magnetic disk), an optical recording medium (such as an optical disk), a magneto-optical recording medium, or a semiconductor memory. The program executed by CPU 111A may be provided to first device 100 using a communication means such as the Internet.

[0036] 4 is a diagram showing an example of the hardware configuration of second device 200. The configuration shown in the figure assumes that second device 200 is a glasses-type device. The second device 200 has a control unit 211 that controls the operation of the entire device, an information storage device 212 that stores various data, various communication interfaces 213 that comply with wireless communication standards, and an input device 214 such as a touch sensor or button. The second device 200 also includes a display 202 configured as a liquid crystal display device, an organic EL display device, or the like, for displaying information, a GPS 216 , a sensor 217 , and a camera 203 .

[0037] The control unit 211 includes a CPU 211A as an example of a processor, a ROM 211B in which firmware, BIOS, etc. are stored, and a RAM 211C used as a work area. The communication interface 213 is an interface used for communication with the first device 100 and the like. GPS 216 is a sensor that receives radio waves from GPS satellites and measures the position of second device 200. Information of latitude, longitude, and altitude output from GPS 216 provides second device 200 with information about its current position. The sensor 217 acquires information about the user, such as the user's brain waves, body temperature, and heart rate. Camera 203 acquires an image of real space RW located in front of the user wearing second device 200. In other words, camera 203 acquires an image of real space RW located in front of the user and visually recognized by the user.

[0038] Here, the program executed by CPU211A can be provided to second device 200 in a state where it is stored on a computer-readable recording medium such as a magnetic recording medium (such as a magnetic tape or a magnetic disk), an optical recording medium (such as an optical disk), a magneto-optical recording medium, or a semiconductor memory. Furthermore, the program executed by CPU 211A may be provided to second device 200 using a communication means such as the Internet. It should be noted that the first device 100 and the second device 200 are not limited to being a glasses-type device and a wrist-worn device, respectively. For example, the first device may be a smartphone and the second device may be a glasses-type device.

[0039] In this embodiment, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). Furthermore, the operations of the processors may not only be performed by a single processor, but may also be performed by multiple processors located at physically separate locations working together. The order of the operations of the processors is not limited to the order described in this embodiment, and may be changed.

[0040] 5(A) and 5(B) are diagrams showing the first device 100 in a worn state. 5(A) and 5(B), first device 100 is worn on the user's wrist, which is an example of the user's wearing portion 30. In other words, first device 100 is worn on the user's arm, more specifically, on the user's wrist. While attached to the attachment site 30, the first device 100 can rotate around the attachment site 30. Specifically, the first device 100 can rotate in the direction indicated by the arrow 5A in FIG. 5(A).

[0041] In this embodiment, this rotation causes the orientation of the first device 100 to change. The wearing orientation of the first device 100 changes as the first device 100 rotates around the axis of the wearing portion 30. In this embodiment, the wearing orientation of the first device 100 can be changed without removing the first device 100. In other words, in this embodiment, the wearing orientation of the first device 100 can be changed while the first device 100 is being worn. A CPU 111A (see FIG. 3), which is an example of a processor provided in the first device 100, transitions the mode of the first device 100 from the first mode to the second mode in response to the first device 100 being attached to the user's attachment portion 30 in a predetermined second orientation.

[0042] In this embodiment, the correspondence between the orientation of first device 100 and the mode of first device 100 is notified to the user in advance, for example, by a manual. Based on this correspondence, the user wears first device 100 in a specific orientation, thereby causing first device 100 to switch to the mode corresponding to this specific orientation.

[0043] In this embodiment, FIG. 5(B) shows a state in which the first device 100 is attached in the second orientation, and in this embodiment, in response to the first device 100 being attached in this second orientation, the mode of the first device 100 transitions from the first mode to the second mode. The second mode is a mode in which the user is permitted to operate second device 200 (see FIG. 1) using predetermined finger movements. In other words, the second mode is a mode in which the user is permitted to operate second device 200 via first device 100.

[0044] In response to the first device 100 being attached to the user's attachment portion 30 in a second orientation, the CPU 111A of the first device 100 transitions the mode of the first device 100 from the first mode to a second mode in which the user is permitted to operate the second device 200 using predetermined finger movements. In other words, when the mounting orientation of the first device 100 changes from a first orientation different from the second orientation to this second orientation, the CPU 111A transitions the mode of the first device 100 from a first mode corresponding to the first orientation to a second mode corresponding to the second orientation.

[0045] FIG. 5(A) shows a state in which the first device 100 is attached to the user's attachment portion 30 in a first orientation, and in this state, the CPU 111A sets the mode of the first device 100 to the first mode. When the mounting orientation of the first device 100 changes from the first orientation to the second orientation, the CPU 111A transitions the mode of the first device 100 from the first mode corresponding to the first orientation to the second mode corresponding to the second orientation.

[0046] When the first device 100 is in the second mode and the user performs an operation on the first device 100, for example, control information for controlling the second device 200 (see FIG. 1) is generated in the first device 100, and this control information is transmitted to the second device 200. More specifically, in this embodiment, when first device 100 is in the second mode and a user touches display 101 (touch panel) of first device 100 to perform an operation on display 101, first device 100 generates control information for controlling second device 200. Then, this control information is transmitted to second device 200.

[0047] Also, for example, when the first device 100 is in the second mode and the user performs an operation on the display 101 of the first device 100, information indicating the content of this operation is transmitted from the first device 100 to the second device 200. In this case, CPU 211A (see FIG. 4) of second device 200 controls second device 200 based on information indicating the content of this operation. As a result, in this embodiment, the user can operate the second device 200 by operating the first device 100.

[0048] The first mode is not a mode in which the user operates second device 200, which is an example of another device, but a mode in which the user operates first device 100 itself. When the first device 100 is in the first mode, the display 101 displays a menu screen with icons of applications installed on the first device 100 and screens of these applications, and the user issues instructions to execute functions of the applications installed on the first device 100 via UI elements (such as buttons) displayed on the display 101.

[0049] The second mode is a mode for operating the second device 200 via the first device 100. In the second mode, when the user performs an operation on display 101 of first device 100, processing corresponding to this operation is performed in second device 200, such as changing the display on display 202 (see FIG. 1) of second device 200.

[0050] It should be noted that in the second mode, it is possible to operate first device 100 itself. In the second mode, when the user performs a specific operation, the second device 200 may be controlled, and when the user performs another specific operation, the first device 100 itself may be controlled. In addition, in this embodiment, an example has been described in which a user's operation on the first device 100 is received by the display 101, but the user's operation on the first device 100 may also be received by a part of the first device 100 other than the display 101, such as a belt that secures the display 101 to the user's wrist.

[0051] When the orientation of the first device 100 is no longer the second orientation, the CPU 111A of the first device 100 accordingly returns the mode of the first device 100 from the second mode to the first mode before entering the second mode. When the mode of the first device 100 returns to the first mode, the user cannot operate the second device 200 via the first device 100.

[0052] In this embodiment, as shown in FIG. 5(A), when the first device 100 is worn by a user so that the display 101 of the first device 100 is positioned on the back of the user's hand, the first device 100 operates in a first mode and functions as a smartwatch. 5(B), when first device 100 is worn by the user so that display 101 of first device 100 is located on the palm side of the user's hand, first device 100 operates in the second mode. In this case, first device 100 functions as a remote control for controlling second device 200.

[0053] In this embodiment, when the display 101 of the first device 100 is located on the back side of the user's hand, the first device 100 is in the first mode, and when the display 101 of the first device 100 is located on the palm side of the user's hand, the first device 100 is in the second mode. However, this is not limited to this, and the first device 100 may be in the first mode when the display 101 of the first device 100 is located on the palm side of the user's hand, and the first device 100 may be in the second mode when the display 101 of the first device 100 is located on the back side of the user's hand.

[0054] Furthermore, the user may be able to set a mode according to the orientation of first device 100. In this case, when the orientation of the first device 100 is the first orientation set by the user, the first device 100 is in the first mode, and when the orientation of the first device 100 is the second orientation set by the user, the first device 100 is in the second mode. The mode according to the orientation of first device 100 may also be determined based on the usage status of first device 100 by the user. Specifically, in this case, information on the frequency of the direction in which first device 100 faces, for example, is acquired as the usage status. Then, for example, among the directions in which the first device 100 faces, the direction that is most frequently faced is set as the first direction, and the direction that is least frequently faced is set as the second direction.

[0055] The CPU 111A of the first device 100 switches the content of the processing to be performed in accordance with a predetermined gesture made by the user on the first device 100 between when the first device 100 is attached to the user's attachment portion 30 in a first state and when the first device 100 is attached in a second state different from the first state. Specifically, the CPU 111A of the first device 100 switches the content of the processing to be performed in accordance with a predetermined gesture made by the user on the first device 100, for example, when the first device 100 is attached to the user's attachment portion 30 in the state shown in FIG. 5(A) and when the first device 100 is attached in the state shown in FIG. 5(B).

[0056] Specifically, in this embodiment, when the first device 100 is attached to the attachment portion 30 in the state shown in FIG. 5(B), the CPU 111A of the first device 100 controls the second device 200 based on a predetermined gesture made by the user on the display 101 of the first device 100. Furthermore, when the first device 100 is attached to the attachment portion 30 in the state shown in FIG. 5(A), the CPU 111A of the first device 100 does not control the second device 200, but controls the first device 100 based on a predetermined gesture made by the user on the display 101 of the first device 100.

[0057] FIG. 6 is a diagram showing another example of the configuration of first device 100. In FIG. In this configuration example, the first device 100 is configured as a so-called smart ring. In other words, the first device 100 is a device in the form of a ring. In this configuration example, the first device 100 rotates around the axis of the user's finger that is passed through the first device 100. In this configuration example, when first device 100 is worn by a user with a specific part of first device 100 facing a specific direction, the mode of first device 100 changes to the second mode, and first device 100 functions as a remote control used to operate second device 200.

[0058] Furthermore, in this configuration example, when the first device 100 is worn by a user with a specific part of the first device 100 not facing a specific direction, the mode of the first device 100 becomes the first mode, and the power of the first device 100 is turned off. When first device 100 is in the first mode, for example, processing for acquiring biometric information of the user may be performed without turning off the power.

[0059] 7(A) and (B) are diagrams of the first device 100 and the finger on which the first device 100 is worn, viewed from the direction indicated by arrow VII in FIG. In this configuration example shown in Figures 6, 7(A), and (B), when this first device 100 in the form of a ring is worn on a user's finger in a second orientation, it enters the second mode as described above.

[0060] Specifically, when the first device 100 is worn by the user so that a specific portion 119 of the first device 100, indicated by 7A in FIG. 7(A), is located on the palm side of the user's hand, the first device 100 enters the second mode. Also, for example, when the first device 100 is worn by the user so that the specific part 119 is on the back of the user's hand, as shown in FIG. 7(B), the first device 100 is in the first mode.

[0061] Note that this is just one example, and for example, when the first device 100 is worn by the user so that the specific portion 119 is on the palm side of the user's hand, the first device 100 may be in the first mode. Furthermore, when the first device 100 is worn by the user so that the specific portion 119 is on the back of the user's hand, the first device 100 may be set to the second mode. Additionally, for example, as shown in FIG. 8 (a diagram showing another example of wearing the first device), when the first device 100 is worn by the user so that a specific portion 119 is located between the finger on which the first device 100 is worn and the finger adjacent to that finger, the first device 100 may be set to the second mode.

[0062] When the first device 100 in the form of a ring is in the second mode, the movement of the finger on which the first device 100 is worn is detected by an acceleration sensor or the like provided in the first device 100. Specifically, the user moves his / her finger as shown in Fig. 9 (a diagram showing the movement of the user's finger). In this embodiment, this movement of the user's finger is detected by an acceleration sensor or the like provided in first device 100, and second device 200 is controlled based on the result of this detection.

[0063] In this embodiment, as shown in FIG. 9(A), when the finger wearing the first device 100 moves rightward, right scrolling is performed on the display 202 (see FIG. 1) of the second device 200. Furthermore, as shown in FIG. 9(B), when the finger wearing first device 100 moves leftward, display 202 of second device 200 scrolls leftward.

[0064] In this example, as shown in FIG. 9(C), when the finger wearing first device 100 moves downward, display 202 of second device 200 scrolls downward. Furthermore, as shown in FIG. 9(D), when the finger wearing first device 100 moves upward, display 202 of second device 200 scrolls upward.

[0065] 9(E), when the finger wearing first device 100 rotates in one direction, the display 202 of second device 200 switches from a state in which a certain display element is focused to a state in which another display element is focused. More specifically, the display element immediately following the initially focused display element (for example, the display element to the right) is switched to a focused state. In other words, when the finger wearing first device 100 rotates in one direction, the display element on which a pointer such as a cursor is placed can be changed. Also, in this example, as shown in FIG. 9(F), when the finger wearing the first device 100 rotates in the opposite direction, the display 202 of the second device 200 switches to a focused state with the display element immediately before the initially focused display element (for example, the display element to the left).

[0066] Also, in this example, as shown in FIG. 9(G), when the finger wearing the first device 100 moves toward and presses against the finger adjacent to it, a display element such as an icon is selected on the display 202 of the second device 200. Specifically, a display element displayed on the display 202 of the second device 200 and on which a pointer such as a cursor is placed is selected. In other words, in this case, a process equivalent to a so-called click is performed. For example, if a display element represents a file, a preview of the file represented by the display element may be displayed when the display element is selected.

[0067] Also, in this example, as shown in FIG. 9(H), when the finger on which the first device 100 is worn moves twice toward the finger adjacent to this finger and is pressed against this finger twice, a decision process is performed. Specifically, in this case, for example, a display element displayed on the display 202 of the second device 200 and on which a pointer such as a cursor is placed is determined to be the display element selected by the user. In other words, in this case, a process equivalent to a so-called double click is performed. For example, if a display element represents a file, when the display element is selected, the file represented by the display element opens. It is not necessary to separate the selection and decision into two steps, and the content represented by the selected display element may be executed upon selection of the display element.

[0068] When the first device 100 has the form of a ring, the user can operate the second device 200 with a feeling similar to that when using a trackpad. In addition, in the first device 100 having the form of a ring, the first device 100 may be provided with a processor CPU 111A and various sensors, and the first device 100 may generate control information for controlling the second device 200 and control the second device 200. Furthermore, without being limited to this, similar to the above, the results of various detections performed by the first device 100 may be transmitted to the second device 200, and the second device 200 may control the second device 200 based on the results of these detections.

[0069] Alternatively, the detection of the movement of a finger wearing the first device 100 in the form of a ring may be performed not by the first device 100 but by another device 800, as shown in FIG. 10 (a diagram showing another method of detecting the movement of a finger). In this example shown in FIG. 10, a first device 100 in the form of a ring is provided with a detection target such as a magnet or metal, and the movement of this detection target is detected by another device 800. Here, the other device 800 is a wearable device, more specifically, the other device 800 is a wrist-wearable device.

[0070] More specifically, in this example shown in FIG. 10, first, the mode of the other device 800 is switched according to the orientation of the first device 100 in the form of a ring. Specifically, when the orientation of the first device 100 in the form of a ring becomes the second orientation, the mode of the other device 800 is switched from the first mode to the second mode. In this case, the movement of the finger wearing first device 100 is detected by a sensor provided in other device 800. In this case, second device 200 is controlled based on the detection result obtained by the sensor provided in other device 800.

[0071] 11(A) and 11(B) are diagrams showing other configuration examples of first device 100. In FIG. In this configuration example, as shown in FIG. 11(A), the first device 100 has a rotatable part 131 (hereinafter referred to as "rotating part 131"). In this configuration example, first device 100 is composed of smartphone 132 and strap 133 attached to smartphone 132. Smartphone 132 also has display 101, which can display display screen 101A such as a menu screen on which icons of various applications installed on the smartphone are arranged, or a screen for a selected application. In this configuration example, the user places his / her head through the looped strap 133, and the first device 100 is suspended from the user's neck.

[0072] In this configuration example, a connector 134 for rotating the smartphone 132 is provided at the connection between the strap 133 and the smartphone 132 . This allows the smartphone 132, which is positioned below the strap 133, to rotate relative to the strap 133. In this configuration example, the orientation in which the first device 100 is worn changes as the smartphone 132, which is an example of the rotating portion 131, rotates. In this configuration example, as the smartphone 132 rotates, the mode of the first device 100 transitions from the first mode to the second mode.

[0073] Specifically, in this configuration example, as shown in FIG. 11(A), when the display 101 of the smartphone 132 is aligned vertically and facing away from the user, the mode of the first device 100 becomes the second mode. In other words, when the first device 100 is oriented vertically and facing away from the user, the mode of the first device 100 is the second mode. This allows the user to operate the second device 200 (not shown in FIG. 11) by touching the display 101 of the smartphone 132 in the hanging state, as shown by the reference symbol 11X in FIG. 11(A).

[0074] On the other hand, in this configuration example, as shown in FIG. 11(B), when the smartphone display 101 (hidden and not visible in FIG. 11(B)) is aligned vertically and facing the user, the mode of the first device 100 becomes the first mode. In other words, when the display 101 of the first device 100 is aligned vertically and faces the user, the mode of the first device 100 is the first mode. In this first mode, first device 100 enters a sleep state, and the user cannot operate second device 200. When first device 100 enters a sleep state, operations on the touch panel of display 101 of first device 100 are disabled, and first device 100 and second device 200 do not operate even if the user touches the touch panel.

[0075] Also, although not shown in the figures, in this configuration example, when the first device 100 is lifted by the user and the display 101 of the first device 100 is aligned in a direction other than the vertical direction, the first device 100 functions as a smartphone. In this case, even if the user touches the display 101 of the first device 100, the second device 200 will not operate.

[0076] The first device 100 may also be an ID card with a strap. This ID card with a strap has a functional section on one side of the ID card that has the same function as the touch panel, that is, a functional section for receiving user operations. In this ID card with a strap, when the side of the ID card on which this functional unit is installed faces away from the user, the first device 100 is set to the second mode. Furthermore, when the side of the ID card on which this functional unit is installed faces the user, first device 100 is set to the first mode.

[0077] Detection of the orientation of first device 100 will be described. The orientation of first device 100 is determined based on the output from sensor 115 (see FIG. 3) provided in first device 100. Specifically, the orientation of first device 100 is determined based on the output from an illuminance sensor provided in first device 100, for example. Specifically, for example, in the above-mentioned first device 100 in which a smartphone 132 (see FIG. 11), which is an example of a rotating portion 131, rotates, an illuminance sensor is provided in the first device 100, and the orientation of the first device 100 is detected based on the output from this illuminance sensor.

[0078] In the present embodiment, as an example, an illuminance sensor is provided in display 101 to measure the illuminance on the outside of display 101. In this case, when display 101 is worn so that it is not visible to others, as in FIG. 11(B), the measurement value of the illuminance sensor will be smaller than when display 101 is worn so that it is visible to others, as in FIG. 11(A). Therefore, for example, when the measurement result of the illuminance sensor is smaller than a predetermined threshold, it can be determined that display 101 of first device 100 faces toward the user, and when the measurement result of the illuminance sensor is equal to or larger than the predetermined threshold, it can be determined that display 101 of first device 100 faces away from the user. Additionally, in the above-mentioned first device 100 in which the smartphone 132 rotates, a sensor for detecting the rotation of the smartphone 132 may be provided in the connector 134 between the strap 133 and the smartphone 132, and the orientation of the smartphone 132 may be determined based on the output from this sensor.

[0079] Also, for example, if the first device 100 is a wrist-worn device, a sensor that acquires information about the blood vessels on the surface of the user's arm is provided inside the first device 100, and the orientation of the first device 100 is determined based on the output from this sensor. In this case, information about the blood vessels located in the part of the user's wrist that is on the palm side and information about the blood vessels located in the part of the user's wrist that is on the back side of the hand are acquired and registered in advance. Then, the orientation of the first device 100 is determined by comparing information about blood vessels obtained when the user actually wears the first device 100 with the above registered information.

[0080] Furthermore, for example, in the first device 100 having the above-mentioned ring form, a sensor is provided on the inner surface of the first device 100 to acquire information about the blood vessels on the surface of the user's finger, and the orientation of the first device 100 is determined based on the output from this sensor. In this case, too, information about the blood vessels located in the part of the user's finger that is located on the palm side and information about the blood vessels located in the part of the user's finger that is located on the back side of the hand are acquired and registered in advance. Then, the orientation of the first device 100 is determined by comparing information about blood vessels obtained when the user actually wears the first device 100 with the above registered information.

[0081] Furthermore, in the first device 100 having the form of the ring described above, a pressure sensor that detects pressure may be provided on the outer peripheral surface of the first device 100, and the orientation of the first device 100 may be determined based on the output from this pressure sensor. Specifically, for example, a pressure sensor may be provided in the specific portion 119 (see FIG. 8) and the orientation of the first device 100 may be determined based on the output from this pressure sensor. In the case of first device 100 having the form of a ring, as shown in FIG. 8, in the second mode, first device 100 may be worn with specific portion 119 positioned between the finger on which first device 100 is worn and the finger adjacent to that finger.

[0082] In this case, if a pressure sensor is provided in this specific portion 119, pressure will act on this pressure sensor, and it will be detected that this specific portion 119 is located between the fingers and is pinched by the two fingers. In other words, in this case, it is detected that the specific portion 119 is pinched between the finger on which the first device 100 is worn and the finger adjacent to this finger. In this case, in this embodiment, the mode of first device 100 transitions from the first mode to the second mode.

[0083] In this case, when the specific portion 119 is not positioned between the finger on which the first device 100 is worn and the finger adjacent to this finger, the pressure acting on the pressure sensor decreases, and the first device 100 enters the first mode. The above-described method for detecting the orientation of first device 100 is an example. Other sensors, such as a gravity sensor, a tilt sensor, or an acceleration sensor, may be used to detect the orientation of first device 100. The orientation of first device 100 may also be detected by other known methods.

[0084] Second Embodiment FIG. 12 is a diagram showing a first device 100 in the second embodiment. In the first device 100 of the second embodiment, as shown in FIG. 12, when switching the mode of the first device 100, the user performs an operation of covering the outer surface side of the first device 100 worn by the user. In this embodiment, in response to the external side of first device 100 being covered, CPU 111A of first device 100 transitions the mode of first device 100 to a second mode in which operation of second device 200 by the user's predetermined finger movements is permitted.

[0085] Furthermore, in response to the fact that the outside world side of the first device 100 is no longer covered, the CPU 111A of the first device 100 transitions the mode of the first device 100 from this second mode to the first mode that was in effect before the second mode was entered. CPU 111A of first device 100 determines whether the outside world side of first device 100 is covered, for example, by determining whether a specific portion of the outside world side of first device 100 is covered in excess of a predetermined area. An example of the specific part on the outside world side is the display 101 of the first device 100. In other words, an example of the specific part on the outside world side is the touch panel of the first device 100.

[0086] CPU 111A of first device 100 determines whether the outside world side of first device 100 is covered, for example, by determining whether display 101 located on the outside world side of first device 100 is covered by more than a predetermined area. In other words, CPU 111A of first device 100 determines whether the outside world side of first device 100 is covered by determining whether the touch panel located on the outside world side of first device 100 is covered by more than a predetermined area. In this specification, the "internal side of a device" refers to the side that comes into contact with the user when the device is worn by the user, or the side that is closer to the user even if not in contact, and the "external side of a device" refers to the opposite. For example, in the case of a wristwatch, the side that comes into contact with the user's wrist when worn on the user's wrist is the internal side of the watch, not the external side. The surface that displays the time, etc., is the external side. In the case of earphones, the part that goes inside the user's ear and comes into contact with the user's ear when worn is the internal side, and the part that protrudes outside the ear is the external side. In addition, the lenses of eyeglasses do not come into contact with the user's eyes when the user wears the glasses, but the surface that comes closest to the eyes is the internal side, and the opposite side is the external side. In the case of a device that can be worn by a user in any state, a part of the device may be on the inside world side or on the outside world side depending on the state of wearing (e.g., the direction of wearing). For example, Fig. 11(A) shows a state in which the display 101 is on the outside world side of the first device 100. On the other hand, Fig. 11(B) shows a state in which the display 101 is on the inside world side of the first device 100.

[0087] In this embodiment, display 101 is a touch panel, and CPU 111A of first device 100 identifies the part of display 101 that the user has covered, based on the output from this touch panel. Then, CPU 111A of first device 100 acquires information about the area of ​​the part covered by the user based on this identified part.

[0088] CPU 111A of first device 100 transitions the mode of first device 100 from the first mode to the second mode when the area of ​​the covered portion on the outside side of first device 100 exceeds a predetermined threshold. On the other hand, if the outside side of the first device 100 is not covered, or if the area of ​​the covered part of the outside side of the first device 100 does not exceed this predetermined threshold, the CPU 111A does not transition the mode of the first device 100 to the second mode, but keeps it in the first mode.

[0089] Additionally, CPU 111A of first device 100 may transition the mode of first device 100 to the second mode when the external side of first device 100 is covered by the palm of the user's hand, and may not transition the mode of first device 100 to the second mode when the external side is covered by the user's fingertips. When the outside world side of the first device 100 is covered by the user's fingertips, it is assumed that the user is operating the first device 100 itself, and in this case, the mode of the first device 100 is not transitioned to the second mode.

[0090] Whether the external side of the first device 100 is covered by the user's palm (parts other than the user's fingertips) or the user's fingertips is determined based on, for example, information about the area of ​​the part of the display 101 that the user actually touched. Specifically, for example, if the area of ​​the portion of display 101 that the user actually touches is smaller than a predetermined threshold, it is determined that the outside world side of first device 100 is covered by the user's fingertip. Also, for example, if the area of ​​the part of display 101 that the user actually touches is larger than a predetermined threshold, it is determined that the outside world side of first device 100 is covered by the user's palm (parts other than the user's fingertips).

[0091] In this embodiment, whether or not the outside world side of first device 100 is covered is determined based on the output from the touch panel, but the method for determining whether or not it is covered is not limited to this. For example, an illuminance sensor may be provided in a portion of first device 100 that faces the outside world, and based on the output from this illuminance sensor, it may be determined whether the outside world side of first device 100 is covered. Furthermore, for example, a pressure sensor may be provided on the outside world side of first device 100, and the pressure acting on the outside world side of first device 100 may be detected to determine whether the outside world side of first device 100 is covered. In other words, whether the outside world side of first device 100 is covered may be determined based on the pressure acting on the outside world side of first device 100. Furthermore, for example, it may be determined whether the outside side of first device 100 is covered based on a change in capacitance on the surface of first device 100.

[0092] In addition, when determining whether the outside side of first device 100 is covered based on the output from the illuminance sensor, if the user wears long-sleeved clothing, the illuminance may decrease and first device 100 may be determined to be covered. Therefore, when determining whether the first device 100 is covered based on the illuminance, it may be determined whether the first device 100 is covered based on information about the illuminance and, for example, information about changes in capacitance on the surface of the first device 100.

[0093] Specifically, for example, if the output from the illuminance sensor indicates that the illuminance has decreased and the output from the capacitance sensor indicates that the user has touched the first device 100, it is determined that the outside world side of the first device 100 has been covered by the user. Also, for example, if the output from the illuminance sensor indicates that the illuminance has decreased and the output from the capacitance sensor does not indicate that the user has touched the first device 100, it is determined that the outside world side of the first device 100 is covered by clothing.

[0094] Alternatively, for example, when the external environment side of first device 100 is covered by something that satisfies a predetermined condition, first device 100 may be shifted to the second mode. In this case, if the external side of first device 100 is covered by something that does not satisfy the predetermined condition, the mode of first device 100 does not transition to the second mode, but remains in the first mode.

[0095] In other words, it may be possible to determine what is covering the first device 100, and switch the mode of the first device 100 based on the result of this determination. In other words, information about the type of object covering first device 100 may be obtained, and the mode of first device 100 may be switched based on this information about the type. Specifically, for example, it may be determined whether the first device 100 is covered by clothing or by the user, and the mode may be switched based on this determination.

[0096] In this case, for example, if the first device 100 is covered by clothing, the mode of the first device 100 is not switched. On the other hand, for example, if the first device 100 is covered by a user, the mode of the first device 100 is switched. Here, whether the first device 100 is covered by clothing or the user can be determined based on a change in capacitance on the surface of the first device 100.

[0097] Also, for example, if what is covering the first device 100 changes during the process, and what is covering the first device 100 changes from clothing to the user, for example, the mode of the first device 100 may be switched, and the mode of the first device 100 may be set to the second mode. When the covering of the first device 100 changes from clothing to the user, it is expected that there will be no change in illuminance. However, as described above, if the first device 100 is provided with a sensor that detects changes in capacitance, it can detect that the covering has changed from clothing to the user.

[0098] In this embodiment, when a user performs an operation on the first device 100 and at least a portion of the first device 100 is covered, it becomes necessary to determine whether the user's operation is an operation for operating only the first device 100 or an operation for switching to the second mode.

[0099] The determination of whether the operation is for operating only the first device 100 or for switching to the second mode can be made based on the magnitude of the pressure acting on the first device 100, for example. In this case, for example, the first device 100 is provided with a sensor that detects the pressure acting on the first device 100, and depending on the magnitude of the pressure acting on the first device 100, it is determined whether the user's operation is an operation for operating only the first device 100 or an operation for switching to the second mode.

[0100] Specifically, for example, if the pressure acting on the first device 100 exceeds a predetermined threshold, the user's operation is determined to be an operation for operating only the first device 100, and the first mode is maintained. When the operation is for operating only the first device 100, pressure acts locally on the touch panel that is the display 101, and the pressure acting on the first device 100 tends to be large. In this case, the user's operation is determined to be an operation for operating only first device 100, and the first mode is maintained.

[0101] Furthermore, for example, if the pressure acting on the first device 100 does not exceed a predetermined threshold, the user's operation is determined to be an operation for switching to the second mode, and switching to the second mode is performed. When performing an operation to switch to the second mode, the user will often cover the display 101 of the first device 100 with the entire palm of their hand, and the pressure acting on the first device 100 will tend to be smaller. In this case, the user's operation is determined to be an operation for switching to the second mode, and switching to the second mode is performed.

[0102] Alternatively, whether the operation is a user operation on only first device 100 or an operation for switching to the second mode may be determined based on the area of ​​the covered portion of first device 100, for example. Specifically, for example, if the area of ​​the covered portion of the first device 100 is smaller than a predetermined threshold, the user's operation is determined to be an operation on only the first device 100, and the first mode is maintained. Furthermore, for example, if the area of ​​the covered portion of first device 100 is larger than a predetermined threshold, the user's operation is determined to be an operation for switching to the second mode. In this case, the mode of first device 100 is switched from the first mode to the second mode.

[0103] Additionally, whether the user's operation is directed only to the first device 100 or whether the operation is for switching to the second mode may be determined based on, for example, both the pressure acting on the first device 100 and the area of ​​the covered portion of the first device 100. Specifically, for example, if the pressure acting on the first device 100 exceeds a predetermined threshold and the area of ​​the covered portion is smaller than the predetermined threshold, the user's operation is determined to be an operation on only the first device 100, and the first mode is maintained.

[0104] Also, for example, if the pressure acting on the first device 100 does not exceed a predetermined threshold and the area of ​​the covered portion is larger than a predetermined threshold, the user's operation is determined to be an operation for switching to the second mode. In this case, the mode of first device 100 is switched from the first mode to the second mode.

[0105] Furthermore, whether or not the user has covered the outside world side of first device 100 may be determined based on whether or not the user has covered a portion other than display 101. Specifically, for example, if the first device 100 is a device in the form of a wristwatch, a pressure sensor, a sensor that detects changes in capacitance, and an illuminance sensor are provided in the bezel 141 (see Figure 12) that corresponds to the frame of the first device 100. In this case, it is determined whether or not the user has covered the bezel 141 based on the outputs from the pressure sensor, the sensor that detects a change in capacitance, and the illuminance sensor. If it is determined that the user has covered bezel 141, it is determined that the user has covered the outside world side of first device 100.

[0106] In this case, information about the area of ​​the part of bezel 141 that the user touched may be obtained, and if the area of ​​the touched part exceeds a predetermined threshold, it may be determined that the user has covered the outside world side of first device 100. In addition, information about the pressure acting on the part of the bezel 141 that the user touches may be obtained, and if the pressure exceeds a predetermined threshold, it may be determined that the user has covered the outside world side of the first device 100. In addition, both area and pressure may be taken into consideration. For example, if the area of ​​the portion of bezel 141 that the user touches exceeds a predetermined threshold and the pressure acting on the portion of bezel 141 that the user touches exceeds a predetermined threshold, it may be determined that the user has covered the outside world side of first device 100.

[0107] Alternatively, for example, a pressure sensor may be provided on the inside of first device 100, and based on the detection result of this pressure sensor, it may be determined whether or not the user has covered first device 100.

[0108] When the user covers the first device 100, pressure also acts on the interior side of the first device 100. Whether the user has covered the first device 100 can also be determined by detecting the pressure acting on the interior side of the first device 100. In this case, for example, if the pressure detected by the pressure sensor exceeds a predetermined threshold, it is determined that the user has covered the first device 100, and the mode of the first device 100 is switched to the second mode. On the other hand, if the pressure detected by the pressure sensor does not exceed the predetermined threshold, it is not determined that the user has covered the first device 100, and the mode of the first device 100 remains in the first mode.

[0109] Additionally, a pressure sensor, a sensor that detects a change in capacitance, or an illuminance sensor may be provided on the belt 142 (see FIG. 12) of the first device 100. In this case, when the user switches the mode of the first device 100, the user covers the belt 142 of the first device 100. When the user covers belt 142 of first device 100, the outputs from the pressure sensor, the sensor that detects a change in capacitance, and the illuminance sensor change, and accordingly, the mode of first device 100 is switched from the first mode to the second mode.

[0110] Furthermore, in this embodiment, even if the user does not cover the first device 100 with his / her hand, but covers the first device 100 with a part other than his / her hand, the mode of the first device 100 can be switched. Specifically, for example, as shown in FIG. 13 (a diagram showing the state of a user wearing the first device 100), even if the user covers a specific part of the first device 100 facing the outside world by facing it against their own clothing or the like, the mode of the first device 100 can be switched to the second mode. The example shown in FIG. 13 illustrates a state in which the user faces the outside world side of display 101, as a specific portion of the outside world side of first device 100, towards his or her own clothes.

[0111] More specifically, for example, when the user contacts the outside world side of the display 101 with their own clothing or the like with a pressure equal to or greater than a predetermined magnitude, the mode of the first device 100 is switched to the second mode. Furthermore, for example, when a user faces the outside world side of the first device 100 toward their own clothing or the like and reduces the illuminance on the outside world side of the first device 100 to a predetermined threshold or below, the mode of the first device 100 may be switched to the second mode.

[0112] 14 illustrates a state in which the user has the outside world side of belt 142 facing his or her own clothing as a specific portion of the outside world side of first device 100. In this example, sensors such as a pressure sensor, a sensor that detects changes in capacitance, and an illuminance sensor are provided on belt 142 of first device 100.

[0113] More preferably, the sensor is provided in a portion of the belt 142 that is located on the palm side of the user when the first device 100 is worn by the user.

[0114] Assuming that a wristwatch is typically worn with the part that shows the time (display 101 in first device 100) located on the back of the user's hand, the part of first device 100 that the user is more likely to face toward their own clothing is belt 142 rather than display 101. Therefore, if a sensor is provided on belt 142, the user can take a more natural posture when facing the part where the sensor is provided toward their own clothing compared to the case shown in FIG. 13. In other words, the mode can be switched by taking a more natural posture.

[0115] FIG. 15 is a diagram illustrating detection of the movement of the user's finger in the second mode. In the second mode, the detection of the user's finger movement can be performed in a first manner, for example, as shown in FIG. 15(A), in which the movement of the fingers at the tip of the arm on which the first device 100 is not worn is detected, and a second manner, as shown in FIG. 15(B), in which the movement of the fingers at the tip of the arm on which the first device 100 is worn is detected.

[0116] 15(A), the user moves the fingers of the hand that is covering first device 100. In other words, the user moves the fingers of the hand that is holding first device 100. In a first mode shown in FIG. 15(A), for example, the movement of the user's finger is detected using display 101 (touch panel) (see FIG. 12) located on the external side of first device 100. Alternatively, for example, a contact sensor may be provided in a bezel 141 (see FIG. 12) that is the frame of the first device 100, and the movement of the user's finger may be detected in this bezel 141 portion. Alternatively, if first device 100 is a wrist-worn device, a sensor may be provided on belt 142 (see FIG. 15(A)), and the sensor provided on belt 142 may detect the movement of the user's finger.

[0117] In a second mode shown in FIG. 15(B), the user moves the fingers at the tip of the arm on which the first device 100 is worn. In the second mode shown in FIG. 15(B), for example, a vibration sensor may be provided inside the first device 100, or a sensor that detects the movement of the user's muscles or tendons may be provided inside the first device 100. In the second mode shown in Fig. 15(B), these sensors are used to detect the movement of the fingers at the tip of the arm wearing first device 100. In the second mode shown in Fig. 15(B), second device 200 is controlled based on the movement of the fingers at the tip of the arm wearing first device 100. In other words, in the second mode shown in FIG. 15(B), CPU 111A of first device 100 controls second device 200 based on the movement of the fingers at the end of the arm on which first device 100 is worn.

[0118] In addition, in the second mode, the detection of the user's finger movement is not limited to using only one of the detection in the first mode or the detection in the second mode, but may also use both the detection in the first mode and the detection in the second mode. That is, in the second mode, when detecting the movement of the user's fingers, it is possible to detect both the movement of the fingers at the tip of the arm on which the first device 100 is not being worn and the movement of the fingers at the tip of the arm on which the first device 100 is being worn.

[0119] Alternatively, the finger at the tip of the arm on which the first device 100 is worn may be detected by detecting the movement of the wearable device 290 worn on this finger. Specifically, in this case, for example, as shown in FIG. 16 (a diagram showing the state of the user's fingers), a wearable device 290 in the form of a ring is worn on the finger at the end of the arm on which the first device 100 is worn. In this configuration example, first device 100 is used to detect the movement of this wearable device 290. This also makes it possible to detect the movement of the fingers at the tip of the arm on which first device 100 is worn.

[0120] In the second embodiment, as one of the detection modes, a mode has been described in which the movement of the finger at the tip of the arm on which first device 100 is worn is detected. This aspect of detecting the movement of the finger at the tip of the arm on which the device is worn may also be applied to first device 100 described in the first embodiment above. First device 100 described in the first embodiment also detects the movement of the user's finger in the second mode, but may detect the movement of the finger at the tip of the wrist during this detection. Then, in the first embodiment, second device 200 may be controlled based on this finger movement.

[0121] Furthermore, first device 100 described in the first embodiment detects a user's operation on display 101 (touch panel), and controls second device 200 based on the result of this detection. In the first embodiment, the location where the user touches first device 100 is not limited to the touch panel of display 101, but may be another location. For example, if first device 100 is a wristwatch, the sensor may be bezel 141, which corresponds to the frame of first device 100. Alternatively, for example, a sensor may be provided on belt 142, and the location where the user touches first device 100 may be belt 142.

[0122] FIG. 17 is a diagram showing an example of a display on the display 202 (see FIG. 1) provided in the second device 200. As shown in FIG. In the display example shown in Fig. 17, the user's finger movement and the content of the process executed by second device 200 based on the movement are displayed in a mutually associated state. In other words, Fig. 17 shows a guidance display for guiding the user on how to operate the finger.

[0123] The display example shown in FIG. 17 shows an operation that the user performs when first device 100 is in the second mode, and the content of the process that is performed by second device 200 when this operation is performed. Specifically, the operations performed by the user on the first device 100 are displayed in the area indicated by reference numeral 17A in FIG. 17, and the contents of the processing performed on the second device 200 are displayed in the area indicated by reference numeral 17B in FIG. 17. More specifically, the content of the processing performed by second device 200 is displayed inside a circular area indicated by reference numeral 17X. Note that the content of this processing is not shown in FIG.

[0124] The display example shown in FIG. 17 shows operations and processing details in a situation where the user is covering first device 100 with his / her right hand. More specifically, FIG. 17 shows an operation performed by the user with the left hand and the processing content performed by the second device 200 when this operation is performed, and also shows an operation performed by the user with the right hand and the processing content performed by the second device 200 when this operation is performed. In other words, Figure 17 shows a guidance display when both detection of finger movement at the tip of the arm on which the first device 100 is not worn and detection of finger movement at the tip of the arm on which the first device 100 is worn are performed.

[0125] In a situation where the user is covering first device 100 with his / her right hand, the user can perform operations on first device 100 by moving the fingertips of his / her right hand and the fingertips of his / her left hand. In the display example shown in FIG. 17, the movement of the fingertips of the left hand and the processing content corresponding to this movement are displayed in the area indicated by reference numeral 17C. In other words, in the display example shown in FIG. 17, the movement of the fingertips of the left hand, which is the hand on which first device 100 is worn, and the processing content corresponding to this movement are displayed on the left side of display screen 202A displayed on display 202 (see FIG. 1).

[0126] In the example display shown in FIG. 17, the fingertip movements of the right hand and the processing content corresponding to these movements are displayed at the location indicated by reference numeral 17D. In other words, in the display example shown in FIG. 17, the right side of the display screen 202A displays the fingertip movements of the right hand, which is the hand not wearing the first device 100, and the processing content corresponding to these movements. In this embodiment, the left side of the display screen 202A displays the movement of the fingertips of the left hand, and the right side of the display screen 202A displays the movement of the fingertips of the right hand. In this case, the user can more intuitively recognize the content of the operation of each hand compared to when the movement of the fingertips of the right hand is displayed on the left side of display screen 202A and the movement of the fingertips of the left hand is displayed on the right side of display screen 202A.

[0127] Furthermore, in the display example shown in Figure 17, an image showing the first device 100 is displayed, as indicated by the symbol 17F, and in the display example shown in Figure 17, it is indicated that the second device 200 can be operated by performing an operation on the first device 100. In other words, the example display shown in FIG. 17 indicates that the mode of first device 100 is the second mode for operation of second device 200. In other words, the example display shown in FIG. 17 indicates that first device 100 is in a remote control mode for operating second device 200.

[0128] FIG. 17 shows a display when first device 100 is worn on the left hand of the user. Although not shown in the figures, when the first device 100 is worn on the user's right hand, for example, the display shown at the location indicated by the symbol 17C displays the fingertip movements of the left hand, which is the hand on which the first device 100 is not worn, and the operation content corresponding to this movement. Furthermore, when the first device 100 is worn on the user's right hand, the display, for example, at the location indicated by the symbol 17D, displays the fingertip movements of the right hand, which is the hand on which the first device 100 is worn, and the operation content corresponding to these movements.

[0129] Alternatively, for example, it may be possible to determine whether first device 100 is worn on the user's right hand or left hand, and automatically switch the display on display 202 of second device 200 depending on the result of this determination. In this case, if it is determined that the arm on which the first device 100 is worn is the left arm, the display shown in FIG. 17 is displayed. 17, as described above, the fingertip movements of the left hand and the processing content corresponding to these movements are displayed in the area indicated by reference numeral 17C, and the fingertip movements of the right hand and the processing content corresponding to these movements are displayed in the area indicated by reference numeral 17D.

[0130] Also, if it is determined that the arm on which the first device 100 is worn is the right arm, the movement of the fingertips of the left hand and the processing content corresponding to this movement are displayed in the area indicated by the symbol 17C. Furthermore, the location indicated by the reference numeral 17D displays the fingertip movements of the right hand and the processing content corresponding to these movements.

[0131] FIG. 18 is a diagram showing another example of display on the second device 200. In FIG. This display example shows a display example when moving a finger at the tip of the arm on which first device 100 is worn. Specifically, this example shows a display example when moving a finger at the tip of the left arm, which is the arm on which first device 100 is worn. In this case, the display 202 of the second device 200 displays the movement of the fingertips of the left arm, which is the arm on which the first device 100 is worn, and the content of the processing to be executed in response to this movement, as shown in FIG. 18.

[0132] In this embodiment, the user can operate the first device 100 using the fingertips at the end of the arm on which the first device 100 is worn (hereinafter referred to as "wearing-side operation"), and can operate the first device 100 using the fingertips at the end of the arm on which the first device 100 is not worn (hereinafter referred to as "non-wearing-side operation"). In this embodiment, the first device 100 can be operated both on the mounting side and on the non-operating side. In this embodiment, there are three operation modes, and in each of the three operation modes, first device 100 accepts the content of the operation performed on first device 100 by the user.

[0133] In this embodiment, for example, the user may be allowed to select an operation mode from among these three operation modes. In this case, first device 100 accepts the content of the operation performed by the user in the operation mode selected by the user from the three operation modes. Alternatively, an operation mode that the user can perform on first device 100 may be determined in advance for each first device 100. In this case, the user performs an operation in this predetermined operation mode, and first device 100 accepts this operation.

[0134] If the configuration allows the user to select an operation mode, display 202 of second device 200 displays a display corresponding to the operation mode selected by the user. Specifically, for example, in an operation mode in which the user can perform both wearing-side operation and non-wearing-side operation, the display shown in Fig. 17 is displayed. Also, in an operation mode in which the user can perform only wearing-side operation, the display shown in Fig. 18 is displayed. Also, although not shown in the figures, in an operation mode in which the user can only perform non-wearing side operations, the fingertip movements of the arm on which the first device 100 is not worn and the operation content corresponding to this fingertip movement are displayed.

[0135] FIG. 19 is a diagram showing an example of screen transition on display 101 of first device 100. In FIG. In FIG. 19, the location indicated by the reference numeral 19A shows an example of the display of the first device 100 before the first device 100 is rotated as described above or before the first device 100 is covered by the user. In other words, in FIG. 19, the portion indicated by reference numeral 19A shows an example of the display of first device 100 when first device 100 is in the first mode. In the first mode, if no operation is performed on the first device 100 for a certain period of time, the first device 100 enters a sleep state, and the display 101 of the first device 100 is turned off, as shown in FIG. 19(A).

[0136] From this state, when the user, for example, moves the arm on which the first device 100 is attached upward, the display 101 of the first device 100 lights up, as shown in FIG. 19(B), and the user can view, for example, applications on the display screen 101A. In other words, the user can visually recognize display elements 185 such as icons displayed on display screen 101A of first device 100. Then, for example, when the user selects an application from the plurality of applications being displayed, a screen corresponding to the selected application is displayed, as shown in FIG. 19(C).

[0137] In other words, when a user makes a selection using a predetermined gesture such as a tap on a display element 185 such as an icon displayed on the display 101 of the first device 100, a screen corresponding to the selected application from among the applications installed on the first device 100 is displayed. 19(C) illustrates a case where a chat application for sending and receiving messages is selected by the user, and in this case, a screen corresponding to the chat application is displayed on first device 100. In the example shown in Fig. 19(C), a chat message "Enjoy (omitted)" received by this user from another user (e.g., user A) is displayed, and "Got it" and "Thank you" are displayed as options for a chat message to reply to user A.

[0138] Next, a display example on first device 100 when first device 100 transitions to the second mode will be described. When CPU 111A of first device 100 transitions the mode of first device 100 from the first mode to the second mode, CPU 111A of first device 100 changes the display on display 101 of first device 100. Specifically, in this embodiment, as shown in Figures 5, 7, 11, and 12, when the orientation of the first device 100 is changed or when the first device 100 is covered, the CPU 111A of the first device 100 changes the display on the display 101 of the first device 100. As a result, the display 101 of the first device 100 displays, for example, the display shown by reference numeral 19X in FIG.

[0139] As described above, in this embodiment, when the orientation of the first device 100 is changed or when the first device 100 is covered, the mode of the first device 100 transitions to the second mode. In this embodiment, with the transition to the second mode, for example, display screen 101A of first device 100 transitions to the state indicated by reference numeral 19X. In this embodiment, regardless of the display content displayed on the first device 100 immediately before the transition to the second mode, the display screen 101A of the first device 100 switches to the content indicated by the symbol 19X in response to the transition to the second mode. Furthermore, in this embodiment, regardless of whether a screen was displayed on the first device 100 immediately before the transition to the second mode, the content indicated by the symbol 19X is displayed on the display 101 of the first device 100 in response to the transition to the second mode.

[0140] Specifically, for example, even if the menu screen (see FIG. 19(B)) is displayed on the first device 100, or even if a screen other than the menu screen is displayed, when the second mode is entered, the display screen 101A indicated by the symbol 19X is displayed on the display 101 of the first device 100. Also, as shown in FIG. 19(A), even if the first device 100 is in an off state, when the first device 100 transitions to the second mode, the display screen 101A indicated by the symbol 19X is displayed on the display 101 of the first device 100.

[0141] Display 101, designated by reference numeral 19X, displays "In remote control mode," indicating that first device 100 is in a so-called remote control mode in which second device 200 can be operated via first device 100. In other words, a display is displayed indicating that first device 100 is in the second mode. Furthermore, on this screen denoted by reference numeral 19X, as denoted by reference numeral 19Y, an operation method for transitioning to the first mode is displayed. In other words, on this screen denoted by reference numeral 19X, an operation method for returning to the first mode is displayed.

[0142] FIG. 20 is a diagram showing an example of a display on first device 100 when first device 100 is in the second mode. In addition to the display indicated by reference numeral 19X in Fig. 19, examples of the display when first device 100 is in the second mode include the displays shown in Fig. 20(A) and (B). The displays shown in Fig. 20(A) and (B) have reduced brightness.

[0143] Specifically, in FIG. 20A, the brightness of the display 101 is set to 0% and the display is in an off state. 20(B) shows a display screen 101A in which a gray screen is additionally displayed on top of the display screen 101A displayed in the first mode (see FIG. 19(B)). The brightness of the display screen 101A shown in FIG. 20(B) is 25%. In FIG. 20(B), display elements 185 such as icons are visible on display screen 101A, but in the second mode, these display elements 185 are disabled. Therefore, even if the user performs an operation such as tapping or swiping on this display element 185, this operation is not accepted.

[0144] FIG. 19(B) shows an example of display screen 101A of first device 100 when first device 100 is in the first mode. The above brightness of 0% and 25% indicate the percentage of brightness when the brightness of display screen 101A in this first mode is 100%. In the displays shown in FIGS. 20(A) and 20(B), the brightness is reduced, which allows the user to recognize that the mode of first device 100 is the second mode.

[0145] The display screen 101A shown in FIG. 20(C) is the same display screen 101A as the display screen 101A indicated by the reference numeral 19X in FIG. This display screen 101A is a display screen 101A in which a second display screen 101D (see FIG. 20(E)) that does not include display elements 185 that can be selected by the user is superimposed on the display screen 101A (see FIG. 19(B)) (hereinafter referred to as "first display screen 101C") that was displayed on the display 101 of the first device 100 before the transition to the second mode.

[0146] FIG. 20(E) shows only the second display screen 101D, and when the CPU 111A transitions the mode of the first device 100 to the second mode, it overlays this second display screen 101D on top of the first display screen 101C (see FIG. 19(B)) that was displayed on the display 101 of the first device 100 before the transition. As a result, in the second mode, display screen 101A displayed on first device 100 becomes display screen 101A shown in FIG. 20(C).

[0147] On the first display screen 101A displayed in the first mode (display screen 101A shown in FIG. 19(B)), display elements 185 that can be selected by the user, such as buttons, icons, links, etc., are displayed. In contrast to this, in the displays in FIGS. 20(B) and (C), the display element 185 cannot be selected by the user. In other words, in Figures 20(B) and (C), a display is displayed indicating that display element 185 that was displayed and selectable on first device 100 before the transition to the second mode cannot be selected.

[0148] When the CPU 111A of the first device 100 transitions the first device 100 from the first mode to the second mode, it changes the display so that it is clear that the display elements 185 that were selectable in the first mode are no longer selectable, as shown in Figures 20(B) and (C). 20(B) and (C), the user can view the display element 185 that was displayed before the transition to the second mode. However, in the display examples shown in these Figures 20(B) and (C), the user cannot select this display element 185.

[0149] 20(B) and 20(C), the display also indicates that the display element 185 is invalid. In other words, the display allows the user to recognize that the display element 185 cannot be selected. In other words, in Figures 20(B) and (C), even if the user touches the display 101, the first device 100 does not react, and the displays in Figures 20(B) and (C) are intended to inform the user that the operation on the display 101 is a meaningless operation. As another example of a display indicating that the display element 185 is invalid, the display element 185 that was displayed in color may be displayed in black and white. When this display shown in Figures 20(B) and (C) is being displayed, CPU 111A of first device 100 will not execute processing corresponding to display element 185, even if the user touches the area where display element 185 is displayed and performs an operation on display element 185.

[0150] 20(D) shows display screen 101A that does not include display element 185. In other words, display screen 101A shown in Fig. 20(D) is display screen 101A in which only second display screen 101D shown in Fig. 20(E) is displayed on display 101 of first device 100. In this embodiment, when the CPU 111A transitions the mode of the first device 100 to the second mode, it switches the display on the display 101 from the first display screen 101A shown in FIG. 19(B) to, for example, the second display screen 101A shown in FIG. 20(D) which does not include the display element 185.

[0151] 20(D) does not include display elements 185 that respond to user operations, that is, it does not include display elements 185 such as buttons, icons, links, etc. In the display in FIG. 20(D), even if the user touches the display 101, the first device 100 does not react, and the display in FIG. 20(D) is a display that informs the user that the operation on the display 101 is a meaningless operation. Also, display screen 101A shown in FIG. 20(D) displays a message indicating that first device 100 is in a so-called remote control mode in which second device 200 can be operated via first device 100.

[0152] In other words, display screen 101A shown in Fig. 20(D) displays an indication that first device 100 is in the second mode. Note that the indication that first device 100 is in the second mode may be displayed using text, or may be displayed using something other than text, such as an illustration or an icon. Moreover, a display screen 101A shown in FIG. 20(D) displays a method for canceling the second mode.

[0153] FIG. 21 is a diagram showing another example of a display on first device 100 when first device 100 is in the second mode. The display example shown in FIG. 21 shows a display example in which the layout of display screen 101A of first device 100 is changed in conjunction with the transition to the second mode. Specifically, in this display example, when the mode of first device 100 transitions from the first mode to the second mode, as shown in FIG. 21, display screen 101A (see FIG. 19(B)) that was displayed in the first mode is reduced and displayed in the upper half of the displayable area of ​​first device 100. Note that reduced display screen 101A in FIG. 19(B) may be displayed not only at the top of the displayable area but also at the bottom, right, left, etc. Furthermore, display screen 101A in FIG. 19(B) does not need to be reduced to half its size, and may be reduced to a size set by the user, for example.

[0154] Furthermore, in this display example, when the mode of the first device 100 transitions from the first mode to the second mode, the lower half of the displayable area of ​​the first device 100 (i.e., the area where the reduced display screen 101A of Figure 19 (B) is not displayed) becomes a reception area 193, which is an area for receiving user operations on the second device 200. A display is provided in this reception area 193 to inform the user that this is an area for receiving operations from the user. Specifically, an image showing the user's index finger and middle finger is displayed in reception area 193. Note that the fingers displayed here may vary depending on the user's dominant hand, on which arm first device 100 is worn, etc.

[0155] In other words, this display example displays a guide that guides the user as to where on first device 100 the user can operate second device 200 by moving their finger. It can also be said that this display example shows the user as to where on first device 100 the user can operate second device 200 by moving which finger. In this display example, in the second mode, the user operates second device 200 by moving (eg, tapping) a finger in reception area 193.

[0156] The display form of the reception area 193 is not limited to the display form shown in FIG. The reception area 193 may display a plain image without any text or icons. Furthermore, in the reception area 193, text such as "Operations for the second device 200 are accepted in this area" may be displayed.

[0157] Here, as a conventional technique, a method for operating one user device (e.g., a smartwatch) from another user device (e.g., a smartphone) includes, for example, displaying an icon on the smartwatch indicating an application for operating the smartphone paired with the smartwatch, and when this icon is selected on the smartwatch, displaying buttons on the smartwatch indicating functions that can be executed on the smartphone.

[0158] As a more specific example, when an icon indicating an application for operating the camera of a smartphone (corresponding to the second device 200) is tapped on a smartwatch (corresponding to the first device 100), a button for releasing the shutter of the smartphone camera is displayed on the smartwatch, and the user can take photos or videos with the smartphone camera by tapping this button.

[0159] However, in this case, it is difficult for the user to operate the smartphone from the smartwatch without looking at the screen displayed on the smartwatch display. Furthermore, if the user is wearing a glasses-type device, the glasses-type device and the screen displayed thereon may get in the way, making it difficult to see the screen displayed on the touch panel of the smartwatch unless the display on the glasses-type device is turned off or the user removes the device. 1 to 21, the user switches the mode of a device (first device 100) to a mode for operating another device (second device) by rotating or covering the device. In other words, the user can switch the mode of the device without necessarily looking at the device.

[0160] Another example of the configuration of the first device 100 will be described. In the above, a wristwatch is described as an example of a wrist-worn first device 100, a ring is described as an example of a finger-worn first device 100, and a smartphone with a neck strap is described as an example of a neck-worn first device 100. However, the first device 100 is not limited to these. The first device 100 may be worn on the upper body (including the head, neck, back, abdomen, arms, etc.), the lower body (including the waist, legs, etc.), or both. Specifically, the first device 100 may be provided in the form of a hat, contact lenses, headset, earphones, earrings, piercings, belly warmers, neck warmers, necklaces, scarves, arm warmers, wristbands, gloves, false nails, nail stickers, tops (long sleeves, short sleeves, tank tops, etc.), bottoms (skirts, pants, etc.), dresses, shoes, socks, etc.

[0161] Some of these first devices 100 can rotate around the torso, neck, arm, finger, etc., similar to the above-mentioned first devices 100 in the form of a wristwatch or ring, and can switch modes by rotating in the same manner as above. In other words, the first device 100 has a hole through which a part of the human body can pass. Specifically, for example, the first device 100 having the form of a belly warmer, neck warmer, necklace, arm warmer, wristband, etc. has holes provided in these first devices 100 so that a part of the human body can be passed through them. In these first devices 100, the mode can be switched by rotating the first device 100 around this part.

[0162] Furthermore, the first device 100 may be, for example, a device that is configured to be worn over a part of the human body. Specifically, examples of the first device 100 that can be worn on a part of the human body include devices in the form of hats, gloves, shoes, socks, and the like. In the first device 100 in the form of a hat, the mode can be switched by rotating the hat in a circumferential direction around the user's head. Furthermore, in the case of first device 100 in the form of shoes, gloves, socks, or the like, for example, the mode can be switched by wearing first device 100 on the left hand or left foot instead of the right hand or left foot. Also, the mode can be switched by wearing first device 100 on the left hand or left foot instead of the right hand or right foot.

[0163] An example of the first device 100 is a device that fits into a hole in the human body. An example of the first device 100 that is configured to fit into a hole in the human body is the first device 100 that is configured as an earphone. In the first device 100 in the form of an earphone, the mode can be switched by rotating the first device 100 in a circumferential direction around the part that is inserted into the user's ear.

[0164] An example of the first device 100 is a device that is passed through a hole in the human body and then hooked onto the human body. An example of first device 100 that is configured to be passed through a hole in the human body and then hooked onto the human body is a device in the form of a piercing that is attached to the user's earlobe. In the case of the first device 100 in the form of a pierced earring, the mode can be switched by rotating the first device 100 in a circumferential direction around the part that goes inside the user's ear. Furthermore, with the first device 100 in the form of a pierced earring, the mode can be switched by attaching the first device 100 that has been attached to one side of the earlobe to the other side.

[0165] An example of the first device 100 is a device that has a form in which a part of the device is clamped to the human body. Specifically, for example, the first device 100 may be in the form of a headset that clips onto the user's head, or in the form of an earring that clips onto the earlobe. In the case of the first device 100 in the form of a headset, the user can switch modes by wearing the first device 100 with the right ear side and the left ear side interchanged. In addition, in the case of the first device 100 in the form of an earring, the mode can be switched by changing the state in which the first device 100 is worn so that the part located on one side of the earlobe and the part located on the other side are interchangeable.

[0166] Examples of the first device 100 include devices in the form of a scarf, a top (long sleeve, short sleeve, tank top, etc.), false nails, nail stickers, and the like. In these first devices 100, a pressure sensor, a sensor that detects a change in capacitance, and an illuminance sensor are provided in the portion of the first device 100 that is located on the outside world side, as described above. When the outside world side of these first devices 100 is covered by the user, the mode is switched.

[0167] The above-described configurations are not limited to the above-described embodiments and their modifications, and can be modified within the scope of the spirit of the invention. In other words, it is understood that various modifications of the form and details are possible without departing from the spirit and scope of the claims. For example, some of the components described above may be omitted, or other functions may be added to the components described above. Furthermore, although multiple embodiments have been described above, the configuration included in one embodiment may be interchanged with the configuration included in another embodiment, or the configuration included in one embodiment may be added to another embodiment. [Explanation of symbols]

[0168] 30: Mounting portion, 100: First device, 101: Display, 111A: CPU, 131: Rotating portion, 200: Second device

Claims

1. A device having a processor and worn on a user's body part, allowing the user to operate other devices through the device; The processor: Detecting the orientation of the device attached to the attachment site; transitioning a mode of the device to a second mode in which operation of the other device via the device is permitted in response to the device being worn in a second orientation with respect to the wearing portion of the user; Device.

2. The device is rotatable about the attachment site as an axis while being attached to the attachment site, The orientation of the device is changed by rotating the device around the attachment site.

10. The apparatus of claim 1.

3. The processor: transitioning a mode of the device from a first mode corresponding to the first orientation to the second mode in response to a change in the orientation of the device with respect to the attachment site from a first orientation different from the second orientation to the second orientation; 10. The apparatus of claim 1.

4. the device has a rotatable portion; the orientation of the device is changed by rotating the rotatable portion; The processor: transitioning the mode of the device to the second mode in response to the rotation of the rotatable portion; 10. The apparatus of claim 1.

5. The processor: and returning the mode of the device from the second mode to the first mode prior to entering the second mode in response to the device no longer being oriented in the second orientation.

10. The apparatus of claim 1.

6. the first mode is a mode for operating the device, but not a mode for operating the other device; the second mode is a mode for operating the other device via the device; 6. The device according to claim 3 or 5.

7. The processor: The device of claim 1 , wherein when the mode of the device is changed to the second mode, a display on the display of the device is changed.

8. The processor: When the mode of the device is transitioned to the second mode, the brightness of the display of the device is reduced.

10. The apparatus of claim 1.

9. The processor: When the mode of the device is changed to the second mode, a selectable element that was displayed on the display of the device before the change is displayed so as to be clearly unselectable.

10. The apparatus of claim 1.

10. The processor: When the mode of the device is transitioned to the second mode, a second screen not including any selectable elements is displayed superimposed on a first screen that was displayed on a display of the device before the transition, or the display on the display is switched from the first screen to the second screen.

10. The apparatus of claim 1.

11. the other device is a device worn by the user that is different from the device worn by the user; 11. Apparatus according to any one of claims 1 to 10.

12. The other device is a device worn in front of the user's eyeball.

12. The apparatus of claim 11.

13. the device is worn on the user's arm; The processor: Controlling the other device based on the movement of a finger at the end of the arm on which the device is worn.

13. An apparatus according to any one of claims 1 to 12.

14. The second orientation is a predetermined specific orientation, The processor: transitioning a mode of the device to the second mode in response to the device being attached in the predetermined specific orientation with respect to the attachment portion; 10. The apparatus of claim 1.

15. A program executed by a computer provided in a device that is attached to a user's attachment site and allows the user to operate other devices through the device, a function of detecting the orientation of the device attached to the attachment site; a function of transitioning the device to a second mode in which operation of the other device via the device is permitted in response to the device being attached to the attachment portion of the user in a first orientation; A program for causing the computer to realize the above.

Images