Wearable terminal, system, control method thereof, program, and storage medium

Abstract

To provide a wearable terminal and a portable terminal, a control method for the same, and a program that control display of the wearable terminal to prevent overlap of the display of the wearable terminal and display of the portable terminal.SOLUTION: A wearable terminal (smart glasses) can perform wireless communication with a portable terminal (smart watch) having a display, and has: receiving means that, when the status of the portable terminal is changed, receives information on the status from the portable terminal; determination means that determines whether to switch display of the wearable terminal based on the received information; and display control means that switches the display based on a result of determination made by the determination means.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a mechanism for controlling the display of applications by linking wearable devices such as smart glasses and mobile devices such as smartphones and smart watches. [Background technology]

[0002] In recent years, mobile devices, including wearable devices, have become increasingly diverse (smart glasses, smart watches, smartphones, etc.), and there are many cases where people wear multiple devices at the same time. Different applications are often installed on smart glasses and other wearable devices, and people often view the screens of each device depending on the purpose. As a result, a system has been developed in which smart glasses equipped with a camera detect the line of sight and communicate with a smart watch via wireless communication or other means (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-201160 A Summary of the Invention [Problem to be solved by the invention]

[0004] When using a smartphone and a smartwatch, for example, each device has a screen, the display on one screen does not overlap with the display on the other screen. However, when using smart glasses and other mobile devices, the display on the smart glasses and the display on the other mobile device overlap, making it difficult for users to see. The present invention aims to improve convenience when using a wearable device together with another mobile device by controlling the display of the wearable device in accordance with the user's purpose. [Means for solving the problem]

[0005] The present invention relates to a wearable terminal, The display control means controls so that a content image is displayed within the field of view of a user wearing the wearable terminal, and controls so that the displayed content image is hidden or reduced when a mobile terminal is present within the field of view of the user, and when status information of a specific mobile terminal that is paired with the wearable terminal and communicates with the wearable terminal is first information, the display control means controls so that the content image is hidden or reduced when the specific mobile terminal is present within the field of view of the user, and when the status information is second information indicating that the specific mobile terminal is in a sleep state, the display control means controls so that the content image is not hidden or reduced even when the specific mobile terminal is present within the field of view of the user. It is characterized by: Effect of the Invention

[0006] According to the present invention, by controlling the display of a wearable device in accordance with a user's purpose, it is possible to improve convenience when using a wearable device together with another mobile device. [Brief description of the drawings]

[0007] [Figure 1] Overview of smart glasses and smart watches [Figure 2A] Smart glasses hardware configuration diagram [Figure 2B] Smartwatch hardware configuration diagram [Diagram 3] Smart glasses and smart watches software configuration diagram [Figure 4] Flowchart showing the status notification process for smartwatches and the hidden process for smart glasses [Diagram 5] Example of what is displayed when the AR / MR displayed by smart glasses is hidden [Figure 6] Flowchart showing the status notification process for smartwatches and the hidden process for smart glasses DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS EXAMPLES

[0008] Overview of smart glasses and smart watches Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing the overview and connection relationship of smart glasses and a smart watch. The smart glasses 101 are wearable information terminals worn by a user, and display virtual images on a display unit 102 within the user's field of vision without blocking the user's field of vision. Such displays are known as AR (Augmented Reality) or MR (Mixed Reality), and are provided by a transparent display (lens) or a function for projecting information onto the retina. The display unit 102 is also provided with a camera unit 103 for capturing an image of a subject in the user's line of sight. The operation frame unit 104 is equipped with a touch sensor, and is a frame for operating the terminal. The smart watch 110 is a wristwatch-type information terminal worn by a user on the wrist, and the display unit 111 not only displays information such as the time, but also functions as a touch panel and can operate the terminal. Wireless communication 120 for exchanging data between the smart glasses 101 and the smart watch 110 is assumed to be wireless communication of standards such as Bluetooth and NFC, but is not limited to this. In the following description, a mobile terminal that cooperates with the smart glasses 101 is described as the smart watch 110, but this is not limited to this and any device equipped with a display that communicates with the smart glasses 101 may be used. For example, a mobile terminal such as a tablet or smartphone may be used.

[0009] Hardware configuration Smart GlassesFIG. 2A is a diagram showing a configuration of smart glasses 101 according to an embodiment of the present invention. The CPU 201 collectively controls various functions of the smart glasses 101 via an internal bus 206 by an application program stored in the ROM 203. The execution result of the application program executed by the CPU 201 is displayed on the display 202. In this embodiment, the display method is assumed to be a method in which the user sees something projected on a transmissive display, but it is also possible to adopt a method of directly projecting onto the retina. The ROM 203 is a flash memory or the like, and various setting information and application programs as described above are stored therein. The RAM 204 functions as a memory and a work area for the CPU 201. The network I / F 205 controls the smart glasses 101 to exchange data with an external network device unidirectionally or bidirectionally via the wireless communication 120. The operation unit 207 accepts an input from a user via the operation frame unit 104, and transmits a signal corresponding to the input to each of the processing units described above via the operation unit I / F 208. The sensor unit 209 includes a GPS, a gyro sensor, an acceleration sensor, a proximity sensor, a blood pressure / heart rate measurement sensor, a gaze detection sensor, and the like. It is also possible to detect biological information such as fingerprint authentication, vein authentication, and iris authentication. The camera 210 of the camera unit 103 has a photographing function, and photographed image data is stored in the ROM 203. The laser 211 projects various contents onto the display 202, and in the case of a retinal projection method, projects the contents directly onto the retina. The storage device 212 is a storage medium, and is a device for storing various data such as applications. It also includes a device for reading data from the storage medium and a device for deleting data. Some terminals do not have the storage device 212 and only have the ROM 203.

[0010] Smart WatchesFIG. 2B is a diagram showing the configuration of a smart watch 110 according to an embodiment of the present invention. The CPU 221 controls various functions of the smart watch 110 via an internal bus 226 by application programs stored in the ROM 223. The results of the application programs executed by the CPU 221 are displayed on the display 222 of the display unit 111. The ROM 223 is a flash memory or the like, and stores various setting information and application programs as described above. The RAM 224 functions as a memory and work area for the CPU 221. The network I / F 225 controls the smart watch 110 to exchange data with an external network device one-way or two-way via the wireless communication 120. The operation unit 227 accepts input from a user on the display unit 111 and transmits a signal corresponding to the input to each of the processing units described above via the operation unit I / F 228. The sensor unit 229 indicates a GPS, a gyro sensor, an acceleration sensor, a proximity sensor, a blood pressure / heart rate measurement sensor, a gaze detection sensor, and the like. The camera 230 has a photographing function, and photographed image data is stored in the ROM 223. In addition, the image data acquired through the camera 230 and the sensor unit 229 can detect the user's line of sight.

[0011] ● Software configuration Smart Glasses 3(a) is a diagram explaining the software module configuration of the smart glasses 101. The communication unit 301 receives status information of the smart watch 110 and notifications from the application server. The storage unit 302 exchanges information with the ROM 203, RAM 204, and other processing units. It also stores image data captured by the camera 210. The display unit 303 displays the results of various applications executed by the CPU 201, such as AR / MR display. For example, AR technology is used to display content (information projection) on the display 202 so that virtual content is superimposed on real space. Note that the present invention can also employ a method of direct projection onto the retina. Here, in the information projection, the position and orientation of the user's own device in real space may be estimated based on a technology such as SLAM (simultaneous localization and mapping). The estimation result is used in the display processing of the virtual content. The operation unit 304 accepts input from the user through the operation frame unit 104, and accepts and controls various application operations and operation instructions for display on the display 202. The camera control unit 305 controls the start, stop, and shooting of the camera 210, and stores the captured image data in the ROM 203 in cooperation with the storage unit 302. The mode control unit 306 controls switching to multiple modes provided in the smart glasses 101, and switches the smart glasses 101 to a mode desired by the user. The status detection unit 307 manages information such as status changes and usage status detected by the sensor unit 209, and stores it in the ROM 203. The pairing unit 308 controls the network I / F 205 so as to enable bidirectional data communication with an external network device via the wireless communication 120. The application management unit 309 manages the execution status, version information, and notifications received from the server of various applications, and manages them in the ROM 203 and RAM 204 via the storage unit 302.

[0012] Smart WatchesFIG. 3B is a diagram for explaining the software module configuration of the smart watch 110. The clock unit 321 manages and controls time information to be displayed on the display 222. The time information may be managed and controlled by an application program stored in the ROM 223. The communication unit 322 not only transmits status information to the smart glasses 101, but also receives notifications from the application server. The status information indicates the state of an application, such as an application being started or being displayed, the display state on the display, and the state of the main body, such as the main body being in sleep mode. The storage unit 323 exchanges information between the ROM 223, the RAM 224, and other processing units. The display unit 324 displays the time information managed by the clock unit 321 and the results of various applications executed by the CPU 221. The operation unit 325 accepts input from the user on the display unit 111, and controls the operation of various applications and the display on the display 222. The status detection unit 326 manages the change in status detected by the sensor unit 229 as information and stores it in the ROM 223. A pairing unit 327 controls the network I / F 225 to enable two-way data communication with an external network device via the wireless communication 120. An application management unit 328 manages the execution status, version information, and notifications received from the server of various applications, and manages them in the ROM 223 and RAM 224 via the storage unit 323.

[0013] Processing flow Smartwatch (status information notification processing)FIG. 4(a) shows a flowchart of the status information notification process in which the smart watch 110 detects a status change and notifies the smart glasses 101 of the status information. The smart watch 110 has a setting in the storage unit 323 for determining which status should be transmitted to the smart glasses 101 among the detected status changes (see Table 1). The smart watch 110 selects whether or not to notify the smart glasses 101 for each status according to the setting of the status notification setting table in Table 1. In this embodiment, the status information to be notified is selected by the smart watch 110, but the smart glasses 101 that receive the status information may also select the information. Specifically, the smart watch 110 may notify all status information, and the status notification setting table in Table 1 may be stored in the storage unit 302 of the smart glasses 101 in order to discard the status information of the smart watch 110 received by the smart glasses 101. In addition, the status notification setting can be performed by the smart glasses 101 or the smart watch 110.

[0014] [Table 1]

[0015] First, in S401, the smart watch 110 detects a change in status by the status detection unit 326. A change in status indicates a transition to one of the above-mentioned statuses, such as when the display unit 324 switches from displaying the time to displaying another application. In S402, the smart watch 110 refers to the status notification setting table and determines whether or not the change in status should be notified to the smart glasses 101. If the result of the determination in S402 is that the detected status change is selected as one that should be notified to the smart glasses 101 (Yes in S402), the process proceeds to S403. On the other hand, if the detected status change is selected as one that should not be notified to the smart glasses 101 (No in S402), this process ends. In S403, the status information is transmitted to the smart glasses 101. The destination of the status information at this time is a device that has already been paired with the smart watch 110. In addition, when the smart watch 110 transmits status information to the smart glasses 101 in S403, the smart watch 110 may switch whether or not to transmit the status information depending on the radio wave strength of Bluetooth (beacon) or the like transmitted from the smart glasses 101. For example, if the radio wave strength of Bluetooth transmitted from the smart glasses 101 is equal to or greater than a predetermined value, the smart watch 110 transmits the status information. In other words, the status information is transmitted only when the smart watch 110 and the smart glasses 101 are sufficiently close to each other.

[0016] Smart glasses (non-display processing) 4(b) is a flowchart showing a display process in which the smart glasses 101 hide AR / MR in response to a change in the status of the smart watch 110. The smart glasses 101 have a setting in the storage unit 302 for determining whether to hide AR / MR depending on the status notified by the smart watch 110 (see Table 2). The smart glasses 101 control the display to determine whether to hide AR / MR for each notified status in accordance with the settings in the display setting table in Table 2. This setting can be made by the smart glasses 101.

[0017] [Table 2]

[0018] First, in S421, the smart glasses 101 receive status information from the smart watch 110 via the communication unit 301. In S422, the smart glasses 101 refer to the display setting table shown in Table 2. In S423, the smart glasses 101 determine whether the status information of the smart watch 110 received in S421 is to be hidden from the AR / MR 501. If the result of the determination in S423 is that the status information is not to be hidden from the AR / MR 501 (No in S423), this process ends. If the result of the determination in S423 is that the status information is to be hidden from the AR / MR 501 (Yes in S423), the process proceeds to S424. In S424, the smart glasses 101 perform display control to hide the AR / MR 501 displayed on the display 202, and end the process. That is, the smart glasses 101 change from a state in which the AR / MR 501 is displayed as shown in FIG. 5(a) to a state in which the AR / MR 501 is not displayed as shown in FIG. 5(b). Here, the smart watch 110 notifies the smart glasses 101 of the status information, and the smart glasses 101 hide the AR / MR 501 based on the status information. However, the present invention is not limited to this, and the smart watch 110 may notify the smart glasses 101 only in a predetermined status, and the smart glasses 101 that receive the notification may uniformly hide the AR / MR.

[0019] According to the above, even when the AR / MR 501 is displayed on the smart glasses 101, if a mobile terminal communicating with the smart glasses 101 receives a user operation and the status of the mobile terminal changes, the AR / MR 501 can be hidden. This makes it easier for the user to see the display of the mobile terminal that the user is operating. In addition, if the smart glasses 101 and the smart watch 110 are sufficiently close to each other, the AR / MR 501 on the smart glasses 101 can be hidden when the smart watch 110 receives a user operation. In this embodiment, a process flow for controlling the AR / MR display of the smart glasses 101 according to the status of the smart watch 110 has been shown. However, it is also possible to hide the AR / MR by detecting a touch operation of the operation frame unit 104 or a remote operation to the smart watch 110. In addition, the configuration of each wearable terminal, the configuration of a software module, and a process flow related to application notification of the wearable terminal have been shown, but these are merely examples and are not limited to these. EXAMPLES

[0020] In the AR / MR display control described in the first embodiment, there is a possibility that the display of the smart glasses 101 will be hidden if the user unintentionally touches the smart watch 110. In the second embodiment, a mechanism for hiding the AR / MR by detecting the presence of the smart watch 110 in the user's line of sight or in the user's field of vision in addition to the status of the smart watch 110 will be described. The basic configuration of the second embodiment is the same as that of the first embodiment, so only the differences are shown.

[0021] Smartwatch (status information notification processing) FIG. 6(a) is a flowchart showing a status notification process in which the smartwatch 110 detects the user's line of sight and its own status change, and notifies the smartglasses 101 of the status information. As in the first embodiment, the smartwatch 110 has a setting in the storage unit 323 for determining which status should be sent to the smartglasses 101 among the detected status changes (see Table 1). The smartwatch 110 controls whether or not to notify the smartglasses 101 for each status according to the setting in the status notification setting table in Table 1. In this embodiment, the status notification setting table is held by the smartwatch 110, but the table may be held in the storage unit 302 of the smartglasses 101 in order to discard the status information of the smartwatch 110 received by the smartglasses 101. This notification setting can be performed by the smartglasses 101 or the smartwatch 110. In S601, the smart watch 110 detects the user's line of sight using the camera provided in the smart watch 110. If the user's line of sight is detected (Yes in S601), the process proceeds to S401, and if the user's line of sight is not detected (No in S601), the process ends. Since S401 to S403 are the same as those in the first embodiment, the description thereof will be omitted. In the above description, the user's gaze is detected by the camera of the smart watch 110, but the gaze can also be detected by the camera of the smart glasses 101. Specifically, when the user looks at the smart watch 110, the camera of the smart glasses 101 captures the smart watch 110 to detect the user's gaze. The smart glasses 101 may then notify the smart watch 110 that the user is looking at the smart watch 110, so that the smart watch 110 detects the gaze. When the smart glasses 101 detect the user's gaze, the detection of the user's gaze in S601 is not a required step.

[0022] Smart glasses (non-display processing) 6(b) is a flowchart showing a non-display process in which the smart glasses 101 detect a change in the status of the smart watch 110 and the presence of the smart watch in the field of view, and hide the AR / MR 501. As in the first embodiment, the smart glasses 101 have a setting in the storage unit 302 for determining whether to hide the AR / MR 501 based on the status information notified by the smart watch 110 (see Table 2). The smart glasses 101 control whether to hide the AR / MR 501 for each notified status according to the settings in the display setting table in Table 2. This setting can be made by the smart glasses 101. In S421, the smart glasses 101 receive status information from the smart watch 110 via the communication unit 301. In the following S622, the smart glasses 101 judge whether the smart watch 110 is present in the user's field of view. The judgement of whether the smart watch 110 is present is performed by the camera control unit 305. It is judged whether the smart watch 110 has been detected from the image acquired from the camera control unit 305. For example, the camera equipped in the smart glasses detects the smart watch 110, or detects the user's line of sight and judges whether the smart watch 110 is in the user's line of sight. The details of this process are not the point of this proposal, so the explanation will be omitted. If the result of the judgment in S622 is that the smart watch 110 is present in the user's field of view (Yes in S622), proceed to S422, and if the smart watch 110 is not present in the user's field of view (No in S622), this process is terminated. S422 to S423 are the same as in the first embodiment, so the explanation will be omitted. As a result of the determination in S423, if the status information is for which AR / MR is to be hidden (Yes in S423), the process proceeds to S625. In S625, the smart glasses 101 perform display control to hide the AR / MR displayed on the display 202 (FIG. 5(b)). At this time, instead of hiding the AR / MR, the display may be controlled to switch the AR / MR display from a normal display to a reduced display as shown in FIG. 5(c). Then, this process ends. In addition, in the judgment of S622, it may be determined whether the mobile terminal with which the smart glasses 101 are paired is within the field of view. In this way, even if another person's mobile terminal is within the field of view, the smart glasses 101 can perform display control so as not to hide the AR / MR. With the above processing, when a user is looking at another mobile terminal through the smart glasses 101, the AR / MR of the smart glasses 101 is hidden, thereby preventing the user's field of vision from being obstructed. In addition, the smart glasses 101 may be configured to hide AR / MR when the smart watch 110 is nearby, depending on the radio wave strength of the Bluetooth packet transmitted from the smart watch 110. Furthermore, the smart glasses 101 may determine that the two are close enough to each other when the display of the smart watch 110 detected by the camera provided in the smart glasses 101 becomes a predetermined size or larger, and may perform display control to hide AR / MR. In this embodiment, a processing flow has been shown for controlling the AR / MR display of the smart glasses 101 by detecting the status of the smart watch 110 as well as the user's line of sight or the presence of the smart watch 110 in the user's field of vision. In the above embodiment, the smart glasses 101 hide the AR / MR depending on the status of the smart watch 110. However, the AR / MR may be hidden in consideration of the status of the smart glasses 101. For example, when important information is displayed on the smart glasses 101, the AR / MR may not be hidden regardless of the status of the smart watch 110. In the above embodiments, the configurations of the mobile terminals and wearable terminals, the configurations of the software modules, and the process flows related to application notifications of the mobile terminals have been shown, but these are merely examples and are not limiting.

[0023] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0024] 101 Smart Glasses 110 Smart Watch

Claims

1. A wearable device, A display control means for controlling a content image to be displayed within a field of view of a user wearing the wearable device, a display control means for controlling the content image displayed on the display device so as to be hidden or reduced in size when the mobile terminal is within the user's field of vision; The display control means when status information of a specific portable terminal that is paired with the wearable terminal and communicates with the wearable terminal is first information and the specific portable terminal is within a field of view of the user, control is performed to hide or reduce the content image; When the status information is second information indicating that the predetermined portable terminal is in a sleep state, even if the predetermined portable terminal is within the field of view of the user, the content image is controlled not to be hidden or reduced. A wearable device characterized by:

2. The display control means controls the content image not to be hidden or reduced when a portable terminal is not paired with the wearable terminal and capable of communicating with the wearable terminal even if the portable terminal is within the field of view of the user. The wearable terminal according to claim 1 .

3. The wearable terminal further includes an imaging means, The display control means controls the content image to be hidden or reduced in size when the predetermined mobile terminal whose status information is the first information is present in the image captured by the imaging means. The wearable terminal according to claim 1 or 2.

4. The wearable device further includes a detection unit for detecting a line of sight of a user, The display control means controls the content image to be hidden or reduced when the detection means detects that the predetermined mobile terminal, the status information of which is the first information, is within the line of sight of the user. The wearable terminal according to any one of claims 1 to 3.

5. The display control means controls the content image to be hidden or reduced in size when the predetermined mobile terminal, whose status information is the first information, is located at a position overlapping the content image. The wearable terminal according to any one of claims 1 to 4.

6. The display control means controls an AR (augmented reality) display or an MR (mixed reality) display. The wearable terminal according to any one of claims 1 to 5.

7. The predetermined portable terminal is a terminal that communicates with the wearable terminal via a network. The wearable terminal according to any one of claims 1 to 6.

8. A control method for a wearable device, comprising: A display step of controlling the wearable device so that a content image is displayed within a field of view of a user wearing the wearable device; a display control step of controlling the displayed content image so as to be hidden or reduced in size when the mobile terminal is within the user's field of view; In the display control step, when status information of a predetermined portable terminal that is paired with the wearable terminal and communicates with the wearable terminal is first information, and when the predetermined portable terminal is within a field of view of the user, control is performed to hide or reduce the content image; When the status information is second information indicating that the predetermined portable terminal is in a sleep state, even if the predetermined portable terminal is within the field of view of the user, the content image is controlled not to be hidden or reduced. A control method for a wearable device comprising the steps of:

9. A wearable terminal capable of wireless communication with a mobile terminal having a display unit, a receiving means for receiving status information of the portable terminal from the portable terminal; and a display control means for controlling display of a content image displayed in the field of view of a user wearing the wearable device based on the status information. the display control means controls the content image to be hidden or reduced when the status information is first information and the mobile terminal is within a field of view of the user; When the status information is second information indicating that the mobile terminal is in a sleep state, even if the mobile terminal is within the field of view of the user, the content image is controlled not to be hidden or reduced. A wearable device characterized by:

10. A system including a wearable terminal and a mobile terminal having a display unit, The wearable terminal includes: a receiving means for receiving status information of the portable terminal from the portable terminal; and a display control means for controlling display of a content image displayed in the field of view of a user wearing the wearable device based on the status information. the display control means controls the content image to be hidden or reduced when the status information is first information and the mobile terminal is within a field of view of the user; When the status information is second information indicating that the mobile terminal is in a sleep state, even if the mobile terminal is within the field of view of the user, control is performed so that the content image is not hidden or reduced; The system is characterized in that the mobile terminal transmits status information to the wearable terminal.

11. The mobile device transmits status information to the wearable device when a status of the mobile device changes. The system of claim 10.

12. The mobile device transmits status information to the wearable device when the user's line of sight is detected. The system of claim 10.

13. The mobile terminal determines whether to transmit status information to the wearable terminal according to the radio wave intensity of Bluetooth (registered trademark) received from the wearable terminal. The system according to any one of claims 10 to 12.

14. The display control means controls an AR (augmented reality) display or an MR (mixed reality) display. A system according to any one of claims 10 to 13.

15. The first information indicates the launch of an application and / or the display of an application. A system according to any one of claims 10 to 14.

16. A method for controlling a wearable device capable of wireless communication with a portable device having a display unit, comprising: a receiving step of receiving status information of the mobile terminal from the mobile terminal; A display control step of controlling display of a content image displayed in a field of view of a user wearing the wearable device based on the status information. the display control step includes controlling the content image to be hidden or reduced when the status information is first information and the mobile terminal is within a field of view of the user; When the status information is second information indicating that the mobile terminal is in a sleep state, even if the mobile terminal is within the field of view of the user, the content image is controlled not to be hidden or reduced. A control method for a wearable device comprising the steps of:

17. A method for controlling a system including a wearable terminal and a portable terminal having a display unit, comprising: In the wearable terminal, a receiving step of receiving status information of the mobile terminal from the mobile terminal; A display control step of controlling display of a content image displayed in a field of view of a user wearing the wearable device based on the status information. In the display control step, when the status information is the first information and the mobile terminal is within a visual field of the user, the content image is controlled to be hidden or reduced in size; When the status information is second information indicating that the mobile terminal is in a sleep state, even if the mobile terminal is within the field of view of the user, control is performed so that the content image is not hidden or reduced; A transmitting step of transmitting status information to the wearable device in the portable device.

23. A method for controlling a system comprising:

18. A program for causing at least one computer to function as each of the means of the wearable terminal or system according to any one of claims 1 to 7 and 9 to 15.

19. A computer-readable storage medium storing a program for causing at least one computer to function as each of the means of the wearable terminal or system described in any one of claims 1 to 7 and 9 to 15.

Images