Wearable device, control device, system, control method, and program

Abstract

To provide a technology in which a user can readily understand a time for switching a usage form of a wearable device that is usable in a plurality of usage forms.SOLUTION: A wearable device that is usable in a plurality of usage forms includes notification means for notifying a user of information indicating a recommended usage form out of the plurality of usage forms, the information being determined based on information relating to an external environment.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a wearable device, a control device, a system, a control method, and a program. [Background technology]

[0002] Patent Document 1 discloses a wearable device that is worn on the head (face). Examples of head-worn wearable devices include video see-through devices, optical see-through devices, and face shields. Therefore, if a wearable device is purchased for each purpose, it is necessary to secure space to store multiple wearable devices, which incurs a lot of purchasing costs.

[0003] Patent Document 1 discloses a technology that enables a wearable device to switch between a state in which a captured image of the outside world is presented to the user (video see-through state) and a state in which the user can directly see the outside world in front of their eyes (optical see-through state) by user operation or in response to changes in the outside environment. If a wearable device that employs the technology described in Patent Document 1 is purchased, there is no need to purchase a video see-through type device and an optical see-through type device separately, and therefore the wearable device can be stored in a smaller space. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2016-197816 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, a user wearing a wearable device is often concentrating on the displayed image, making it difficult for the user to determine the timing to switch the state (usage mode) of the wearable device. Furthermore, if the state of the wearable device is automatically switched without notifying the user, the user may be confused by the sudden change in field of view.

[0006] Therefore, an object of the present invention is to provide a technique that makes it easier for a user to know when to switch the usage mode of a wearable device that can be used in multiple usage modes. [Means for solving the problem]

[0007] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. User's A wearable device that is worn on the head and can be used in multiple ways, A display means; via the display means, Information about whether the wearable device is being used indoors or outdoors, or information about whether the user is walking or standing still. Information determined based on information about the external environment, the information indicating 1) a usage mode corresponding to the external environment among the plurality of usage modes, or 2) instruction information indicating the removal of the wearable device. Image shown a notification means for notifying the user of the a control means for setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; The wearable device is characterized by having:

[0008] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. User's A control device that controls a wearable device that is worn on the head, has a display means, and can be used in a plurality of ways, Information about whether the wearable device is being used indoors or outdoors, or information about whether the user is walking or standing still. a determination means for determining, based on information about the external environment, 1) which of the plurality of usage patterns corresponds to the external environment, or 2) determining whether the wearable device has been removed; 1) A usage pattern corresponding to the external environment or 2) Information indicating a determination result of whether the wearable device has been removed 1) an image showing a usage mode corresponding to the external environment among the plurality of usage modes, or 2) an image showing instruction information showing how to remove the wearable device. is notified to the user via the display means. and setting the usage mode of the wearable device to the usage mode indicated by the image showing the instruction information based on an operation by the user. a control means for controlling the wearable device to The control device is characterized by having:

[0009] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. User's A system including a wearable device that is worn on the head, has a display means, and can be used in a plurality of ways, and a control device that controls the wearable device, Information about whether the wearable device is used indoors or outdoors; is information about whether the user is in a walking state or a stationary state. a determination means for determining, based on information about the external environment, 1) which of the plurality of usage patterns corresponds to the external environment, or 2) determining whether the wearable device has been removed; 1) a usage pattern corresponding to the external environment or 2) information indicating a determination result of whether the wearable device has been removed 1) an image showing a usage mode corresponding to the external environment among the plurality of usage modes, or 2) an image showing instruction information showing how to remove the wearable device. a notification means for notifying the user of the above via the display means; 、 a control means for setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; The system is characterized by having:

[0010] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. User's A control method for a wearable device that is worn on the head, has a display means, and can be used in a plurality of ways, comprising: via the display means, information on whether the wearable device is being used indoors or outdoors, or information on whether the user is walking or standing still. Information determined based on information about the external environment, the information indicating 1) a usage mode corresponding to the external environment among the plurality of usage modes, or 2) instruction information indicating the removal of the wearable device. Image shown a notification step of notifying the user of the a control step of setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; The control method is characterized by having the following.

[0011] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. User's A wearable device that is worn on the head, has a display means, and can be used in multiple ways Control device for controlling A control method for Information about whether the wearable device is being used indoors or outdoors, or information about whether the user is walking or standing still. a determination step of 1) determining a usage mode corresponding to the external environment from among the plurality of usage modes, or 2) determining whether the wearable device has been removed, based on information about the external environment; 1) a usage pattern corresponding to the external environment or 2) information indicating a determination result of whether the wearable device has been removed 1) an image showing a usage mode corresponding to the external environment among the plurality of usage modes, or 2) an image showing instruction information showing how to remove the wearable device. is notified to the user via the display means. and setting the usage mode of the wearable device to the usage mode indicated by the image showing the instruction information based on an operation by the user. a control step of controlling the wearable device so as to , The control method is characterized by having the following.

[0012] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. User's A control method for a system including a wearable device that is worn on the head, has a display means, and can be used in a plurality of usage modes, and a control device that controls the wearable device, comprising: Information about whether the wearable device is being used indoors or outdoors, or information about whether the user is walking or standing still. a determination step of 1) determining a usage mode corresponding to the external environment from among the plurality of usage modes, or 2) determining whether the wearable device has been removed, based on information about the external environment; 1) a usage pattern corresponding to the external environment or 2) information indicating a determination result of whether the wearable device has been removed 1) an image showing a usage mode corresponding to the external environment among the plurality of usage modes, or 2) an image showing instruction information showing how to remove the wearable device. a notification step of notifying the user of the above via the display means; a control step of setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; The control method is characterized by having the following. [Effects of the Invention]

[0013] According to the present invention, it becomes easier for a user to know when to switch the usage mode of a wearable device that can be used in multiple usage modes. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a configuration diagram of a viewing system according to a first embodiment. [Figure 2] FIG. 1 is a configuration diagram of a wearable device according to a first embodiment. [Figure 3] FIG. 2 is a configuration diagram of a controller according to the first embodiment. [Figure 4] FIG. 2 is a configuration diagram of a server according to the first embodiment. [Figure 5] 4 is a flowchart of processing of the wearable device according to the first embodiment. [Figure 6] 4 is a flowchart of processing by a controller according to the first embodiment. [Figure 7] 4 is a flowchart of processing by a server according to the first embodiment. [Figure 8] 10 is a flowchart of a process according to the second embodiment. [Figure 9] 10 is a flowchart of a process according to a third embodiment. [Figure 10] 10 is a flowchart of a process according to a fourth embodiment. [Figure 11] 13 is a flowchart of processing of a wearable device according to a sixth embodiment. [Figure 12] 13 is a flowchart of a process of a controller according to a sixth embodiment. [Figure 13] FIG. 10 is a diagram illustrating recommended information and a wearable device. [Figure 14] FIG. 1 is a diagram illustrating a wearable device. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, with reference to the drawings, a viewing system (information processing system) that notifies a user of information on recommended usage patterns for a wearable device (see FIG. 13A) based on information on the external environment of the wearable device will be described.

[0016] Examples of usage patterns for wearable devices include a video mode in which images are displayed using video see-through, an optical mode in which images are displayed using optical see-through, and a usage pattern in which the device is used as a face shield. Alternatively, examples of usage patterns for wearable devices include a combination of either the video mode or the optical mode with a usage pattern in which the device is used as a face shield. Usage patterns for wearable devices may also include a usage pattern in which the device is used as sunglasses. In other words, the usage pattern is determined by at least one of the display mode (video mode or optical mode) and the device form (sunglasses or face shield).

[0017] Video see-through refers to displaying an image on the display unit in which a virtual object is superimposed on an image (captured image; live view image) captured in real time of the space in front of the wearable device. Optical see-through refers to displaying a virtual object on part of the display unit in a state in which the external space is visible through the display unit (half mirror; optical system) of the wearable device. Therefore, in optical mode, the user can see the external space through the display unit, whereas in video mode, the user cannot see the external space through the display unit.

[0018] Even when the display mode is video mode, the user can see the space in front of the wearable device from the captured image. However, because there is a slight time lag between capturing the image and displaying it on the display unit, the user can use the wearable device more safely when the display mode is optical mode than when the display mode is video mode.

[0019] 13B illustrates an example of a wearable device WD according to each embodiment. Note that, as shown in FIG. 13C, a shield FS that covers at least the user's mouth may be attached to the wearable device WD, so that the wearable device WD can be used as a face shield.

[0020] 14 illustrates the structure of a wearable device according to each embodiment. The wearable device WD includes a body B and a shield FS. The shield FS can be rotated up and down by a user operation or automatically.

[0021] When the video mode is set as the display mode either by user operation or automatically, the shutter S is closed. Therefore, the user cannot see the object OB through the half mirror HM1 and half mirror HM2. Meanwhile, external light from the object OB is reflected by the half mirror HM1 and enters the camera C. After that, when an image (captured image) of the object OB captured by the camera C is sent to the panel P, the panel P displays (projects) the light of the captured image on the half mirror HM2. Then, the light reflected by the half mirror HM2 (the light of the captured image displayed on the half mirror HM2) enters the user's eye EP. This allows the user to see the image representing the object OB.

[0022] When optical mode is set as the display mode either by user operation or automatically When the shutter S is open, external light from the object OB passes through the half mirrors HM1 and HM2 and enters the user's eye EP. Also, the light of the image from the panel P is reflected by the half mirror HM2 and enters the user's eye EP. This allows the user to see the object OB through the half mirrors HM1 and HM2, and at the same time, to see the image displayed on the half mirror HM2.

[0023] <Embodiment 1> [Viewing system configuration] 1 shows the configuration of a viewing system 1. The viewing system 1 includes a wearable device 10, a controller 20, and a server 30.

[0024] The wearable device 10 is an electronic device that displays images on a display unit. The wearable device 10 is, for example, a head-mounted display. A user can view images by wearing the wearable device 10 on their head. When the display mode is the optical mode, the wearable device 10 can support the user by displaying additional information about the real space.

[0025] The controller 20 is a control device (electronic device) that controls the wearable device 10. The controller 20 can add additional information to the image acquired from the server 30 as needed and transmit the image to the wearable device 10.

[0026] The server 30 accumulates images to be displayed on the wearable device 10. The server 30 transmits images to the controller 20 in response to a request from the controller 20.

[0027] [Wearable device configuration] 2 shows the configuration of wearable device 10. Wearable device 10 has a recording unit 151, an operation unit 152, a power management unit 153, an image processing unit 154, a CPU 155, a left-eye display unit 156, a right-eye display unit 157, a program memory 158, a data memory 159, and a wireless communication unit 160. Wearable device 10 also has a card connection unit 161, a controller connection unit 162, a mode setting unit 163, an audio input unit 164, an audio output unit 165, a bone conduction unit 166, an imaging unit 167, a body temperature measurement unit 168, and an image addition unit 169.

[0028] The components of the wearable device 10 can transmit and receive information to and from each other via the signal line 100. Furthermore, the controller 20 may have part of the components of the wearable device 10.

[0029] Recording unit 151 stores captured images (moving images or still images) in a formatted form.

[0030] The operation unit 152 accepts user operations. User operations include, for example, an operation to select a display mode of the wearable device 10, an operation to replace the battery, an operation to register a connectable wearable device 10, etc. The operation unit 152 outputs information on the accepted user operations to the CPU 155 via the signal line 100.

[0031] The power management unit 153 manages the power supply of the wearable device 10. When the power switch is off, the power management unit 153 can only detect pressing of the power button. In this state, when the power management unit 153 detects pressing of the power button, it supplies power to the entire wearable device 10.

[0032] When a signal-processed image (still image or moving image) is input, the image processing unit 154 Perform image processing on the image.

[0033] The CPU 155 is a central processing unit that executes control based on a control program stored in the program memory 158 .

[0034] The left-eye display unit 156 displays an image to be viewed by the left eye of the user. The right-eye display unit 157 displays an image to be viewed by the right eye of the user. The user can perceive, for example, a single image (space) with a three-dimensional effect by viewing the image displayed on the left-eye display unit 156 with his left eye and the image displayed on the right-eye display unit 157 with his right eye. The left-eye display unit 156 and the right-eye display unit 157 each include a shutter S, half mirrors HM1 and HM2, and a panel P, as shown in FIG. 14. Therefore, the left-eye display unit 156 and the right-eye display unit 157 can switch between transmitting and not transmitting light depending on the display mode (video mode or optical mode).

[0035] Program memory 158 stores a control program for executing control by CPU 155. Data memory 159 stores information on setting conditions of wearable device 10. Data memory 159 also stores captured images (still images or videos) and image attribute information (information indicating resolution and frame rate), etc.

[0036] The wireless communication unit 160 performs wireless communication according to any wireless communication standard such as Wi-Fi (registered trademark), Bluetooth (registered trademark), 4G, or 5G.

[0037] A memory card such as an SD card can be inserted into the card connection unit 161. The controller connection unit 162 is a connection unit that connects the wearable device 10 and the controller 20 directly or via a wire.

[0038] The mode setting unit 163 sets the display mode in response to a user operation or in response to information about the external environment.

[0039] The audio input unit 164 is a microphone that acquires audio. The audio output unit 165 is a speaker that outputs audio by air vibration. The audio output unit 165 outputs audio directly to the left and right ears of the user. The bone conduction unit 166 is an audio output unit that outputs audio (audio information) by bone conduction. The bone conduction unit 166 outputs audio by vibrating the bones above the left and right ears of the user.

[0040] The imaging unit 167 acquires a captured image by capturing an image of the space in front of the user when the wearable device 10 operates in video mode, for example. In the first embodiment, the imaging unit 167 is the camera C shown in FIG. 14. Using the captured image, the CPU 155 can simultaneously estimate its own position and generate (create) an environmental map by SLAM (Simultaneous Localization and Mapping) technology. By utilizing the SLAM technology, the CPU 155 can generate an environmental map of the surroundings of the wearable device 10 even in an unknown environment. The environmental map indicates, for example, the positions of obstacles placed around the wearable device 10 and the size of the surrounding space.

[0041] The body temperature measurement unit 168 measures the body temperature of the user. The image addition unit 169 superimposes (adds) any image onto the image for the optical mode when the wearable device 10 operates in the optical mode.

[0042] [Controller Configuration] 3 shows the configuration of the controller 20. The controller 20 controls the wearable device 10. The controller 20 has an Ethernet controller 270, a memory unit 271, an operation unit 272, a power management unit 273, an image processing unit 274, a CPU 275, a device detection unit 276, a display control unit 277, a program memory 278, and a data memory 279. The controller 20 has a wireless communication unit 280, a card connection unit 281, a device connection unit 282, an image conversion unit 283, a format conversion unit 284, a compression / decompression unit 285, a resolution conversion unit 286, an indoor detection unit 287, and a walking detection unit 288. The controller 20 has an infection risk detection unit 289, a boarding detection unit 290, an approach detection unit 291, and an owner detection unit 292.

[0043] The components of the controller 20 can transmit and receive information to and from each other via a signal line 200. Furthermore, the wearable device 10 may have some or all of the components of the controller 20.

[0044] The Ethernet controller 270 determines whether the acquired information is information destined for the controller 20. If the acquired information is not information destined for the controller 20, the Ethernet controller 270 discards the acquired information.

[0045] Captured images acquired by the wearable device 10 and the like are formatted and stored in the storage unit 271. The formatted captured images are used when the display control unit 277 controls the display of the wearable device 10.

[0046] The operation unit 272 accepts user operations on the controller 20.

[0047] The power management unit 273 detects the power state of the controller 20, similar to the power management unit 153 of the wearable device 10. The image processing unit 274 performs image processing on the image that has undergone signal processing.

[0048] The CPU 275 is a central processing unit that controls each component based on a control program stored in the program memory 278 .

[0049] The device detection unit 276 detects the wearable device 10 connected to the controller 20. The display control unit 277 controls the display on the display unit (left eye display unit 156 and right eye display unit 157) of the wearable device 10 by transmitting an image to the wearable device 10.

[0050] The program memory 278 stores a control program for executing control by the CPU 275. The data memory 279 stores information on setting conditions of the controller 20. The data memory 279 also stores captured images, attribute information of the captured images, and the like.

[0051] The wireless communication unit 280 performs wireless communication according to any wireless communication standard such as Wi-Fi, Bluetooth, 4G, or 5G.

[0052] A memory card such as an SD card can be inserted into the card connection unit 281. The device connection unit 282 is a connection unit (joint) that connects the controller 20 and the wearable device 10 directly or via a cable. The device connection unit 282 can be directly connected to the controller connection unit 162 of the wearable device 10.

[0053] The image conversion unit 283 converts image attributes, etc. The image conversion unit 283 also converts images in a way that cannot be done with other configurations.

[0054] The format conversion unit 284 converts the representation format of an image, which is a stereoscopic video. For example, the format conversion unit 284 converts an image using equidistant projection into an image using equirectangular projection. The compression / expansion unit 285 compresses the size of an image or expands the size of a compressed image. The resolution conversion unit 286 converts the resolution of an input image.

[0055] The indoor detection unit 287 detects (determines) whether the controller 20 is located indoors or outdoors. For example, the indoor detection unit 287 detects whether the controller 20 is located indoors or outdoors by analyzing an image of the surroundings of the controller 20 using SLAM technology.

[0056] The walking detection unit 288 detects (determines) whether or not the user holding the controller 20 is walking. For example, the walking detection unit 288 acquires position information of the controller 20 by GPS or the like, and detects that the user is walking if the position of the controller 20 continues to change between 2 km and 6 km per hour.

[0057] The infection risk detection unit 289 detects the current environmental conditions where the controller 20 is located, and detects (determines) the risk of infection with an infectious disease, etc. For example, the infection risk detection unit 289 determines whether the infection risk is high or not depending on whether the density of people in the current location where the controller 20 is located is higher than a predetermined value.

[0058] The boarding detection unit 290 detects whether or not the user holding the controller 20 is on a vehicle (train, bus, etc.). For example, the boarding detection unit 290 acquires position information of the controller 20 by GPS or the like, and detects that the user is on a vehicle if the position of the controller 20 continues to change at a speed of 10 km / h or more.

[0059] The approach detection unit 291 detects whether an object is approaching the controller 20 (whether the distance between the controller 20 and the object is within a predetermined distance). When the approach detection unit 291 detects that the object has approached within the predetermined distance from the controller 20, it can stop the output of sound from the wearable device 10.

[0060] The owner detection unit 292 is an authentication unit that authenticates the user who holds the controller 20. The owner detection unit 292 detects whether the user who holds the wearable device 10 and the controller 20 is a pre-registered owner of the wearable device 10 connected to the controller 20.

[0061] In this way, information about the external environment of the controller 20 can be acquired by the indoor detection unit 287, walking detection unit 288, infection risk detection unit 289, riding detection unit 290, approach detection unit 291, and owner detection unit 292. The information about the external environment of the controller 20 is information indicating, for example, whether the controller 20 is being used outdoors, whether the user is walking, whether there is a high risk of infection with an infectious disease, or whether an object is approaching. Note that, because the controller 20 and the wearable device 10 are held by the same user, the information about the external environment of the controller 20 is also information about the external environment of the wearable device 10.

[0062] [Server Configuration] 4 shows the configuration of server 30. Server 30 has an Ethernet controller 310, a CPU 311, a program memory 312, a data memory 313, a power management unit 314, an image processing unit 315, and an operation unit 316. Server 30 also has a wireless communication unit 317, an image conversion unit 318, a compression / decompression unit 319, and a resolution conversion unit 320. Note that each component of server 30 can transmit and receive information to and from each other via signal line 300.

[0063] The Ethernet controller 310 determines whether the acquired information is information destined for the server 30. If the acquired information is not information destined for the server 30, the Ethernet controller 310 discards the acquired information.

[0064] The CPU 311 is a central processing unit that controls each component of the server 30 based on a control program stored in the program memory 312 .

[0065] The program memory 312 stores a control program for the CPU 311 to execute control. The data memory 313 stores data, images, image attribute information, etc. for setting up the server 30. The power management unit 314 monitors the operating state of the server 30 and manages the power supply.

[0066] The image processing unit 315 performs image processing on the image. The operation unit 316 generally accepts user operations via a keyboard or the like. The wireless communication unit 317 performs wireless communication in accordance with any wireless communication standard such as Wi-Fi, Bluetooth, 4G, or 5G.

[0067] The image conversion unit 318 converts attributes of an image. The image conversion unit 318 also converts attributes that cannot be performed by other configurations. The compression / expansion unit 319 compresses or expands the size of an image. The resolution conversion unit 320 converts the resolution of an image.

[0068] [Wearable Device Processing] A control process (control method) for a usage pattern executed by wearable device 10 will be described with reference to the flowchart shown in Fig. 5. The process of the flowchart shown in Fig. 5 is realized by CPU 155 executing a control program stored in program memory 158. The process of this flowchart starts when wearable device 10 is put into an operable state, for example, when wearable device 10 is powered on.

[0069] Note that even during the period when the processing of this flowchart is being performed, the wearable device 10 can perform other processing. For example, the wearable device 10 can change the volume of the output sound, the brightness of the displayed image, etc., in response to a user operation.

[0070] In step S501, the CPU 155 determines whether or not the controller 20 is connected to the wearable device 10. Specifically, if the CPU 155 can communicate with the controller 20 via the wireless communication unit 160 or the controller connection unit 162, the CPU 155 determines that the controller 20 is connected to the wearable device 10. If it is determined that the controller 20 is connected to the wearable device 10, the process proceeds to step S502. If it is determined that the controller 20 is not connected to the wearable device 10, the process of step S501 is repeated.

[0071] In step S502, CPU 155 transmits, as terminal information, information indicating selectable (usable; settable) usage modes of wearable device 10 to controller 20. That is, the terminal information indicates a usage mode selectable for wearable device 10 from, for example, video mode, optical mode, and usage modes used as a face shield.

[0072] In step S503, the CPU 155 determines whether the wearable device 10 is connected to the controller 2. 0 (wirelessly connected). If the wireless communication unit 160 and the wireless communication unit 280 are communicating wirelessly, the CPU 155 determines that the wearable device 10 is communicating wirelessly with the controller 20. If the controller connection unit 162 and the device connection unit 282 are communicating, the CPU 155 determines that the wearable device 10 is not communicating wirelessly with the controller 20. If it is determined that the wearable device 10 is communicating wirelessly with the controller 20, the process proceeds to step S504. If it is determined that the wearable device 10 is not communicating wirelessly with the controller 20 (is communicating wired), the process proceeds to step S505.

[0073] In step S504, the CPU 155 measures the amount of delay in wireless communication because the wearable device 10 is communicating wirelessly with the controller 20. The CPU 155 then performs setting (control) according to the measured amount of delay. Specifically, when making a request that requires a response from the controller 20, the CPU 155 sets the maximum wait time from making the request until receiving a response to a time according to the amount of delay. Note that if the maximum wait time is set, the CPU 155 performs the next step of processing when it receives a response or when the maximum wait time has elapsed after making a request to the controller 20. For example, after a request to set the video mode is requested in step S507, the processing of step S508 is performed when the instruction to set the video mode is received or when the maximum wait time has elapsed. If the maximum wait time has elapsed, it may be determined that an error has occurred and the processing of the flowchart in FIG. 5 may be forcibly terminated.

[0074] In step S505, the CPU 155 performs control without considering delays in wireless communication because the wearable device 10 is not communicating wirelessly with the controller 20. Specifically, when making a request that requires a response to the controller 20, the CPU 155 sets the maximum waiting time from making the request until receiving a response to a predetermined, relatively short time (a time shorter than the maximum waiting time set in step S504).

[0075] In step S506, CPU 155 determines whether a user operation to select the video mode as the display mode has been performed. If it is determined that a user operation to select the video mode has been performed, the process proceeds to step S507. If it is determined that a user operation to select the video mode has not been performed, the process proceeds to step S514.

[0076] In step S507, the CPU 155 requests the controller 20 to issue an instruction (an instruction to set the video mode) to set the display mode to the video mode (to set the display mode to the video mode).

[0077] In step S508, CPU 155 determines whether or not an instruction to set video mode as the display mode has been received from controller 20 (a video mode setting instruction has been given). If it is determined that a video mode setting instruction has been received, the process proceeds to step S509. If it is determined that a video mode setting instruction has not been received, the process proceeds to step S506.

[0078] In step S509, the CPU 155 controls the mode setting unit 163 to set the video mode as the display mode.

[0079] In step S510, the CPU 155 displays the video mode image acquired from the controller 20 on the left eye display unit 156 and the right eye display unit 157.

[0080] In step S511, the CPU 155 determines whether recommendation information has been acquired from the controller 20. The recommendation information is, for example, information recommending the optical mode as the display mode, information recommending the use of a display mode other than the video mode, or information recommending removing the wearable device 10 from the head. If it is determined that the recommendation information has been acquired, the process proceeds to step S512. If it is determined that the recommendation information has not been acquired, the process proceeds to step S513.

[0081] In step S512, CPU 155 notifies the user of the recommendation information. For example, CPU 155 superimposes an item indicating that the optical mode is recommended as the display mode on an image for video mode and displays it on left-eye display unit 156 and right-eye display unit 157. Alternatively, CPU 155 outputs, from audio output unit 165 or bone conduction unit 166, a sound indicating that the optical mode is recommended as the display mode.

[0082] An example of an item indicating that the optical mode is recommended as the display mode is item 1300 as shown in FIG. 13A . Item 1300 has area 1301 and area 1302. It is assumed here that wearable device 10 includes a gaze detection unit that detects the area the user is looking at. In this case, when the gaze detection unit detects that the user is looking at area 1301 continuously for a predetermined time, CPU 155 detects that a user operation to select the optical mode as the display mode has been performed. Therefore, when the gaze detection unit detects that the user is looking at area 1301 continuously for a predetermined time, CPU 155 sets the optical mode as the display mode. Furthermore, when the gaze detection unit detects that the user is looking at area 1302 continuously for a predetermined time, CPU 155 hides item 1300. Furthermore, when the recommended information is notified by voice, CPU 155 sets the optical mode as the display mode when the voice detection unit detects an affirmative response (a response that affirms that the optical mode will be set as the display mode in accordance with the recommended information).

[0083] In step S531, CPU 155 determines whether an affirmative response from the user is detected by gaze or voice within a predetermined time after the notification of the recommended information. If it is determined that an affirmative response is detected within the predetermined time after the notification of the recommended information, the process proceeds to step S515. If it is determined that an affirmative response is not detected within the predetermined time after the notification of the recommended information, the process proceeds to step S513. Note that if the process proceeds to step S515, an image is displayed in optical mode.

[0084] In step S513, CPU 155 determines whether or not wearable device 10 will end operating in video mode (video mode will end). For example, CPU 155 determines that video mode will end when it acquires a user operation to select a mode other than video mode as the display mode. If it is determined that video mode will end, the process proceeds to step S506. If it is determined that video mode will not end, the process proceeds to step S510.

[0085] In step S514, CPU 155 determines whether a user operation to select the optical mode as the display mode has been performed. If it is determined that a user operation to select the optical mode has been performed, the process proceeds to step S532. If it is determined that a user operation to select the video mode has not been performed, the process proceeds to step S506.

[0086] In step S515, the CPU 155 requests the controller 20 to issue an instruction (optical mode setting instruction) to set the optical mode as the display mode (to set the display mode to the optical mode).

[0087] In step S516, the CPU 155 determines whether or not an instruction to set the optical mode as the display mode has been issued from the controller 20 (whether or not an instruction to set the optical mode has been issued). If it is determined that an instruction to set the optical mode has been issued, the process proceeds to step S517. If it is determined that an instruction to set the optical mode has not been issued, the process proceeds to step S506.

[0088] In step S517, CPU 155 controls mode setting unit 163 to set the optical mode as the display mode. This opens shutters S of left eye display unit 156 and right eye display unit 157, allowing the user to see the space in front of wearable device 10 through the images on left eye display unit 156 and right eye display unit 157.

[0089] In step S518, the CPU 155 displays the images for the optical mode obtained from the controller 20 in the corresponding areas of the left eye display unit 156 and the right eye display unit 157.

[0090] In step S519, CPU 155 determines whether or not an image addition command has been issued by controller 20. Image addition means that an image for optical mode is displayed, and a reduced image of an image for video mode is additionally displayed in part of the area of ​​left eye display unit 156 and right eye display unit 157. If it is determined that an image addition command has been issued, the process proceeds to step S520. If it is determined that an image addition command has not been issued, the process proceeds to step S521.

[0091] In step S520, CPU 155 controls image adding unit 169 to display an image for optical mode, and also displays reduced images of images for video mode acquired from controller 20 in part of the areas of left eye display unit 156 and right eye display unit 157. This allows the user to directly visually check the situation around the user (external space) in optical mode while checking the image that was being viewed in video mode.

[0092] In step S521, CPU 155 determines whether or not wearable device 10 has ended operation in the optical mode (the optical mode has ended). For example, CPU 155 determines that the optical mode has ended when it acquires a user operation to select a mode other than the optical mode as the display mode. If it is determined that the optical mode has ended, the process proceeds to step S506. If it is determined that the optical mode has not ended, the process proceeds to step S518.

[0093] In step S532, the CPU 155 requests the controller 20 to issue an instruction (optical mode setting instruction) to set the optical mode as the display mode (to set the display mode to the optical mode).

[0094] In step S533, CPU 155 determines whether or not an instruction to set the optical mode as the display mode has been received from controller 20 (an instruction to set the optical mode has been received). If it is determined that an instruction to set the optical mode has been received, the process proceeds to step S534. If it is determined that an instruction to set the optical mode has not been received, the process proceeds to step S506.

[0095] In step S534, CPU 155 controls mode setting unit 163 to set the optical mode as the display mode. This opens shutters S of left eye display unit 156 and right eye display unit 157, allowing the user to see the space in front of wearable device 10 through the images on left eye display unit 156 and right eye display unit 157.

[0096] In step S535, the CPU 155 displays the images for the optical mode obtained from the controller 20 in the corresponding areas of the left eye display unit 156 and the right eye display unit 157.

[0097] In step S536, CPU 155 determines whether or not wearable device 10 ends operation in the optical mode (the optical mode ends). For example, when CPU 155 receives a user operation to select a mode other than the optical mode as the display mode, If it is determined that the optical mode is to be ended, the process proceeds to step S506. If it is determined that the optical mode is not to be ended, the process proceeds to step S535.

[0098] [Controller processing] The control process (control method) of the usage pattern executed by the controller 20 will be described with reference to the flowchart shown in Fig. 6. The process of the flowchart shown in Fig. 6 is realized by the CPU 275 executing a control program stored in the program memory 278. The process of this flowchart starts when the controller 20 is put into an operable state, for example, when the power of the controller 20 is turned on.

[0099] It should be noted that even during the period when the processing of this flowchart is being performed, the controller 20 can perform other processing. For example, the controller 20 can change the method of wireless communication performed by the wireless communication unit 280 in response to a user operation.

[0100] In step S601, the CPU 275 determines whether the wearable device 10 is connected to the controller 20. Specifically, if the CPU 275 can communicate with the controller 20 via the wireless communication unit 280 or the device connection unit 282, it determines that the wearable device 10 is connected to the controller 20. If it is determined that the wearable device 10 is connected to the controller 20, the process proceeds to step S602. If it is determined that the wearable device 10 is not connected to the controller 20, the process of step S601 is repeated.

[0101] In step S602, CPU 275 determines whether terminal information has been acquired from wearable device 10. If it is determined that terminal information has been acquired, the process proceeds to step S603. If it is determined that terminal information has not been acquired, the process of step S602 is repeated. The terminal information indicates a usage mode that can be selected for wearable device 10 from among usage modes such as video mode, optical mode, and use as a face shield.

[0102] In step S603, the CPU 275 determines whether the controller 20 is performing wireless communication with the wearable device 10 (is wirelessly connected). If the wireless communication unit 280 and the wireless communication unit 160 are performing wireless communication, the CPU 275 determines that the controller 20 is performing wireless communication with the wearable device 10. If the device connection unit 282 is communicating with the controller connection unit 162, the CPU 275 determines that the controller 20 is not performing wireless communication with the wearable device 10. If it is determined that the controller 20 is performing wireless communication with the wearable device 10, the process proceeds to step S604. If it is determined that the controller 20 is not performing wireless communication with the wearable device 10 (is performing wired communication), the process proceeds to step S605.

[0103] In step S604, the CPU 275 measures the amount of delay in wireless communication because the controller 20 is performing wireless communication with the wearable device 10. Then, similar to step S504, the CPU 275 performs control according to the measured amount of delay.

[0104] In step S605, the CPU 275 performs control without taking into account delays in wireless communication, as in step S505, because the controller 20 is not performing wireless communication with the wearable device 10.

[0105] In step S606, the CPU 275 issues a command to set the video mode as the display mode. It is determined whether a command to set the video mode has been requested from the wearable device 10. If it is determined that a command to set the video mode has been requested, the process proceeds to step S631. If it is determined that a command to set the video mode has not been requested, the process proceeds to step S634.

[0106] In step S631, CPU 275 controls indoor detection unit 287 to determine whether or not wearable device 10 (or controller 20) is being used indoors. If it is determined that wearable device 10 is being used indoors, the process proceeds to step S607. If it is determined that wearable device 10 is being used outdoors, the process proceeds to step S616.

[0107] In step S607, based on the terminal information acquired in step S602, CPU 275 determines whether or not video mode can be set as the display mode of wearable device 10. If it is determined that video mode can be set as the display mode, the process proceeds to step S608. If it is determined that video mode cannot be set as the display mode, the process proceeds to step S606.

[0108] In step S608, the CPU 275 instructs the wearable device 10 to set the video mode as the display mode.

[0109] In step S609, CPU 275 transmits an image for video mode as an image to be displayed in video mode by wearable device 10. The image for video mode is, for example, an image in which an image of a virtual object stored in data memory 279 or an image of a virtual object accumulated in server 30 is superimposed on an image (live view image) captured in real time by imaging unit 167. The image for video mode is generated by image processing unit 274.

[0110] In step S632, CPU 275 controls indoor detection unit 287 to determine whether wearable device 10 (or controller 20) has transitioned from a state where it is being used indoors to a state where it is being used outdoors. If it is determined that wearable device 10 has transitioned to a state where it is being used outdoors, the process proceeds to step S612. If it is determined that wearable device 10 has not transitioned to a state where it is being used outdoors, the process proceeds to step S615.

[0111] In step S612, based on the terminal information acquired in step S602, CPU 275 determines whether or not the optical mode can be set as the display mode of wearable device 10. If it is determined that the optical mode can be set as the display mode of wearable device 10, the process proceeds to step S613. If it is determined that the optical mode cannot be set as the display mode of wearable device 10, the process proceeds to step S614.

[0112] In step S613, the CPU 275 transmits recommendation information recommending the optical mode as the display mode to the wearable device 10. That is, the CPU 275 transmits recommendation information recommending the optical mode as the display mode to the wearable device 10. transitioned to the state When walking To users of Used transitioned to the state In this case, if the optical mode can be set as the display mode, it is determined that the optical mode is recommended as the display mode. CPU 275 then transmits recommendation information recommending the optical mode as the display mode to wearable device 10, thereby controlling wearable device 10 to notify the user of the recommendation information. When the processing of step S613 ends, the processing proceeds to step S616.

[0113] In step S614, the CPU 275 switches the display mode from the video mode. The wearable device 10 transmits to the wearable device 10 recommendation information such as recommendation information recommending that the wearable device 10 be removed from the head or recommendation information recommending that the wearable device 10 be removed from the head.

[0114] In this way, according to steps S632, S612 to S614, the controller 20 controls the wearable device 10 (or the controller 20) but When the wearable device 10 is switched from indoor use to outdoor use, the wearable device 10 is caused to notify recommended information. The recommended information may include information recommending the optical mode as the display mode, or information recommending the display mode as the video From Mode To optical modeTherefore, when there is a high need for the user to directly view the external space, the wearable device 10 can recommend that the user directly view the external space. The user may be notified to exit the non-visible video mode.

[0115] In step S615, CPU 275 determines whether or not wearable device 10 has finished operating in video mode (video mode has ended). For example, when CPU 275 is notified by wearable device 10 that a user operation to select a mode other than video mode as the display mode has been acquired, CPU 275 determines that video mode has ended. If it is determined that video mode has ended, the process proceeds to step S606. If it is determined that video mode has not ended, the process proceeds to step S609.

[0116] In step S616, CPU 275 determines whether an instruction to set the optical mode as the display mode (an instruction to set the optical mode) has been requested from wearable device 10. If it is determined that an instruction to set the optical mode has been requested, the process proceeds to step S617. If it is determined that an instruction to set the optical mode has not been requested, the process proceeds to step S606.

[0117] In step S617, based on the terminal information acquired in step S602, CPU 275 determines whether or not optical mode can be set as the display mode of wearable device 10. If it is determined that optical mode can be set as the display mode, the process proceeds to step S618. If it is determined that video mode cannot be set as the display mode, the process proceeds to step S606.

[0118] In step S618, the CPU 275 instructs the wearable device 10 to set the optical mode as the display mode.

[0119] In step S619, CPU 275 transmits an image for the optical mode as an image to be displayed by wearable device 10 in the optical mode. The image for the optical mode is, for example, an image of a virtual object stored in data memory 279 or an image of a virtual object accumulated in server 30. Typically, CPU 275 transmits additional information to enhance understanding of the image viewed in the optical mode.

[0120] In step S620, the CPU 275 determines whether the danger level of the environment (ambient environment) around the wearable device 10 (or the controller 20) is high based on the information about the external environment. For example, when the CPU 275 detects a road with many cars passing by or a road where the sidewalk and the roadway are not clearly separated around the wearable device 10 (or the controller 20), it determines that the danger level of the surrounding environment is high. Furthermore, the CPU 275 determines that the danger level of the surrounding environment is high when the sound in the external environment around the wearable device 10 is louder than a predetermined value. On the other hand, when the user is walking on a wide road (ordinary road), for example, the CPU 275 determines that the danger level of the surrounding environment is not high. If it is determined that the danger level of the surrounding environment is high, the process proceeds to step S633. If it is determined that the danger level of the surrounding environment is not high, the process proceeds to step S621.

[0121] In step S621, the CPU 275 instructs the wearable device 10 to add an image.

[0122] In step S622, the CPU 275 transmits a reduced image of the image for video mode to the wearable device 10. The image for video mode here is the same as the image transmitted to the wearable device 10 in step S609.

[0123] Thus, in steps S620 to S622, if the danger level of the surrounding environment is not high, controller 20 causes wearable device 10 in optical mode to also display a reduced image of the image that can be viewed in video mode. This allows, for example, the user to continue viewing the image that was displayed in video mode before the display mode was switched to optical mode. This improves the user's convenience of wearable device 10.

[0124] In step S633, the CPU 275 instructs the wearable device 10 not to add an image. In other words, when the danger level of the surrounding environment is high, the controller 20 does not cause the wearable device 10 in optical mode to display a reduced image of an image that can be viewed in video mode. This makes it easier for the user to pay attention to the surrounding space, allowing the user to use the wearable device 10 safely.

[0125] In this way, in the first embodiment, display and non-display of the reduced image are switched depending on the level of danger in the surrounding environment (information on the external environment). However, once the processing of step S619 is completed, the processing of step S621 may be started without making the determination in step S620. In other words, in all cases where wearable device 10 operates in optical mode, a reduced image of an image for video mode may be displayed on wearable device 10.

[0126] In step S623, CPU 275 determines whether or not wearable device 10 has finished operating in the optical mode (optical mode has ended). For example, when CPU 275 is notified by wearable device 10 that a user operation to select a mode other than optical mode as the display mode has been acquired, CPU 275 determines that optical mode has ended. If it is determined that optical mode has ended, the process proceeds to step S606. If it is determined that optical mode has not ended, the process proceeds to step S619.

[0127] In step S634, CPU 275 determines whether an instruction to set the optical mode as the display mode (an instruction to set the optical mode) has been requested from wearable device 10. If it is determined that an instruction to set the optical mode has been requested, the process proceeds to step S635. If it is determined that an instruction to set the optical mode has not been requested, the process proceeds to step S606.

[0128] In step S635, based on the terminal information acquired in step S602, CPU 275 determines whether or not optical mode can be set as the display mode of wearable device 10. If it is determined that optical mode can be set as the display mode, the process proceeds to step S636. If it is determined that video mode cannot be set as the display mode, the process proceeds to step S606.

[0129] In step S636, the CPU 275 instructs the wearable device 10 to set the optical mode as the display mode.

[0130] In step S637, CPU 275 transmits an image for the optical mode as an image to be displayed by wearable device 10 in the optical mode. The image for the optical mode is, for example, an image of a virtual object stored in data memory 279 or an image of a virtual object accumulated in server 30. CPU 275 generally transmits additional information to enhance understanding of the image viewed in the optical mode.

[0131] In step S638, CPU 275 determines whether or not wearable device 10 has finished operating in the optical mode (optical mode has ended). For example, when CPU 275 is notified by wearable device 10 that a user operation to select a mode other than optical mode as the display mode has been acquired, CPU 275 determines that optical mode has ended. If it is determined that optical mode has ended, the process proceeds to step S606. If it is determined that optical mode has not ended, the process proceeds to step S637.

[0132] [Server processing] The image storage and transmission process executed by server 30 will be described with reference to the flowchart shown in Fig. 7. The process of the flowchart shown in Fig. 7 is realized by CPU 311 executing a control program stored in program memory 312. The process of this flowchart starts when server 30 is put into an operable state, for example, when server 30 is powered on.

[0133] In step S701, CPU 311 determines whether or not an image has been acquired from a device (external device) other than controller 20 and wearable device 10. If it is determined that an image has been acquired from an external device, the process proceeds to step S702. If it is determined that an image has not been acquired from an external device, the process proceeds to step S703.

[0134] In step S702, the CPU 311 stores (accumulates) the image acquired in step S701 in the data memory 313.

[0135] In step S703, the CPU 311 determines whether or not an image has been acquired from the controller 20. If it is determined that an image has been acquired from the controller 20, the process proceeds to step S704. If it is determined that an image has not been acquired from the controller 20, the process proceeds to step S705.

[0136] In step S704, the CPU 311 stores the image acquired in step S703 in the data memory 313.

[0137] In step S705, the CPU 311 determines whether or not the controller 20 has requested that the wearable device 10 transmit an image to be displayed on the wearable device 10. If it is determined that the controller 20 has requested that the wearable device 10 transmit an image, the process proceeds to step S706. If it is determined that the controller 20 has not requested that the wearable device 10 transmit an image, the process proceeds to step S701.

[0138] In step S706, the CPU 311 transmits an image to be displayed on the wearable device 10 to the controller 20.

[0139] According to steps S705 and S706, the controller 20 can obtain an image to be displayed on the wearable device 10 from the server 30 at any timing.

[0140] As described above, according to the first embodiment, the viewing system 1 determines a recommended usage pattern for the wearable device 10 based on information about the external environment, and notifies the user of the information about the recommended usage pattern. Specifically, when the wearable device 10 is being used in video mode, the controller 20 determines whether the wearable device 10 is being used outdoors. transitioned to the state If so, the controller 20 determines to recommend the optical mode. Then, the controller 20 transmits recommendation information recommending the optical mode to the wearable device 10, and causes the wearable device 10 to notify the user of the recommendation information.

[0141] This allows the user to know that if viewing images in video mode could pose a risk, they should switch to optical mode, which allows for safer viewing of images. This makes it easier for the user to know when to switch the usage mode of a wearable device that can be used in multiple ways. For example, when leaving a room and going outside, the user cannot see the outside space. This could result in the user being injured outside. However, as in the first embodiment, if the user receives notification from the wearable device 10 of recommendation information recommending optical mode as the display mode, the user can immediately reset the display mode to optical mode. This reduces the possibility of the user being injured outside, ensuring the user's safety.

[0142] Note that, when wearable device 10 notifies the user of recommendation information recommending the optical mode as the display mode, it may further set the optical mode as the display mode (switch to the optical mode) after a predetermined time has elapsed since notifying the user of the recommendation information. That is, after the processing of step S512 has elapsed and after waiting for a predetermined time, it may proceed to step S515 without going through step S531. That is, after a predetermined time, for example, about 2 seconds, has elapsed after displaying the recommendation information, the display mode may be switched without waiting for an affirmative response. Also, if it is determined in step S514 that a user operation to select the optical mode has been performed, it may proceed to step S515. Then, if it is determined in step S606 that an instruction to set the video mode has not been requested, it may proceed to step S616.

[0143] Also, instead of the video mode, any usage mode may be used in which the user cannot see the outside through the left eye display unit 156 and the right eye display unit 157. For example, instead of the video mode, a mode in which any image (an image showing a VR space) is displayed on the left eye display unit 156 and the right eye display unit 157 may be used. Also, instead of the optical mode, a usage mode in which no image is displayed on the left eye display unit 156 and the right eye display unit 157 may be used as long as the user can directly see the outside space.

[0144] <Embodiment 2> In the first embodiment, a viewing system 1 is described that recommends displaying images in optical mode when a user is displaying images in video mode indoors and then moves outdoors. In the second embodiment, a viewing system 1 is described that recommends displaying images in optical mode when a user is displaying images in video mode while standing still and then starts walking. Note that a standing still state refers to any state in which the user is not walking (changing location).

[0145] [Controller processing] 8A and 8B, a description will be given of a control process for a usage pattern executed by controller 20. The process of the flowcharts shown in FIGS. 8A and 8B is realized by CPU 275 executing a control program stored in program memory 278.

[0146] In the second embodiment, instead of the "determination as to whether the wearable device 10 is being used indoors" (processing of step S631) in the first embodiment, "determination as to whether the user is walking" (processing of step S801) is performed. Then, "determination as to whether the wearable device 10 has shifted from being used indoors to being used outdoors" (processing of step S632) is performed. Instead, "determination as to whether the user has transitioned from a stationary state to a walking motion" (processing of step S802) is performed.

[0147] The process of FIG. 8A starts when the answer to step S606 in the flowchart shown in FIG. 6 is YES (when it is determined that an instruction to set the video mode has been requested).

[0148] In step S801, the CPU 275 controls the walking detection unit 288 to determine whether or not the wearable device 10 (or the controller 20) is being used while the user is walking. If it is determined that the wearable device 10 is being used while the user is walking, the process proceeds to step S616. If it is determined that the wearable device 10 is not being used while the user is walking, the process proceeds to step S607.

[0149] The process of FIG. 8B starts when the process of step S609 in the flowchart shown in FIG. 6 (the process of transmitting an image for video mode) ends.

[0150] In step S802, CPU 275 controls walking detection unit 288 to determine whether the user of wearable device 10 (or controller 20) has transitioned from a stationary state to a walking motion. If it is determined that the user has transitioned from a stationary state to a walking motion, the process proceeds to step S612. If it is determined that the user has not transitioned from a stationary state to a walking motion, the process proceeds to step S615.

[0151] As described above, according to the second embodiment, the viewing system 1 determines a recommended usage pattern for the wearable device 10 based on information about the external environment, and notifies the user of the information about the recommended usage pattern. Specifically, when the wearable device 10 is being used in video mode, the controller 20 Use User When the movement transitions to walking, If so, the controller 20 determines to recommend the optical mode. Then, the controller 20 transmits recommendation information recommending the optical mode to the wearable device 10, and causes the wearable device 10 to notify the user of the recommendation information.

[0152] This allows the user to know that if viewing an image in video mode could pose a risk, the user should switch to optical mode, which allows for safer viewing of the image. This makes it easier for the user to know when to switch the usage mode of a wearable device that can be used in multiple ways. For example, if the user is viewing an image in video mode in a room, the user cannot see the external space when walking down stairs. This could lead to the user tripping over the stairs. However, as in the second embodiment, if the user receives notification from wearable device 10 of recommendation information recommending optical mode as the display mode, the user can immediately reset the display mode to optical mode. This reduces the possibility of the user tripping over the stairs, ensuring the user's safety.

[0153] When wearable device 10 notifies the user of recommendation information recommending the optical mode as the display mode, it may further set the optical mode as the display mode (or switch to the optical mode) after a predetermined time has elapsed since notifying the user of the recommendation information. In other words, after the process of step S512 has elapsed, it may proceed to step S515 after waiting for a predetermined time.

[0154] Also, instead of the video mode, any usage mode in which the user cannot see the outside through the left eye display unit 156 and the right eye display unit 157 may be used. For example, instead of the video mode, a mode in which any image (an image showing a VR space) is displayed on the left eye display unit 156 and the right eye display unit 157 may be used. Also, instead of the optical mode, if the user can directly see the outside space, an image may be displayed on the left eye display unit 156 and the right eye display unit 157. A usage mode in which no display is made at all may also be used.

[0155] By combining embodiment 1 and embodiment 2, when a user is standing still indoors and using wearable device 10 operating in video mode, the display may be switched to optical mode when the user moves outdoors or begins walking.

[0156] Furthermore, when the user is outdoors or walking, if video mode is selected as the display mode, images may be displayed in optical mode from the beginning without displaying images in video mode at all.

[0157] <Embodiment 3> In the third embodiment, a viewing system 1 that recommends using the wearable device 10 as a face shield will be described. When the wearable device 10 is used as a face shield, the wearable device 10 may display images on the left eye display unit 156 and the right eye display unit 157, or may display images on the shield FS (see FIG. 14). When the shield FS displays images, the shield FS may display images using light projected by a small projector. Alternatively, if the shield FS is a self-luminous curved display, the shield FS may display images by self-luminosity.

[0158] [Wearable Device Processing] In the third embodiment, the process of the flowchart shown in Fig. 9A is further executed in the usage pattern control process executed by the wearable device 10 shown in Fig. 5. Specifically, the process of the flowchart shown in Fig. 9A is executed between step S535 and step S536.

[0159] When the processing of step S535 ends, in step S901, CPU 155 determines whether or not recommendation information recommending a face shield as a usage mode (recommending the use of a face shield) has been acquired from controller 20. If it is determined that recommendation information recommending a face shield has been acquired, the process proceeds to step S902. If it is determined that recommendation information recommending a face shield has not been acquired, the process proceeds to step S536.

[0160] In step S902, CPU 155 determines whether the user is currently using wearable device 10 as a face shield. For example, CPU 155 determines whether the user is using wearable device 10 as a face shield based on whether a shield FS is attached to wearable device 10. If it is determined that the user is using wearable device 10 as a face shield, the process proceeds to step S536. If it is determined that the user is not using wearable device 10 as a face shield, the process proceeds to step S903.

[0161] In step S903, CPU 155 notifies the user of recommendation information recommending a face shield as a usage pattern. For example, CPU 155 displays an item indicating that a face shield is recommended as a usage pattern on left eye display unit 156 and right eye display unit 157.

[0162] [Controller processing] In the third embodiment, the process of the flowchart shown in Fig. 9B is further executed in the control process of the usage pattern executed by the controller 20 shown in Fig. 6. Specifically, the process of the flowchart shown in Fig. 9B is executed between step S637 and step S638.

[0163] When the processing of step S637 ends, in step S911, the CPU 275 controls the infection risk detection unit 289 to determine whether the infection risk of an infectious disease around the wearable device 10 is higher than a threshold. For example, the infection risk detection unit 289 determines that the infection risk of an infectious disease is higher than the threshold when the density of people around the wearable device 10 (or the controller 20) is higher than a predetermined value or when the current humidity of the surroundings is lower than a predetermined humidity. Furthermore, the infection risk detection unit 289 determines that the infection risk of an infectious disease is higher than the threshold when the carbon dioxide concentration around the wearable device 10 (or the controller 20) is higher than a predetermined concentration. If it is determined that the infection risk of an infectious disease is higher than the threshold, the process proceeds to step S912. If it is determined that the infection risk of an infectious disease is not higher than the threshold, the process proceeds to step S638.

[0164] In step S912, CPU 275 transmits recommendation information recommending a face shield as a usage mode (recommending the use of a face shield) to wearable device 10. Note that the recommendation information may include, for example, information recommending the use of protective clothing or a mask together with wearable device 10, in addition to the information recommending a face shield as a usage mode.

[0165] In this way, when the risk of infection of an infectious disease around the wearable device 10 is higher than a threshold, the CPU 275 determines that the usage pattern of using the wearable device 10 as a face shield is the recommended usage pattern of the wearable device 10. Then, the CPU 275 transmits recommendation information recommending the face shield as the usage pattern to the wearable device 10, and causes the wearable device 10 to notify the user of the recommendation information.

[0166] 9A may be executed between steps S510 and S511 instead of between steps S535 and S536. In this case, the process shown in Fig. 9B may be executed between steps S609 and S632 instead of between steps S637 and S638.

[0167] In the third embodiment, when the risk of infection is high, a face shield is recommended as a form of use for the wearable device 10. This allows the user to use the wearable device 10 as a face shield at an appropriate time, thereby enabling the user to be active while reducing the risk of infection.

[0168] <Embodiment 4> In the fourth embodiment, a viewing system 1 that recommends audio output via bone conduction will be described. In the fourth embodiment, when the wearable device 10 displays an image, the wearable device 10 outputs (emits) audio corresponding to the image to the outside from the audio output unit 165 or the bone conduction unit 166.

[0169] [Wearable Device Processing] In the fourth embodiment, the process of the flowchart shown in Fig. 10A is further executed in the usage pattern control process executed by the wearable device 10 shown in Fig. 5. Specifically, the process of the flowchart shown in Fig. 10A is executed between step S535 and step S536.

[0170] When the process of step S535 ends, in step S1001, the CPU 155 determines whether or not audio is currently being output by the bone conduction unit 166. If it is determined that audio is being output by the bone conduction unit 166, the process proceeds to step S1006. If it is determined that audio is not being output by the bone conduction unit 166 (audio is being output by the audio output unit 165), the process proceeds to step S1007. If so, the process proceeds to step S1002.

[0171] In step S1002, CPU 155 determines whether or not recommendation information recommending a usage mode in which sound is output by bone conduction unit 166 has been acquired from controller 20. If it is determined that recommendation information recommending a usage mode in which sound is output by bone conduction unit 166 has been acquired, the process proceeds to step S1003. If it is determined that recommendation information recommending a usage mode in which sound is output by bone conduction unit 166 has not been acquired, the process proceeds to step S1004.

[0172] In step S1003, CPU 155 notifies the user of recommendation information that recommends a usage mode in which sound is output by bone conduction unit 166. For example, CPU 155 displays, on left eye display unit 156 and right eye display unit 157, an item indicating that a usage mode in which sound is output by bone conduction unit 166 is recommended.

[0173] In step S1004, CPU 155 determines whether or not a user operation has been performed to select audio output by bone conduction unit 166 (a user operation to select bone conduction as the audio output mode). If it is determined that a user operation to select bone conduction has been performed, the process proceeds to step S1005. If it is determined that a user operation to select bone conduction has not been performed, the process proceeds to step S1007.

[0174] In step S1005, the CPU 155 outputs the sound from the bone conduction unit 166.

[0175] In step S1006, CPU 155 determines whether or not to end the output of sound from bone conduction unit 166. If it is determined that the output of sound from bone conduction unit 166 will end, the process proceeds to step S1007. If it is determined that the output of sound from bone conduction unit 166 will not end, the process proceeds to step S536.

[0176] In step S1007, CPU 155 outputs sound from audio output unit 165 (produces sound using air vibrations).

[0177] [Controller processing] In the fourth embodiment, the process of the flowchart shown in Fig. 10B is further executed in the control process of the usage pattern executed by the controller 20 shown in Fig. 6. Specifically, the process of the flowchart shown in Fig. 10B is executed between step S637 and step S638.

[0178] When the processing of step S637 ends, in step S1011, CPU 155 controls boarding detection unit 290 to determine whether or not the user carrying wearable device 10 (controller 20) is on a train. If it is determined that the user is on a train, the process proceeds to step S1012. If it is determined that the user is not on a train, the process proceeds to step S638.

[0179] In step S1012, CPU 155 transmits recommendation information to wearable device 10 that recommends outputting audio from bone conduction unit 166.

[0180] In this way, when the user is on a train, CPU 275 determines that the usage mode in which sound is output by bone conduction is the recommended usage mode for wearable device 10. CPU 275 then transmits recommendation information recommending the usage mode in which sound is output by bone conduction (outputting sound by bone conduction unit 166) to wearable device 10, and causes wearable device 10 to notify the recommendation information.

[0181] Instead of determining whether the user is on a train, it may be determined whether the user is on another vehicle (public transportation) or whether the user is in a public place such as a school campus. Whether the user is on a specific vehicle (public transportation) can be determined, for example, by the user traveling along the travel route of the specific vehicle and the user's traveling speed being equal to or greater than a predetermined speed.

[0182] 10A may be executed between steps S510 and S511 instead of between steps S535 and S536. In this case, the process shown in Fig. 10B may be executed between steps S609 and S632 instead of between steps S637 and S638.

[0183] According to the fourth embodiment, when outputting sound by air vibrations may cause the sound to leak to the surroundings and cause a nuisance to those around, it is recommended to output sound by bone conduction. This allows the user to use the wearable device 10 to output sound by bone conduction at an appropriate time, thereby enabling the user to be active while reducing the possibility of causing a nuisance to those around them.

[0184] <Embodiment 5> Furthermore, when the proximity detection unit 291 detects the approach of an object, the controller 20 may transmit recommendation information to the wearable device 10 recommending a usage mode in which the wearable device 10 does not output sound. Then, when the wearable device 10 acquires the recommendation information recommending a usage mode in which no sound is output, the controller 20 may notify the user of the recommendation information. The approach of an object means that the distance between the wearable device 10 (controller 20) and an object such as a person, animal, or vehicle becomes equal to or shorter than a predetermined distance.

[0185] When the user receives notification of the recommended information and stops the audio output, the user can concentrate on understanding the situation around them when there is a possibility of contact between the user and an object, thereby enabling the user to use the wearable device 10 safely.

[0186] Note that when the display mode of the wearable device 10 is the optical mode, the controller 20 may control the wearable device 10 to stop outputting sound when the approach detection unit 291 detects the approach of an object.

[0187] <Embodiment 6> In the sixth embodiment, the wearable device 10 notifies the user of the recommended usage pattern of the wearable device 10 only when it is recognized that the wearable device 10 is being used by a pre-registered user (identity authentication is successful).

[0188] [Wearable Device Processing] Fig. 11 is a flowchart showing the process of personal authentication performed by wearable device 10. The process of the flowchart shown in Fig. 11 is performed before the start of the flowchart shown in Fig. 5. The process of the flowchart shown in Fig. 11 is realized by CPU 155 executing a control program stored in program memory 158.

[0189] In step S1101, CPU 155 determines whether or not the user has requested registration of personal information. Personal information is information for identifying the user who owns wearable device 10. If it is determined that registration of personal information has been requested, the process proceeds to step S1102. If it is determined that registration of personal information has not been requested, the process proceeds to step S1105.

[0190] In step S1102, the CPU 155 notifies the controller 20 that registration of personal information has been requested (registration request).

[0191] In step S1103, the CPU 155 determines whether or not an instruction to acquire personal information has been issued from the controller 20. If it is determined that an instruction to acquire personal information has been issued, the process proceeds to step S1104. If it is determined that an instruction to acquire personal information has not been issued, the process of step S1103 is repeated.

[0192] In step S1104, the CPU 155 acquires an image of the user's eyes as personal information. The CPU 155 also acquires an arbitrary password from the user. The CPU 155 then transmits the acquired personal information and password to the controller 20.

[0193] In step S1105, CPU 155 determines whether or not personal authentication has been requested by the user. If it is determined that personal authentication has been requested, the process proceeds to step S1106. If it is determined that personal authentication has not been requested, the process proceeds to step S1101.

[0194] In step S1106, the CPU 155 notifies the controller 20 that personal authentication has been requested (authentication request).

[0195] In step S1107, the CPU 155 determines whether or not an instruction to acquire user information has been issued from the controller 20. If it is determined that an instruction to acquire user information has been issued, the process proceeds to step S1108. If it is determined that an instruction to acquire user information has not been issued, the process of step S1107 is repeated.

[0196] In step S1108, CPU 155 acquires a password from the user and an image of the user's eyes as user information.

[0197] In step S1109, the CPU 155 transmits to the controller 20 the password and user information (image of the user's eyes) acquired in step S1108.

[0198] In step S1110, CPU 155 determines whether or not personal authentication has been successful. If CPU 155 is notified by controller 20 that authentication has been successful (authentication successful), it determines that personal authentication has been successful. If CPU 155 is notified by controller 20 that authentication has failed (authentication successful), it determines that personal authentication has not been successful. If it is determined that personal authentication has been successful, the processing of this flowchart ends (the processing of the flowchart shown in FIG. 5 starts). If it is determined that personal authentication has not been successful, the processing proceeds to step S1101.

[0199] [Controller processing] Fig. 12 is a flowchart showing the process of personal authentication performed by the controller 20. Before the start of the flowchart shown in Fig. 6, the process of the flowchart shown in Fig. 12 is performed. The process of the flowchart shown in Fig. 12 is realized by the CPU 275 executing a control program stored in the program memory 278.

[0200] In step S1201, CPU 275 determines whether or not a request to register personal information (registration request) has been received from wearable device 10. If it is determined that a request to register personal information has been received, the process proceeds to step S1202. If it is determined that a request to register personal information has not been received, the process proceeds to step S1205.

[0201] In step S1202, the CPU 275 executes the process of acquiring personal information from the wearable device 1. Instruct 0.

[0202] In step S1203, CPU 275 determines whether or not personal information and a password have been acquired from wearable device 10. If it is determined that personal information and a password have been acquired, the process proceeds to step S1204. If it is determined that personal information and a password have not been acquired, the process of step S1203 is repeated.

[0203] In step S1204, CPU 275 associates the image of the user's eyes, which is the personal information acquired from wearable device 10, with the password and registers them in owner detection unit 292. As a result, the user corresponding to the personal information acquired from wearable device 10 is registered as the owner of wearable device 10.

[0204] In step S1205, CPU 275 determines whether or not it has received a notification from wearable device 10 that personal authentication has been requested (authentication request). If it is determined that an authentication request has been notified, it proceeds to step S1206. If it is determined that an authentication request has not been notified, it proceeds to step S1201.

[0205] In step S1206, the CPU 275 instructs the wearable device 10 to acquire user information.

[0206] In step S1207, the CPU 275 acquires the user information and password from the wearable device 10.

[0207] In step S1208, CPU 275 controls owner detection unit 292 to determine whether the user information and password acquired in step S1207 match the personal information and password registered in step S1204 (whether personal authentication has been successful). If it is determined that these pieces of information match (personal authentication has been successful), the process proceeds to step S1209. If it is determined that these pieces of information do not match, the process proceeds to step S1210. Note that a match between the user information and the personal information refers to a match between the eye features indicated by the user information and the eye features indicated by the personal information.

[0208] In step S1209, the CPU 275 notifies the wearable device 10 that the authentication has been successful (authentication success).

[0209] In step S1210, the CPU 275 notifies the wearable device 10 that the authentication has failed (is not successful). When the processing of step S1210 ends, the process returns to step S1201 again.

[0210] In addition, instead of the above-mentioned "image of the user's eyes," any biometric information that can identify the user may be used as the personal information and user information, such as information extracted from the feature values ​​of the image of the user's eyes, an image of the user's fingerprint, or information about the voice spoken by the user.

[0211] As a result, the control process of the usage pattern of the wearable device 10 (the process of FIG. 5) is performed only when the wearable device 10 is used by a pre-registered owner (user). In other words, if the wearable device 10 is used by someone other than the pre-registered owner (user), the wearable device 10 does not notify the recommended information. Furthermore, the controller 20 does not determine the recommended usage pattern, and controls the wearable device 10 not to notify the recommended information. This makes it possible to prevent the control process of the usage pattern of the wearable device 10 from being performed on a user who is unaware that the control process of the usage pattern of the wearable device 10 shown in embodiments 1 to 5 is being performed. Therefore, This improves safety when using the wearable device 10.

[0212] The embodiments may be combined in any way as long as no contradictions arise. The interpretation of the claims is not limited solely by the matters described in the embodiments. The interpretation of the claims also includes the scope of the claims that would enable a person skilled in the art to recognize that the problem of the invention can be solved, taking into account the common general technical knowledge at the time of filing.

[0213] Note that each functional unit in each of the above embodiments (variations) may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of multiple functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware such as an ASIC, FPGA, or DSP. For example, an apparatus may have a processor and a memory (storage medium) in which a control program is stored. Then, the functions of at least some of the functional units of the apparatus may be realized by the processor reading and executing the control program from the memory.

[0214] (Other embodiments) While the above-described wearable device 10 is worn on the head, the present invention is not limited to wearable devices worn on the head. For example, the present invention also includes a watch-type wearable device that can be worn on the wrist and that can be used in two modes (multiple usage modes): a mode that notifies notifications such as received emails by sound and a mode that notifies by vibration or the like instead of sound, and that has a notification means for notifying the user of recommended information that indicates a recommended usage mode among multiple usage modes (for example, recommending a mode that notifies by vibration when it is detected that the user has gone from indoors to outdoors) determined based on whether the user is indoors, such as in a room or on a train, or outdoors (information about the external environment).

[0215] The present invention also includes a contact lens-type wearable device that can be worn on the eyeball and can be used in multiple modes of use, such as a mode for correcting presbyopia (vision correction), a mode for displaying digital information in the field of view, and a mode for checking health status from tears, and is characterized by having a notification means for notifying the user of recommended information that indicates a recommended mode of use among multiple modes of use (for example, when it is detected that the user has transitioned from an awake state to a sleep state, it is recommended that the mode for displaying digital information in the field of view be turned off and that the mode be switched to a mode for checking health status from tears).

[0216] The present invention can also be realized by supplying a program that realizes one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more of the functions. [Explanation of symbols]

[0217] 10: Wearable device, 155: CPU, 156: Left eye display, 157: Right eye display

Claims

1. A wearable device that is worn on a user's head and can be used in multiple ways, A display means; a notification means for notifying the user, via the display means, of information determined based on information about the external environment, which is information about whether the wearable device is being used indoors or outdoors or information about whether the user is walking or standing still, and which 1) indicates a usage mode corresponding to the external environment among the plurality of usage modes, or 2) an image showing instruction information indicating the user to remove the wearable device; and a control means for setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; A wearable device comprising:

2. the plurality of usage modes include a first mode in which the user can view an external space through the display means, and a second mode in which the user cannot view an external space through the display means; The wearable device according to claim 1 .

3. the notification means notifies the user of information indicating the first mode as the instruction information when the wearable device is operating in the second mode and the information related to the external environment indicates that the wearable device will transition from a state where it is being used indoors to a state where it is being used outdoors. The wearable device according to claim 2 .

4. the notification means notifies the user of information indicating the first mode as the instruction information when the wearable device is operating in the second mode and the information regarding the external environment indicates that the user of the wearable device will transition from a stationary state to a walking motion.

4. The wearable device according to claim 2 or 3.

5. In the second mode, the display means displays an image; the notification means notifies the user of information indicating the first mode as the instruction information when the information on the external environment indicates that the wearable device operating in the second mode will transition from a state in which the wearable device is being used by the user indoors and stopped to a state in which the wearable device is being used outdoors, or when the information on the external environment indicates that the user will transition to a walking motion. The wearable device according to claim 2 .

6. In the second mode, the display means displays an image; When the wearable device operates in the first mode, the display means switches whether to display a reduced image of the image based on the information about the external environment. The wearable device according to any one of claims 2 to 5.

7. a detection means for detecting a position where the user is looking; When the detection means detects that the user is continuously looking at a predetermined area of ​​the image on which the instruction information is displayed for a predetermined period of time, the control means sets the usage mode of the wearable device to the usage mode indicated by the instruction information. The wearable device according to any one of claims 1 to 6.

8. the notification means does not notify the user of the instruction information if the user of the wearable device is not a pre-registered owner. The wearable device according to any one of claims 1 to 7.

9. A control device for controlling a wearable device that is worn on a user's head, has a display means, and can be used in multiple ways, comprising: a determination means for 1) determining a usage mode corresponding to the external environment from among the plurality of usage modes, or 2) determining whether the wearable device has been removed, based on information about the external environment, which information is information about whether the wearable device is being used indoors or outdoors or information about whether the user is walking or standing still; a control means for notifying a user via the display means of an image showing 1) a usage mode corresponding to the external environment or 2) information indicating a determination result of whether the wearable device has been removed, the image showing 1) the usage mode corresponding to the external environment among the plurality of usage modes, or 2) instruction information indicating whether the wearable device has been removed, and for controlling the wearable device to set the usage mode of the wearable device to the usage mode shown by the image showing the instruction information based on an operation by the user; A control device comprising:

10. the plurality of usage modes include a first mode in which the user can view an external space through the display means, and a second mode in which the user cannot view an external space through the display means; The control device according to claim 9 .

11. the determination means determines that the first mode is a usage form corresponding to the external environment when the wearable device is operating in the second mode and the information on the external environment indicates that the wearable device is transitioning from a state where it is being used indoors to a state where it is being used outdoors; The control device according to claim 10 .

12. The determination means determines whether the wearable device is operating in the second mode, and When the information about the external environment indicates that the user of the wearable device transitions from a stationary state to a walking motion, the first mode is determined to be a usage form corresponding to the external environment.

12. The control device according to claim 10 or 11.

13. In the second mode, the display means displays an image; The determination means determines that the first mode is a usage form corresponding to the external environment when the information on the external environment indicates that the wearable device operating in the second mode will transition from a state in which the wearable device is being used by the user at rest indoors to a state in which the wearable device is being used outdoors, or that the user will transition to walking. The control device according to claim 10 .

14. In the second mode, the display means displays an image; When the wearable device operates in the first mode, the control means controls the wearable device to switch whether or not to display a reduced image of the image based on information about the external environment.

14. The control device according to claim 10, wherein the control device is a control unit for controlling a vehicle.

15. the determination means acquires information indicating the plurality of usage patterns available for the wearable device from the wearable device, and determines a usage pattern corresponding to the external environment based on the information indicating the plurality of usage patterns; 15. The control device according to any one of claims 9 to 14.

16. further comprising an authentication means for authenticating whether the user of the wearable device is a pre-registered owner of the wearable device; the control means controls the wearable device so as not to notify information indicating a usage mode corresponding to the external environment when the user of the wearable device is not the owner.

16. The control device according to any one of claims 9 to 15.

17. A system comprising: a wearable device that is worn on a user's head, has a display means, and can be used in a plurality of ways; and a control device that controls the wearable device, a determination means for 1) determining a usage mode corresponding to the external environment from among the plurality of usage modes, or 2) determining whether the wearable device has been removed, based on information about the external environment, which information is information about whether the wearable device is being used indoors or outdoors or information about whether the user is walking or standing still; a notification means for notifying a user via the display means of an image showing 1) a usage mode corresponding to the external environment or 2) a determination result of whether the wearable device has been removed, the image showing 1) the usage mode corresponding to the external environment among the plurality of usage modes, or 2) instruction information showing whether the wearable device has been removed; and a control means for setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; A system comprising:

18. A control method for a wearable device that is worn on a user's head, has a display means, and can be used in multiple ways, comprising: via the display means, information regarding whether the wearable device is being used indoors or outdoors or information regarding whether the user is walking or standing still; a notification step of notifying the user of an image showing information determined based on information about the external environment, the information being information related to the external environment, the image showing 1) a usage mode corresponding to the external environment among the plurality of usage modes, or 2) instruction information indicating that the wearable device should be removed; a control step of setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; A control method comprising:

19. A control method for a control device that controls a wearable device that is worn on a user's head, has a display means, and can be used in multiple ways, comprising: a determination step of 1) determining a usage mode corresponding to the external environment from among the plurality of usage modes, or 2) determining whether the wearable device has been removed, based on information about the external environment, which information is information about whether the wearable device is being used indoors or outdoors or information about whether the user is walking or standing still; a control step of notifying a user via the display means of an image showing instruction information indicating 1) a usage mode corresponding to the external environment or 2) a determination result of whether the wearable device has been removed, the image showing instruction information indicating 1) the usage mode corresponding to the external environment among the plurality of usage modes, or 2) the removal of the wearable device, and controlling the wearable device to set the usage mode of the wearable device to the usage mode shown by the image showing the instruction information based on an operation by the user; A control method comprising:

20. A control method for a system having a wearable device that is worn on a user's head, has a display means, and can be used in a plurality of ways, and a control device that controls the wearable device, comprising: a determination step of 1) determining a usage mode corresponding to the external environment from among the plurality of usage modes, or 2) determining whether the wearable device has been removed, based on information about the external environment, which information is information about whether the wearable device is being used indoors or outdoors or information about whether the user is walking or standing still; a notification step of notifying the user via the display means of an image showing information indicating 1) a usage mode corresponding to the external environment or 2) a determination result of whether the wearable device has been removed, the image showing 1) the usage mode corresponding to the external environment among the plurality of usage modes, or 2) instruction information showing whether the wearable device has been removed; a control step of setting a usage mode of the wearable device to a usage mode indicated by the image showing the instruction information based on an operation by the user; A control method comprising:

21. A program for causing a computer to function as each of the means of the wearable device according to any one of claims 1 to 8.

22. A program for causing a computer to function as each of the means of the control device according to any one of claims 9 to 16.

23. A program for causing a computer to function as each means of the system according to claim 17.

Images