Information device, related method, and program

Abstract

To realize notification control that takes into account usage situations and / or user actions / usage scenes, for glasses-type information devices used as a replacement for mobile phones and smart phones.SOLUTION: A glasses-type information device includes a first speaker function configured to transmit sound to a user wearing the device, a second speaker function configured to transmit sound to a surrounding area of the device, and a notification function including at least any of a vibration function and a lamp turning-on function. When temples of the glasses-type information device are folded and the device is not worn by the user, the first speaker function is disabled and output processing is performed using at least any of the second speaker function and the notification function for an application installed on the glasses-type information device.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a mechanism for controlling notifications of applications installed in eyeglass-type information devices such as smart glasses.

Background Art

[0002] Conventionally, mobile phones and smartphones have become widespread in the consumer market, and are equipped with means such as earphones (function for listening to voices when placed on the ear), speakers, bone conduction speakers, vibrations, and LED lamps. Smartphones use these means for incoming calls, alarms, timers, and mail notifications. Among them, there is also a proposed technique for switching so that when making a voice call on a flip-type mobile phone, if the mobile phone is open, sound is emitted through the speaker, and if it is closed, sound is transmitted through the bone conduction speaker (Patent Document 1).

[0003] In recent years, as technologies related to cooperation with smartphones and technologies for replacing smartphones, technologies related to smart glasses, which are wearable terminals worn like glasses, have been proposed, and penetration in the future consumer market is also expected. There are already smart glasses that have been commercialized, and there are also smart glasses equipped with means such as earphones / speakers / bone conduction speakers / vibrations / LED lamps similar to smartphones.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Since glasses-type information devices such as smart glasses are devices worn on the face, usage situations, user actions, and usage scenarios specific to smart glasses different from those of smartphones are assumed.

[0006] For example, on a smartphone, the speaker sound may be turned off in consideration of disturbing others. At this time, since the user is not constantly looking at the screen, there are cases where the smartphone's vibration function is turned on so that the user can notice notifications. On the other hand, during the wearing of smart glasses, even when the speaker sound is turned off in consideration of disturbing others, it is assumed that the vibration function in which the smart glasses themselves vibrate is unnecessary or may be uncomfortable.

[0007] Therefore, notification control assuming at least one of the usage situation of the glasses-type information device, user actions, and usage scenarios may be required.

Means for Solving the Problem

[0008] The present invention is a glasses-type information device that can be worn by a user, and includes a first speaker function for transmitting sound to the user wearing the glasses-type information device, a second speaker function for transmitting sound to the surroundings of the glasses-type information device, and a notification function including at least one of a vibration function and a function of lighting a lamp. When the temple of the glasses-type information device is folded and not worn by the user, for the application installed in the glasses-type information device, the first speaker function is invalidated, and output using at least one of the second speaker function and the notification function is performed. When the glasses-type information device is worn by the user, for the application, the second speaker function and the notification function are invalidated, and output using the first speaker function is performed.

Effect of the Invention

[0009] According to the present invention, it is possible to perform notification control assuming at least one of the usage status of the glasses-type information device and the user operation / usage scenario.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Modes for Carrying Out the Invention

[0011] Hereinafter, modes for carrying out the present invention will be described with reference to the drawings.

[0012] <Example 1> FIG. 1 is an example of a system configuration diagram of glasses-type information devices. The glasses-type information device is a device that can communicate with a mobile network (mobile communication network) 130 and the Internet 140 directly or via a mobile router (not shown). In the present invention, smart glasses 101 are cited as an example. As the glasses-type information device, monocular smart glasses, head-mounted displays, etc. are also applicable.

[0013] The smart glasses 101 are a wearable information terminal that the user wears near the eyes, and display a video that is a virtual image within the field of view on the display unit 102 without blocking the user's field of view. Such a display method is called so-called AR (Augmented Reality) or MR (Mixed Reality), and is provided by a function of projecting information onto a transmissive display (lens 105), the user's retina (not shown), etc. Although the illustration provides video for one eye, in the present invention, it is also possible to apply the smart glasses 101 that project video onto the fields of view of both eyes.

[0014] In addition, the display unit 102 is provided with a camera unit 103 for photographing a subject in the user's line of sight. 104 is a frame and at the same time has a touch sensor outside the frame, and is an operation frame unit for operating the terminal. The frame 104 has a built-in audio function, and can transmit sound to the user by a loudspeaker sound that can be heard without being applied to the ear or an earphone sound that can be heard when the frame hits the ear. As an alternative to this earphone sound, it is also possible to mount a bone conduction function. In this embodiment, functions such as the earphone function and the bone conduction function are defined as a first speaker that transmits sound with directivity to the wearer of the smart glasses 101. On the other hand, when the smart glasses 101 are closed, etc., a speaker (such as the speaker 224 described later) that outputs sound to unspecified users around is defined as a second speaker.

[0015] Furthermore, the template portion of the frame 104 can be folded to close or open, and is equipped with a template opening / closing switch for detecting its open / closed state. The frame 104 can also be equipped with an ON / OFF switch that is used for mode switching such as a manner mode and detects the switching. In addition, an inside of the frame 104 is provided with a skin sensor for detecting whether the skin is in contact, and may be provided with a person detection sensor for detecting a person in the vicinity of the camera unit 103 on the frame 104. In order to convey a notification from an application on the smart glasses 101 to the user, notification functions such as a vibration function and an LED lamp blinking function are also mounted on the frame 104.

[0016] FIG. 2 is a diagram showing an example of a hardware configuration of the smart glasses 101.

[0017] The CPU 201 comprehensively controls various functions of the smart glasses 101 via the internal bus 206 according to a program stored in the ROM 203. The execution result of the program by the CPU 201 can be projected and displayed as an image in the user's field of view by the display 202. In this embodiment, for the display method, it is assumed that the user views what is projected by the display 202 in the field of view through the transmissive lens 105. However, it is also possible to adopt a method in which the display 202 directly projects onto the retina. The ROM 203 is a flash memory or the like, and stores various setting information and application programs as described above. The RAM 204 functions as a memory and a work area for the CPU 201. Note that the processes shown in the flowcharts, which are the features of this embodiment described later with reference to the drawings, are processes realized by the CPU 201 executing the corresponding programs.

[0018] The network I / F (interface) 205 is a hardware module for connecting to a mobile network 130 or Wi-Fi. When using a mobile router, it is also possible to connect using the USB I / F (not shown) of the smart glasses 101.

[0019] The operation unit 207 receives an input from the user via the frame 104 and transmits a signal corresponding to the input to each of the aforementioned processing units by the operation unit I / F 208. The detection I / F 209 receives signals from each of the sensors shown in 214 to 220 and signals due to switching of each of the switches 227 and 228, and transmits them to each of the aforementioned processing units. Each of the sensors shown in 214 to 220 is a GPS, a gyro sensor, an acceleration sensor, a proximity sensor, a blood pressure / heart rate measurement sensor, a skin sensor, and a human presence sensor, respectively, and at least any one of these is implemented. Also, each of the sensors shown in 227 and 228 is an ON / OFF switch and a temple opening / closing switch, respectively, and a plurality of ON / OFF switches may be implemented. Further, the smart glasses 101 may be implemented with a sensor for detecting biometric information for realizing fingerprint authentication, vein authentication, iris authentication, etc. The camera 210 has a photographing function, and the photographed image data is stored in the ROM 203. The laser 211 projects various contents onto the display 202, and in the case of a retinal projection method, projects the contents directly onto the retina. The storage device 212 is a storage medium and is a device for storing various data such as applications. It also includes a device for reading data from the storage medium and a device for deleting data. Depending on the terminal, there may be a case where there is no storage device 212 and only the ROM 203. The short-range communication I / F 213 is an interface used for communication with other wearable terminals, etc.

[0020] The audio I / F 222 transmits audio output to the earphone 223 and the speaker 224, which are audio functions. Also, the earphone 223 and the speaker 224 share one audio output port and output audio through either one according to the notification and application. During an audio call, the user receives audio through the earphone 223 or the speaker 224 and transmits audio through a microphone (not shown). At this time, the line used for the audio call is a network connected by the network I / F or a wired or wireless telephone line connected by a telephone line connection component (not shown). Also, the audio I / F 222 can transmit audio output to the earphone 223 via bone conduction (not shown). The vibration 225 and the LED lamp 226 respectively notify the user of notifications from applications on the smart glasses 101 through vibration and LED lamp blinking.

[0021] Figure 3 is a diagram showing an example of the module configuration of the software of the smart glasses 101.

[0022] The communication unit 301 receives notifications from an application server that communicates via a network using the network I / F 205. Also, the communication unit 301 transmits and receives information to and from a wearable terminal to be coordinated. The storage unit 302 exchanges information with the ROM 203, the RAM 204, and other processing units. Also, it stores image data captured by the camera 210 and the like.

[0023] The display unit 303 displays the results of various applications executed by the CPU 201, such as AR / MR display. For example, using AR technology, content is displayed (information projection) on the display 202 so that virtual content is superimposed on the real space. Note that the present invention can also adopt a method of directly projecting onto the retina. Here, in information projection, based on a technology such as SLAM (simultaneous localization and mapping), the position and orientation of oneself in the real space may be estimated. The estimation result is used for the display process of virtual content.

[0024] The operation unit 304 receives inputs from the user via the frame 104, accepts and controls operations for various applications and instructions for operations on the display on the display 202. The camera control unit 305 controls the activation, deactivation, and shooting of the camera 210, and stores the captured image data in the ROM 203 in cooperation with the storage unit 302. The mode control unit 306 controls the switching to a plurality of call / notification modes provided in the smart glasses 101, and switches the smart glasses 101 to the mode desired by the user. The call / notification modes include a normal mode, a manner mode, a silent mode, a drive mode, a custom mode, and an uninstalled mode which is a feature of this embodiment.

[0025] The manner mode is a mode that mainly transitions while the smart glasses 101 are being worn, and is a mode that uses functions such as the vibration function and the LED while restricting the sound output of the speaker. The silent mode is a mode that mainly transitions while the smart glasses 101 are being worn, and is a mode that restricts outputs by sound and vibration other than the display control on the display 202. The drive mode is a mode that is mainly transitioned when driving a vehicle or the like while the smart glasses 101 are being worn. The custom mode is a special mode customized by the user of the smart glasses 101. The normal mode is a mode that is being worn by the smart glasses 101 and is a mode other than those modes, and is a mode that uses the sound output with earphones (or bone conduction) and the display control on the display 202. It is also possible to arbitrarily enable the sound output of the speaker.

[0026] The uninstalled mode is a mode used when the user is not wearing the smart glasses 101. The detection unit 307 manages information such as changes in the status detected by the detection I / F 209 and the usage status, and holds it in the ROM 203. The pairing unit 308 controls the short-range communication I / F 213 to enable two-way data communication with an external network device via wireless communication.

[0027] The application management unit 309 manages the execution status of various applications, version information, notifications to each application received from the server, and which mode state among the aforementioned modes, etc., and manages them in the ROM 203 and the RAM 204 via the storage unit 302.

[0028] Also, the application management unit 309 controls various applications based on user input via the operation unit 304. Also, when displaying content on the display 202 during application control, the application management unit 309 displays the content on the display 202 via the display unit 303.

[0029] FIG. 4 shows a processing flow that is a feature of this patent when controlling an application mounted on the smart glass 101. The main body of the processing steps included in this flowchart is the application management unit 309.

[0030] When the application management unit 309 detects a change in the state of a switch or sensor associated with mode change from the detection unit 307 (S401), it checks whether the detection is a change in the state of a switch indicating that the template of the smart glass 101 has been closed (S402). In this embodiment, as the detection of the smart glass template being closed ("glass closed" state), it may be detected that the template is completely folded and closed. Or, even when the smart glass 101 is not worn by the user, the state where the template is folded at a predetermined angle or more may also be detected as the template being closed ("glass closed" state).

[0031] When the closing of the smart glass template (“glass closed” state) is detected, the process proceeds to S403. Otherwise, if it is a state change of other switches or sensors, the process proceeds to S411 to execute mode change based on the state of the detected switch or sensor (S411). At this time, the information on the state change is transmitted from the detection unit 307 to the application management unit 309. The application management unit 309 determines the mode based on the settings on the setting application related to mode selection on the smart glass 101 and the information on the transmitted state change of the switch or sensor, and changes the mode via the mode control unit 306.

[0032] At S403, it is determined whether an alarm notification is in progress in the application of the smart glass 101. If it is in progress, the alarm notification is stopped (S404). If the alarm notification is not in progress, it is further confirmed whether it is in the snooze state (S405). If it is in the snooze state, the snooze is stopped (S406).

[0033] After that, the process proceeds to S407 to confirm whether the screen is unlocked. If the screen is unlocked, the screen is locked (S408), and furthermore, the screen is turned off (S409). Also, if the screen is locked at S407, it is confirmed whether the screen is lit (S410). If the screen is lit, the screen is turned off at S409. After executing the series of alarm stop, snooze stop, screen lock, and screen turn-off associated with the detection of the template closing, a mode change is executed based on the state of the template closing (S411).

[0034] At S401, if the state change of the switch or sensor associated with the mode change is not detected, the process proceeds to S412 to confirm whether the change in mode selection is detected. This detection of the change in mode selection indicates that the user has made a mode selection via the operation unit 304 on the setting application related to the settings of the smart glass 101. When the user makes a mode selection with the operation unit 304, the selection operation on the application is transmitted to the application management unit 309, and the selected mode information is further transmitted from the application management unit 309 to the mode control unit 306 to switch the mode.

[0035] If the change of mode selection is not detected at S412, the process proceeds to S413 to confirm whether a call start is detected. If a call start is detected, the current mode is acquired (S414), and a call setting based on the acquired mode is acquired (S415). Then, a call is executed (S416) with the acquired call setting. Here, the call start in S413 above indicates that the user presses a call start button on the phone call application during a phone call incoming. And upon receiving the pressing of the call start button, the actual call start inside the smart glass 101 is the call execution in S416. Also, the information referred to for the setting acquisition in S415 is the information in the mode-specific common call setting table shown in FIG. 11.

[0036] The smart glass 101 uses the display 202, earphone 223, speaker 224, vibration 225, and LED lamp 226 described above in FIG. 2 to notify the user of information from each application by voice, vibration, blinking / lighting of the LED, and message display.

[0037] The mode-specific common call setting table in FIG. 11 prescribes, for each mode, the means for delivering voice to the user using the above notification means during a call. In the example shown in FIG. 11, for example, if the current mode acquired at S414 is the normal mode during wearing, the sound output by the earphone (or bone conduction) is valid, the sound output by the speaker is made invalid, and a call is made with the smart glass 101 at S416. At this time, it can be seen that the LED lamp, vibration function, etc. of the smart glass 101 are also invalid. In other examples, for example, if the current mode acquired at S414 is the non-wearing mode, the sound output by the earphone (or bone conduction) becomes invalid, the sound output by the speaker is valid, and a call is made with the smart glass 101 at S416. At this time, it can be seen that the LED lamp, vibration function, etc. of the smart glass 101 are also invalid.

[0038] Separately, an equivalent table is shown for notification means at the time of notification from each application other than during a call. However, FIG. 11 shows the means during a call and assumes only voice notifications. Therefore, when assuming a call, it is assumed that those which are shaded cells in FIG. 11 are basically OFF (basically not used as call settings). However, it may be predefined, such as turning on the LED lamp, to indicate to other people around the user that a call is in progress. Also, in the call in this embodiment, differences in call settings by applications such as "a call application using a telephone line" and "a call application such as a messenger application using a network line" are not assumed. Therefore, those call applications commonly execute calls according to the call settings in FIG. 11, but for each call application, call settings for each mode may be predefined.

[0039] If a call start is not detected in S413, the process proceeds to S417 to check whether there is a notification from an application on the smart glass 101. If there is an application notification, the current mode is acquired in the same manner as in S414 (S418), and a notification setting (S419) based on the acquired mode is obtained. Then, the notification is executed (S420) with the acquired notification setting.

[0040] The information referred to for setting acquisition in S419 is the table information shown in FIG. 12.

[0041] The common notification settings for each mode in FIG. 12(A) are settings for each mode common to the applications. The per-application notification settings in the normal mode shown in FIG. 12(B) and the per-application notification settings in the non-worn mode shown in FIG. 12(C) show examples of settings for each application in the normal mode and the non-worn mode, respectively. In the normal mode while being worn, functions such as the LED lamp and the vibration function are invalid. This can be said to be a setting intended to suppress the smart glass from shifting or the lighting of the LED lamp from causing poor visibility due to notifications.

[0042] When the setting to prioritize application settings is ON in the setting application on the smart glass 101, the per-application notification setting table shown in FIGS. 12(B) and 12(C) is referred to. When not prioritizing application settings, the common notification setting table shown in FIG. 12(A) is referred to.

[0043] Here, in the cells of FIGS. 12(B) and 12(C), the cells filled with gray color have settings different from the common settings in FIG. 12(A). Also, for notification settings that are not basically assumed to be used at the time of notification, the cells on the table are dot-painted and set to OFF, but they may be set to ON by default if used. For example, in FIG. 12(C), the message display is set to OFF, but this is because the message display on the lens 105 of the smart glass 101 is assumed to be viewed while the smart glass 101 is worn, so it is set to OFF when not worn. However, if the smart glass 101 has a function that reverses the projection message on the lens 105 when worn and allows the user to view the lens 105 from the outside when not worn as the message display on the lens 105, the message display may be set to ON.

[0044] Subsequently, using FIGS. 5 to 7, display examples by the setting application UI (user interface) on the display 202 of the smart glass 101 are shown. The settings in the setting application include the setting screen when the user sets the ON / OFF settings shown in FIGS. 11 and 12. This screen can also be used for setting operations by being provided via a network to a web browser or the like of another terminal.

[0045] FIG. 5 shows an example of the top screen when the setting application is launched and an example of the screen when an item on the top screen display is selected.

[0046] In the example of the top screen shown in FIG. 5(A), setting items for making various settings such as mode selection 501, call / notification 502, and screen 503 are listed on the setting screen 500. In addition, on the setting screen 500, various setting items in the smart glasses 101, such as Wi-Fi, Bluetooth, and battery, are also listed separately for each major category of items.

[0047] FIGS. 5(B) to (D) are the setting screens for each item that transitions when the items 501, 502, and 503 in FIG. 5(A) are selected, respectively.

[0048] FIG. 5(B) is the mode selection setting screen (510). The user can switch the mode by making a pull-down selection of the mode at 511 on the mode selection setting screen. There is also a check box 512 for enabling the hard switch to enable mode switching in association with the hard switch. After enabling the hard switch, at 513, it is possible to make a pull-down selection of which mode to associate with each switch (including sensors) mounted on the smart glasses 101. This hard switch is assumed to be the ON / OFF switch 227, the temple opening / closing switch 228, and the ON / OFF of other sensor states shown in FIG. 2. Depending on the states of multiple hard switches, there may be a conflict in the associated modes. Therefore, it is also possible to set the priority of which mode associated with which switch to prioritize in the event of a conflict at 513. At this time, those without a priority number in the priority order on 513 indicate that the corresponding hard switch is in an invalid state, and it is possible to enable it and set the priority by pressing the check box. Furthermore, when the hard switch is enabled, the mode based on the state of the switch set at 513 is prioritized over the mode selected by the user at 511.

[0049] Figure 5(C) is the call / notification setting screen (520). The call / notification setting screen 520 displays the common settings 521 for common application settings and the settings for each individual application other than that. The settings for each individual application include applications such as phone 522, mail 523, clock 524, etc., as well as the settings for each application installed on the smart glass 101, such as system sound, messenger, calendar, news app, etc.

[0050] Figure 5(D) is the screen setting screen (530). The screen setting screen 530 is for settings related to the screen display of the display 202 of the smart glass 101. For example, in the display setting 531, the brightness of the screen can be adjusted with a slide bar, or the time until the screen lock when the screen operation by the user has been absent for a predetermined time can be selectable with a pull-down menu. Also, in the display setting 531, check boxes for enabling the setting of "locking the screen when the frame 104 is closed" and "unlocking the screen when the frame 104 is opened" are also provided. The unlocking of the screen here indicates that an authentication screen for requesting user authentication for unlocking the screen is displayed. Also, in the screen setting screen 530, security setting 532 is also possible, and this can be set to ON / OFF with a check box for whether to enable the above-mentioned screen lock using fingerprint authentication or password use.

[0051] FIG. 6 is an example of a setting screen for common settings related to calls and notifications, which is transitioned to when 521 is selected in FIG. 5(C). The common setting screen 600 for calls and notifications has a slide bar for volume adjustment during calls and other than calls, and a selection pull-down for selecting sounds. There are also slide bars for adjusting vibration intensity and blinking speed, selection pull-downs for selecting vibration patterns, blinking patterns, and colors, and a selection pull-down for selecting message display patterns. Furthermore, the common setting screen 600 includes items for call means by mode 601 and notification means by mode 602. When these items 601 and 602 are selected, each mode item such as normal mode, manner mode, silent mode, drive mode, non-worn mode, custom mode, etc., which shows lower-level items, is displayed in a list. For example, when the normal mode 603 or non-worn mode 604, which are lower-level items under the item of notification means by mode 602, is selected, notification means such as "earphone / bone conduction", "speaker", "vibration", "LED lamp", "message display" are displayed for each mode. When the check boxes of these notification means are checked, it is set to notify by the notified means checked in the corresponding mode. Also, the settings made in the call means by mode 601 and notification means by mode 603 of this common setting screen 600 are reflected in the ON / OFF settings of FIGS. 11 and 12(A), respectively.

[0052] (A) to (C) of FIG. 7 are examples of setting screens for per-application settings related to notifications, which are transitioned to when 522, 523, and 524 are selected in FIG. 5(C), respectively.

[0053] FIG. 7(A) is an example of a settings screen related to notifications of a phone app. On the phone app notification settings screen 700, there is a checkbox for app priority (701). By checking this checkbox, when using this app, the settings on the phone app notification settings screen 700 in FIG. 7(A) will be given priority over the settings on the common settings screen 600 shown in FIG. 6 above. On the phone app notification settings screen 700, for the notification settings related to an incoming call 702 as a notification regarding the phone app, the same settings as those on the common settings screen 600 are possible. The per-mode notification means 703 in the incoming call 702 on the phone app notification settings screen 700 is for setting the notification means for each mode of the phone app individually. And this setting is reflected in, for example, the ON / OFF setting in the row of the application ID "NOTIFY-APP-001" in FIGS. 12(B) and 12(C).

[0054] FIG. 7(B) is an example of a settings screen related to notifications of a mail app. The mail app notification settings screen 710 also has a checkbox for app priority as in FIG. 7(A), and the same settings as those on the common settings screen 600 are possible. For the notifications on the mail app notification settings screen 710, there are setting items such as a new mail reception notification 711 and a mail sending notification 712. The settings for these items 711 and 712 are reflected in the ON / OFF settings in the rows of the application IDs "NOTIFY-APP-002" and "NOTIFY-APP-003" in FIGS. 12(B) and 12(C), respectively.

[0055] FIG. 7(C) is an example of a setting screen related to the notification of the clock application. Similar to FIG. 7(A), the clock application notification setting screen 720 also has a check box for app priority and can be set equivalently to the notification settings on the common setting screen 600. The notifications on the clock application notification setting screen 720 include setting items such as an alarm notification 721 and a timer notification 722. The settings in these items 721 and 722 are respectively reflected in the ON / OFF settings of the rows of the application IDs "NOTIFY-APP-007" and "NOTIFY-APP-008" in FIG. 12(B) and FIG. 12(C). In addition, the clock application notification setting screen 720 has a check box 723 for enabling the function of stopping the alarm notification when the frame 104 is opened in the state where the alarm notification continues while the frame 104 is closed. Furthermore, the clock application notification setting screen 720 has a check box 724 for enabling the function of stopping the snooze activation when the frame 104 is opened in the state where the snooze is activated while the frame 104 is closed.

[0056] According to the first embodiment described above, it is possible to selectively use functions used in notifications, calls, etc. based on the opening and closing and mode of the frame 104 of the smart glass 101.

[0057] <Second Embodiment> Another embodiment will be described with reference to FIG. 8. The process in FIG. 8 is an extension of the notification process based on the person detection function while the frame 104 of the smart glass 101 is closed.

[0058] FIG. 8 shows a flowchart for explaining the notification process of the glasses-type information device in the second embodiment.

[0059] In S801, the human sensor 220 mounted on the smart glass 101 detects whether a person has approached within a specific range of the smart glass 101. If it is detected that a person has approached within a specific range of the smart glass 101, then in S802, it is detected whether the temple of the smart glass 101 is in the closed state ("while the glasses are closed").

[0060] If the smart glasses 101 are closed at S802, the process further proceeds to S803 to check whether the user has any unread latest app notifications.

[0061] If the user has an unread latest app notification at S803, at S804, a message is reversely displayed on the lens 105 of the smart glasses 101. This reverse display of the message is such that when the laser 211 projects various contents onto the display 202, the display is reversed compared to when the user wears the smart glasses 101 during projection.

[0062] According to the above Embodiment 2, when the user approaches while the frame 104 of the smart glasses 101 is closed, it becomes possible to check the message of the new application notification without opening the frame 104.

[0063] <Embodiment 3> With reference to FIG. 9, another embodiment will be further described. The process in FIG. 9 is an extension of the notification process while the smart glasses 101 are closed and stored in a glasses case (not shown) for charging. When stored in the glasses case for charging, there is a concern that the user may not notice the notification as described in the other embodiments above.

[0064] FIG. 9 shows a flowchart for explaining the notification process of the glasses-type information device in Embodiment 3.

[0065] At S901, the smart glasses 101 detect whether there is an app notification in the same manner as S417 in Embodiment 1. Thereafter, S902 to S903 are also the same processes as S418 to S420 in Embodiment 1. After obtaining the notification setting at S903, it is checked whether the smart glasses 101 are closed (S904). If the smart glasses 101 are in the closed template state (“glasses closed”) at S904, it is further checked whether the smart glasses 101 are stored in a glasses case that can be stored and charged (S905).

[0066] At this time, it is assumed that the smart glasses 101 and the glass case can communicate via the proximity communication I / F 213. Further, it is assumed that the glass case is provided with alternative notification means (not shown) that substitutes for the display 202, speaker 224, vibration 225, and LED lamp 226 of the smart glasses 101. The alternative notification means provided in the glass case includes a display for displaying notification contents and the like, or a speaker for outputting sound.

[0067] In S905, when the smart glasses 101 are stored in the glass case and being charged, the process proceeds to S906, and notification control using the alternative notification means is instructed to the glass case (S906). The instruction may include at least a part of the notification content in addition to the information of the application as the notification source. By this instruction, alternative notification by the alternative notification means provided in the glass case is realized. Also, in S905, when the smart glasses 101 are not stored in the glass case, similar to S420 in the first embodiment, the notification from the application is transmitted to the user using the notification means mounted on the smart glasses 101 itself.

[0068] According to the above-described third embodiment, even when the smart glasses 101 are stored in the glass case and being charged, it is possible to substitute the notification by the glass case.

[0069] <Fourth Embodiment> As another embodiment, as a hard switch assumed to be associated with the unmounted mode, in addition to the temple opening / closing switch, it may be assumed to detect ON / OFF of the skin sensor.

[0070] FIG. 10 shows an example of a mode selection setting screen that enables associating the detection ON / OFF of the skin sensor with the unmounted mode.

[0071] The mode selection screen 1000 in FIG. 10 is equivalent to the mode selection setting screen 510 described in the first embodiment. And 1001 to 1003 on the mode selection screen 1000 are also screen items equivalent to 511 to 512 on the mode selection screen 510, respectively.

[0072] The skin sensor OFF 1004 on the mode selection screen 1004 is a hard switch item that is a feature of the fourth embodiment, and is a switch item assuming an association with the non-worn mode. The skin sensor shown here is the temple skin sensor 219. The temple skin sensor 219 installed inside the temple part of the frame 104 on the smart glass 101 detects whether a person's skin is touching the inside of the temple part. When a person's skin is not touching, the skin detection by the temple skin sensor 219 is in an undetected state, and this undetected state is the switch state of the skin sensor OFF 1004.

[0073] According to the above fourth embodiment, it is possible to detect the wearing state of the smart glass 101 by the user by a detection means different from the opening and closing of the smart glass 101, and it is possible to switch the notification means for each application based on this.

[0074] Also, there are users who remove the smart glass 101 with the frame 104 of the smart glass 101 open and leave it as it is. For example, it is assumed in cases such as during washing or while wiping the lens with a cloth. In such use cases, it is not sufficient to simply associate the temple opening and closing switch in the frame 104 of the smart glass 101 with the non-worn mode. Therefore, in this use case, it is effective to associate the detection ON / OFF of the skin sensor shown in the fourth embodiment with the non-worn mode, and the use case can be extended compared to the first embodiment.

[0075] (Other embodiments) The present invention also includes an apparatus, a system, or a method configured by appropriately combining the above-described embodiments.

[0076] Here, the present invention is an apparatus or a system that serves as a subject for executing one or more software (programs) that realize the functions of the above-described embodiments. Also, a method for realizing the above-described embodiments executed by the apparatus or the system is also one of the present inventions. Further, the program is supplied to the system or the apparatus via a network or various storage media, and the program is read out and executed in one or more memories by one or more computers (such as a CPU or an MPU) of the system or the apparatus. That is, as one of the present inventions, it further includes the program itself, or various storage media readable by a computer storing the program. Also, the present invention can be realized by a circuit (for example, an ASIC) that realizes the functions of the above-described embodiments.

Explanation of Signs

[0077] 101 Smart Glasses

Claims

1. A glasses-type information device that can be worn by a user, a first speaker function for transmitting sound to a user wearing the glasses-type information device; a second speaker function for transmitting sound to the surroundings of the glasses-type information device; A notification function including at least one of a vibration function and a function of turning on a lamp; and when the temples of the glasses-type information device are folded and the user is not wearing the glasses-type information device, the first speaker function is disabled for an application installed on the glasses-type information device, and output is performed using at least one of the second speaker function and the notification function. A glasses-type information device characterized by having a control means that, when the glasses-type information device is worn by the user, disables the second speaker function and the notification function for the application and performs output using the first speaker function.

2. The glasses-type information device according to claim 1, further comprising a setting means for setting the function to be used for the application from the second speaker function and the notification function when the temples of the glasses-type information device are folded and not worn by a user.

3. A glasses-type information device that can be worn by a user, a first speaker function for transmitting sound to a user wearing the glasses-type information device; a second speaker function for transmitting sound to the surroundings of the glasses-type information device; A notification function including at least one of a vibration function and a function to turn on a lamp; and a setting means for setting a function to be used for each of a plurality of applications installed in the glasses-type information device from the first speaker function, the second speaker function, and the notification function.

4. a first speaker function for transmitting sound to a user wearing the glasses-type information device; a second speaker function for transmitting sound to the surroundings of the glasses-type information device; and a notification function including at least one of a vibration function and a function of turning on a lamp, when the temples of the glasses-type information device are folded and the user is not wearing the glasses-type information device, the first speaker function is disabled for an application installed on the glasses-type information device, and output is performed using at least one of the second speaker function and the notification function; A method comprising a control step of disabling the second speaker function and the notification function for the application when the glasses-type information device is worn by the user, and performing output using the first speaker function.

5. a first speaker function for transmitting sound to a user wearing the glasses-type information device; a second speaker function for transmitting sound to the surroundings of the glasses-type information device; and a notification function including at least one of a vibration function and a function of turning on a lamp, A method comprising a setting step of setting a function to be used for each of a plurality of applications installed on the glasses-type information device from the first speaker function, the second speaker function, and the notification function.

6. a first speaker function for transmitting sound to a user wearing the glasses-type information device; a second speaker function for transmitting sound to the surroundings of the glasses-type information device; and a notification function including at least one of a vibration function and a function of turning on a lamp. when the temples of the glasses-type information device are folded and the user is not wearing the glasses-type information device, the first speaker function is disabled for an application installed on the glasses-type information device, and output is performed using at least one of the second speaker function and the notification function; A program characterized by functioning as a control means that, when the glasses-type information device is worn by the user, disables the second speaker function and the notification function for the application and performs output using the first speaker function.

7. a first speaker function for transmitting sound to a user wearing the glasses-type information device; a second speaker function for transmitting sound to the surroundings of the glasses-type information device; and a notification function including at least one of a vibration function and a function of turning on a lamp. A program characterized by functioning as a setting means for setting the functions to be used for each of a plurality of applications installed on the glasses-type information device from the first speaker function, the second speaker function, and the notification function.

Images