Information processing device, information processing system, and program

Abstract

To provide an information processing apparatus configured to allow a user to visually recognize information displayed on a virtual screen without wearing the apparatus as well as when wearing it, an information processing system, and a program.SOLUTION: A smart glass 10, as an information processing apparatus, includes lens sections 104L, 104R arranged in a line-of-sight direction of a user when wearing on the head of the user, and a processor. The processor selects a mode so as to superimpose a virtual screen to be displayed as a real space through the lens sections 104L, 104R when the apparatus is mounted on the head of the user, or a mode so as to display information displayed on the virtual screen on the lens sections 104L, 104R when the apparatus is not mounted on the head of the user.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing system, and a program. [Background technology]

[0002] 2. Description of the Related Art There are wearable terminal devices that can display and visually recognize a virtual screen superimposed on a real space. When such a wearable terminal device is in the form of glasses, it is sometimes called, for example, smart glasses.

[0003] Patent Document 1 describes a wearable terminal having a display function. A terminal attachment / detachment detection unit of this wearable terminal detects attachment / detachment of the terminal to the user's head. A user authentication unit authenticates the user who uses the terminal. A screen display control unit displays a screen of a processing device that operates in response to the user's operation of an operation device on the display surface, superimposed on the background. The screen display control unit displays a personal computer screen when attachment is detected and the user is authenticated. When removal of the terminal is detected, the screen display control unit performs an information amount reduction process that reduces the amount of information displayed on the display surface. Thereafter, when user authentication processing is performed after attachment of the terminal is detected, the screen display control unit performs an information amount restoration process that restores the amount of information that was reduced by the information amount reduction process.

[0004] Patent Document 2 describes an electronic device that can be connected to a wearable device that includes a display unit, a wearing sensor, and a posture sensor. The electronic device includes a display screen orientation control unit. The display screen orientation control unit controls the orientation of the screen of the display unit based on the posture of the wearable device detected by the posture sensor for a predetermined time from the time when the wearing sensor detects that the user is wearing the wearable device. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-34646 A [Patent Document 2] JP 2019-117505 A Summary of the Invention [Problem to be solved by the invention]

[0006] A user may want to obtain information on a virtual screen not only when the user is wearing a wearable terminal device, but also when the user is not wearing the wearable terminal device. In other words, it is desirable for the user to be able to visually recognize the display content of the virtual screen even when the user is not wearing the wearable terminal device. An object of the present invention is to provide an information processing device or the like that allows the user to view the display contents of a virtual screen not only when the device is being worn, but also when the device is not being worn. [Means for solving the problem]

[0007] The invention described in claim 1 is an information processing device comprising a translucent member arranged in the user's line of sight when worn on the user's head, and a processor, wherein when the device is worn on the user's head, the processor passes the translucent member through a first region of the translucent member that displays a virtual screen superimposed on real space, and the virtual screen is displayed superimposed on real space, and when the device is not worn on the user's head, the processor switches the display content of the virtual screen to be displayed in a second region of the translucent member that is used to display the display content of the virtual screen. The invention described in claim 2 is the information processing device described in claim 1, characterized in that the device is a glasses-type wearable terminal device having two lenses as the translucent member, and the display content is displayed on at least one of the lenses. The invention described in claim 3 is the information processing device described in claim 2, characterized in that when the display content is displayed on the light-transmissive member, a density of the display content is changed for the virtual screen. The invention described in claim 4 is the information processing device described in claim 1, characterized in that the device is a glasses-type wearable terminal device having lenses as the translucent member and temples that are placed on the user's ears, and the processor detects whether the device is worn on the user's head based on whether the user is wearing the glasses-type wearable terminal device. The invention described in claim 5 is the information processing device described in claim 4, characterized in that the processor detects whether or not the user is wearing the glasses-type wearable terminal device based on whether or not the user is touching the device. The invention described in claim 6 is the information processing device described in claim 4, characterized in that the processor detects whether or not the user is wearing the glasses-type wearable terminal device based on whether or not the temples are folded. The invention described in claim 7 is an information processing device comprising two lenses as translucent members arranged in the user's line of sight when worn on the user's head, and a processor, wherein when the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device is not worn on the user's head, the processor switches to displaying the display content of the virtual screen on the translucent member, and uses one of the two lenses to display the virtual screen superimposed on real space through the translucent member, and uses the other lens to display the display content. The invention described in claim 8 is an information processing device comprising two lenses as translucent members arranged in the user's line of sight when worn on the user's head, and a processor, wherein when the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device is not worn on the user's head, the processor switches to displaying the display content of the virtual screen on the translucent member, and displays the display content on each of the two lenses in a front-to-back or upside-down relationship. The invention described in claim 9 is the information processing device described in claim 7 or 8, characterized in that when the display content is displayed on the translucent member, the density of the display content is changed for the virtual screen. The invention described in claim 10 is an information processing device comprising two lenses as translucent members arranged in the user's line of sight when worn on the user's head, and a processor, wherein when the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device is not worn on the user's head, the processor switches to displaying the display content of the virtual screen on the translucent member, and at least one of the two lenses has a first area for displaying the virtual screen superimposed on real space, and a second area used to display the display content on the translucent member. The invention described in claim 11 is the information processing device described in claim 10, characterized in that the first area and the second area are arranged so as to be separated into upper and lower areas within the lens when the device is worn. The invention described in claim 12 is the information processing device described in claim 10, characterized in that the first area is arranged at a location that is on the outside relative to the second area when worn by a user. The invention described in claim 13 is A glasses-type wearable terminal device comprising a lens as a translucent member arranged in the user's line of sight when worn on the user's head, temples that are placed on the user's ears, and a processor, wherein the processor detects whether the user is wearing the glasses-type wearable terminal device based on whether the temples are folded, and detects whether the device itself is being worn on the user's head based on whether the user is wearing the glasses-type wearable terminal device, and when the device itself is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device itself is not worn on the user's head, the processor switches so that the display content of the virtual screen is displayed on the lens facing the opposite side to the side where the temples are folded. The invention described in claim 14 is The information processing system includes a translucent member that is arranged in the user's line of sight when worn on the user's head, a detection unit that detects whether the device is worn by the user, and a processor, and when the device is worn on the user's head, the processor passes the translucent member through a first region of the translucent member that displays a virtual screen superimposed on real space, and displays the virtual screen superimposed on real space, and when the device is not worn on the user's head, the processor switches the translucent member to a second region used for displaying the display content of the virtual screen so that the display content of the virtual screen is displayed in the second region of the translucent member. The invention described in claim 15 is This program enables a computer to realize an acquisition function that acquires a detection result indicating whether or not the device is being worn by a user, and a switching function that, based on the detection result, when the device is worn on the user's head, passes the translucent member through a first region of the translucent member that is arranged in the user's line of sight when worn on the user's head and displays a virtual screen superimposed on real space, and when the device is not worn on the user's head, switches to displaying the display contents of the virtual screen in a second region of the translucent member that is used to display the display contents of the virtual screen. Effect of the Invention

[0008] According to the invention of claim 1, it is possible to provide an information processing device that allows the user to view the display content on the virtual screen not only when the device is worn, but also when the user is not wearing the device. According to the invention of claim 2, the display mode can be selected by using two lenses. According to the invention of claim 3, the user can easily view the display contents. According to the invention of claim 4, it becomes easier to detect whether the device itself is worn or not. According to the invention of claim 5, it is possible to detect that the device has been separated from the user when the device is not worn. According to the invention of claim 6, it is possible to detect a user's action performed on the glasses-type own device when the user is not wearing the own device. According to the invention of claim 7, an information processing device can be provided that allows the display content of a virtual screen to be viewed not only when the device is worn but also when the device is not worn, and the display mode can be differentiated by using two lenses, thereby simplifying the structure of the device itself. According to the invention of claim 8, an information processing device can be provided that allows the display content of a virtual screen to be viewed not only when the device is worn but also when the device is not worn. The two lenses can be used to select different display modes, making it easier to read the display content regardless of the orientation of the device. According to the invention of claim 9, the user can easily view the display contents. According to the invention of claim 10, an information processing device can be provided that allows the display content of a virtual screen to be viewed not only when the device is worn but also when the device is not worn, and two lenses can be used to change display modes, and the display mode can be switched within a single lens. According to the invention of claim 11, different display contents can be displayed on the two lenses, respectively. According to the invention of claim 12, the first area can be disposed at a position suitable for displaying the virtual screen. According to the invention of claim 13, It is possible to provide an information processing device that allows the user to view the display content of a virtual screen not only when the device is being worn but also when the device is not being worn, making it easier to detect whether the device is being worn or not, and making it possible to detect the user's actions toward the glasses-type device when the device is not being worn, making it easier for the user to view the display content. According to the invention of claim 14, It is possible to provide an information processing system that allows the user to view the display contents on a virtual screen not only when the device is worn, but also when the device is not worn. According to the invention of claim 15, The computer can realize a function that allows the user to view the display contents on the virtual screen not only when the device is being worn, but also when the device is not being worn. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing a configuration of smart glasses to which the present embodiment is applied. [Diagram 2] 13 is a flowchart illustrating the operation of smart glasses. [Diagram 3]FIG. 1 is a diagram showing the optical system of smart glasses that display the screen of display example 1. [Figure 4] 13(a) and 13(b) are diagrams showing a first display example. [Diagram 5] FIG. 13 is a diagram showing the optical system of smart glasses that display the screen of display example 2. [Figure 6] 13(a) and 13(b) are diagrams showing a second display example. [Figure 7] 13(a) and 13(b) are diagrams showing a display example 3. [Figure 8] 13(a) and 13(b) are diagrams showing a display example 4. [Figure 9] 13(a) and 13(b) are diagrams showing display example 5. [Figure 10] 13(a) to 13(d) are diagrams showing the state when a user places the smart glasses. [Figure 11] 1 is a diagram showing an information processing system to which the present embodiment is applied; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] <10 Smart Glasses Configurations> Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a diagram showing the configuration of smart glasses 10 to which this embodiment is applied. The smart glasses 10 are an example of an information processing device, and are a so-called glasses-type wearable terminal device. Here, "wearable" means that the user can wear it. Thus, a glasses-type wearable terminal device is a computer device that has the shape of glasses and can actually be worn by a user. Since the smart glasses 10 are glasses-type, they include a lens unit 104, a bridge 105, and temples 106. Note that "lens" is the name of a component of the lens unit 104 in a glasses-type wearable terminal device, and includes those that are not spherical. The smart glasses 10 display a virtual screen superimposed on real space. That is, the user can view the virtual screen through the smart glasses 10 and can also view the real space through the lens unit 104 of the smart glasses 10.

[0011] The display content of the virtual screen may include, for example, exercise data such as the number of steps taken, calories burned, and distance traveled, health data such as the user's heart rate and blood pressure, notification data such as incoming emails and messages, and guidance data such as maps and guides of the surrounding area. Although the smart glasses 10 are shown here as a so-called glasses-type device, the shape and format are not particularly limited as long as the device is worn on the user's head and displays a virtual screen to the user. The smart glasses 10 may also be so-called AR glasses that have a function of recognizing the surrounding environment. In this case, the AR glasses recognize walls, floors, and the like in the real space using a camera or sensor. Then, the virtual screen is displayed for the user by superimposing it on the real space, and AR is displayed. Here, "AR" stands for "Augmented Reality." The "virtual screen" refers to the display of an image that is created by a computer and does not exist in the real space, and the "real space" refers to a space that actually exists.

[0012] FIG. 2 is a flowchart illustrating the operation of the smart glasses 10. First, the user turns on the power of the smart glasses 10 (step 101). This starts up each mechanical part of the smart glasses 10. Next, the smart glasses 10 determine whether there is information to be displayed on the smart glasses 10 (step 102). For example, the smart glasses 10 determines whether there is information by polling a cloud server or a device such as a smartphone that acquires information. The smart glasses 10 may also determine whether there is information based on the presence or absence of a push notification from these devices. As a result, if there is no information to be displayed (No in step 102 ), the process returns to step 102 .

[0013] On the other hand, if there is information to be displayed (Yes in step 102), the smart glasses 10 acquire the information (step 103). Then, the smart glasses 10 determine whether or not the user is wearing the device (step 104). As a result, if the user is wearing the smart glasses 10 (Yes in step 104), the smart glasses 10 display a virtual screen to the user (step 105). This allows the user wearing the smart glasses 10 to view the virtual screen displayed on the smart glasses 10. On the other hand, if the user is not wearing the smart glasses 10 (No in step 104), the smart glasses 10 display the display content of the virtual screen on the lens unit 104 (step 106). This allows the user who is not wearing the smart glasses 10 to visually recognize the display content of the virtual screen displayed on the lens unit 104 of the smart glasses 10.

[0014] In the smart glasses 10 of this embodiment, when the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the lens unit 104, and when the device is not worn on the user's head, the lens unit 104 is switched to display the display contents of the virtual screen. This configuration will be described in detail below.

[0015] <Display example> A description will be given of a display example in which a virtual screen is displayed to the user in step 105 in FIG. 2, and in which the display content of the virtual screen is displayed on the lens unit 104 in step 106 in FIG.

[0016] <Display example 1> FIG. 3 is a diagram showing the optical system of the smart glasses 10 that display the screen of the display example 1. Note that Fig. 3 illustrates the smart glasses 10 as viewed from the III direction in Fig. 1. In Fig. 3, when a user wears the smart glasses 10, the reference numerals of the components on the left side are marked with "L" and the reference numerals of the components on the right side are marked with "R." There are various types of smart glasses 10 that realize the display of a virtual screen, such as a virtual image projection type and a retinal projection type, and any type may be used. The smart glasses 10 have, for example, the following configuration. The smart glasses 10 are of the retinal projection type.

[0017] The smart glasses 10 include a laser light source 101L, an optical fiber 102L, a mirror 103L, lens units 104L and 104R, a bridge 105, temples 106L and 106R, a communication module 107, and a glasses mode module 108.

[0018] The laser light source 101L is a light source for creating a virtual screen. The laser light source 101L uses three laser colors, red, green, and blue, and can create a full-color virtual screen by switching between them at high speed.

[0019] The optical fiber 102L is provided inside the temple 106L, and guides the laser light La emitted from the laser light source 101 to the mirror 103L. The optical fiber 102L may be made of either glass or plastic.

[0020] The mirror 103L reflects the laser light La at an angle that is nearly perpendicular to the traveling direction of the laser light La, and guides it to the lens unit 104L. This mirror 103L can swing up, down, left, and right, which changes the angle at which the laser light enters the lens unit 104L. This also changes the position at which the laser light reaches the user's retina ML up, down, left, and right. As a result, the user can view a two-dimensional image as a virtual screen.

[0021] The lens units 104L and 104R are an example of two lenses, and are also an example of a light-transmitting member disposed in the line of sight of the user when worn on the user's head. Here, the "light-transmitting member" is a member that transmits visible light. The light-transmitting member does not need to transmit all visible light. That is, the light-transmitting member may have a function as a so-called filter that transmits some wavelengths in the visible light range. The lens units 104L and 104R have a light guide unit 114L and a reflecting unit 124L inside. The light guide units 114L respectively guide the laser light La, the angle of which has been changed by the mirror 103L, toward the bridge 105 by totally reflecting the laser light La. The reflecting unit 124L reflects the laser light La guided by the light guide unit 114L in a direction substantially perpendicular to change the traveling direction of the laser light La toward the retina ML of the user's left eye. In addition, since the lens portions 104L and 104R are made of a light-transmitting material, the user can view the real space through the lens portions 104L and 104R. This allows the user to view the virtual screen superimposed on the real space. In addition, since the smart glasses 10 are glasses-type, the term "lens unit" is used here for convenience, but the lens unit does not need to have an actual lens function. In other words, the lens units 104L and 104R do not need to have an optical function of refracting light.

[0022] Further, the lens unit 104R includes a display unit 134R. The display unit 134R is a transmissive display, and when no display is being performed, the user can see through the display unit 134R. In other words, when the display unit 134R is not performing a display, the user can see the real space through the lens unit 104R. There are various types of transmissive displays, such as a transmissive organic EL (Electroluminescence) display, a transmissive inorganic EL display, and a transmissive liquid crystal display, but the transmissive display is not limited to these. In the case of a transmissive organic EL display or a transmissive inorganic EL display, the display content is displayed by a light-emitting element arranged in the display unit 134R.

[0023] The bridge 105 is a component that supports the smart glasses 10 by resting on the user's nose and attaches the smart glasses 10 to the user's head. The temples 106L and 106R are members that support the smart glasses 10 by hanging them on the user's ears and attach the smart glasses 10 to the user's head.

[0024] The communication module 107 is a communication interface for communicating with the outside. Glass mode module 108 controls the operation of laser light source 101L and mirror 103L when displaying a virtual screen. Also, when displaying the contents of the virtual screen on display unit 134R, it controls display unit 134R. Glass mode module 108 can be realized by using a CPU, internal memory, and external memory, and running control software that controls laser light source 101L, mirror 103L, and display unit 134R using these. Here, the CPU is an example of a processor.

[0025] When the user wears the smart glasses 10, the laser light La is emitted from the above-mentioned laser light source 101L, and a virtual screen is displayed to the user. At this time, no display is performed on 134R. On the other hand, when the user is not wearing the smart glasses 10, the display content of the virtual screen is displayed on the display unit 134R. At this time, the laser light La is not emitted from the laser light source 101L, and the virtual screen is not displayed. In the smart glasses 10, the display content of a virtual screen is displayed on one of the lens units 104L and 104R. Here, one of the two lens units 104L and 104R, the lens unit 104L, is used to display a virtual screen superimposed on real space through the lens unit 104L. The other lens unit 104R is used to display the display content of the virtual screen.

[0026] 4(a) and (b) are diagrams showing display example 1. FIG. 4(a) shows the state of the field of view when the user is wearing the smart glasses 10. Also, FIG. 4(b) shows the screen displayed on the lens unit 104R when the user is not wearing the smart glasses 10. When the user wears the smart glasses 10, as shown in FIG. 4(a), the user can view the real space S through the lens units 104L and 104R. Furthermore, a virtual screen is displayed superimposed on the real space S. Here, a state in which messages Me1 and Me2 are displayed as the virtual screen is shown. In this case, of the two lens units 104L and 104R, the lens unit 104L is a first region R1 that displays the virtual screen superimposed on the real space S, and the lens unit 104R can be considered as a second region R2 used to display the display contents of the virtual screen.

[0027] When the user is not wearing the smart glasses 10, as shown in FIG. 4(b), the same display content as the virtual screen is displayed on the lens unit 104R. In reality, the display unit 134R of the lens unit 104R displays this screen. Here, the state in which messages Me1 and Me2 are displayed on the lens unit 104R is shown, similar to FIG. 4(a). However, the messages Me1 and Me2 displayed in Fig. 4(b) may have a different density than the messages Me1 and Me2 on the virtual screen displayed in Fig. 4(a). The density is, for example, made darker than the messages Me1 and Me2 on the virtual screen. In this way, when the virtual screen is displayed as in Fig. 4(a), the density of the messages Me1 and Me2 is made lighter so that the messages Me1 and Me2 do not interfere with the user's viewing of the real space S. This can also be said to increase the transparency of the messages Me1 and Me2, allowing the real space S to be viewed through the messages Me1 and Me2. 4(b), when the contents of the virtual screen are displayed on the lens unit 104R, the user does not need to view the real space S, so the density of the messages Me1 and Me2 is increased to improve the visibility of the messages Me1 and Me2. This can also be said to be the same as lowering the transparency of the messages Me1 and Me2 to make them easier to view.

[0028] Also, the messages Me1 and Me2 displayed in Fig. 4(b) may be enlarged relative to the messages Me1 and Me2 on the virtual screen displayed in Fig. 4(a). As a result, when the virtual screen is displayed as in Fig. 4(a), the messages Me1 and Me2 are displayed small so that the messages Me1 and Me2 do not interfere with the user's viewing of the real space S. On the other hand, when the contents of the virtual screen are displayed on the lens unit 104R as in Fig. 4(b), the user does not need to view the real space S, so the messages Me1 and Me2 are displayed large to improve the visibility of the messages Me1 and Me2. Furthermore, even when the same display content as that of the virtual screen is displayed on lens unit 104R, the layout may be changed, etc. Specifically, the shape and aspect ratio of the message, the relative sizes of characters and icons in the message, etc. may be different between the virtual screen and what is displayed on lens unit 104.

[0029] <Display example 2> 5 is a diagram showing the optical system of the smart glasses 10 displaying the screen of display example 2. Note that display examples 3 and subsequent display examples described below have the same optical system as FIG. Compared to the optical system shown in Fig. 3, the optical system of the smart glasses 10 shown in Fig. 5 uses both the left and right lens units 104L and 104R to display a virtual screen. Also, it is possible to display the same display content as the content of the virtual screen using both the display units 134L and 134R. Therefore, the laser light source, which is the light source, is divided into two systems, one on the left and one on the right, consisting of laser light sources 101L and 101R. Similarly, the optical fibers, mirrors, and display units are divided into two systems, one on the left and one on the right, consisting of optical fibers 102L and 102R, mirrors 103L and 103R, and display units 134L and 134R, respectively. As a result, the laser light La reaches the retinas ML and MR of both eyes of the user. In addition, both display units 134L and 134R display the same content as that of the virtual screen. The functions of each of these are the same as those described in FIG. 3.

[0030] 6(a) and (b) are diagrams showing the second display example. Fig. 6(a) shows the state of the field of view when the user is wearing the smart glasses 10. Also, Fig. 6(b) shows the screen displayed on the lens units 104L and 104R when the user is not wearing the smart glasses 10.

[0031] When the user wears the smart glasses 10, as shown in FIG. 6(a), the user can view the real space S through the lens units 104L and 104R. Furthermore, a virtual screen is displayed superimposed on the real space S. Here, messages Me1 and Me2 are displayed on the virtual screen. This is the same as in FIG. 4(a).

[0032] When the user is not wearing the smart glasses 10, the same display content as the virtual screen content is displayed on the lens units 104L and 104R as shown in Fig. 6(b). In reality, the display unit 134R of the lens unit 104L and the display unit 134R of the lens unit 104R display this screen. However, here, message Me1 is displayed on lens portion 104L, and message Me2 is displayed on lens portion 104R. That is, the left and right lens portions 104L, 104R are used differently to display the messages Me1 and Me2, which are different display contents.

[0033] Moreover, the two lens parts 104L and 104R have a first region R1 for displaying a virtual screen superimposed on the real space S, and a second region R2 for displaying the display contents of the virtual screen on the lens parts 104L and 104R. That is, the first region R1 is an area where the display parts 134L and 134R are not provided and where the user is allowed to view the virtual screen. The second region R2 is provided with the display parts 134L and 134R and displays the display contents of the virtual screen. Since it is difficult to manufacture the lens parts 104L and 104R by providing the first region R1 and the second region R2 so as to overlap each other, it is preferable to provide these regions separately on the lens parts 104L and 104R.

[0034] In the case of Fig. 6, the first region R1 and the second region R2 are arranged so as to be divided into upper and lower regions within the lens units 104L and 104R when the device is attached. In this case, the first region R1 and the second region R2 are arranged so as to be divided into three regions, from the top to the bottom, in the order of the first region R1 → the second region R2 → the first region R1, when the device is attached. Note that the number of divisions is not limited to this, and for example, it may be divided into two, one of which is the first region R1 and the other is the second region R2.

[0035] <Display example 3> 7(a) and (b) are diagrams showing display example 3. In FIG. Fig. 7(a) shows the state of the field of view when the user is wearing the smart glasses 10. Also, Fig. 7(b) shows the screen displayed on the lens units 104L and 104R when the user is not wearing the smart glasses 10.

[0036] The case of FIG. 7(a) in which the user is wearing the smart glasses 10 is similar to FIG. 6(a). When the user is not wearing the smart glasses 10, as shown in Fig. 7(b), the same display content as the content of the virtual screen is displayed on the lens units 104L and 104R. Here, similar to Fig. 6(b), messages Me1 and Me2 are displayed on both the lens units 104L and 104R, and the two lens units 104L and 104R have a first region R1 and a second region R2. 7(b), the first region R1 is disposed at a position that is on the outside of the second region R2 when worn by the user. In this case, the first region R1 and the second region R2 are provided in two parts, from the bridge 105 toward the temples 106L and 106R, so that the second region R2 is separated from the first region R1. By placing the first region R1 on the temples 106L and 106R side, which are on the outside, with respect to the second region R2, the laser light La can be irradiated to the first region R1 without passing through the second region R2.

[0037] <Display example 4> 8(a) and (b) are diagrams showing display example 4. In FIG. Fig. 8(a) shows the state of the field of view when the user is wearing the smart glasses 10. Fig. 8(b) shows the screen displayed on the lens units 104L and 104R when the user is not wearing the smart glasses 10.

[0038] The case of FIG. 8(a) in which the user is wearing the smart glasses 10 is similar to FIG. 6(a). When the user is not wearing the smart glasses 10, the same display content as the content of the virtual screen is displayed on the lenses 104L and 104R as shown in Fig. 8(b). Here, messages Me1 and Me2 are displayed on both the lenses 104L and 104R. However, here, messages Me1 and Me2 are displayed on two lens portions 104L and 104R, respectively, with the messages Me1 and Me2 displayed in a front-back relationship. As a result, no matter which of the two surfaces of lens portion 104L and 104R a user looks from, the messages Me1 and Me2 are displayed in the correct orientation on one side of lens portion 104L and 104R, and are not displayed upside down. As a result, the user can view messages Me1 and Me2 in the correct orientation.

[0039] <Display example 5> 9(a) and (b) are diagrams showing display example 5. FIG. Fig. 9(a) shows the state of the field of view when the user is wearing the smart glasses 10. Also, Fig. 9(b) shows the screen displayed on the lens units 104L and 104R when the user is not wearing the smart glasses 10.

[0040] The case of FIG. 9(a) in which the user is wearing the smart glasses 10 is similar to FIG. 6(a). When the user is not wearing the smart glasses 10, the same display content as the content of the virtual screen is displayed on the lenses 104L and 104R as shown in Fig. 9(b). Here, messages Me1 and Me2 are displayed on both the lenses 104L and 104R. However, here, messages Me1 and Me2 are displayed upside down on two lens portions 104L and 104R, respectively.

[0041] 10(a) to (d) are diagrams showing a state when a user places the smart glasses 10. In this case, the smart glasses 10 are viewed from the X direction in FIG. When the user places the smart glasses 10, there are two possible orientations: as shown in FIG. 10(a), the smart glasses 10 are placed in the orientation in which the device is worn; and as shown in FIG. 10(b), the smart glasses 10 are placed upside down with respect to the state in which the device is worn. In either orientation, the messages Me1 and Me2 are displayed in the correct orientation on one of the two lens units 104L and 104R, and are not displayed upside down. This allows the user to view the messages Me1 and Me2 in the correct orientation. Furthermore, when the user places the smart glasses 10, the temples 106L and 106R may be folded as shown in Fig. 10(c) to (d). In this case, if the display content is displayed on the lens parts 104L and 104R facing the side where the temples 106L and 106R are folded as shown in Fig. 10(d), the user has difficulty viewing the display content from the side where the temples 106L and 106R are folded. Therefore, it is preferable to display the display content on the lens parts 104L and 104R facing the side opposite to the side where the temples 106L and 106R are folded.

[0042] <Explanation of the judgment on wearing the own device> Next, a method for the glasses mode module 108 to determine whether or not the user is wearing the smart glasses 10, which are the device itself, in step 104 of FIG. 2 will be described. In this case, the glasses mode module 108 detects whether the device is worn on the user's head based on whether the user is wearing the smart glasses 10. Specifically, the glasses mode module 108 performs the detection in the following manner.

[0043] (Movement detection) The glasses mode module 108 detects whether the user is wearing the smart glasses 10 based on whether the device itself is moving. If the device itself is moving, the glasses mode module 108 determines that the user is wearing the smart glasses 10. On the other hand, if the device itself is not moving, the glasses mode module 108 determines that the user is not wearing the smart glasses 10. In practice, for example, an acceleration sensor is provided in the smart glasses 10, and it is possible to determine whether the device itself is moving or not based on the detection result of this acceleration sensor. That is, if the acceleration sensor detects acceleration, the glasses mode module 108 determines that the device itself is moving. On the other hand, if the acceleration sensor does not detect acceleration and the acceleration is 0 for a certain period of time, the glasses mode module 108 determines that the device itself is not moving.

[0044] (Contact detection) The glasses mode module 108 detects whether the user is wearing the smart glasses 10 based on whether the user is touching the device. If the user is touching the device, the glasses mode module 108 determines that the user is wearing the smart glasses 10. On the other hand, if the user is not touching the device, the glasses mode module 108 determines that the user is not wearing the smart glasses 10. In practice, for example, a contact sensor is provided in the smart glasses 10, and it is possible to determine whether or not the user is touching the device based on the detection result of this contact sensor. For example, a capacitance sensor can be used as the contact sensor. The capacitance sensor is a sensor that detects a change in dielectric constant caused by the user's approach as a change in capacitance. For example, a temperature sensor can be used as the contact sensor. The temperature sensor detects temperature, and when this temperature is close to the user's body temperature, it can be determined that the user is touching the device, and when the difference between the temperature and the user's body temperature is large, it can be determined that the user is not touching the device.

[0045] (Temple position detection) The glasses mode module 108 detects whether the user is wearing the smart glasses 10 based on whether the temples 106L, 106R are folded. If the temples 106L, 106R are not folded, the glasses mode module 108 determines that the user is wearing the smart glasses 10. On the other hand, if the temples 106L, 106R are folded, the glasses mode module 108 determines that the user is not wearing the smart glasses 10. In practice, the smart glasses 10 may be provided with a switch that turns ON / OFF depending on whether the temples 106L, 106R are folded or not, and whether the user is wearing the smart glasses 10 can be detected by the ON / OFF state of this switch.

[0046] The acceleration sensor, contact sensor, and switch described above function as a detection unit that detects whether or not the device itself is being worn by a user.

[0047] According to the smart glasses 10 described above, a wearable terminal device can be provided that allows the user to view the display content of a virtual screen not only when the smart glasses 10 are worn, but also when the user is not wearing the glasses.

[0048] It should be noted that, although the smart glasses 10 described above create and display a virtual screen by themselves, the present invention is not limited to this. FIG. 11 is a diagram showing an information processing system 1 to which this embodiment is applied. The illustrated information processing system 1 includes smart glasses 10 and a terminal device 20. The terminal device 20 is, for example, a computer device such as a mobile phone, a smartphone, a tablet, etc. The terminal device 20 creates a virtual screen to be displayed on the smart glasses 10 by running various software under the management of an OS (Operating System).

[0049] The terminal device 20 includes a CPU (Central Processing Unit) which is a computing means, a main memory which is a storage means, and a storage such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). Here, the CPU executes various software such as an OS (operating system) and application software. The main memory is a storage area for storing various software and data used for executing the software, and the storage is a storage area for storing input data for the various software and output data from the various software. Furthermore, the terminal device 20 is equipped with a communication interface (hereinafter referred to as "communication I / F") for communicating with the outside, a display device consisting of a video memory, a display, etc., and input devices such as a keyboard, a mouse, and a touch panel.

[0050] In the information processing system 1 of the present embodiment, the smart glasses 10 and the terminal device 20 are paired. The pairing is performed, for example, by a wireless connection such as Bluetooth (registered trademark). However, this is not limited to this, and the connection may be made via a wireless LAN (Local Area Network), the Internet, or the like. Furthermore, the connection is not limited to a wireless connection, and the connection may be made via a wired connection such as DVI (Digital Visual Interface), HDMI (registered trademark) (High-Definition Multimedia Interface), DisplayPort, USB (Universal Serial Bus), IEEE1394, RS-232C, or the like.

[0051] In this embodiment, a virtual screen to be displayed on the smart glasses 10 is created by the terminal device 20 and transmitted to the smart glasses 10 by a communication means such as Bluetooth. Then, the smart glasses 10 display the virtual screen created by the terminal device 20. In addition, depending on whether the smart glasses 10 detect that their own device is being worn, the smart glasses 10 may control whether to display the virtual screen using the laser light sources 101L, 101R or to display the display content on the display units 134L, 134R.

[0052] <Program Description> The processes performed by the smart glasses 10 in this embodiment described above are performed by a program such as control software, for example.

[0053] Therefore, the program that realizes the processing performed by the smart glasses 10 in this embodiment can be understood as a program for realizing in a computer an acquisition function for acquiring a detection result indicating whether or not the device is worn by a user, and a switching function for switching, based on the detection result, so that when the device is worn on the user's head, a virtual screen is displayed superimposed on the real space S through the lens units 104L, 104R that are arranged in the user's line of sight when worn on the user's head, and when the device is not worn on the user's head, so that the display content of the virtual screen is displayed on the lens units 104L, 104R.

[0054] The program for implementing the present embodiment can be provided not only by communication means but also by being stored in a recording medium such as a CD-ROM.

[0055] Although the present embodiment has been described above, the technical scope of the present invention is not limited to the scope described in the above embodiment. It is clear from the claims that various modifications and improvements to the above embodiment are also included in the technical scope of the present invention. [Explanation of symbols]

[0056] 1...information processing system, 10...smart glasses, 101L, 101R...laser light source, 102L, 102R...optical fiber, 103L, 103R...mirror, 104, 104L, 104R...lens unit, 106L, 106R...temple, 108...glass mode module, 134L, 134R...display unit, R1...first region, R2...second region, S...real space

Claims

1. a light-transmitting member disposed in the line of sight of a user when the headset is worn on the user's head; A processor; Equipped with The processor, An information processing device that, when the device is worn on the user's head, passes the virtual screen through a first region of the translucent member, which displays the virtual screen superimposed on real space, and when the device is not worn on the user's head, switches to displaying the display contents of the virtual screen in a second region of the translucent member, which is used to display the display contents of the virtual screen.

2. The information processing device according to claim 1, wherein the device is a glasses-type wearable terminal device having two lenses as the light-transmitting member, and the display content is displayed on at least one of the lenses.

3. 3. The information processing apparatus according to claim 2, wherein when the display content is displayed on the light-transmitting member, a density of the display content is changed for the virtual screen.

4. the device is a glasses-type wearable terminal device having lenses as the light-transmitting member and temples that are placed on the ears of a user, The information processing device according to claim 1 , wherein the processor detects whether the device is attached to the user's head based on whether the user is wearing the glasses-type wearable terminal device.

5. The information processing device according to claim 4 , wherein the processor detects whether the user is wearing the glasses-type wearable terminal device based on whether the user is touching the device.

6. The information processing device according to claim 4 , wherein the processor detects whether the user is wearing the eyeglass-type wearable terminal device based on whether the temples are folded.

7. Two lenses as light-transmitting members arranged in the line of sight of a user when the headset is worn on the user's head; A processor; Equipped with The processor, When the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device is not worn on the user's head, the display content of the virtual screen is switched to be displayed on the translucent member; An information processing device in which one of the two lenses is used to display the virtual screen superimposed on real space through the translucent member, and the other lens is used to display the display content.

8. Two lenses as light-transmitting members arranged in the line of sight of a user when the headset is worn on the user's head; A processor; Equipped with The processor, When the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device is not worn on the user's head, the display content of the virtual screen is switched to be displayed on the translucent member; An information processing device that displays the display contents on each of the two lenses in a front-back or upside-down relationship.

9. 9. The information processing apparatus according to claim 7, wherein when the display content is displayed on the light-transmitting member, a density of the display content is changed on the virtual screen.

10. Two lenses as light-transmitting members arranged in the line of sight of a user when the headset is worn on the user's head; A processor; Equipped with The processor, When the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device is not worn on the user's head, the display content of the virtual screen is switched to be displayed on the translucent member; An information processing device, wherein at least one of the two lenses has a first area for displaying the virtual screen superimposed on real space, and a second area used to display the display content on the translucent member.

11. 11. The information processing device according to claim 10, wherein the first area and the second area are arranged so as to be separated into upper and lower areas within the lens when the device is attached.

12. The information processing device according to claim 10 , wherein the first area is disposed on an outer side of the second area when worn by a user.

13. a lens as a light-transmitting member disposed in the line of sight of the user when the headset is worn on the user's head; Temples that are placed on the user's ears, A processor; A glasses-type wearable terminal device comprising: The processor, Detecting whether or not a user is wearing the glasses-type wearable terminal device based on whether or not the temples are folded; Detecting whether the glasses-type wearable terminal device is worn on the user's head based on whether the user is wearing the glasses-type wearable terminal device; When the device is worn on the user's head, a virtual screen is displayed superimposed on real space through the translucent member, and when the device is not worn on the user's head, the information processing device switches so that the display content of the virtual screen is displayed on the lens facing opposite the side on which the temples are folded.

14. a light-transmitting member disposed in the line of sight of a user when the headset is worn on the user's head; a detection unit that detects whether the device is worn by a user; A processor; Equipped with The processor, An information processing system which, when the device is worn on the user's head, passes a virtual screen through a first region of the translucent member, which displays the virtual screen superimposed on real space, and when the device is not worn on the user's head, switches so that the display contents of the virtual screen are displayed in a second region of the translucent member, which is used to display the display contents of the virtual screen.

15. On the computer, An acquisition function for acquiring a detection result indicating whether the device is worn by a user; a switching function that, based on the detection result, when the device is worn on the user's head, passes the translucent member through a first region of the translucent member that is disposed in the line of sight of the user when worn on the user's head, and displays the virtual screen superimposed on real space, and when the device is not worn on the user's head, switches the display content of the virtual screen to a second region of the translucent member that is used to display the display content of the virtual screen; and A program to achieve this.

Images