Information processing apparatus, and program

Abstract

To provide an information processing device capable of reducing the burden on a user viewing a stereoscopic image, a program, and an information processing method.SOLUTION: An information processing device comprises: a data acquisition unit which acquires measurement data measured by a sensor mounted on a spectacle-type device; a first focal distance determination unit which determines a first focal distance, which is the focal distance of the user's eyes when the user wearing the spectacle-type device is viewing a target object on the basis of the measurement data acquired by the data acquisition unit; a second focal distance determination unit which determines a second focal distance, which is the focal distance of the user' eyes when viewing content displayed on a display unit mounted on the spectacle-type device using the first focal distance; and a display position determination unit which determines a display position of the content displayed in a first display region of the display unit corresponding to the user's right eye and a display position of the content displayed in a second display region of the display unit corresponding to the user's left eye on the basis of the second focal distance.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a program, and an information processing method.

Background Art

[0002] Patent Document 1 describes a program, a system, and a method for the purpose of reducing the burden on a user who views a stereoscopic video. [Prior Art Document] [Patent Document] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2018-190380

Summary of the Invention

Means for Solving the Problems

[0003] According to an embodiment of the present invention, an information processing apparatus is provided. The information processing apparatus may include a data acquisition unit that acquires measurement data measured by a sensor mounted on the glasses-type device. The information processing apparatus may include a first focal length determination unit that determines a first focal length, which is the focal length of the user's eye when the user wearing the glasses-type device views a visual recognition target, based on the measurement data acquired by the data acquisition unit. The information processing apparatus may include a second focal length determination unit that determines a second focal length, which is the focal length of the user's eye when the user views content displayed on a display unit mounted on the glasses-type device, using the first focal length. The information processing apparatus may include a display position determination unit that determines a display position of the content displayed in a first display area of the display unit corresponding to the user's right eye and a display position of the content displayed in a second display area of the display unit corresponding to the user's left eye based on the second focal length.

[0004] In the information processing apparatus, the second focal length determination unit may determine the second focal length so that a distance difference between the first focal length and the second focal length is smaller than a predetermined distance difference threshold.

[0005] In any one of the information processing apparatuses, the second focal length determination unit may determine the second focal length such that the first focal length and the second focal length are the same focal length.

[0006] In any one of the information processing apparatuses, when the first focal length changes, the first focal length determination unit may further determine the changed first focal length, and the information processing apparatus may further include a continuity determination unit that determines whether the changed first focal length continues for a predetermined continuous period. When the continuity determination unit determines that the changed first focal length continues for the continuous period, the second focal length determination unit may further determine a second focal length corresponding to the changed first focal length using the changed first focal length, and the display position determination unit may change the display position of the content displayed in the first display area and the display position of the content displayed in the second display area based on the second focal length corresponding to the changed first focal length.

[0007] In any one of the information processing apparatuses, when the first focal length changes, the first focal length determination unit may further determine the changed first focal length, the second focal length determination unit may determine a second focal length corresponding to the changed first focal length using the changed first focal length, the display position determination unit may change the display position of the content displayed in the first display area and the display position of the content displayed in the second display area based on the second focal length corresponding to the changed first focal length, and the information processing apparatus may further include a display control unit that controls the display of the content by the glasses-type device such that the content displayed in the first display area and the content displayed in the second display area move from the display position before the change to the display position after the change at a predetermined moving speed.

[0008] Any of the information processing apparatuses may further include a moving speed setting unit that sets the moving speed based on the frequency of change of the first focal length, and the display control unit causes the content displayed in the first display area and the content displayed in the second display area to move from the display position before the change to the display position after the change at the moving speed set by the moving speed setting unit, and may control the display of the content by the glasses-type device.

[0009] Any of the information processing apparatuses may further include a moving speed setting unit that sets the moving speed based on the distance difference between the second focal length corresponding to the first focal length before the change and the second focal length corresponding to the first focal length after the change, and the display control unit causes the content displayed in the first display area and the content displayed in the second display area to move from the display position before the change to the display position after the change at the moving speed set by the moving speed setting unit, and may control the display of the content by the glasses-type device.

[0010] Any of the information processing apparatuses may further include a visual recognition target specifying unit that specifies the visual recognition target based on the imaging data obtained by the camera mounted on the glasses-type device and included in the measurement data acquired by the data acquisition unit, and the display position determination unit further based on the imaging data, determines the display position of the content displayed in the first display area and the display position of the content displayed in the second display area so that the content displayed in the first display area and the content displayed in the second display area are not displayed superimposed on the visual recognition target specified by the visual recognition target specifying unit.

[0011] Any of the information processing apparatuses may further include a learning data storage unit that stores learning data including imaging data captured by a camera mounted on the glasses-type device and visual recognition target data indicating a visual recognition target of a user wearing the glasses-type device at the timing when the imaging data was captured, and a model generation unit that generates, by machine learning, an estimation model for estimating a visual recognition target of a user wearing the glasses-type device from the imaging data captured by the camera mounted on the glasses-type device, using the plurality of pieces of learning data stored in the learning data storage unit as teacher data. The visual recognition target specifying unit may specify the visual recognition target by estimating the visual recognition target from the imaging data using the estimation model.

[0012] Any of the information processing apparatuses may further include a visual recognition determination unit that determines whether or not the user is visually recognizing the content displayed in the first display area and the content displayed in the second display area, based on the second focal length and the gaze data measured by a gaze sensor mounted on the glasses-type device and included in the measurement data acquired by the data acquisition unit, when the content displayed in the first display area and the content displayed in the second display area are located on the gaze of the user indicated by the gaze data. When the visual recognition determination unit determines that the user is not visually recognizing the content displayed in the first display area and the content displayed in the second display area, the display position determination unit may change the display position of the content displayed in the first display area and the display position of the content displayed in the second display area so that the content displayed in the first display area and the content displayed in the second display area are not located on the gaze of the user.

[0013] According to an embodiment of the present invention, there is provided a program for causing a computer to function as any of the information processing apparatuses when executed by the computer.

[0014] According to an embodiment of the present invention, an information processing method executed by a computer is provided. The information processing method may include a data acquisition step of acquiring measurement data measured by a sensor mounted on a glasses-type device. The information processing method may include a first focal length determination step of determining a first focal length, which is the focal length of the user's eye when the user wearing the glasses-type device is viewing a viewing target, based on the measurement data acquired in the data acquisition step. The information processing method may include a second focal length determination step of determining a second focal length, which is the focal length of the user's eye when the user views the content displayed on the display unit mounted on the glasses-type device, using the first focal length. The information processing method may include a display position determination step of determining a display position of the content displayed in a first display area of the display unit corresponding to the user's right eye and a display position of the content displayed in a second display area of the display unit corresponding to the user's left eye based on the second focal length.

[0015] Note that the above summary of the invention does not list all the necessary features of the present invention. Also, sub-combinations of these feature groups may also be inventions.

Brief Description of the Drawings

[0016]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0017] An AR (Augmented Reality) glass can display information corresponding to an object being viewed by a user, such as CG (Computer Graphics) content, or information unrelated to the object being viewed by the user, such as a mail notification. For example, when the focal length of the user's eyes when viewing an object is 10 m and the focal length of the user's eyes when viewing CG content displayed on the AR glass is 1 m, in a case where the focal length of the user's eyes when viewing the object is different from the focal length of the user's eyes when viewing the CG content, when the user alternately views the object and the CG content, the user must change the focal length of the user's eyes according to whether the user is viewing the object or the CG content. Also, the CG content does not necessarily have to be displayed at a display position on the AR glass corresponding to a position close to the object, and it is considered that the optimal display position of the CG content varies according to the user's point of fixation. The system according to the present embodiment employs, for example, a mechanism that calculates the focal length of the user's eyes when the user views an object and determines a display position for displaying the CG content on the AR glass according to the calculated focal length of the user's eyes. Thereby, the burden on the user associated with the movement of the user's point of fixation and the switching of the focus can be reduced.

[0018] Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution means of the invention.

[0019] FIG. 1 schematically shows an example of the system 10. The system 10 may include a glasses-type device 100 and an information processing apparatus 200.

[0020] The glasses-type device 100 may be any device as long as it is a glasses-type device having a wireless communication function and a display function for displaying content on a display unit. The glasses-type device 100 is, for example, AR glasses.

[0021] The content may be in any data format. For example, the content may be text. For example, the content may be an illustration. For example, the content may be a still image. Also, for example, the content may be a video. For example, the content may be 3D CG data. The content may include these in a composite manner.

[0022] The glasses-type device 100 may be a device capable of giving the user 102 wearing the glasses-type device 100 a feeling that the content is arranged in the real space by displaying the content on a transparent or translucent glass. That is, the glasses-type device 100 may be a so-called transmissive (see-through type) device. Incidentally, the glasses-type device 100 may be a video pass-through type device. In this case, the glasses-type device 100 may display a captured image of a range corresponding to the visual field of the user 102 on a non-transmissive display and superimpose the content.

[0023] The glasses-type device 100 measures various data using, for example, sensors mounted on the glasses-type device 100. The glasses-type device 100 may transmit the measurement data measured by the sensors mounted on the glasses-type device 100 to the information processing device 200 via the network 20. The glasses-type device 100 may, for example, transmit the measurement data to the information processing device 200 periodically.

[0024] The network 20 may include the cloud. The network 20 may include a mobile communication network. The mobile communication network may conform to any of the communication methods such as 3G (3rd Generation) communication method, LTE (Long Term Evolution) communication method, 5G (5th Generation) communication method, and 6G (6th Generation) communication method and later. The network 20 may conform to short-range wireless communication methods such as Wi-Fi (registered trademark) communication method, Bluetooth (registered trademark) communication method, and Zigbee (registered trademark) communication method. The network 20 may include wired.

[0025] The glasses-type device 100 transmits, for example, the terminal ID of the glasses-type device 100 to the information processing device 200 together with measurement data. The glasses-type device 100 may transmit the user ID of the user 102 of the glasses-type device 100 to the information processing device 200 together with the measurement data.

[0026] The information processing device 200 executes various processes. For example, the information processing device 200 executes a display position determination process for determining the display position of the content displayed on the display unit of the glasses-type device 100. For example, the information processing device 200 determines the focal length of the eye of the user 102 and determines the display position of the content displayed on the display unit of the glasses-type device 100 based on the determined focal length of the eye of the user 102. For example, the information processing device 200 determines the focal length of the eye of the user 102 based on the measurement data received from the glasses-type device 100 via the network 20.

[0027] The focal length of the eye of the user 102 may be the distance from the user 102 to the focus of the eye of the user 102. The focal length of the eye of the user 102 may be the distance from the user 102 to the visual target that the user 102 is viewing. The distance from the glasses-type device 100 to the visual target that the user 102 is viewing may be regarded as the focal length of the eye of the user 102.

[0028] For example, the information processing device 200 executes a display control process for controlling the display of the content by the glasses-type device 100. For example, the information processing device 200 controls the display of the content by the glasses-type device 100 so that the content displayed on the display unit of the glasses-type device 100 is displayed at the display position determined in the display position determination process.

[0029] For example, the information processing device 200 controls the display of the content by the glasses-type device 100 by transmitting control information to the glasses-type device 100 via the network 20. The glasses-type device 100 may display the content on the display unit based on the control information received from the information processing device 200 via the network 20.

[0030] Furthermore, various processes executed by the information processing apparatus 200 may be executed by the glasses-type device 100. The glasses-type device 100 may be equipped with the information processing apparatus 200, and the glasses-type device 100 and the information processing apparatus 200 may be integrated.

[0031] FIG. 2 schematically shows an example of the configuration of the glasses-type device 100. The glasses-type device 100 may include a frame 110 having a rim 112, a bridge 114, and temples 118.

[0032] The glasses-type device 100 includes, for example, a sensor 120. FIG. 2 illustrates an example in the case where the glasses-type device 100 includes one sensor 120. The glasses-type device 100 may include a plurality of sensors 120.

[0033] The sensor 120 is, for example, a camera. When the glasses-type device 100 includes a plurality of sensors 120, the sensor 120 may be a stereo camera. The sensor 120 may be a so-called depth camera having a distance measurement function in addition to an imaging function. The sensor 120 may be a distance measurement sensor.

[0034] The sensor 120 measures, for example, data related to the field of view of the user 102 wearing the glasses-type device 100. For example, when the glasses-type device 100 includes one sensor 120, one sensor 120 measures data related to the field of view corresponding to both eyes of the user 102. For example, when the glasses-type device 100 includes two sensors 120, one sensor 120 measures data related to the field of view corresponding to the right eye of the user 102, and the other sensor 120 measures data related to the field of view corresponding to the left eye of the user 102.

[0035] The measurement data measured by the sensor 120 includes, for example, imaging data. The measurement data measured by the sensor 120 may include distance measurement data indicating the distance from the glasses-type device 100 to the object.

[0036] The measurement range of the sensor 120 corresponds to, for example, the field of view of the user 102 wearing the glasses-type device 100. The measurement range of the sensor 120 may be wider than the field of view of the user 102, or may be substantially the same as the field of view of the user 102.

[0037] The arrangement of the sensor 120 in FIG. 2 is an example. The sensor 120 may be arranged at other positions of the frame 110. For example, the sensor 120 is arranged at an arbitrary position inside the frame 110. The sensor 120 may be arranged at an arbitrary position outside the frame 110.

[0038] The glasses-type device 100 includes, for example, a sensor 122. FIG. 2 illustrates an example in the case where the glasses-type device 100 includes one sensor 122. The glasses-type device 100 may include a plurality of sensors 122.

[0039] The sensor 122 is, for example, a line-of-sight sensor. The line-of-sight sensor includes, for example, a camera. The camera is, for example, a visible light camera. The camera may be an infrared camera. The line-of-sight sensor may include an infrared light source such as an infrared LED (Light Emitting Diode).

[0040] The sensor 122 measures, for example, data related to the eyes of the user 102 wearing the glasses-type device 100. For example, when the glasses-type device 100 includes one sensor 122, one sensor 122 measures data related to both eyes of the user 102. For example, when the glasses-type device 100 includes two sensors 122, one sensor 122 measures data related to the right eye of the user 102, and the other sensor 122 measures data related to the left eye of the user 102.

[0041] The measurement data measured by the sensor 122 includes, for example, line-of-sight data indicating the line of sight of the user 102. The line of sight of the user 102 may be the orientation of the user 102's eyes. The line of sight of the user 102 may be a line connecting the center of the user 102's eyes and the object of view of the user 102. The measurement data measured by the sensor 122 may include angle data indicating the angle of the user 102's eyes.

[0042] The arrangement of the sensor 122 in FIG. 2 is an example. The sensor 122 may be arranged at other positions of the frame 110. For example, the sensor 122 may be arranged at any position inside the frame 110. The sensor 122 may be arranged at any position outside the frame 110.

[0043] The glasses-type device 100 includes, for example, a control device 150. The control device 150 controls various functions of the glasses-type device 100.

[0044] The control device 150 controls, for example, the input reception function of the glasses-type device 100. The glasses-type device 100 may receive various inputs from the user 102 according to the control by the control device 150.

[0045] The glasses-type device 100 receives various inputs from the user 102 through, for example, an operation unit arranged at any position of the glasses-type device 100. The glasses-type device 100 receives various inputs from the user 102 through, for example, an input unit such as a button arranged at any position of the frame 110. The glasses-type device 100 may receive various inputs from the user 102 by receiving input information from a communication terminal such as a smartphone, a tablet terminal, or a PC via the network 20.

[0046] The control device 150 controls, for example, the communication function of the glasses-type device 100. The glasses-type device 100 may communicate according to the control by the control device 150.

[0047] The glasses-type device 100 communicates with, for example, the information processing device 200. The glasses-type device 100 may communicate with any other communication terminal.

[0048] The control device 150 controls, for example, the display function of the glasses-type device 100. The glasses-type device 100 may display content on the display unit according to the control by the control device 150.

[0049] The display unit may be a transparent or translucent display. In this case, the glasses-type device 100 may be a transparent or translucent display-type device. Also, the control device 150 may control the projection function of the glasses-type device 100 that projects a display onto the display unit. In this case, the glasses-type device 100 may be a projection-type device. The projection function of the glasses-type device 100 may be an example of the display function of the glasses-type device 100.

[0050] FIG. 2 illustrates an example case where the glasses-type device 100 includes two lenses, a lens 115 corresponding to the right eye of the user 102 and a lens 117 corresponding to the left eye of the user 102. The lenses 115 and 117 may be an example of the display unit of the glasses-type device 100. The glasses-type device 100 may include one lens corresponding to both eyes of the user 102. The lens corresponding to both eyes of the user 102 may be an example of the display unit of the glasses-type device 100.

[0051] The control device 150 may include a battery (not shown). The control device 150 and the battery may be separately arranged at another position of the frame 110.

[0052] The arrangement of the control device 150 in FIG. 2 is an example. The control device 150 may be arranged at other positions of the frame 110. The control device 150 is arranged, for example, at an arbitrary position inside the frame 110. For example, the control device 150 is arranged in the temple 118. As a specific example, the control device 150 may be arranged at the tip of the temple 118, that is, in a modern manner. The control device 150 may be arranged at an arbitrary position outside the frame 110.

[0053] FIG. 3 is an explanatory diagram for explaining an example of determining the display position of the content displayed on the display unit of the glasses-type device 100 by the information processing apparatus 200. Here, it is assumed that the user 102 wearing the glasses-type device 100 is viewing the display 300.

[0054] First, an example of determining the display position of the content displayed on the display unit of the glasses-type device 100 by the information processing apparatus 200, illustrated in the upper part of FIG. 3, will be described. Here, it is assumed that the contents 125 and 127 with the text "Analysis Results" are the contents related to the display 300, and the contents 135 and 137 which are icons for notifying the reception of new mails are the contents not related to the display 300.

[0055] The information processing apparatus 200 receives, for example, the measurement data measured by the sensors mounted on the glasses-type device 100 from the glasses-type device 100 via the network 20. The information processing apparatus 200 receives, for example, the measurement data measured by at least one of the sensors 120 and 122.

[0056] The information processing apparatus 200 determines, for example, a first focal length which is the focal length of the eyes of the user 102 when the user 102 wearing the glasses-type device 100 is viewing the viewing target, based on the measurement data received from the glasses-type device 100. Here, it is assumed that the information processing apparatus 200 has determined the first focal length when the user 102 is viewing the display 300, and the description will continue. The specific method for determining the first focal length based on the measurement data measured by the sensors mounted on the glasses-type device 100 will be described later.

[0057] The information processing device 200 determines, for example, a second focal length, which is the focal length of the user 102's eyes when the user 102 visually recognizes the content displayed on the display unit mounted on the glasses-type device 100, using the first focal length. The information processing device 200 determines, for example, the second focal length such that the distance difference between the first focal length and the second focal length is smaller than a predetermined distance difference threshold. The information processing device 200 determines, for example, the second focal length such that the first focal length and the second focal length become the same focal length. Here, the description will continue on the assumption that the information processing device 200 has determined the second focal length when the user 102 visually recognizes the content 125 displayed on the lens 115 and the content 127 displayed on the lens 117.

[0058] The information processing device 200 determines, for example, based on the second focal length, the display position of the content displayed within the first display area of the display unit corresponding to the right eye of the user 102 and the display position of the content displayed within the second display area of the display unit corresponding to the left eye of the user 102. Here, the description will continue on the assumption that the information processing device 200 has determined the display position of the content 125 displayed on the lens 115 and the display position of the content 127 displayed on the lens 117 based on the second focal length.

[0059] The information processing device 200 determines, for example, the display position of the content 125 such that the content 125 is displayed in the central portion of the lens 115, and determines the display position of the content 127 such that the content 127 is displayed in the central portion of the lens 117. The area where the lens 115 can display content may be an example of the first display area, and the area where the lens 117 can display content may be an example of the second display area. Also, when the glasses-type device 100 includes one lens corresponding to both eyes of the user 102, the area where the lens can display content corresponding to the right eye of the user 102 may be an example of the first display area, and the area where the lens can display content corresponding to the left eye of the user 102 may be an example of the second display area.

[0060] For the content 125 and content 127 which are the content related to the display 300, the information processing apparatus 200 determines the second focal length using the first focal length, and determines the display position based on the determined second focal length. On the other hand, for the content 135 and content 137 which are the content not related to the display 300, the information processing apparatus 200 does not determine the display position. The information processing apparatus 200 may also determine the display position for the content 135 and content 137 in the same manner as the content 125 and content 127.

[0061] The information processing apparatus 200 transmits control information to the glasses-type device 100 via the network 20 so that, for example, the content 125 and content 127 are displayed on the display unit of the glasses-type device 100 at the determined display positions. The control apparatus 150 may control the display function of the glasses-type device 100 based on the control information received from the information processing apparatus 200.

[0062] Next, an example of the information processing apparatus 200 determining the display position of the content displayed on the display unit of the glasses-type device 100, which is illustrated in the middle section of FIG. 3, will be described. Here, the differences from the example of the information processing apparatus 200 determining the display position of the content displayed on the display unit of the glasses-type device 100, which is illustrated in the upper section of FIG. 3, will be mainly described. It is assumed that the first focal length in the example illustrated in the middle section of FIG. 3 is longer than the first focal length in the example illustrated in the upper section of FIG. 3.

[0063] In an example illustrated in the middle section of FIG. 3, since the first focal length is longer than the first focal length in an example illustrated in the upper section of FIG. 3, the second focal length in an example illustrated in the middle section of FIG. 3 is longer than the second focal length in an example illustrated in the upper section of FIG. 3. Based on the second focal length that is longer than the second focal length in an example illustrated in the upper section of FIG. 3, the information processing apparatus 200 determines the display position of the content 125 displayed on the lens 115 and the display position of the content 127 displayed on the lens 117. In this case, the information processing apparatus 200 determines the display position of the content 125 and the display position of the content 127 such that, for example, the display positions of the content 125 and the content 127 are located closer to the temple side than the display positions of the content 125 and the content 127 in an example illustrated in the upper section of FIG. 3.

[0064] Next, an example of the information processing apparatus 200 determining the display position of the content displayed on the display unit of the glasses-type device 100, which is illustrated in the lower section of FIG. 3, will be described. Here, the differences from an example of the information processing apparatus 200 determining the display position of the content displayed on the display unit of the glasses-type device 100, which is illustrated in the upper section of FIG. 3, will be mainly described. It is assumed that the first focal length in an example illustrated in the lower section of FIG. 3 is shorter than the first focal length in an example illustrated in the upper section of FIG. 3.

[0065] In an example illustrated in the lower part of FIG. 3, since the first focal length is shorter than the first focal length in an example illustrated in the upper part of FIG. 3, the second focal length in an example illustrated in the lower part of FIG. 3 is shorter than the second focal length in an example illustrated in the upper part of FIG. 3. The information processing apparatus 200 determines the display position of the content 125 displayed on the lens 115 and the display position of the content 127 displayed on the lens 117 based on a second focal length shorter than the second focal length in an example illustrated in the upper part of FIG. 3. In this case, the information processing apparatus 200 determines the display position of the content 125 and the display position of the content 127 such that, for example, the display positions of the content 125 and the content 127 are located closer to the bridge side than the display positions of the content 125 and the content 127 in an example illustrated in the upper part of FIG. 3.

[0066] When a user of the glasses-type device views the content displayed on the display unit of the glasses-type device, if the distance difference between the focal length of the user's eye when the user views the content and the focal length of the user's eye when the user views something other than the content is large, the user needs to adjust the focus of the eye each time the user views the content, so the burden on the user when viewing the content increases. In particular, when the user's viewing target frequently switches between the content and something other than the content, such as when the user checks the content displayed on the display unit of the glasses-type device while looking through materials displayed on a display or the like, if the distance difference is large, the burden on the user when viewing the content significantly increases. Therefore, it is desirable to improve the user experience of the user of the glasses-type device by reducing the burden on the user when the user of the glasses-type device views the content.

[0067] On the other hand, according to the system 10 according to the present embodiment, the information processing apparatus 200 determines a first focal length, determines a second focal length using the determined first focal length, and determines a display position of content displayed in the first display area and a display position of content displayed in the second display area based on the second focal length. By determining the display position of the content based on the second focal length determined using the first focal length, the information processing apparatus 200 can appropriately determine the display position of the content so that the distance difference between the focal length of the user 102's eyes when the user 102 wearing the glasses-type device 100 views the content and the focal length of the user 102's eyes when the user 102 views something other than the content becomes smaller. Thereby, the information processing apparatus 200 can reduce the burden on the user when the user of the glasses-type device views the content, and as a result, can improve the user experience of the user of the glasses-type device.

[0068] FIG. 4 is an explanatory diagram for explaining another example of determining the display position of the content displayed on the display unit of the glasses-type device 100 by the information processing apparatus 200. Here, mainly, the points different from an example of determining the display position of the content displayed on the display unit of the glasses-type device 100 by the information processing apparatus 200 illustrated in FIG. 3 will be described. It is assumed that the user 102 wearing the glasses-type device 100 is viewing the display 300.

[0069] First, an example of determining the display position of the content displayed on the display unit of the glasses-type device 100 by the information processing apparatus 200 illustrated in the upper part of FIG. 4 will be described. It is assumed that the display 300 is located in front of the user 102.

[0070] The information processing device 200 determines the positional relationship between the user 102 and the object of the user 102's visual recognition based on the line of sight of the user 102 indicated by the line-of-sight data measured by the line-of-sight sensor mounted on the glasses-type device 100, which is included in the measurement data received from the glasses-type device 100, for example. Here, the description will continue on the assumption that the information processing device 200 has determined that the display 300 is positioned in front of the user 102 based on the line of sight of the user 102.

[0071] The information processing device 200 determines, for example, in addition to the second focal length, the display position of the content displayed in the first display area and the display position of the content displayed in the second display area based further on the positional relationship between the user 102 and the object of the user 102's visual recognition. The information processing device 200 determines, for example, the display position of the content displayed in the first display area and the display position of the content displayed in the second display area such that the amount of change in the line of sight of the user 102 is reduced. Here, the description will continue on the assumption that the information processing device 200 has determined the display position of the content 125 so that the content 125 is displayed in the central portion of the lens 115 and has determined the display position of the content 127 so that the content 127 is displayed in the central portion of the lens 117.

[0072] Next, an example of the information processing device 200 determining the display position of the content displayed on the display unit of the glasses-type device 100, which is illustrated in the middle section of FIG. 4, will be described. Here, the points that are mainly different from an example of the information processing device 200 determining the display position of the content displayed on the display unit of the glasses-type device 100, which is illustrated in the upper section of FIG. 4, will be described. It is assumed that the display 300 is positioned on the right side of the front of the user 102.

[0073] The information processing device 200 determines the positional relationship between the user 102 and the object of the user 102's visual recognition based on the line of sight of the user 102, for example. Here, the description will continue on the assumption that the information processing device 200 has determined that the display 300 is positioned on the right side of the front of the user 102 based on the line of sight of the user 102.

[0074] The information processing apparatus 200 determines, for example, in addition to the second focal length, the display position of the content displayed in the first display area and the display position of the content displayed in the second display area, further based on the positional relationship between the user 102 and the object to be visually recognized by the user 102. Here, the description will continue assuming that the information processing apparatus 200 has determined the display position of the content 125 to be located closer to the temple side than the display position of the content 125 in an example illustrated in the upper part of FIG. 4, and the display position of the content 127 to be located closer to the bridge side than the display position of the content 127 in an example illustrated in the upper part of FIG. 4.

[0075] Next, an example of determining the display position of the content displayed by the information processing apparatus 200 on the display unit of the glasses-type device 100, which is illustrated in the lower part of FIG. 4, will be described. Here, the description will mainly focus on the differences from an example of determining the display position of the content displayed by the information processing apparatus 200 on the display unit of the glasses-type device 100, which is illustrated in the upper part of FIG. 4. It is assumed that the display 300 is located on the left side of the front of the user 102.

[0076] The information processing apparatus 200 determines, for example, the positional relationship between the user 102 and the object to be visually recognized by the user 102 based on the line of sight of the user 102. Here, the description will continue assuming that the information processing apparatus 200 has determined, based on the line of sight of the user 102, that the display 300 is located on the left side of the front of the user 102.

[0077] The information processing device 200 determines, for example, in addition to the second focal length, the display positions of the content displayed in the first display area and the content displayed in the second display area, based further on the positional relationship between the user 102 and the object to be visually recognized by the user 102. Here, the description will continue assuming that the information processing device 200 has determined the display positions of the content 125 and the content 127 such that the display position of the content 125 is closer to the bridge side than the display position of the content 125 in an example illustrated in the upper part of FIG. 4, and the display position of the content 127 is closer to the temple side than the display position of the content 127 in an example illustrated in the upper part of FIG. 4.

[0078] In an example illustrated in FIG. 4, the information processing device 200 determines the display position of the content displayed on the display unit of the glasses-type device 100 based on the second focal length and the line-of-sight data. By determining the display position of the content based on the second focal length and the line-of-sight data, the information processing device 200 can more appropriately determine the display position of the content so as to reduce the distance difference between the focal length of the user 102's eyes when the user 102 visually recognizes the content and the focal length of the user 102's eyes when the user 102 visually recognizes something other than the content, and to reduce the amount of change in the line of sight of the user 102 when the user 102 visually recognizes the content. As a result, the information processing device 200 can further reduce the burden on the user of the glasses-type device when the user visually recognizes the content, and thus can further improve the user experience of the user of the glasses-type device.

[0079] FIG. 5 is an explanatory diagram for explaining another example of determining the display position of the content displayed on the display unit of the glasses-type device 100 by the information processing apparatus 200. Here, mainly described are the differences from an example of determining the display position of the content displayed on the display unit of the glasses-type device 100 by the information processing apparatus 200, which is illustrated in each of FIGS. 3 and 4. In FIG. 5, it is assumed that the content 125 and the content 127 with the text "analysis result" are the content related to the display 300, and the content 145 and the content 147 with the text "basic data" are the content related to the display 350.

[0080] Here, mainly described is an example in the case where the information processing apparatus 200 determines whether or not the viewing target of the user 102 wearing the glasses-type device 100 has changed, and determines the display position of the content displayed on the display unit of the glasses-type device 100 based on the determination result. It is assumed that the user 102 wearing the glasses-type device 100 is viewing the display 300, and the state where the content 125 and the content 127 are displayed on the lenses 115 and 117, as shown in the upper part of FIG. 5, is taken as the start state.

[0081] The information processing apparatus 200 determines, for example, whether or not the viewing target of the user 102 has changed based on the measurement data received from the glasses-type device 100. The information processing apparatus 200 determines, for example, whether or not the viewing target of the user 102 has changed based on the first focal length. The information processing apparatus 200 determines, for example, whether or not the viewing target of the user 102 has changed based on the gaze data measured by the gaze sensor mounted on the glasses-type device 100, which is included in the measurement data received from the glasses-type device 100. The information processing apparatus 200 may determine whether or not the viewing target of the user 102 has changed based on the imaging data obtained by the camera mounted on the glasses-type device 100, which has imaged the viewing target of the user 102 and is included in the measurement data received from the glasses-type device 100. Here, the description continues assuming that the information processing apparatus 200 has determined that the viewing target of the user 102 has changed from the display 300 to the display 350.

[0082] For example, in response to determining that the visual target of the user 102 has changed from the display 300 to the display 350, the information processing apparatus 200 uses the first focal length when the user 102 is viewing the display 350 to determine the second focal length when the user 102 views the content 145 displayed on the lens 115 and the content 147 displayed on the lens 117. The information processing apparatus 200 determines the display position of the content 145 displayed on the lens 115 and the display position of the content 147 displayed on the lens 117 based on the determined second focal length.

[0083] The information processing apparatus 200 transmits control information to the glasses-type device 100 via the network 20 so that, for example, the content 145 and the content 147 are displayed on the lenses 115 and 117 at the determined display positions, and the display of the content 125 and the content 127 is terminated. The control device 150 may control the display function of the glasses-type device 100 based on the control information received from the information processing apparatus 200. As a result, as illustrated in the lower part of FIG. 5, when the information processing apparatus 200 determines that the visual target of the user 102 has changed from the display 300 to the display 350, the content displayed on the lenses 115 and 117 of the glasses-type device 100 is switched from the content 125 and the content 127 to the content 145 and the content 147.

[0084] When the information processing apparatus 200 causes the glasses-type device 100 to display the content 145 and the content 147, it does not necessarily have to terminate the display of the content 125 and the content 127 on the glasses-type device 100. For example, when the content 145 and the content 147 and the content 125 and the content 127 are displayed on the display unit of the glasses-type device 100, and each of the content 145 and the content 147 does not overlap with each of the content 125 and the content 127, the information processing apparatus 200 does not terminate the display of the content 125 and the content 127 on the glasses-type device 100.

[0085] In one example illustrated in FIG. 5, in response to determining that the viewing target of the user 102 wearing the glasses-type device 100 has changed, the information processing apparatus 200 switches the content displayed on the display unit of the glasses-type device 100. Thereby, the information processing apparatus 200 can further improve the user experience of the user of the glasses-type device by appropriately switching the content displayed on the display unit of the glasses-type device 100 according to the change in the viewing target of the user 102.

[0086] FIG. 6 is an explanatory diagram for explaining another example in which the information processing apparatus 200 determines the display position of the content displayed on the display unit of the glasses-type device 100. Here, mainly, points different from the example in FIGS. 3 to 5 in which the information processing apparatus 200 determines the display position of the content displayed on the display unit of the glasses-type device 100 are explained. Note that the state in which the user 102 wearing the glasses-type device 100 is viewing the display 300 is set as the start state.

[0087] The information processing apparatus 200 identifies the viewing target of the user 102 based on, for example, imaging data obtained by the camera mounted on the glasses-type device 100 and included in the measurement data received from the glasses-type device 100, the imaging data being of the viewing target of the user 102 wearing the glasses-type device 100. Here, the explanation continues assuming that the information processing apparatus 200 has identified that the viewing target of the user 102 is the display 300 based on the imaging data obtained by the camera mounted on the glasses-type device 100 and imaging the display 300 and the presenter 500.

[0088] For example, in addition to the second focal length, the information processing apparatus 200 determines the display positions of the content 125 displayed on the lens 115 and the content 127 displayed on the lens 117 so that they are not superimposed on the specified visual target in the captured image data. For example, the information processing apparatus 200 determines the display positions of the content 125 and the content 127 so that they are not superimposed on the specified visual target and a predetermined overlapping avoidance target. Here, the description will continue on the assumption that the information processing apparatus 200 has determined the display positions of the content 125 and the content 127 so that the content 125 and the content 127 are not superimposed on the display 300, which is the visual target of the user 102, and the presenter 500, which is an example of the overlapping avoidance target.

[0089] For example, the information processing apparatus 200 transmits control information to the glasses-type device 100 via the network 20 so that the content 125 and the content 127 are not superimposed on the display 300 and the presenter 500. The control device 150 may control the display function of the glasses-type device 100 based on the control information received from the information processing apparatus 200. As a result, as shown in the upper part of FIG. 6, the content 125 is displayed on the lens 115 so as not to be superimposed on the display 300 and the presenter 500. Similarly, the content 127 is also displayed on the lens 117 so as not to be superimposed on the display 300 and the presenter 500, like the content 125.

[0090] Thereafter, the information processing apparatus 200 determines the line of sight of the user 102 based on, for example, the line-of-sight data measured by the line-of-sight sensor mounted on the glasses-type device 100 and included in the measurement data received from the glasses-type device 100. For example, when the content 125 displayed on the lens 115 and the content 127 displayed on the lens 117 are located on the line of sight of the user 102 based on the second focal length, the information processing apparatus 200 determines whether the user 102 is visually recognizing the content 125 and the content 127. For example, even when the content 125 and the content 127 are located on the line of sight of the user 102, as in the case where the content 125 and the content 127 and the object 600 are located on the line of sight of the user 102 and the user 102 is visually recognizing the object 600, there may be a case where the user 102 is not visually recognizing the content 125 and the content 127.

[0091] For example, when the distance difference between the first focal length and the second focal length is greater than a predetermined distance difference threshold value, the information processing apparatus 200 determines that the user 102 is not visually recognizing the content 125 and the content 127. For example, when the focal length of the user 102's eye and the second focal length are not the same, the information processing apparatus 200 determines that the user 102 is not visually recognizing the content 125 and the content 127. Here, the description will continue on the assumption that the information processing apparatus 200 has determined that the user 102 is not visually recognizing the content 125 and the content 127.

[0092] The information processing apparatus 200 changes the display position of content 125 and the display position of content 127 so that content 125 and content 127 are not located on the line of sight of the user 102, for example, in response to the determination that the user 102 has not visually recognized content 125 and content 127. The information processing apparatus 200 changes the display position of content 125 and the display position of content 127 so that content 125 and content 127 are not displayed in an overlapping manner with the object to be visually recognized by the user 102. Here, the description will continue on the assumption that the information processing apparatus 200 has changed the display position of content 125 and the display position of content 127 so that content 125 and content 127 are not displayed in an overlapping manner with the object 600 that is the object to be visually recognized by the user 102.

[0093] The information processing apparatus 200 transmits control information to the glasses-type device 100 via the network 20 so that content 125 and content 127 are not displayed in an overlapping manner with the object 600. The control device 150 may control the display function of the glasses-type device 100 based on the control information received from the information processing apparatus 200. As a result, as shown in the lower part of FIG. 6, content 125 is displayed on the lens 115 so as not to be displayed in an overlapping manner with the object 600. Also, content 127 is similarly displayed on the lens 117 so as not to be displayed in an overlapping manner with the object 600, just like content 125.

[0094] In an example illustrated in FIG. 6, the information processing apparatus 200 determines the display position of the content displayed on the display unit of the glasses-type device 100 so that the content displayed on the display unit of the glasses-type device 100 does not overlap with the visual target of the user 102 wearing the glasses-type device 100. Thereby, the information processing apparatus 200 can determine the display position of the content displayed on the display unit of the glasses-type device so as not to interfere with the visual recognition of the user of the glasses-type device. As a result, the user experience of the user of the glasses-type device can be further improved. Further, when the content displayed on the display unit of the glasses-type device 100 is located on the line of sight of the user 102, the information processing apparatus 200 determines whether or not the user 102 is visually recognizing the content. When it is determined that the user 102 is not visually recognizing the content, the information processing apparatus 200 changes the display position of the content displayed on the display unit of the glasses-type device 100 so that the content displayed on the display unit of the glasses-type device 100 is not located on the line of sight of the user 102. Thereby, when the content displayed on the display unit of the glasses-type device is located on the line of sight of the user of the glasses-type device, the information processing apparatus 200 can change the display position of the content so as not to interfere with the visual recognition of the user of the glasses-type device when the user of the glasses-type device is visually recognizing something other than the content. As a result, the user experience of the user of the glasses-type device can be further improved.

[0095] FIG. 7 schematically shows an example of the functional configuration of the information processing apparatus 200. The information processing apparatus 200 includes a data acquisition unit 202, a first focal length determination unit 204, a second focal length determination unit 206, a display position determination unit 208, a continuation determination unit 210, a content storage unit 211, a display control unit 212, a movement speed setting unit 214, a visual target identification unit 216, a learning data storage unit 220, a model generation unit 222, a model storage unit 224, a model acquisition unit 226, and a visual recognition determination unit 230. Note that it is not always essential for the information processing apparatus 200 to include all of these configurations.

[0096] The data acquisition unit 202 acquires various types of data. The data acquisition unit 202 acquires various types of data, for example, by receiving various types of data via the network 20. The data acquisition unit 202 may acquire various types of data by receiving an input from a user of the information processing apparatus 200 via an input unit included in the information processing apparatus 200. The user of the information processing apparatus 200 is, for example, an administrator who manages the content displayed on the glasses-type device 100.

[0097] The data acquisition unit 202 acquires various types of data from the glasses-type device 100, for example. The data acquisition unit 202 acquires measurement data measured by a sensor mounted on the glasses-type device 100, for example. The data acquisition unit 202 acquires measurement data measured by the sensor 120, for example. The data acquisition unit 202 acquires measurement data measured by the sensor 122, for example. The data acquisition unit 202 acquires both the measurement data measured by the sensor 120 and the measurement data measured by the sensor 122, for example. The data acquisition unit 202 acquires the terminal ID of the glasses-type device 100 transmitted together with the measurement data by the glasses-type device 100, for example. The data acquisition unit 202 acquires the user ID of the user 102 of the glasses-type device 100 transmitted together with the measurement data by the glasses-type device 100, for example. The data acquisition unit 202 may acquire various types of data from any other communication terminal.

[0098] The first focal length determination unit 204 determines the first focal length. The first focal length determination unit 204 determines the first focal length after the change, for example, when the first focal length changes.

[0099] The first focal length determination unit 204 determines the first focal length based on the measurement data acquired by the data acquisition unit 202, for example. The first focal length determination unit 204 determines the first focal length based on the measurement data acquired by the data acquisition unit 202 in response to the data acquisition unit 202 acquiring the measurement data, for example.

[0100] The first focal length determination unit 204 determines the first focal length by determining, for example, the distance from the user 102 wearing the glasses-type device 100 to the user 102's viewing target located on the line of sight of the user 102 indicated by the line-of-sight data, based on the measurement data measured by the sensor 120 and the line-of-sight data measured by the line-of-sight sensor, which are included in the measurement data acquired by the data acquisition unit 202. For example, when the sensor 120 is a single camera, the first focal length determination unit 204 uses the focal length of the camera when the camera captures imaging data with the focus of the camera adjusted to the user 102's viewing target using the autofocus function, to determine the distance from the user 102 to the user 102's viewing target. For example, when the sensor 122 is two cameras, the first focal length determination unit 204 uses the parallax of the user 102's viewing target between the imaging data captured by one camera of the user 102's viewing target and the imaging data captured by the other camera of the user 102's viewing target, and the distance between the two cameras, to determine the distance from the user 102 to the user 102's viewing target. For example, when the sensor 120 is a depth camera, the first focal length determination unit 204 uses the distance from the glasses-type device 100 to the user 102's viewing target indicated by the distance measurement data included in the imaging data captured by the depth camera, to determine the distance from the user 102 to the user 102's viewing target. For example, when the sensor 120 is a distance measurement sensor, the first focal length determination unit 204 uses the distance from the glasses-type device 100 to the user 102's viewing target indicated by the distance measurement data measured by the distance measurement sensor, to determine the distance from the user 102 to the user 102's viewing target.

[0101] The first focal length determination unit 204 determines the first focal length by determining the distance from the user 102 to the focus of the user 102's eye, for example, based on the measurement data measured by the sensor 122 included in the measurement data acquired by the data acquisition unit 202. The first focal length determination unit 204 uses, for example, the line-of-sight data included in the measurement data measured by the sensor 122 to indicate the line of sight of the right eye of the user 102 and the line of sight of the left eye of the user 102, and the distance between the center of the right eye of the user 102 and the center of the left eye of the user 102 to determine the distance from the user 102 to the focus of the user 102's eye. The first focal length determination unit 204 uses, for example, the angle data included in the measurement data measured by the sensor 122 to indicate the angle of the right eye of the user 102 and the angle of the left eye of the user 102, and the distance between the center of the right eye of the user 102 and the center of the left eye of the user 102 to determine the distance from the user 102 to the focus of the user 102's eye.

[0102] The first focal length determination unit 204 may also determine the first focal length by determining the distance from the glasses-type device 100 to the visual target of the user 102 based on the measurement data measured by the sensor 120 included in the measurement data acquired by the data acquisition unit 202. In this case, it is assumed that the user 102 visually recognizes the visual target at the center of the measurement range of the sensor 120.

[0103] For example, when the sensor 120 is a single camera, the first focal length determination unit 204 uses the focal length of the camera when the camera uses the autofocus function to capture imaging data with the focus of the camera adjusted to the visual target of the user 102 located at the center of the imaging range of the camera, to determine the distance from the glasses-type device 100 to the visual target of the user 102. For example, when the sensor 122 is two cameras, the first focal length determination unit 204 uses the parallax of the visual target of the user 102 located at the center of the imaging ranges of the two cameras between the imaging data captured by one camera and the imaging data captured by the other camera, and the distance between the two cameras, to determine the distance from the glasses-type device 100 to the visual target of the user 102. For example, when the sensor 120 is a depth camera, the first focal length determination unit 204 uses the distance from the glasses-type device 100 to the visual target of the user 102 located at the center of the imaging range of the depth camera indicated by the distance measurement data included in the imaging data captured by the depth camera, to determine the distance from the glasses-type device 100 to the visual target of the user 102. For example, when the sensor 120 is a distance measurement sensor, the first focal length determination unit 204 uses the distance from the glasses-type device 100 to the visual target of the user 102 located at the center of the measurement range of the distance measurement sensor indicated by the distance measurement data measured by the distance measurement sensor, to determine the distance from the glasses-type device 100 to the visual target of the user 102.

[0104] The second focal length determination unit 206 determines the second focal length. The second focal length determination unit 206 determines the second focal length using, for example, the first focal length determined by the first focal length determination unit 204. The second focal length determination unit 206 determines the second focal length corresponding to the changed first focal length using, for example, the changed first focal length when the first focal length changes.

[0105] The second focal length determination unit 206 determines the second focal length such that, for example, the distance difference between the first focal length and the second focal length is smaller than a predetermined distance difference threshold. The second focal length determination unit determines the second focal length such that, for example, the first focal length and the second focal length become the same focal length.

[0106] The maximum distance can be set for the second focal length. The second focal length determination unit 206 determines the second focal length, for example, by setting the second focal length to the maximum distance when the first focal length is longer than a predetermined distance threshold.

[0107] The display position determination unit 208 determines the display position of the content displayed on the display unit of the glasses-type device 100. The display position determination unit 208 determines the display position of the content displayed on the display unit of the glasses-type device 100, for example, based on the second focal length determined by the second focal length determination unit 206. The display position determination unit 208 determines the display position of the content displayed within the first display area of the display unit of the glasses-type device 100 and the display position of the content displayed within the second display area of the display unit of the glasses-type device 100, for example, based on the second focal length.

[0108] The display position determination unit 208 determines the display position of the content displayed within the first display area and the display position of the content displayed within the second display area, for example, based further on the gaze data measured by the gaze sensor mounted on the glasses-type device 100, which is included in the measurement data acquired by the data acquisition unit 202. The display position determination unit 208 determines the positional relationship between the user 102 and the user 102's viewing target based on the gaze of the user 102 indicated by the gaze data, and determines the display position of the content displayed within the first display area and the display position of the content displayed within the second display area of the display unit based on the determined positional relationship between the user 102 and the user 102's viewing target. The display position determination unit 208 determines the display position of the content displayed within the first display area and the display position of the content displayed within the second display area, for example, such that the amount of change in the gaze of the user 102 is less.

[0109] When the first focal length changes, the continuation determination unit 210 determines whether the changed first focal length continues for a predetermined continuation period. The continuation period is arbitrarily set, for example, within the range from 100 ms to 10 s. The continuation period may be set shorter than 100 ms. The continuation period may be set longer than 10 s.

[0110] When the continuation determination unit 210 determines that the changed first focal length continues for the continuation period, the second focal length determination unit 206 may determine the second focal length corresponding to the changed first focal length using the changed first focal length. When the continuation determination unit 210 determines that the changed first focal length does not continue for the continuation period, the second focal length determination unit 206 may maintain the second focal length corresponding to the first focal length before the change.

[0111] For example, when the first focal length changes, the display position determination unit 208 changes the display positions of the content displayed in the first display area and the content displayed in the second display area based on the second focal length corresponding to the changed first focal length. For example, when the first focal length changes and the continuation determination unit 210 determines that the changed first focal length continues for the continuation period, the display position determination unit 208 changes the display positions of the content displayed in the first display area and the content displayed in the second display area based on the second focal length corresponding to the changed first focal length. When the line of sight of the user 102 changes, the display position determination unit 208 may change the display positions of the content displayed in the first display area and the content displayed in the second display area based on the changed line of sight of the user 102.

[0112] The content storage unit 211 stores content. The content storage unit 211 stores content in association with, for example, the terminal ID of the glasses-type device 100. The content storage unit 211 stores content in association with, for example, the user ID of the user 102 of the glasses-type device 100. The content storage unit 211 may store content in association with identification information for identifying an object. The object may be an example of a visual target of the user 102.

[0113] The display control unit 212 controls the display of content by the glasses-type device 100. The display control unit 212 controls the display of content by the glasses-type device 100, for example, by generating control information for controlling the glasses-type device 100 and transmitting the generated control information to the glasses-type device 100 via the network 20.

[0114] The control information includes, for example, display position information indicating the display position of the content to be displayed on the display unit of the glasses-type device 100. The display position information indicates, for example, the display position of the content displayed within the first display area and the display position of the content displayed within the second display area. The control information includes, for example, content information indicating the content to be displayed on the display unit of the glasses-type device 100. The control information may include the content to be displayed on the display unit of the glasses-type device 100.

[0115] The display control unit 212 controls the display of content by the glasses-type device 100 so that the content corresponding to the terminal ID of the glasses-type device 100 acquired by the data acquisition unit 202 is displayed on the display unit of the glasses-type device 100. The display control unit 212 transmits control information including content information indicating the content stored in the content storage unit 211 in association with the terminal ID of the glasses-type device 100 to the glasses-type device 100. The display control unit 212 may transmit control information including the content stored in the content storage unit 211 in association with the terminal ID of the glasses-type device 100 to the glasses-type device 100.

[0116] The display control unit 212 controls the display of content by the glasses-type device 100 so that, for example, the content corresponding to the user ID of the user 102 of the glasses-type device 100 acquired by the data acquisition unit 202 is displayed on the display unit of the glasses-type device 100. The display control unit 212 transmits, for example, control information including content information indicating the content stored in the content storage unit 211 associated with the user ID of the user 102 of the glasses-type device 100 to the glasses-type device 100. The display control unit 212 may transmit control information including the content stored in the content storage unit 211 associated with the user ID of the user 102 of the glasses-type device 100 to the glasses-type device 100.

[0117] The display control unit 212 controls the display of content by the glasses-type device 100 so that, for example, the content displayed in the first display area and the content displayed in the second display area are displayed at the display positions determined by the display positioning unit 208. The display control unit 212 controls the display of content by the glasses-type device 100 so that, for example, the content displayed in the first display area and the content displayed in the second display area move from the display position before the change to the display position after the change. The display control unit 212 controls the display of content by the glasses-type device 100 so that, for example, the content displayed in the first display area and the content displayed in the second display area move from the display position before the change to the display position after the change at a predetermined moving speed.

[0118] The moving speed is set so that, for example, the content displayed on the display unit of the glasses-type device 100 moves from the display position before the change to the display position after the change within the range of 100 ms to 10 s. The moving speed may be set so that the content displayed on the display unit of the glasses-type device 100 moves from the display position before the change to the display position after the change in a period shorter than 100 ms. The moving speed may be set so that the content displayed on the display unit of the glasses-type device 100 moves from the display position before the change to the display position after the change in a period longer than 10 s.

[0119] The moving speed setting unit 214 sets the moving speed at which the content displayed on the display unit of the glasses-type device 100 moves. The display control unit 212 may control the display of the content by the glasses-type device 100 such that the content displayed in the first display area and the content displayed in the second display area move from the display position before the change to the display position after the change at the moving speed set by the moving speed setting unit 214.

[0120] The moving speed setting unit 214 sets the moving speed, for example, based on the frequency of change of the first focal length. For example, when the frequency of change of the first focal length is higher than a predetermined frequency threshold, the moving speed setting unit 214 sets the moving speed so that the moving speed is faster compared to the case where the frequency of change of the first focal length is lower than the frequency threshold. The moving speed setting unit 214 may set the moving speed such that the higher the frequency of change of the first focal length, the faster the moving speed.

[0121] The moving speed setting unit 214 may also set the moving speed based on the distance difference between the second focal length corresponding to the first focal length before the change and the second focal length corresponding to the first focal length after the change. For example, when the distance difference is longer than a predetermined distance difference threshold, the moving speed setting unit 214 sets the moving speed so that the moving speed is faster compared to the case where the distance difference is shorter than the distance difference threshold. The moving speed setting unit 214 may set the moving speed such that the longer the distance difference, the faster the moving speed.

[0122] The visual target identification unit 216 identifies the visual target of the user 102. For example, the visual target identification unit 216 identifies the visual target of the user 102 based on the imaging data obtained by the camera mounted on the glasses-type device 100 and included in the measurement data acquired by the data acquisition unit 202, where the camera has imaged the visual target of the user 102. For example, the visual target identification unit 216 identifies an object located at the center of the imaging range of the camera and determines that the identified object is the visual target of the user 102, thereby identifying the visual target of the user 102. The visual target identification unit 216 may further identify the visual target of the user 102 located on the line of sight of the user 102 indicated by the line-of-sight data, based on the line-of-sight data measured by the line-of-sight sensor and included in the measurement data acquired by the data acquisition unit 202.

[0123] The visual target identification unit 216 may identify a predetermined duplication avoidance target based on the imaging data. The duplication avoidance target may be, for example, a person. The duplication avoidance target may be, for example, a human face. The duplication avoidance target may be, for example, a vehicle. The duplication avoidance target may be, for example, a train. The duplication avoidance target may be, for example, a road sign. The duplication avoidance target may be, for example, a signal. The duplication avoidance target may be any other arbitrary object.

[0124] Based on the second focal length and the imaging data, the display position determination unit 208 determines the display positions of the content to be displayed in the first display area and the content to be displayed in the second display area so that the content to be displayed in the first display area and the content to be displayed in the second display area do not overlap with the visual target of the user 102 identified by the visual target identification unit 216. Based on the second focal length and the imaging data, the display position determination unit 208 determines the display positions of the content to be displayed in the first display area and the content to be displayed in the second display area so that the content to be displayed in the first display area and the content to be displayed in the second display area do not overlap with the visual target of the user 102 and the duplication avoidance target identified by the visual target identification unit 216.

[0125] The display control unit 212 controls the display of content by the glasses-type device 100 such that, for example, the content corresponding to the viewing target of the user 102 specified by the viewing target specifying unit 216 is displayed on the display unit of the glasses-type device 100. The display control unit 212 transmits control information including content information indicating the content stored in the content storage unit 211 to the glasses-type device 100 in association with the identification information for identifying the viewing target of the user 102 specified by the viewing target specifying unit 216. The display control unit 212 may transmit control information including the content stored in the content storage unit 211 to the glasses-type device 100 in association with the identification information for identifying the viewing target of the user 102 specified by the viewing target specifying unit 216.

[0126] The viewing target specifying unit 216 determines, for example, whether the viewing target of the user 102 has changed. The viewing target specifying unit 216 determines whether the viewing target of the user 102 has changed based on the imaging data obtained by imaging the viewing target of the user 102 by the camera mounted on the glasses-type device 100, which is included in the measurement data obtained by the data acquisition unit 202.

[0127] The viewing target specifying unit 216 determines, for example, whether the viewing target of the user 102 has changed based on the first focal length. For example, when the amount of change in the first focal length is greater than a predetermined distance change threshold, the viewing target specifying unit 216 determines that the viewing target of the user 102 has changed. On the other hand, when the amount of change in the first focal length is less than the distance change threshold, the viewing target specifying unit 216 determines that the viewing target of the user 102 has not changed.

[0128] The visual recognition target specifying unit 216 may determine whether or not the visual recognition target of the user 102 has changed based on the line-of-sight data measured by the line-of-sight sensor mounted on the glasses-type device 100, which is included in the measurement data acquired by the data acquisition unit 202. For example, when the amount of change in the line of sight of the user 102 indicated by the line-of-sight data is greater than a predetermined line-of-sight change amount threshold, the visual recognition target specifying unit 216 determines that the visual recognition target of the user 102 has changed. On the other hand, when the amount of change in the line of sight of the user 102 is less than the line-of-sight change amount threshold, the visual recognition target specifying unit 216 determines that the visual recognition target of the user 102 has not changed.

[0129] For example, when the visual recognition target specifying unit 216 determines that the visual recognition target of the user 102 has changed, the display position determining unit 208 determines the display position of the content to be displayed within the first display area and the display position of the content to be displayed within the second display area based on the second focal length corresponding to the first focal length when the user 102 is viewing the changed visual recognition target. For example, the display control unit 212 controls the display of the content by the glasses-type device 100 so as to switch the content displayed on the display unit of the glasses-type device 100 from the content corresponding to the previous visual recognition target to the content corresponding to the changed visual recognition target.

[0130] The data acquisition unit 202 may acquire learning data including the imaging data captured by the camera mounted on the glasses-type device 100 and the visual recognition target data indicating the visual recognition target of the user 102 wearing the glasses-type device 100 at the timing when the imaging data was captured. The visual recognition target data may be generated by having the user 102 confirm the visual recognition target of the user 102 at the timing when the imaging data was captured. The data acquisition unit 202 may store the acquired learning data in the learning data storage unit 220.

[0131] The model generation unit 222 uses a plurality of pieces of learning data stored in the learning data storage unit 220 as teacher data, and generates an estimation model for estimating the visual recognition target of the user 102 wearing the glasses-type device 100 at the timing when the imaging data was captured, from the imaging data captured by the camera mounted on the glasses-type device 100, by machine learning. The model generation unit 222 may store the generated estimation model in the model storage unit 224.

[0132] The model acquisition unit 226 acquires an estimation model for estimating the visual recognition target of the user 102 wearing the glasses-type device 100 at the timing when the imaging data was captured, from the imaging data captured by the camera mounted on the glasses-type device 100. The model acquisition unit 226 acquires the estimation model, for example, by receiving the estimation model via the network 20. The model acquisition unit 226 may acquire the estimation model by receiving an input from a user of the information processing apparatus 200 via an input unit provided in the information processing apparatus 200. The model acquisition unit 226 acquires an estimation model generated by machine learning in the same manner as when the model generation unit 222 generates an estimation model, for example. The model acquisition unit 226 may store the acquired estimation model in the model storage unit 224.

[0133] The visual recognition target specifying unit 216 specifies the visual recognition target of the user 102, for example, by using the estimation model stored in the model storage unit 224 to estimate the visual recognition target of the user 102 wearing the glasses-type device 100 from the imaging data captured by the camera mounted on the glasses-type device 100. The display positioning unit 208 may determine the display positions of the content displayed in the first display area and the content displayed in the second display area so that the content displayed in the first display area and the content displayed in the second display area do not overlap with the visual recognition target of the user 102 specified by the visual recognition target specifying unit 216 using the estimation model.

[0134] The visual recognition determination unit 230 determines whether the user 102 is visually recognizing the content displayed on the display unit of the glasses-type device 100. For example, the visual recognition determination unit 230 determines whether the user 102 is visually recognizing the content displayed in the first display area and the content displayed in the second display area.

[0135] For example, based on the second focal length and the gaze data measured by the gaze sensor mounted on the glasses-type device 100 included in the measurement data acquired by the data acquisition unit 202, the visual recognition determination unit 230 determines whether the user 102 is visually recognizing the content displayed in the first display area and the content displayed in the second display area. For example, when the content displayed in the first display area and the content displayed in the second display area are located on the gaze line of the user 102 indicated by the gaze data, the visual recognition determination unit 230 determines whether the user 102 is visually recognizing the content displayed in the first display area and the content displayed in the second display area.

[0136] For example, when the distance difference between the first focal length and the second focal length is greater than a predetermined distance difference threshold, the visual recognition determination unit 230 determines that the user 102 is not visually recognizing the content displayed in the first display area and the content displayed in the second display area. On the other hand, when the distance difference is smaller than the distance difference threshold, the visual recognition determination unit 230 determines that the user 102 is visually recognizing the content displayed in the first display area and the content displayed in the second display area.

[0137] For example, when the first focal length and the second focal length are not the same, the visual recognition determination unit 230 determines that the user 102 is not visually recognizing the content displayed in the first display area and the content displayed in the second display area. On the other hand, when the first focal length and the second focal length are the same, the visual recognition determination unit 230 determines that the user 102 is visually recognizing the content displayed in the first display area and the content displayed in the second display area.

[0138] When the visual recognition determination unit 230 determines that the display position determination unit 208, for example, cannot visually recognize the content displayed in the first display area and the content displayed in the second display area by the user 102, the display position determination unit 208 changes the display position of the content displayed in the first display area and the display position of the content displayed in the second display area so that the content displayed in the first display area and the content displayed in the second display area are not located on the line of sight of the user 102. When the visual recognition determination unit 230 determines that the display position determination unit 208, for example, cannot visually recognize the content displayed in the first display area and the content displayed in the second display area by the user 102, the display position determination unit 208 changes the display position of the content displayed in the first display area and the display position of the content displayed in the second display area so that the content displayed in the first display area and the content displayed in the second display area are not superimposed on the visual target of the user 102. On the other hand, when the visual recognition determination unit 230 determines that the user 102 can visually recognize the content displayed in the first display area and the content displayed in the second display area, the display position determination unit 208 may maintain the display position of the content displayed in the first display area and the display position of the content displayed in the second display area.

[0139] FIG. 8 schematically shows an example of the functional configuration of the control device 150. The control device 150 includes a data acquisition unit 152, a first focal length determination unit 154, a second focal length determination unit 156, a display position determination unit 158, a continuation determination unit 160, a content storage unit 161, a display control unit 162, a movement speed setting unit 164, a visual target identification unit 166, a model storage unit 174, a model acquisition unit 176, and a visual recognition determination unit 180. Note that it is not always essential for the control device 150 to include all of these configurations.

[0140] The data acquisition unit 152 acquires various types of data. The data acquisition unit 152 acquires, for example, measurement data measured by sensors mounted on the glasses-type device 100. The data acquisition unit 152 acquires, for example, measurement data measured by the sensor 120. The data acquisition unit 152 acquires, for example, measurement data measured by the sensor 122. The data acquisition unit 152 acquires both the measurement data measured by the sensor 120 and the measurement data measured by the sensor 122. The data acquisition unit 152 may acquire control information by receiving the control information from the information processing device 200 via the network 20.

[0141] The first focal length determination unit 154 determines the first focal length. The first focal length determination unit 154 determines, for example, the changed first focal length when the first focal length changes. The first focal length determination unit 154 determines the first focal length based on, for example, the measurement data acquired by the data acquisition unit 152.

[0142] The first focal length determination unit 154 may determine the first focal length in the same manner as the first focal length determination unit 204. The first focal length determination unit 154 may have the same function as the first focal length determination unit 204.

[0143] The second focal length determination unit 156 determines the second focal length. The second focal length determination unit 156 determines the second focal length using, for example, the first focal length determined by the first focal length determination unit 154. The second focal length determination unit 156 determines, for example, the second focal length corresponding to the changed first focal length using the changed first focal length when the first focal length changes.

[0144] The second focal length determination unit 156 may determine the second focal length in the same manner as the second focal length determination unit 206. The second focal length determination unit 156 may have the same function as the second focal length determination unit 206.

[0145] The display position determination unit 158 determines the display position of the content displayed on the display unit of the glasses-type device 100. For example, the display position determination unit 158 determines the display position of the content displayed on the display unit of the glasses-type device 100 based on the second focal length determined by the second focal length determination unit 156. For example, the display position determination unit 158 further determines the display position of the content displayed on the display unit of the glasses-type device 100 based on the gaze data measured by the gaze sensor mounted on the glasses-type device 100 included in the measurement data acquired by the data acquisition unit 152.

[0146] Similar to the display position determination unit 208, the display position determination unit 158 may determine the display position of the content displayed on the display unit of the glasses-type device 100. The display position determination unit 158 may have the same function as the display position determination unit 208.

[0147] When the first focal length changes, the continuation determination unit 160 determines whether the changed first focal length continues for a predetermined continuation period. Similar to the continuation determination unit 210, the continuation determination unit 160 may determine whether the changed first focal length continues for a predetermined continuation period. The continuation determination unit 160 may have the same function as the continuation determination unit 210.

[0148] The content storage unit 161 stores the content. For example, the content storage unit 161 stores the content in association with the terminal ID of the glasses-type device 100. For example, the content storage unit 161 stores the content in association with the user ID of the user 102 of the glasses-type device 100. The content storage unit 161 may store the content in association with the identification information for identifying the object.

[0149] The display control unit 162 controls the display of content by the glasses-type device 100. For example, the display control unit 162 generates control information and controls the display of content by the glasses-type device 100 based on the generated control information. For example, the display control unit 162 controls the display of content by the glasses-type device 100 based on the control information acquired by the data acquisition unit 152 from the information processing device 200.

[0150] Similar to the display control unit 212, the display control unit 162 may control the display of content by the glasses-type device 100. The display control unit 162 may have a function similar to that of the display control unit 212.

[0151] The movement speed setting unit 164 sets the movement speed at which the content displayed on the display unit of the glasses-type device 100 moves. Similar to the movement speed setting unit 214, the movement speed setting unit 164 may set the movement speed. The movement speed setting unit 164 may have a function similar to that of the movement speed setting unit 214.

[0152] The visual target identification unit 166 identifies the visual target of the user 102. The visual target identification unit 216 may identify a predetermined duplication avoidance target.

[0153] Similar to the visual target identification unit 216, the visual target identification unit 166 may identify the visual target of the user 102 and the duplication avoidance target. The visual target identification unit 166 may have a function similar to that of the visual target identification unit 216.

[0154] The model acquisition unit 176 acquires an estimation model for estimating a visual target of the user 102 wearing the glasses-type device 100 at the timing when the captured data was captured, from the captured data captured by the camera mounted on the glasses-type device 100. The model acquisition unit 176 acquires the estimation model, for example, by receiving the estimation model from the information processing device 200 via the network 20. The model acquisition unit 176 may acquire the estimation model by receiving an input from the user 102 of the glasses-type device 100 via the input reception function provided in the glasses-type device 100. The model acquisition unit 176 may store the acquired estimation model in the model storage unit 174.

[0155] The visual recognition determination unit 180 determines whether or not the user 102 is visually recognizing the content displayed on the display unit of the glasses-type device 100. Similar to the visual recognition determination unit 230, the visual recognition determination unit 180 may determine whether or not the user 102 is visually recognizing the content displayed on the display unit of the glasses-type device 100. The visual recognition determination unit 180 may have the same function as the visual recognition determination unit 230.

[0156] The control device 150 may further include a function of generating, by machine learning, an estimation model for estimating a visual target of the user 102 wearing the glasses-type device 100 at the timing when the captured data was captured, from the captured data captured by the camera mounted on the glasses-type device 100. In this case, the control device 150 may further include a learning data storage unit 220 and a model generation unit 222.

[0157] FIG. 9 is an explanatory diagram for explaining an example of the processing flow of the information processing device 200. Here, a state where no content is displayed on the display unit of the glasses-type device 100 is set as the start state.

[0158] In step 102 (steps may be abbreviated as S), the data acquisition unit 202 acquires measurement data measured by sensors mounted on the glasses-type device 100. In S104, the first focal length determination unit 204 determines the first focal length based on the measurement data acquired by the data acquisition unit 202 in S102. In S106, the second focal length determination unit 206 determines the second focal length using the first focal length determined by the first focal length determination unit 204 in S104. In S108, the display position determination unit 208 determines the display position of the content to be displayed on the display unit of the glasses-type device 100 based on the second focal length determined by the second focal length determination unit 206 in S106.

[0159] The display control unit 212 controls the display of the content by the glasses-type device 100 so that the content to be displayed on the display unit of the glasses-type device 100 is displayed at the display position determined by the display position determination unit 208. Thereby, the glasses-type device 100 starts displaying the content on the display unit.

[0160] In S110, the data acquisition unit 202 acquires measurement data measured by sensors mounted on the glasses-type device 100 while the glasses-type device 100 is displaying the content on the display unit. In S112, the first focal length determination unit 204 determines the first focal length based on the measurement data acquired by the data acquisition unit 202 in S110.

[0161] In S114, the second focal length determination unit 206 determines whether the first focal length has changed. The second focal length determination unit 206 determines whether the first focal length has changed based on, for example, the first focal length determined by the first focal length determination unit 204 for the nth time and the first focal length determined by the first focal length determination unit 204 for the (n + 1)th time. Here, n is assumed to be a natural number.

[0162] For example, when the amount of change between the first focal length determined by the first focal length determination unit 204 at the n-th time and the first focal length determined by the first focal length determination unit 204 at the (n + 1)-th time is greater than a predetermined distance change threshold, the second focal length determination unit 206 determines that the first focal length has changed. On the other hand, when the amount of change between the first focal length determined by the first focal length determination unit 204 at the n-th time and the first focal length determined by the first focal length determination unit 204 at the (n + 1)-th time is less than the distance change threshold, the second focal length determination unit 206 determines that the first focal length has not changed.

[0163] For example, when the first focal length determined by the first focal length determination unit 204 at the n-th time and the first focal length determined by the first focal length determination unit 204 at the (n + 1)-th time are not the same, the second focal length determination unit 206 determines that the first focal length has changed. On the other hand, when the first focal length determined by the first focal length determination unit 204 at the n-th time and the first focal length determined by the first focal length determination unit 204 at the (n + 1)-th time are the same, the second focal length determination unit 206 determines that the first focal length has not changed.

[0164] When the second focal length determination unit 206 determines that the first focal length has changed, the process proceeds to S116. When the second focal length determination unit 206 determines that the first focal length has not changed, the process proceeds to S120.

[0165] In S116, the second focal length determination unit 206 determines a second focal length corresponding to the changed first focal length by using the first focal length determined by the first focal length determination unit 204 in S112. In S118, the display position determination unit 208 changes the display position of the content displayed on the display unit of the glasses-type device 100 based on the second focal length corresponding to the changed first focal length determined by the second focal length determination unit 206 in S116. The display control unit 212 controls the display of the content by the glasses-type device 100 so that the content displayed on the display unit of the glasses-type device 100 moves from the previous display position to the changed display position. Thereby, the display position of the content displayed on the display unit of the glasses-type device 100 is changed. In S120, the display position determination unit 208 determines to maintain the display position of the content displayed on the display unit of the glasses-type device 100.

[0166] In S122, if the data acquisition unit 202 has not acquired an end instruction, the process returns to S108. In S122, if the data acquisition unit 202 has acquired an end instruction, then the processing by the information processing apparatus 200 ends.

[0167] FIG. 10 schematically shows an example of the hardware configuration of a computer 1200 that functions as the control device 150 or the information processing apparatus 200. The program installed in the computer 1200 causes the computer 1200 to function as one or more "units" of the apparatus according to the above-described embodiment, or causes the computer 1200 to execute an operation associated with the apparatus according to the above-described embodiment or the one or more "units", and / or causes the computer 1200 to execute the process according to the above-described embodiment or a stage of the process. Such a program may be executed by the CPU 1212 so as to cause the computer 1200 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0168] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes legacy input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0169] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires image data generated by the CPU 1212 in a frame buffer or the like provided in the RAM 1214 or within itself, and causes the image data to be displayed on the display device 1218.

[0170] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 within the computer 1200. The DVD drive 1226 reads a program or data from a DVD-ROM 1227 or the like and provides it to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0171] ROM 1230 stores therein a boot program or the like executed by computer 1200 upon activation, and / or a program dependent on the hardware of computer 1200. Input / output chip 1240 may also be connected to input / output controller 1220 via various input / output units through a USB port, a parallel port, a serial port, a keyboard port, a mouse port, or the like.

[0172] The program is provided by a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The program is read from the computer-readable storage medium, installed in a storage device 1224, which is also an example of a computer-readable storage medium, RAM 1214, or ROM 1230, and executed by CPU 1212. The information processing described in these programs is read by computer 1200, resulting in cooperation between the programs and the various types of hardware resources described above. The apparatus or method may be configured by realizing an operation or processing of information in accordance with the use of computer 1200.

[0173] For example, when communication is executed between computer 1200 and an external device, CPU 1212 may execute a communication program loaded in RAM 1214 and instruct communication interface 1222 to perform communication processing based on the processing described in the communication program. Communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as RAM 1214, storage device 1224, DVD-ROM 1227, or an IC card under the control of CPU 1212, transmits the read transmission data to the network, or writes received data received from the network to a reception buffer area or the like provided on the recording medium.

[0174] Further, the CPU 1212 may cause all or necessary parts of files or databases stored in an external recording medium such as the storage device 1224, the DVD drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and may execute various types of processing on the data on the RAM 1214. Next, the CPU 1212 may write back the processed data to the external recording medium.

[0175] Various types of information such as various types of programs, data, tables, and databases may be stored in the recording medium and may be subjected to information processing. The CPU 1212 may execute various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branch, unconditional branch, search / replacement of information, etc. described throughout this disclosure and specified by the instruction sequence of the program, and write back the result to the RAM 1214. Also, the CPU 1212 may search for information in files, databases, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 searches for an entry that matches the condition in which the attribute value of the first attribute is specified from among the plurality of entries, reads the attribute value of the second attribute stored in the entry, and thereby may obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0176] The programs or software modules described above may be stored in a computer-readable storage medium on or near the computer 1200. Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the program to the computer 1200 via the network.

[0177] In the flowchart and block diagram in this embodiment, a block may represent a stage of a process in which an operation is executed or a "part" of a device having a role of executing an operation. A specific stage and "part" may be implemented by a dedicated circuit, a programmable circuit supplied together with computer-readable instructions stored on a computer-readable storage medium, and / or a processor supplied together with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuit may include digital and / or analog hardware circuits, and may include an integrated circuit (IC) and / or discrete circuits. The programmable circuit may include, for example, a reconfigurable hardware circuit including a logical product, a logical sum, an exclusive logical sum, a negative logical product, a negative logical sum, and other logical operations, a flip-flop, a register, and a memory element, such as a field programmable gate array (FPGA), a programmable logic array (PLA), and the like.

[0178] The computer-readable storage medium may include any tangible device capable of storing instructions executable by an appropriate device. As a result, a computer-readable storage medium having instructions stored therein will comprise a product including instructions that can be executed to create means for performing the operations specified in the flowchart or block diagram. Examples of the computer-readable storage medium may include an electronic storage medium, a magnetic storage medium, an optical storage medium, an electromagnetic storage medium, a semiconductor storage medium, and the like. More specific examples of the computer-readable storage medium may include a floppy (registered trademark) disk, a diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an electrically erasable programmable read-only memory (EEPROM), a static random access memory (SRAM), a compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), a Blu-ray (registered trademark) disc, a memory stick, an integrated circuit card, and the like.

[0179] Computer-readable instructions may include source code or object code written in any combination of one or more programming languages, including assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or object-oriented programming languages such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages such as the "C" programming language or similar programming languages.

[0180] The computer-readable instructions may be provided locally or via a wide area network (WAN) such as a local area network (LAN), the Internet, etc. to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, or a programmable circuit, for the processor of the general-purpose computer, the special-purpose computer, or other programmable data processing device, or the programmable circuit to execute the operations specified in the flowchart or block diagram by generating means for executing the computer-readable instructions. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0181] As described above, the present invention has been described using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that forms with such changes or improvements may also be included in the technical scope of the present invention.

[0182] In the claims, the specification, and the drawings, for the operations, procedures, steps, and stages of the apparatus, system, program, and method shown, the execution order of each process, such as the operations, procedures, steps, and stages, is not explicitly stated as "earlier" or "preceding" etc. in particular. It should be noted that, unless the output of the previous process is used in the subsequent process, it can be realized in any order. Regarding the operation flows in the claims, the specification, and the drawings, even if, for the sake of convenience, expressions such as "first," "next," etc. are used for explanation, it does not mean that it is essential to implement in this order.

Explanation of Reference Numerals

[0183] 10 System, 20 Network, 100 Glasses-Type Device, 102 User, 110 Frame, 112 Rim, 114 Bridge, 115 Lens, 117 Lens, 118 Temple, 120 Sensor, 122 Sensor, 125 Content, 127 Content, 135 Content, 137 Content, 145 Content, 147 Content, 150 Control Device, 152 Data Acquisition Unit, 154 First Focal Length Determination Unit, 156 Second Focal Length Determination Unit, 158 Display Position Determination Unit, 160 Continuity Determination Unit, 161 Content Storage Unit, 162 Display Control Unit, 164 Movement Speed Setting Unit, 166 Visual Recognition Target Identification Unit, 174 Model Storage Unit, 176 Model Acquisition Unit, 180 Visual Recognition Determination Unit, 200 Information Processing Device, 202 Data Acquisition Unit, 204 First Focal Length Determination Unit, 206 Second Focal Length Determination Unit, 208 Display Position Determination Unit, 210 Continuity Determination Unit, 211 Content Storage Unit, 212 Display Control Unit, 214 Movement Speed Setting Unit, 216 Visual Recognition Target Identification Unit, 220 Learning Data Storage Unit, 222 Model Generation Unit, 224 Model Storage Unit, 226 Model Acquisition Unit, 230 Visual Recognition Determination Unit, 300 Display, 350 Display, 500 Presenter, 600 Object, 1200 Computer, 1210 Host Controller, 1212 CPU, 1214 RAM, 1216 Graphics Controller, 1218 Display Device, 1220 Input / Output Controller, 1222 Communication Interface, 1224 Storage Device, 1230 ROM, 1240 Input / Output Chip

Claims

Claim 1. An information processing apparatus, comprising: a data acquisition unit configured to acquire measurement data including line-of-sight data indicating a line of sight of a user wearing the glasses-type device or angle data indicating an angle of the user's eye, the measurement data being measured by a sensor mounted on the glasses-type device; a first focal length determination unit configured to determine a first focal length, which is a focal length of the user's eye when the user visually recognizes a visual recognition target, based on the line-of-sight data or the angle data included in the measurement data acquired by the data acquisition unit; a second focal length determination unit configured to determine a second focal length, which is a focal length of the user's eye when the user visually recognizes content displayed on a display unit mounted on the glasses-type device, using the first focal length; a display position determination unit configured to determine a display position of the content displayed in a first display area of the display unit corresponding to the user's right eye and a display position of the content displayed in a second display area of the display unit corresponding to the user's left eye based on the second focal length; wherein: when the first focal length changes, the first focal length determination unit further determines the changed first focal length; the information processing apparatus further comprises: a continuity determination unit configured to determine whether the changed first focal length continues for a predetermined continuous period; wherein: when the continuity determination unit determines that the changed first focal length continues for the continuous period, the second focal length determination unit further determines a second focal length corresponding to the changed first focal length using the changed first focal length; the display position determination unit changes the display position of the content displayed in the first display area and the display position of the content displayed in the second display area based on the second focal length corresponding to the changed first focal length; the information processing apparatus further comprises: a display control unit configured to control the display of the content by the glasses-type device such that the content displayed in the first display area and the content displayed in the second display area move from the display position before the change to the display position after the change at a predetermined moving speed; An information processing apparatus. Claim 2 The information processing apparatus according to claim 1, wherein the second focal length determination unit determines the second focal length such that a distance difference between the first focal length and the second focal length is smaller than a predetermined distance difference threshold value.

3. The information processing apparatus according to claim 1, wherein the second focal length determination unit determines the second focal length such that the first focal length and the second focal length are the same focal length.

4. A moving speed setting unit that sets the moving speed based on the frequency of change of the first focal length further comprising The display control unit controls the display of the content by the glasses-type device such that the content displayed in the first display area and the content displayed in the second display area move from the display position before change to the display position after change at the moving speed set by the moving speed setting unit. The information processing apparatus according to any one of claims 1 to 3.

5. A moving speed setting unit that sets the moving speed based on a distance difference between the second focal length corresponding to the first focal length before change and the second focal length corresponding to the first focal length after change further comprising The display control unit controls the display of the content by the glasses-type device such that the content displayed in the first display area and the content displayed in the second display area move from the display position before change to the display position after change at the moving speed set by the moving speed setting unit. The information processing apparatus according to any one of claims 1 to 3.

6. A visual recognition target specifying unit that specifies the visual recognition target based on imaging data obtained by imaging the visual recognition target by a camera mounted on the glasses-type device and included in the measurement data acquired by the data acquisition unit further comprising The display position determination unit determines the display position of the content displayed in the first display area and the display position of the content displayed in the second display area such that the content displayed in the first display area and the content displayed in the second display area do not overlap with the visual recognition target specified by the visual recognition target specifying unit, based on the imaging data. The information processing apparatus according to any one of claims 1 to 3.

7. A learning data storage unit that stores learning data including captured data captured by a camera mounted on a glasses-type device and visual target data indicating a visual target of a user wearing the glasses-type device at the timing when the captured data was captured. A model generation unit that generates an estimation model for estimating a visual target of a user wearing the glasses-type device at the timing when the captured data was captured from the captured data captured by a camera mounted on the glasses-type device by machine learning using a plurality of the learning data stored in the learning data storage unit as teacher data. Further comprising The visual target specifying unit specifies the visual target by estimating the visual target from the captured data using the estimation model. The information processing apparatus according to claim 6.

8. Based on the second focal length and the line-of-sight data, when the content displayed in the first display area and the content displayed in the second display area are located on the line of sight of the user indicated by the line-of-sight data, a visual recognition determination unit that determines whether or not the user is visually recognizing the content displayed in the first display area and the content displayed in the second display area. Further comprising When the visual recognition determination unit determines that the user is not visually recognizing the content displayed in the first display area and the content displayed in the second display area, the display position determination unit positions the content displayed in the first display area and the content displayed in the second display area so that they are not on the user's line of sight. Changes the display position of the content displayed in the first display area and the display position of the content displayed in the second display area. The information processing apparatus according to claim 6.

9. An information processing apparatus, A data acquisition unit that acquires measurement data including line-of-sight data indicating the line of sight of a user wearing the glasses-type device or angle data indicating the angle of the user's eyes measured by a sensor mounted on the glasses-type device. A first focal length determination unit that determines a first focal length, which is the focal length of the user's eye when the user is visually recognizing a visual recognition target, based on the gaze data or the angle data included in the measurement data acquired by the data acquisition unit; A second focal length determination unit that determines a second focal length, which is the focal length of the user's eye when the user visually recognizes the content displayed on the display unit mounted on the glasses-type device, using the first focal length; A display position determination unit that determines the display position of the content displayed in the first display area of the display unit corresponding to the user's right eye and the display position of the content displayed in the second display area of the display unit corresponding to the user's left eye based on the second focal length; A visual recognition determination unit that determines whether or not the user is visually recognizing the content displayed in the first display area and the content displayed in the second display area when the content displayed in the first display area and the content displayed in the second display area are located on the user's line of sight indicated by the gaze data, based on the second focal length and the gaze data included in the measurement data acquired by the data acquisition unit; Comprising: When the visual recognition determination unit determines that the user is not visually recognizing the content displayed in the first display area and the content displayed in the second display area, the display position determination unit changes the display position of the content displayed in the first display area and the display position of the content displayed in the second display area so that the content displayed in the first display area and the content displayed in the second display area are not located on the user's line of sight; When the first focal length changes, the first focal length determination unit further determines the changed first focal length; The information processing apparatus Further comprises a continuation determination unit that determines whether or not the changed first focal length continues for a predetermined continuation period; Comprising further: When the continuation determination unit determines that the changed first focal length continues for the continuation period, the second focal length determination unit further determines a second focal length corresponding to the changed first focal length, using the changed first focal length; The display position determination unit changes the display position of the content displayed in the first display area and the display position of the content displayed in the second display area based on the second focal length corresponding to the changed first focal length. An information processing apparatus.

10. A program that, when executed by a computer, causes the computer to function as the information processing apparatus according to claim 1 or 9.

Images