Display Control Device

Abstract

The present invention enables a plurality of displays to appropriately display information on a common virtual space.　A movement-side display 10 serving as a display control device is a device for performing control relating to display on the movement-side display 10 that displays display information, which is commonly arranged in a virtual space common to the movement-side display 10 and a reference-side display 20 serving as another display, according to the line of sight toward each display in the virtual space based on the position or orientation of each display in a real space. The movement-side display 10 comprises a focused position information acquisition unit 12 that acquires focused position information indicating a position that is focused on the reference-side display 20 in the virtual space and depends on display on the reference-side display 20, and a line-of-sight movement unit 13 that moves the line of sight toward display of the movement-side display 10 in the virtual space on the basis of the acquired focused position information.

Description

[Technical field]

[0001] The present invention relates to a display control device that controls display on a display. [Background technology]

[0002] Conventionally, it has been proposed to display a celestial sphere image on a head mounted display (for example, see Patent Document 1). For example, a part of the celestial sphere image is displayed depending on the orientation of the head mounted display, and another part of the celestial sphere image is displayed by changing the orientation of the head mounted display, i.e., the orientation of the user's head. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-39052 A Summary of the Invention [Problem to be solved by the invention]

[0004] Conventionally, a technique for sharing a display on a display with a display of another user has been used. Sharing of a display with another user can also be performed in a display using the above-mentioned spherical image. For example, in a plurality of head-mounted displays, information arranged in a virtual space can be displayed according to a line of sight in the virtual space, and the virtual space can be shared between the head-mounted displays to display common information. In this case, if the line of sight in the virtual space is independent from each other for each head-mounted display, the users of the head-mounted displays can refer to different displays according to the line of sight in the virtual space.

[0005] In the above-mentioned display sharing between displays, there are cases where it is desired to know which content in the virtual space another user is looking at. For example, when users of displays sharing the display are having a conversation with each other, the users may want to refer to the same content. For this purpose, for example, it is conceivable that the users communicate the position of the content they are paying attention to by a conversation such as a voice call. However, this method takes time to find the content they are paying attention to. The above problem is particularly noticeable when the display is displayed on a display with a narrow viewing angle such as a glasses-type display, when there are many contents arranged in the virtual space, and when the direction of the line of sight is significantly different between the displays (for example, when the azimuth angle of the line of sight in the virtual space is shifted by 180 degrees between the displays). In addition, it is necessary to specify the position of the display every time the content of interest (i.e., the display of the target that the users want to refer to) changes, making it difficult to have a smooth conversation.

[0006] One embodiment of the present invention has been made in consideration of the above, and aims to provide a display control device that can appropriately display information of a common virtual space across multiple displays. [Means for solving the problem]

[0007] In order to achieve the above-mentioned objective, a display control device according to one embodiment of the present invention is a display control device that controls display on a display that displays display information commonly placed in a virtual space shared with other displays, according to the line of sight of each display in the virtual space based on the position or posture in real space of each display, and is equipped with a focus position information acquisition unit that acquires focus position information indicating the focus position of the virtual space on the other display according to the display on the other display, and a line of sight movement unit that moves the line of sight of the virtual space in the display on the display based on the focus position information acquired by the focus position information acquisition unit.

[0008] Furthermore, a display control device according to one embodiment of the present invention is a display control device that controls display on a display that displays display information commonly placed in a virtual space shared with other displays, according to the line of sight of each display in the virtual space based on the position or posture in real space of each display, and is equipped with a focus position information generation unit that generates focus position information indicating a focus position in the virtual space on the display in response to a predetermined trigger, and a transmission unit that transmits the focus position information generated by the focus position information generation unit to other displays.

[0009] According to the control by these display control devices, the line of sight of the virtual space in the display of one display is moved based on the focal position of the virtual space in the other display according to the display on the other display. Therefore, display according to the focal position of the virtual space is performed on both displays, and for example, it is possible for users of each display to refer to the same display information. In other words, according to the display control device according to one embodiment of the present invention, when information of a common virtual space is displayed on multiple displays, the display can be appropriately performed. Effect of the Invention

[0010] According to a display control device according to an embodiment of the present invention, when information of a virtual space common to a plurality of displays is to be displayed, the information can be displayed appropriately. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a diagram showing the functional configurations of a moving display and a reference display which are display control devices according to an embodiment of the present invention. [Diagram 2] 1A to 1C are diagrams illustrating an example of a virtual space displayed on a display and display information arranged in the virtual space. [Diagram 3] FIG. 13 is a diagram for explaining the movement of the line of sight in a virtual space. [Figure 4] FIG. 13 is a diagram showing an example of a display after a line of sight in the virtual space has been moved. [Diagram 5] 11A and 11B are diagrams illustrating an example of information used to specify display information. [Figure 6] 4 is a sequence diagram showing processes executed on a moving display and a reference display which are display control devices according to an embodiment of the present invention. FIG. [Figure 7] FIG. 2 is a diagram showing the hardware configuration of a moving display and a reference display which are display control devices according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of a display control device according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals and duplicated description will be omitted.

[0013] FIG. 1 shows displays 10 and 20, each of which is a display control device according to this embodiment. In the following description, the display 10 is also called the moving side display 10, and the display 20 is also called the reference side display 20, depending on the functions according to this embodiment described later. The displays 10 and 20, which are display devices, control display on the displays 10 and 20 themselves. The displays 10 and 20 display display information commonly arranged in a virtual space common to the other displays 10 and 20 (displays 10 and 20 other than themselves) according to the line of sight of each of the displays 10 and 20 in the virtual space. The line of sight of each of the displays 10 and 20 in the virtual space is based on the position or orientation of the displays 10 and 20 in the real space.

[0014] For example, the displays 10 and 20 display display information (assets) arranged in a virtual three-dimensional space according to the line of sight in the virtual space. The display information is information displayed on the displays 10 and 20. The display information is, for example, content such as text, images, and moving images. Alternatively, the display information may be information that can change the displayed contents of a scheduler, a browser, an SNS (social networking service), a specific application, and the like. Specific contents of the above display information may be, for example, recipes, notes, maps, news articles, source codes, blueprints, and various documents. The display information may also be information that allows communication such as chat between users of the displays 10 and 20. The display information may also be a 3DCG (three-dimensional computer graphics) model. The display information may also be displayed using a cloud service. The display information may also be anything other than the above, as long as it is arranged in a virtual space and can be displayed according to the line of sight in the virtual space.

[0015] The displays 10 and 20 are displays that display virtual content (display information) using, for example, AR (Augmented Reality) or the like. The displays 10 and 20 are transmissive displays that are attached to the eyes of a user. For example, the displays 10 and 20 may be glasses-type head-mounted displays, that is, see-through glasses (smart glasses, AR glasses). The displays 10 and 20 are used by different users. Moreover, the displays 10 and 20 do not need to be attached to the users.

[0016] Displays 10 and 20 display information in a visible area that is visible in the line of sight direction of the virtual space from a reference position of the line of sight in the virtual space. The line of sight in the virtual space is configured to include a reference position of the line of sight in the virtual space and a line of sight direction in the virtual space. Displays 10 and 20 can perform display by moving the line of sight in the virtual space. By moving the line of sight in the virtual space, the display information visible in the virtual space changes, and the display by displays 10 and 20 also changes.

[0017] The movement of the line of sight in the virtual space is performed in a preset method. For example, the movement of the line of sight in the virtual space is performed with a preset degree of freedom. The preset degree of freedom is, for example, 3DoF (Degree of Freedom). In 3DoF, the reference position of the line of sight in the virtual space is fixed, and only the direction of the line of sight in the virtual space can rotate around three axes of the X-axis, Y-axis, and Z-axis of the virtual space. However, the movement of the line of sight in the virtual space may be performed with degrees of freedom other than the above and by a method other than the above.

[0018] 2, a sphere (celestial sphere) 100 is provided in a virtual space, and display information 200 is arranged along the sphere 100 or inside or outside the sphere 100. For example, planar display information 200 is arranged so as to face the center of the sphere 100 along a tangent plane of the sphere 100. That is, the display information 200 is arranged so as to be visible from the center of the sphere 100. In this case, the center of the sphere 100 is set as the reference position of the line of sight in the virtual space.

[0019] The displays 10 and 20 display the display information 200 that is visible from a reference position of the line of sight in the virtual space in a visible state. The shape of the displayed area is the shape of the display screen in the displays 10 and 20, for example, a rectangular shape. As described above, the viewing angle of the displays 10 and 20 (the angle at which the virtual space can be displayed) is limited, so only a part corresponding to a part of the sphere 100 is displayed. By changing the direction of the line of sight in the virtual space, the position of the displayed area changes, and the display by the displays 10 and 20 changes. In this way, the displays 10 and 20 may be spherical displays. The above display on the displays 10 and 20 may be performed by an application that performs the display. The line of sight direction when the application is started may be a default direction set in advance, or may be a different direction for each of the displays 10 and 20.

[0020] As described above, the line of sight of each display 10, 20 in the virtual space is based on the position or orientation of the display 10, 20 in the real space. Therefore, the display 10, 20 may be provided with a sensor that detects the movement (i.e., change in position) and orientation (i.e., orientation) of the display 10, 20 itself. For example, an acceleration sensor that detects acceleration and a gyro sensor that detects angular velocity may be provided. The display 10, 20 detects the movement and orientation of the display 10, 20 itself by these sensors, and moves the line of sight in the virtual space according to the detected movement and orientation. That is, the line of sight may be moved according to the orientation of the head (face) of the user wearing the display 10, 20. However, the movement of the line of sight in the virtual space may be performed according to the detection of the position or orientation by a sensor other than the above. Furthermore, when moving the line of sight with 3DoF as described above, only the orientation needs to be detected.

[0021] Display on the displays 10 and 20 using the line of sight in the virtual space, including the movement of the line of sight in the virtual space, may be performed in the same manner as display using conventional AR, etc. Note that information related to the virtual space may be stored and processed in either the displays 10 and 20, or in a cloud or the like connected to the displays 10 and 20.

[0022] Display information commonly arranged in a common virtual space is used for display on the displays 10 and 20. That is, the virtual space and display information may be shared between the multiple displays 10 and 20. The multiple displays 10 and 20 for which the virtual space and display information are shared are set in advance. The line of sight of the virtual space in the display on the displays 10 and 20 is independent for each display 10 and 20. If the lines of sight on the displays 10 and 20 are different, for example, in the case of 3DoF, if the directions of the lines of sight are different, the displays 10 and 20 perform different displays according to the respective lines of sight. If the lines of sight on the displays 10 and 20 are the same, for example, in the case of 3DoF as described above, if the directions of the lines of sight are the same, the displays 10 and 20 perform the same display. Note that in this embodiment, an example in which the virtual space is common to the two displays 10 and 20 is shown, but the virtual space may be common to three or more displays 10 and 20.

[0023] In the displays 10 and 20, operations related to the display, for example, a user's operation on the display information 200, may be performed. The displays 10 and 20 accept the user's operation and reflect the operation in the display. For example, operations such as moving the display information 200 in a virtual space, enlarging and reducing the display information, inputting characters into the display information, and rotating the sphere 100 may be performed.

[0024] The operation may be performed, for example, using an information processing device such as a smartphone carried by a user wearing the display 10, 20. In this case, the display 10, 20 and the smartphone are connected in advance so as to be able to transmit and receive information. When the user performs an operation on the smartphone, the operation is reflected in the display on the display 10, 20. Also, a display may be displayed in which a laser pointer appears at the position where the smartphone is pointed from the smartphone held by the user. Also, an operation such as designation of display information may be performed by displaying such a laser pointer.

[0025] The operation may be performed by a dedicated controller attached to the head mounted display. The operation may be performed by a user's gesture. The part of the user performing the gesture is, for example, the hand. That is, the operation may be performed by a hand gesture. However, the operation may be performed by a gesture with a part other than the hand. When the operation is performed by the user's gesture, a camera is provided so as to capture an image of the part performing the gesture, and the gesture is determined by a moving image captured by the camera. The operation may be performed by any method other than the above. The above display and operation on the displays 10 and 20 may be performed in the same manner as in the conventional method.

[0026] The displays 10 and 20 may be conventional displays having the above-mentioned functions. The displays 10 and 20 have a communication function. The communication function of the displays 10 and 20 is used to share the above-mentioned virtual space and display information, and to realize the functions according to this embodiment. The above-mentioned functions of the displays 10 and 20 and a part of the functions according to this embodiment described later may be possessed by an information processing device (e.g., a smartphone or a PC (personal computer)) connected to a display device (e.g., the above-mentioned see-through glasses). That is, the displays 10 and 20 according to this embodiment may be realized by including a display device and an information processing device.

[0027] If the displays 10 and 20 are spherical displays as described above, the displays 10 and 20 can display images, videos, browsers, and the like as display information to create a dedicated workspace for the user wearing the displays 10 and 20. This allows a world in which a private space can be carried around anytime and anywhere and where one can concentrate or relax. If the displays 10 and 20 are see-through glasses, the display information can be used while performing other tasks in the real space, i.e., it is possible to use the display information while performing other tasks.

[0028] In addition, by sharing the virtual space and display information between the multiple displays 10, 20 as described above, it is possible to simultaneously share the display information with other users using other displays 10, 20 in the same place or remotely, as if multiple people were entering the omnidirectional display. Therefore, it is possible to improve visual and intuitive communication by sharing the space. By intuitively sharing a viewpoint or idea with other users, it is possible to broaden the scope of one's field of vision and thinking. It is also possible to create a world in which it is easy to have a conversation in which related information is always displayed.

[0029] Use cases of the displays 10 and 20 as personal tools include work, hobbies, shopping, commuting to work or school, etc. Use cases of sharing virtual spaces and display information on multiple displays 10 and 20 include meetings, workshops, chatting, planning, etc.

[0030] Next, the functions of the moving side display 10 and the reference side display 20 according to this embodiment will be described. The moving side display 10 may have the functions of the reference side display 20 according to this embodiment. The reference side display 20 may have the functions of the moving side display 10 according to this embodiment. The displays 10 and 20 may have the functions of both the moving side display 10 and the reference side display 20 according to this embodiment. The displays 10 and 20 may have functions that are provided in conventional display devices such as conventional see-through glasses in addition to those described below.

[0031] The function of the moving side display 10 and the reference side display 20 according to this embodiment is to move the line of sight of the virtual space on the moving side display 10 based on the focus position of the virtual space on the reference side display 20 according to the display on the reference side display 20. The display on the moving side display 10 changes as the line of sight of the virtual space on the moving side display 10 moves. As a result, the display information displayed on the reference side display 20 is displayed on the moving side display 10, and each user can refer to the same display information. However, as described later, even if the line of sight of the virtual space on the moving side display 10 moves, the display information displayed on the reference side display 20 may not be displayed on the moving side display 10.

[0032] As shown in Fig. 3(a), a lion 200a, an elephant 200b, and a horse 200c, which are display information 200, are arranged at respective positions in the virtual space. As shown in Fig. 3(a), the line of sight in the virtual space on the reference side display 20 is directed toward the lion 200a, and the lion 200a is displayed on the reference side display 20. The elephant 200b and the horse 200c are arranged on the opposite side of the line of sight in the virtual space on the reference side display 20, and the elephant 200b and the horse 200c are not displayed on the reference side display 20.

[0033] 3(b), the line of sight in the virtual space on the moving display 10 faces the direction in which the elephant 200b and the horse 200c are located, and the elephant 200b and the horse 200c are displayed on the moving display 10. The lion 200a is located on the opposite side of the line of sight in the virtual space on the moving display 10, and the lion 200a is not displayed on the moving display 10. Therefore, the user of the moving display 10 and the reference display 20 cannot refer to the same display information 200.

[0034] As shown in Fig. 3(d) , the functions of the moving display 10 and the reference display 20 according to this embodiment move the line of sight in the virtual space on the moving display 10 so as to face the direction in which the lion 200a is located, based on the focus position in the virtual space on the reference display 20. This movement of the line of sight causes the lion 200a to be displayed on the moving display 10 as well. Therefore, the user of the moving display 10 and the reference display 20 can refer to the same display information 200 (the lion 200a in this example).

[0035] As shown in FIG. 1, the moving display 10 includes a display unit 11, a focus position information acquisition unit 12, and a line of sight movement unit 13. The focus position information acquisition unit 12 acquires focus position information from the focus position information acquisition unit 12, and a line of sight movement unit 13.

[0036] The display unit 11 is a functional unit that performs display on the moving side display 10. The display unit 11 inputs and displays display information to be displayed on the display 10. For example, the display unit 11 may input display information stored in the display 10, or may receive and input display information from the outside. As described above, the display unit 11 displays display information arranged in the virtual space according to the line of sight in the virtual space. Also, as described above, the display unit 11 shares the virtual space and display information with the reference side display 20, which is another display. The sharing of the virtual space and display information is performed, for example, by transmitting and receiving display information and information indicating the position of the virtual space where the display information is arranged with the reference side display 20. Also, the sharing of the virtual space and display information may be performed via a server with which the displays 10 and 20 can communicate, rather than a direct exchange between the displays 10 and 20. Also, the sharing of the virtual space and display information between the displays 10 and 20 may be performed by a method other than the above. Note that information other than the above that is transmitted and received between the displays 10 and 20 may also be transmitted and received directly between the displays 10 and 20, or may be transmitted and received via a server or the like.

[0037] The above-mentioned functions of the display unit 11 may be the same as conventional functions. Moreover, the display by the display unit 11 is controlled by the line of sight movement unit 13, as described later.

[0038] The attention position information acquisition unit 12 is a functional unit that acquires attention position information indicating the attention position of the virtual space on the reference side display 20 according to the display on the reference side display 20, which is another display. The attention position information is information that can specify the line of sight of the virtual space corresponding to the attention position. In the case of the above-mentioned 3DoF, the reference position of the line of sight is specified as the center of the sphere 100, so the attention position information is information that can specify the direction of the line of sight of the virtual space. For example, the attention position information indicates the coordinates of the sphere 100 in the coordinate system of the virtual space. Alternatively, the attention position information may indicate two deviation angles in the polar coordinate system of the virtual space. In this case, the two deviation angles are the polar angle (zenith angle, elevation angle) θ and the azimuth angle φ. The virtual space corresponds to the real space, and the polar angle θ and the azimuth angle φ of the virtual space correspond to the polar angle and the azimuth angle of the real space. That is, the polar angle θ of the virtual space is an angle corresponding to the vertical direction of the real space, and the azimuth angle φ of the virtual space is an angle corresponding to the horizontal direction of the real space. Furthermore, the attention position information may be information other than the above as long as it indicates the attention position.

[0039] The attention position information acquisition unit 12 receives and acquires attention position information from the reference side display 20. The reference side display 20 transmits attention position information to the moving side display 10 in response to a request from the moving side display 10 or by a trigger of the reference side display 20 itself.

[0040] For example, when a user operation is performed on the moving side display 10 to request attention position information, the attention position information acquisition unit 12 requests attention position information from the reference side display 20. Specifically, the attention position information acquisition unit 12 accepts an operation from a user specifying a user of the reference side display 20 on a UI (user interface) such as that shown in Fig. 3(c) (operation by displaying the laser pointer described above), and requests attention position information from the reference side display 20 corresponding to the specified user. In this case, there are multiple reference side displays 20, and the attention position information of the reference side display 20 of the user specified by the user is acquired.

[0041] When attention position information is acquired in this manner, the moving side display 10 performs processing in the order of display before the line of sight movement shown in Fig. 3(b), acceptance of the user's designation on the reference side display 20 shown in Fig. 3(c), and display after the line of sight movement shown in Fig. 3(d). A case in which attention position information is transmitted to the moving side display 10 by a trigger of the reference side display 20 itself will be described later. The attention position information acquisition unit 12 outputs the acquired attention position information to the line of sight movement unit 13.

[0042] The line of sight movement unit 13 is a functional unit that moves the line of sight in the virtual space in the display of the moving side display 10 based on the attention position information acquired by the attention position information acquisition unit 12. The line of sight movement unit 13 may also move the line of sight based on the line of sight in the virtual space in the display of the moving side display 10 before the movement. The line of sight movement unit 13 may move the line of sight in a preset direction based on the line of sight in the virtual space in the display of the moving side display 10 before the movement. When the attention position indicated by the attention position information or the display information related to the attention position is not included in the display of the moving side display 10, the line of sight movement unit 13 may cause the moving side display 10 (i.e., the display unit 11) to perform a display indicating the position of the attention position or the display information. The line of sight movement unit 13 may cause the moving side display 10 (i.e., the display unit 11) to perform a display indicating that the display information related to the attention position indicated by the attention position information is related to the attention position.

[0043] The line of sight movement unit 13 moves the line of sight in the virtual space displayed on the moving display 10, for example, as follows. The line of sight movement unit 13 inputs attention position information from the attention position information acquisition unit 12. The line of sight movement unit 13 moves (synchronizes, transitions) the line of sight in the virtual space related to the display by the display unit 11 to a position specified by the input attention position information. This movement causes the display by the display unit 11 to correspond to the line of sight after the movement.

[0044] Furthermore, the line of sight movement unit 13 may move (rotate) the line of sight in the virtual space so that the line of sight in the virtual space after the movement coincides with the line of sight specified by the attention position information only at the azimuth angle φ. That is, the line of sight movement unit 13 may move the line of sight in the virtual space only in the horizontal direction. In this case, the attention position information may include only information indicating the azimuth angle φ. Furthermore, when the attention position information does not directly indicate the azimuth angle φ, the line of sight movement unit 13 may calculate the azimuth angle to be moved at this point.

[0045] For example, the attention azimuth angle φ, which is the azimuth angle of the direction of the attention position in the virtual space of the reference side display 20 (USER-B) shown in FIG. B 3B, the azimuth angle φ of the line of sight of the virtual space before the movement in the virtual space of the moving display 10 (USER-A) shown in FIG. A In this case, the line of sight movement unit 13 rotates the line of sight in the virtual space of the moving display 10 by π in the horizontal direction (i.e., around the Z axis) to obtain an azimuth angle φ of the line of sight in the virtual space after the movement in the virtual space of the moving display 10, as shown in FIG. A =φ.

[0046] In this way, by moving (synchronizing) the line of sight in the virtual space only in the azimuth angle, i.e., by limiting the degree of freedom of line of sight movement (synchronization) to one, the display of the virtual space can be changed while maintaining the correspondence with the real space in the polar angle direction. This can reduce stress and sickness associated with the spatial recognition of the user of the moving display 10. In other words, it can make the change in display due to line of sight movement more acceptable to the user of the moving display 10.

[0047] In this way, the line of sight movement unit 13 may move the line of sight based on the line of sight in the virtual space in the display of the moving side display 10 before the movement. Also, the line of sight movement unit 13 may move the line of sight in a preset direction (the azimuth direction in the above example) based on the line of sight in the virtual space in the display of the moving side display 10 before the movement.

[0048] When the line of sight in the virtual space moves only in a preset direction such as an azimuth angle as described above, if the polar angle of the line of sight in the virtual space of the reference display 20 and the polar angle of the line of sight before the movement of the virtual space of the moving display 10 are significantly different from each other, there is a risk that the attention position and the display information 200 related to the attention position (attention content, target content) will not be included in the display range of the moving display 10. The display information 200 related to the attention position is, for example, the display information 200 at the attention position, the display information 200 closest to the attention position, or the display information 200 within a certain distance from the attention position. In other words, there is a risk that the above-mentioned display information 200 will be outside the field of view when the line of sight in the virtual space moves.

[0049] The line of sight movement unit 13 may cause the display unit 11 to display the position of the attention position or the display information 200 when the attention position or the display information 200 related to the attention position indicated by the attention position information is not included in the display of the moving side display 10 after the line of sight in the virtual space is moved. The line of sight movement unit 13 calculates the display range on the moving side display 10 from the line of sight in the virtual space after the movement. The line of sight movement unit 13 judges whether the attention position or the display information 200 is included in the calculated display range, and when it judges that the attention position or the display information 200 is not included in the display range, causes the display unit 11 to perform the above display. For example, the display is an arrow 210 (i.e., an arrow tag that follows these) indicating the direction in which the attention position or the display information 200 is located, as shown in FIG. 4(a). The user of the moving side display 10 can easily find the attention position or the display information 200 by referring to this display.

[0050] Furthermore, the line of sight movement unit 13 may cause the display unit 11 to perform a display indicating that the display information related to the attention position indicated by the attention position information is related to the attention position. For example, the display is a highlight display with a red display 220 around the display information 200 as shown in FIG. 4(b). Alternatively, the display is an animation display in which the display information 200 hops up and down as shown in FIG. 4(c). Note that, as long as the display indicates that the display information is related to the attention position, other displays may be used. Furthermore, these displays may be performed when the display information 200 is included in the display range of the moving side display 10, in addition to when it is not included. The user of the moving side display 10 can easily find the display information 200 or easily recognize the display information 200 by referring to this display. The above is the function of the moving side display 10.

[0051] As shown in FIG. 1, the reference side display 20 includes a display unit 21, an attention position information generating unit 22, and a transmitting unit .

[0052] The display unit 21 is a functional unit that performs display on the reference side display 20. The display unit 21 has the same functions as the display unit 11 of the moving side display 10 described above. The display unit 21 shares a virtual space and display information with the moving side display 10, which is another display. The functions of the display unit 21 related to this sharing are also the same as the functions of the display unit 11 of the moving side display 10. Information used for display by the display unit 21 is referenced by a focus position information generation unit 22.

[0053] The attention position information generating unit 22 is a functional unit that generates attention position information indicating an attention position in a virtual space on the reference side display 20 in response to a display on the reference side display 20 by a predetermined trigger. The attention position information generating unit 22 may detect the line of sight in real space of the user wearing the reference side display 20, and generate attention position information in response to the detected line of sight. The attention position information generating unit 22 may generate attention position information in response to a position specified by the user of the reference side display 20 in the display on the reference side display 20. The attention position information generating unit 22 may generate attention position information in response to a position of display information specified by the user of the reference side display 20 in the display on the reference side display 20. The attention position information generating unit 22 may use at least any one of input by voice, operation, and gesture of the user of the reference side display 20 as a predetermined trigger.

[0054] The attention position information generating unit 22 generates attention position information, for example, as follows. The attention position information generating unit 22 inputs a trigger for generating attention position information. For example, the attention position information generating unit 22 receives a request for attention position information from the moving display 10, and inputs the received request as a trigger.

[0055] The attention position information generating unit 22 may input a trigger other than a request from the moving side display 10, such as the following. The attention position information generating unit 22 inputs the voice of the user of the reference side display 20 as a trigger. For example, the attention position information generating unit 22 inputs the voice (utterance) of the user of the reference side display 20 by a microphone or the like provided in the reference side display 20. The attention position information generating unit 22 performs voice recognition on the input voice, and determines whether or not a character string obtained by the voice recognition is a tag that is a character string set in advance as a trigger. Note that the voice recognition may be performed on the reference side display 20, or may be performed on a server that performs voice recognition. When the voice recognition is performed on the server, the attention position information generating unit 22 transmits the voice to the server and receives a voice recognition result from the server.

[0056] When the attention position information generating unit 22 determines that the character string obtained by the voice recognition is a tag that has been set in advance as a trigger, the attention position information generating unit 22 sets the voice as a trigger. The tag is set in advance, for example, by using a UI of the virtual space of the reference side display 20 or a dedicated management system of an information processing device connected to the reference side display 20. In order to distinguish from a conversation between users, the attention position information generating unit 22 may input the voice of the user of the reference side display 20 only while the user is pressing a specific button or while the user is making a specific hand gesture.

[0057] The attention position information generating unit 22 inputs an operation by a user of the reference side display 20 as a trigger. For example, the attention position information generating unit 22 receives the user's operation and determines whether or not the received operation is a pattern that has been set in advance as a trigger. When the attention position information generating unit 22 determines that the received operation is a pattern that has been set in advance as a trigger, the operation is set as a trigger. The pattern may be set in advance in the same manner as when sound is used as a trigger.

[0058] An example of the trigger pattern is an operation of tapping the center of a trackpad of a smartphone connected to the reference side display 20 n times in succession (n is a natural number set in advance, the same applies below). Also, an example of the trigger pattern is an operation of pulling a trigger button n times in succession or pressing a specific button (bumper) n times in succession on a dedicated controller connected to the reference side display 20. Also, an example of the trigger pattern is an operation of reproducing a specific drawing by displaying a laser pointer in a virtual space by a smartphone. The specific figure is, for example, a circle shape. The reproduction of the figure may be a simple air calligraphy or an actual rendering, or any of them. Alternatively, the trigger pattern may be another operation.

[0059] The attention position information generating unit 22 inputs a gesture of the user of the reference side display 20, for example, a hand gesture, as a trigger. For example, the attention position information generating unit 22 receives the user's gesture and determines whether the received gesture is a pattern that has been set in advance as a trigger. When the attention position information generating unit 22 determines that the received gesture is a pattern that has been set in advance as a trigger, the attention position information generating unit 22 sets the gesture as a trigger. The pattern may be set in advance in the same manner as when voice is used as a trigger.

[0060] The trigger pattern may be, for example, a gesture that can be detected by an existing conventional system (e.g., Fist (hand gesture making a fist), OK (hand gesture making an OK sign), C (hand gesture making a C shape)). Alternatively, the trigger pattern may be other gestures. For example, it may be a peace sign, a movement of switching from a rock (clenched fist) to a paper (splayed fingers), or a clap.

[0061] The attention position information generating unit 22 generates attention position information when a trigger is input. The attention position in the virtual space related to the generated attention position information is, for example, the coordinates of a sphere 100 in the virtual space corresponding to the center position (the position of the reticle) of the display screen in the reference side display 20. If the direction of the line of sight in the virtual space is the center position of the display screen, it is the coordinates of the intersection between the line of sight direction (the direction passing through the reticle) and the sphere 100. Since the display unit 11 holds information indicating the direction of the line of sight in the virtual space, the attention position information generating unit 22 generates the attention position information by referring to the information. As described above, when the movement of the line of sight in the virtual space on the moving side display 10 is performed only in a predetermined direction (for example, azimuth), the attention position information may indicate only the predetermined direction of the attention position (the same applies below).

[0062] Alternatively, the attention position in the virtual space related to the generated attention position information may correspond to the line of sight in the real space of the user wearing the reference side display 20. In this case, the attention position information generating unit 22 detects the line of sight in the real space of the user. For example, a camera capable of capturing an image of the user's eyeball is provided in the reference side display 20. The attention position information generating unit 22 inputs an image of the user's eyeball obtained by capturing an image of the camera. The attention position information generating unit 22 detects the line of sight in the real space of the user from the input image of the user's eyeball. For example, the attention position information generating unit 22 detects the movement of the user's eyeball from a moving image of the user's eyeball, and detects the line of sight based on the movement. The attention position information generating unit 22 detects, for example, the position of the line of sight in the real space on the display screen of the reference side display 20 (the position of the intersection between the line of sight and the display screen, for example, the coordinates on the display screen) as the direction of the line of sight to be detected. The detection may be performed by a conventional method.

[0063] The attention position in the virtual space related to the generated attention position information is the coordinates of a sphere 100 in the virtual space corresponding to the line of sight position in the real space on the display screen of the reference side display 20. Since the display unit 11 holds information indicating the line of sight direction in the virtual space (i.e., information indicating a position in the virtual space corresponding to the display screen of the reference side display 20), the attention position information generating unit 22 calculates the coordinates of the sphere 100 in the virtual space corresponding to the line of sight position from that information and the detected line of sight position in the real space, and sets the calculated coordinates as attention position information. The calculation of the position in the virtual space of the coordinates on the display screen may be performed by a conventional method (the same applies below).

[0064] Alternatively, the focus position in the virtual space related to the generated focus position information may correspond to a position (pointing position) specified by the user of the reference side display 20 in the display on the reference side display 20. In this case, the user specifies a position on the display screen (for example, coordinates on the display screen) on the reference side display 20. The position on the display screen is specified by a user operation. The position on the display screen may be specified by a cursor or a pointer. The focus position information generating unit 22 accepts the user operation and obtains information indicating the position on the display screen specified by the operation.

[0065] The focus position in the virtual space related to the generated focus position information is the coordinates of a sphere 100 in the virtual space corresponding to a specified position on the display screen of the reference side display 20. Since the display unit 11 holds information indicating the line of sight direction in the virtual space (i.e., information indicating a position in the virtual space corresponding to the display screen of the reference side display 20), the focus position information generating unit 22 calculates the coordinates of the sphere 100 in the virtual space corresponding to the specified position on the display screen from that information and the specified position on the display screen, and sets this as focus position information.

[0066] Alternatively, the attention position in the virtual space related to the generated attention position information may correspond to the position of display information (content) specified by the user of the reference side display 20 in the display on the reference side display 20. In this case, the user specifies the display information on the reference side display 20. The display information may be displayed on the reference side display 20. In this case, the user specifies the display information on the reference side display 20. The attention position information generating unit 22 acquires information indicating the specified position on the display screen.

[0067] For example, the user specifies the display information as follows. The attention position information generating unit 22 previously stores the display information in association with a tag, which is a character string. For example, the lion 200a shown in FIG. 3 is previously associated with the tag "#LION", the elephant 200b with the tag "#ELEPHANT", and the horse 200c with the tag "#HORSE". The attention position information generating unit 22 inputs the voice (utterance) of the user of the reference side display 20 by a microphone or the like provided in the reference side display 20. The attention position information generating unit 22 performs voice recognition on the input voice, and determines whether or not the character string obtained by the voice recognition is a tag previously associated with the display information. The voice recognition may be performed by the reference side display 20 as described above, or may be performed by a server that performs voice recognition.

[0068] When the character string obtained by the voice recognition is determined to be a preset tag, the attention position information generating unit 22 acquires the virtual space position of the display information associated with the tag. The display unit 11 holds information indicating the virtual space position of the display information, so the attention position information generating unit 22 acquires the information. The attention position information generating unit 22 calculates the coordinates of the sphere 100 in the virtual space corresponding to the virtual space position of the display information from the virtual space position of the display information, and sets the calculated coordinates as the attention position information. For example, when the display information is placed on the sphere 100 in the virtual space, the information indicating the coordinates of the virtual space position of the display information is set as the attention position information. For example, when the display information is placed at a position other than the sphere 100 in the virtual space, the information indicating the coordinates of the intersection of the straight line extending from the line of sight position in the virtual space and passing through the virtual space position of the display information with the sphere 100 in the virtual space is set as the attention position information.

[0069] The display information may be designated by a user operation other than the voice of the user of the reference side display 20. The attention position information generating unit 22 previously stores display information and user operations in association with each other. For example, as shown in FIG. 5(a), a content ID, which is an identifier of display information, and a controller pattern, which is a user operation, are stored in association with each other. Examples of controller patterns are the same as the above-mentioned trigger user operation. The attention position information generating unit 22 accepts the user operation of the reference side display 20, and sets the display information associated with the accepted operation as the designated display information.

[0070] For example, the display information may be specified by a gesture, such as a hand gesture, of the user on the reference side display 20. The attention position information generating unit 22 previously stores the display information and the user gesture in association with each other. For example, as shown in FIG. 5(b), a content ID, which is an identifier of the display information, and a hand gesture are stored in association with each other. An example of the hand gesture is the same as the above-mentioned trigger gesture. The attention position information generating unit 22 receives the user gesture on the reference side display 20, and sets the display information associated with the received gesture as the specified display information.

[0071] Furthermore, the display information may be designated by a method other than the above. For example, the display information may be designated by a cursor or a pointer. Furthermore, when the display information is designated, the line of sight in the virtual space on the reference side display 20 may be aligned with the position of the display information. Furthermore, when the display information is designated as described above, the designation may be used as a trigger for generating attention position information. The attention position information generating unit 22 outputs the generated attention position information to the transmitting unit 23.

[0072] The transmission unit 23 is a functional unit that transmits the attention position information generated by the attention position information generation unit 22 to the mobile display 10, which is another display. The transmission unit 23 inputs the attention position information from the attention position information generation unit 22. When a request for attention position information has been received from the mobile display 10, the transmission unit 23 transmits the attention position information to the mobile display 10 that is the sender of the request.

[0073] When attention position information is generated by a trigger on the reference side display 20 side, the transmission unit 23 transmits the attention position information to the designated moving side display 10. The moving side display 10 to which the attention position information is transmitted may be designated in advance. For example, all moving side displays 10 that share the virtual space and display information may be set as the moving side displays 10 to which the attention position information is transmitted. Alternatively, the moving side display 10 to which the attention position information is transmitted may be designated by the user of the reference side display 20 at the time when the attention position information is transmitted. These are the functions of the reference side display 20.

[0074] Next, the process executed by the moving side display 10 and the reference side display 20 according to this embodiment (the operation method performed by the moving side display 10 and the reference side display 20) will be described with reference to the sequence diagram of Fig. 6. This process is performed when display is performed by the display unit 11 on the moving side display 10, and when display is performed by the display unit 21 on the reference side display 20. Moreover, display is performed on the moving side display 10 and the reference side display 20 after sharing the virtual space and display information with each other.

[0075] In this process, a trigger for generating attention position information is input by the attention position information generating unit 22 in the reference side display 20 (S01). Then, the attention position information generating unit 22 generates attention position information according to the display on the reference side display 20 (S02). Then, the generated attention position information is transmitted by the transmitting unit 23 to the moving side display 10 (S03).

[0076] In the moving display 10, the attention position information acquisition unit 12 receives and acquires the attention position information (S04). Next, the line of sight movement unit 13 moves the line of sight in the virtual space displayed on the moving display 10 based on the attention position information (S05). The above is the process executed by the moving display 10 and the reference display 20 according to this embodiment.

[0077] According to this embodiment, the line of sight in the virtual space in the display on the moving side display 10 is moved based on the focus position in the virtual space on the reference side display 20 according to the display on the reference side display 20. Therefore, on both displays 10, 20, display according to the focus position in the virtual space is performed, and for example, it is possible for users of the respective displays to refer to the same display information.

[0078] As described above, when the displays 10 and 20 are displayed using independent gazes, the display information that each user sees is different. If the present embodiment allows users to easily refer to the same display information, it is possible to smoothly communicate between users while referring to the display information, without communicating the position of the display information in the virtual space in words. In other words, according to the present embodiment, when information of a common virtual space is displayed between the multiple displays 10 and 20, the display can be appropriately performed.

[0079] Also, as described above, the moving-side display 10 may have the following configuration. The line of sight may be moved based on the line of sight in the virtual space in the display of the moving-side display 10 before the movement. More specifically, the line of sight may be moved only in a preset direction based on the line of sight in the virtual space in the display of the moving-side display 10 before the movement, for example, in the azimuth angle as described above. According to this configuration, the change in display due to the movement of the line of sight can be made more acceptable to the user of the moving-side display 10. However, the line of sight does not necessarily have to be moved as described above, and may be moved in any way as long as it is based on the attention position information.

[0080] Furthermore, when the attention position indicated by the attention position information or the display information related to the attention position is not included in the display of the mobile display 10 after the gaze is moved, the display unit 11 may be caused to perform a display indicating the attention position or the position of the display information. According to this configuration, as described above, the user of the mobile display 10 can easily find the attention position or the display information by referring to this display.

[0081] Furthermore, as described above, after the line of sight moves, the display unit 11 may display information relating to the attention position indicated by the attention position information, indicating that the information relates to the attention position. With this configuration, as described above, the user of the moving display 10 can easily find the display information 200 or easily recognize the display information 200 by referring to this display. However, it is not necessarily required to display these information when the line of sight moves.

[0082] Furthermore, as described above, the reference side display 20 may have the following configuration. In generating attention position information, the line of sight in real space of the user wearing the reference side display 20 may be detected, and attention position information may be generated according to the detected line of sight. In addition, in displaying on the reference side display 20, attention position information may be generated according to a position specified by the user of the reference side display 20. With these configurations, the line of sight of the user wearing the reference side display 20 can be shared based on the position to which the user is paying more attention. As a result, when information of a common virtual space is displayed between the multiple displays 10 and 20, the display can be more appropriately performed.

[0083] Furthermore, in the display on the reference side display 20, attention position information may be generated according to the position of display information specified by the user of the reference side display 20. With this configuration, the user wearing the reference side display 20 can share his / her line of sight based on the display information he / she is paying attention to. As a result, when information of a virtual space common to the multiple displays 10, 20 is displayed, the display can be more appropriately performed. However, the attention position information does not necessarily need to be generated in this manner, and may be generated according to the display on the reference side display 20.

[0084] Furthermore, at least one of voice, operation, and gesture input by the user of the reference-side display 20 may be used as a trigger for generating attention position information. With this configuration, the user of the reference-side display 20 can easily share the line of sight. However, the trigger for generating attention position information does not necessarily have to be the above.

[0085] In the above-mentioned embodiment, the display control device has been described as the moving side display 10 and the reference side display 20 having a display function, but it does not necessarily have to have a display function. The display control device is a device (system) connected to a display (i.e., equipped with a display unit 11 or a display unit 21) that displays display information commonly arranged in a virtual space common to other displays according to the line of sight of each display in the virtual space, and controls the display on the display, and may be one that includes the above-mentioned attention position information acquisition unit 12 and line of sight movement unit 13, or one that includes the above-mentioned attention position information generation unit 22 and transmission unit 23.

[0086] Note that movement of the line of sight in the virtual space on the moving display 10, for example, synchronization with the line of sight in the virtual space on the reference display 20, may be a one-off synchronization performed at that moment like a snapshot, or may be dynamic synchronization that tracks the line of sight in the virtual space on the reference display 20. When dynamic synchronization is performed, attention position information is continuously transmitted from the reference display 20 to the moving display 10, and the moving display 10 sequentially moves the line of sight in the virtual space based on the attention position information.

[0087] Furthermore, in the reference side display 20, a tag or pattern used for detecting a trigger or specifying display information may be set only in a specific reference side display 20, or may be set commonly in multiple (e.g., all) reference side displays 20. If set only in a specific reference side display 20, only a specific user who uses that reference side display 20 can use functions based on the set information. If set commonly in multiple (e.g., all) reference side displays 20, multiple (e.g., all) users who use that reference side display 20 can use functions based on the set information.

[0088] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. The method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically combined, or may be realized by using two or more devices that are physically or logically separated and directly or indirectly connected (for example, by wire, wirelessly, etc.). The functional blocks may be realized by combining the one device or the multiple devices with software.

[0089] Functions include, but are not limited to, judgment, determination, judgment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs the function of transmission is called a transmitting unit or a transmitter. In either case, as described above, there is no particular limitation on the method of realization.

[0090] For example, the displays 10 and 20 according to an embodiment of the present disclosure may function as a computer that performs information processing according to the present disclosure. Fig. 7 is a diagram showing an example of a hardware configuration of the displays 10 and 20 according to an embodiment of the present disclosure. The displays 10 and 20 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

[0091] In the following description, the term "apparatus" may be interpreted as a circuit, a device, a unit, etc. The hardware configuration of displays 10 and 20 may be configured to include one or more of the devices shown in the drawings, or may be configured to exclude some of the devices.

[0092] Each function of displays 10 and 20 is realized by loading a specific software (program) onto hardware such as a processor 1001 and a memory 1002, causing the processor 1001 to perform calculations, control communication via a communication device 1004, and control at least one of the reading and writing of data in memory 1002 and storage 1003.

[0093] The processor 1001, for example, operates an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, each function of the displays 10 and 20 described above may be realized by the processor 1001.

[0094] Moreover, the processor 1001 reads out a program (program code), a software module, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to the read out programs. As the program, a program that causes a computer to execute at least a part of the operations described in the above-mentioned embodiment is used. For example, each function of the displays 10 and 20 may be realized by a control program stored in the memory 1002 and operated by the processor 1001. Although the above-mentioned various processes have been described as being executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The program may be transmitted from a network via a telecommunication line.

[0095] The memory 1002 is a computer-readable recording medium, and may be composed of at least one of, for example, a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store a program (program code), software modules, etc. that are executable to perform information processing according to an embodiment of the present disclosure.

[0096] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, and the like. Storage 1003 may be called an auxiliary storage device. The storage medium provided in display 10, 20 may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0097] The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via at least one of a wired network and a wireless network, and is also called, for example, a network device, a network controller, a network card, or a communication module.

[0098] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that performs output to the outside. The input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0099] In addition, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0100] Furthermore, displays 10 and 20 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc., and some or all of the functional blocks may be realized by the hardware. For example, processor 1001 may be implemented using at least one of these pieces of hardware.

[0101] The order of the steps, sequences, flow charts, etc. of each aspect / embodiment described in this disclosure may be changed unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0102] The input and output information may be stored in a specific location (e.g., memory) or may be managed using a management table. The input and output information may be overwritten, updated, or added to. The output information may be deleted. The input information may be transmitted to another device.

[0103] The determination may be based on a value represented by a single bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0104] Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to execution. In addition, notification of specific information (e.g., notification that "X is the case") is not limited to being done explicitly, but may be done implicitly (e.g., not notifying the specific information).

[0105] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0106] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0107] Additionally, software, instructions, information, etc. may be transmitted or received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired and / or wireless technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave, etc.), then these wired and / or wireless technologies are included within the definition of transmission media.

[0108] As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0109] Furthermore, the information, parameters, etc. described in this disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information.

[0110] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in a memory), and the like. In addition, "judgment" and "decision" can include considering resolving, selecting, choosing, establishing, comparing, etc., to be a "judgment" or "decision." In other words, "judgment" and "decision" can include considering some action to be a "judgment" or "decision." In addition, "judgment" can be interpreted as "assuming," "expecting," "considering," etc.

[0111] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0112] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0113] Any reference to an element using a designation such as "first," "second," etc., used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must precede the second element in some way.

[0114] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Further, when used in this disclosure, the term "or" is not intended to be an exclusive or.

[0115] In this disclosure, where articles have been added due to translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0116] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different." [Explanation of symbols]

[0117] 10...moving display, 11...display unit, 12...attention position information acquisition unit, 13...gaze movement unit, 20...reference display, 21...display unit, 22...attention position information generation unit, 23...transmission unit, 1001...processor, 1002...memory, 1003...storage, 1004...communication device, 1005...input device, 1006...output device, 1007...bus.

Claims

1. A display control device that controls display on a display that displays display information commonly arranged in a virtual space common to other displays in accordance with a line of sight for each display in the virtual space based on a position or orientation in real space for each display, an attention position information acquisition unit that acquires attention position information indicating an attention position of a virtual space on the other display in accordance with a display on the other display; a line of sight movement unit that moves a line of sight in a virtual space displayed on the display based on the attention position information acquired by the attention position information acquisition unit; A display control device comprising:

2. The display control device according to claim 1 , wherein the line of sight movement unit moves the line of sight based also on a line of sight in a virtual space displayed on the display before the movement.

3. The display control device according to claim 2 , wherein the line-of-sight movement unit moves the line of sight in a preset direction based on a line of sight in a virtual space displayed on the display before the movement.

4. The display control device according to claim 1 , wherein the gaze movement unit causes the display to display an indication of the position of interest or the position of the display information when the position of interest indicated by the position of interest information or display information related to the position of interest is not included in the display of the display.

5. The display control device according to claim 1 , wherein the line-of-sight movement unit causes a display to display information relating to the attention position indicated by the attention position information, indicating that the display information relates to the attention position.

Images