Display Control Device

Abstract

The present invention easily and appropriately moves display information in a display using a virtual space.　A display 10, which is a display control apparatus, is an apparatus for controlling display in the display 10 for displaying display information, which is disposed in a virtual space, in accordance with a line of sight in the virtual space. The display 10 comprises: an opportunity detection unit 12 for detecting an opportunity for moving the display information in the virtual space; a setting unit 13 for setting the position and direction in the virtual space used for moving the display information in the virtual space; a conversion unit 14 for converting a coordinate system of the virtual space on the basis of the set position and direction in the virtual space when the opportunity has been detected; and a movement unit 15 for moving, in the converted coordinate system, the display information included in a region corresponding to the set position and direction in the virtual space and for restoring and converting the coordinate system of the virtual space to the original coordinate system.

Description

[Technical field]

[0001] The present invention relates to a display control device that controls display on a display. [Background technology]

[0002] Conventionally, in displays such as head-mounted displays, display information arranged in a virtual space is displayed according to the line of sight in the virtual space. When the display information moves in the virtual space, the display changes according to the movement. Patent Document 1 shows that the display information in the virtual space is specified and moved according to the line of sight in the virtual space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-10702 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the method of designating display information to be moved individually by gaze as shown in Patent Document 1, it may be difficult to easily and appropriately move the display information. For example, in the above method, it is difficult or impossible to designate and move display information that is hidden by other display information and not displayed. In addition, the same problem occurs in the method of designating display information to be moved individually by user operation, not by gaze.

[0005] One embodiment of the present invention has been made in consideration of the above, and aims to provide a display control device that can easily and appropriately move display information in a display using a virtual space. [Means for solving the problem]

[0006] A display control device according to one embodiment of the present invention is a display control device that controls display on a display that displays display information arranged in a virtual space according to a line of sight in the virtual space, and includes: a trigger detection unit that detects a trigger for moving the display information in the virtual space; a setting unit that sets a position and direction in the virtual space used for moving the display information in the virtual space; a conversion unit that, when a trigger is detected by the trigger detection unit, converts a coordinate system of the virtual space based on the position and direction in the virtual space set by the setting unit; and a movement unit that moves, in the coordinate system converted by the conversion unit, display information included in an area according to the position and direction in the virtual space set by the setting unit, and restores and converts the coordinate system of the virtual space to the original coordinate system. The moving unit moves each piece of display information to be moved at a speed corresponding to the position of the display information in the area. .

[0007] In a display control device according to one embodiment of the present invention, display information included in an area corresponding to a position and direction in a virtual space used to move the display information is moved. Therefore, it is possible to easily move display information that could not be easily moved by conventional methods. Furthermore, the coordinate system of the virtual space is converted when moving the display information. Therefore, it is possible to move the display information after converting it into a coordinate system that makes it easier to move the display information. In this way, according to the display control device according to one embodiment of the present invention, it is possible to easily and appropriately move display information in a display using a virtual space. Effect of the Invention

[0008] According to one embodiment of the present invention, it is possible to easily and appropriately move displayed information in a display using a virtual space. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a diagram illustrating a functional configuration of a display which is a display control device according to an embodiment of the present invention. [Diagram 2] 1A to 1C are diagrams illustrating examples of display information arranged in a virtual space and areas used for movement. [Diagram 3]13A and 13B are diagrams illustrating another example of display information arranged in a virtual space and an area used for movement. [Figure 4] 10A and 10B are diagrams illustrating an example of movement of display information in a virtual space. [Diagram 5] 4 is a flowchart showing a process executed on a display which is a display control device according to the embodiment of the present invention. [Figure 6] 1 is a diagram illustrating a hardware configuration of a display that is a display control device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of a display control device according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals and duplicated explanations will be omitted.

[0011] FIG. 1 shows the functional configuration of a display 10 which is a display control device according to this embodiment. The display 10 which is a display device controls the display on the display 10 itself. The display 10 displays display information arranged in a virtual space (e.g., a virtual three-dimensional space) according to the line of sight in the virtual space. The display information is, for example, content such as text, images, and moving images. Furthermore, the display information may be anything other than the above, as long as it can be arranged in the virtual space and displayed according to the line of sight in the virtual space.

[0012] For example, the display 10 is a display that displays virtual content (display information) by XR such as AR (Augmented Reality), MR (Mixed Reality), or VR (Virtual Reality). The display 10 may be a transparent display that is attached to the eye of a user. For example, the display 10 may be a glasses-type head-mounted display, that is, see-through glasses (smart glasses, XR glasses). In the following, the display 10 will be described as being attached to the eye of a user, that is, to the user's head. However, the display 10 does not need to be attached to a user.

[0013] Display 10 displays, in a visible state, display information in an area visible in the line of sight direction in virtual space from a reference position of the line of sight in virtual space (starting point of the line of sight). The line of sight in virtual space is configured to include a reference position of the line of sight in virtual space and a line of sight direction in virtual space. Display 10 can perform display by moving the line of sight in virtual space. By moving the line of sight in virtual space, the display information visible in the virtual space changes, and the display on display 10 also changes.

[0014] The line of sight of the display 10 in the virtual space may be based on the position or orientation of the display 10 in the real space. Therefore, the display 10 may be provided with a sensor that detects the movement (i.e., change in position) and orientation (i.e., orientation) of the display 10 itself. For example, an acceleration sensor that detects acceleration and a gyro sensor that detects angular velocity may be provided. The display 10 may detect the movement and orientation of the display 10 itself using these sensors, and move the line of sight in the virtual space according to the detected movement and orientation. That is, the line of sight may be moved according to the orientation of the head (face) of the user wearing the display 10. However, the movement of the line of sight in the virtual space may be performed according to detection of the position or orientation by a sensor other than the above.

[0015] Furthermore, the movement of the line of sight in the virtual space may be performed by a user's operation on the display 10, not by a sensor as described above. Display on the display 10 using the line of sight in the virtual space, including the movement of the line of sight in the virtual space, may be performed in the same manner as display using conventional AR, MR, VR, etc. Note that information related to the virtual space may be stored and processed on the display 10, or may be stored and processed on a cloud connected to the display 10.

[0016] The movement of the line of sight in the virtual space is performed in a preset manner. For example, the movement of the line of sight in the virtual space is performed with a predetermined degree of freedom. The preset degree of freedom is, for example, 6 DoF (Degree of Freedom).

[0017] In 6DoF, the reference position of the line of sight in the virtual space can move in three axial directions of the X-axis, Y-axis, and Z-axis of the virtual space. In addition, in 6DoF, the direction of the line of sight in the virtual space can rotate around three axes of the X-axis, Y-axis, and Z-axis of the virtual space. Therefore, when a user wearing the display 10 moves his / her head, it is possible to see display information corresponding to the movement. However, the line of sight in the virtual space may be moved with degrees of freedom other than those described above and by methods other than those described above.

[0018] In the display 10, an operation related to the display, for example, a user's operation on the display information, may be performed. The display 10 accepts the user's operation and reflects the operation on the display. For example, an operation such as generation, movement, enlargement, and reduction of the display information in a virtual space, and character input on the display information may be performed. The operation may be performed, for example, using an information processing device such as a smartphone carried by a user wearing the display 10. In this case, the display 10 and the smartphone are connected in advance so as to be able to transmit and receive information.

[0019] The operation may be performed by a dedicated controller attached to the head mounted display. The operation may be performed by a user's gesture. The part of the user performing the gesture is, for example, the hand. That is, the operation may be performed by a hand tracking gesture. However, the operation may be performed by a gesture with a part other than the hand. When the operation is performed by the user's gesture, a camera is provided so as to capture an image of the part performing the gesture, and the gesture is determined by a moving image captured by the camera. The operation may be performed by any method other than the above. The above display and operation on the display 10 may be performed in the same manner as in the conventional method.

[0020] The display on display 10 and the display on the other displays may use display information commonly arranged in a common virtual space. That is, the virtual space and display information may be shared among a plurality of displays. The plurality of displays that share the virtual space and display information are set in advance. The line of sight of the virtual space in the display on display 10 and the display on the other displays may be independent for each display. If the lines of sight on the displays are different, for example, different displays are performed on each display according to the respective lines of sight.

[0021] The virtual space may correspond to the real space. As a result, for example, by directing the display 10 to a specific position in the real space, display information arranged at a position in the virtual space corresponding to the specific position can be displayed. As described above, the virtual space and display information are shared among a plurality of displays, and the virtual space corresponds to the real space, so that asynchronous communication can be performed between users of the plurality of displays. For example, after a user arranges display information generated by the user in the virtual space, another user can arrange the display to a position in the real space corresponding to the arrangement position of the display information, and the display information can be displayed on the display of the other user.

[0022] The above-mentioned display information is, for example, a message (words, text) to other users or a three-dimensional video. The display information may also be a display of a soap bubble floating in a virtual space, and when the soap bubble is popped by a user's operation, etc., the above-mentioned message and content such as a three-dimensional video may be referred to. In other words, the content may be displayed in space with the content inside the soap bubble.

[0023] A conventional display having the above-mentioned functions can be used as the display 10. The display 10 may also have a communication function. The communication function of the display 10 may be used to share the above-mentioned virtual space and display information, and to realize the functions according to this embodiment. The above-mentioned functions of the display 10 and a part of the functions according to this embodiment described later may be possessed by an information processing device (e.g., a smartphone or a PC (personal computer)) connected to a display device (e.g., the above-mentioned see-through glasses). That is, the display 10 according to this embodiment may be realized by including a display device and an information processing device.

[0024] Next, the functions of the display 10 according to this embodiment will be described. As shown in Fig. 1, the display 10 includes a display unit 11, a trigger detection unit 12, a setting unit 13, a conversion unit 14, and a movement unit 15. In addition to the above, the display 10 may include functions included in conventional display devices such as conventional see-through glasses.

[0025] The function of the display 10 described below is for moving the display information arranged in the virtual space. For example, if the display information is far from the reference position of the line of sight in the virtual space, the display information is displayed small. If the display information is moved closer to the reference position of the line of sight, the display information is displayed large, so that the user can see it clearly.

[0026] As described above, in the conventional method of specifying (selecting) display information to be moved individually by gaze, it is impossible or difficult to specify and move display information that is hidden by other display information and is not displayed. In addition, when multiple pieces of displayed display information, i.e., multiple pieces of display information included in the range of the user's field of vision, are brought together and moved closer to the reference position of the gaze in the virtual space, it is difficult to move them easily and appropriately using the conventional method described above. The same problem occurs in the method of specifying display information to be moved individually by user operation rather than by gaze specification.

[0027] Also, a method of designating display information to be moved by a user touching the display information with his / her hand using a hand tracking gesture or a dedicated controller, etc., is conceivable. However, in this method, the display information that can be designated is limited to a range within reach. In order to move display information that is far away, for example, the user himself / herself must move. Also, a method of designating display information to be moved by a pointer beam is conceivable. However, in this method, delicate operation is required, especially when designating display information that is far away. In addition, in each of the above methods, it is difficult or impossible to move multiple pieces of display information at once. The function according to this embodiment solves the above problems and allows display information to be moved easily and appropriately. For example, the function according to this embodiment allows the user to operate display information that is out of reach without burdening the user while wearing the display 10.

[0028] The movement of the display information on the display 10 may be performed by a function other than that of the present embodiment, in addition to the function of the present embodiment. For example, the display information may be moved by any of the methods described above.

[0029] The display unit 11 is a functional unit that performs display on the display 10. The display unit 11 inputs and displays display information to be displayed on the display 10. For example, the display unit 11 may input display information stored in the display 10, or may receive and input display information from the outside. As described above, the display unit 11 displays display information arranged in the virtual space according to the line of sight in the virtual space. Also, as described above, the display unit 11 may share the virtual space and display information with other displays. The sharing of the virtual space and display information is performed, for example, by transmitting and receiving the display information and information indicating the position of the virtual space where the display information is arranged with the other displays. Also, the sharing of the virtual space and display information may be performed via a server with which each of the displays can communicate, rather than a direct exchange between the displays. Also, the sharing of the virtual space and display information between the displays may be performed by a method other than the above.

[0030] The above-mentioned functions of the display unit 11 may be the same as conventional functions. Moreover, the display by the display unit 11 is controlled by the movement unit 15 as described later.

[0031] The trigger detection unit 12 is a functional unit that detects a trigger for moving display information in a virtual space. For example, the trigger detection unit 12 stores a user operation that is the above-mentioned trigger in advance. When the trigger detection unit 12 receives a user operation and the received user operation is one that has been stored in advance, it is determined that the trigger has been detected. The user operation that is the above-mentioned trigger is, for example, pressing a button, inputting a specific command by gesture or voice. Note that the trigger may be a user operation other than the above, or may be something other than a user operation. When the trigger detection unit 12 detects a trigger, it notifies the setting unit 13 of that effect.

[0032] The setting unit 13 is a functional unit that sets a position and a direction in the virtual space used for moving the display information in the virtual space. The setting unit 13 may set the position and the direction of the line of sight in the virtual space to the position and the direction in the virtual space used for moving the display information in the virtual space.

[0033] The set position and direction are the reference for determining the display information to be moved. For example, the reference position and direction of the line of sight in the virtual space are set in advance to be used as the position and direction used for movement. The setting unit 13 receives a notification of the detection of the trigger from the trigger detection unit 12. At the timing of receiving the notification, the setting unit 13 acquires information indicating the reference position and direction of the line of sight in the virtual space held by the display unit 11, and sets the reference position and direction of the line of sight as the position and direction in the virtual space used for moving the display information. The information indicating the reference position of the line of sight in the virtual space is, for example, a coordinate in the coordinate system (absolute coordinate system) of the virtual space. The information indicating the direction of the line of sight in the virtual space is, for example, a vector in the coordinate system of the virtual space. The coordinate system of the virtual space is, for example, a Cartesian coordinate system (X, Y, Z).

[0034] The setting unit 13 outputs information indicating the set position and direction in the virtual space used for movement to the conversion unit 14. Note that the position and direction in the virtual space used for movement of the display information do not need to be the position and direction of the line of sight in the virtual space, and may be other positions and directions. Also, the position and direction in the virtual space used for movement of the display information do not need to be set according to the setting criteria stored in advance as described above, and may be set, for example, by accepting a user operation at the time of setting.

[0035] The conversion unit 14 is a functional unit that converts the coordinate system of the virtual space based on the position and direction in the virtual space set by the setting unit 13 when a trigger is detected by the trigger detection unit 12. The conversion unit 14 inputs information indicating the position and direction in the virtual space used for movement from the setting unit 13. For example, the conversion unit 14 converts the coordinate axes of the virtual space so that the position indicated by the input information is the origin and the direction indicated by the information is the preset direction extending from the origin. When the reference position and direction of the line of sight in the virtual space are the position and direction used for movement as described above, the reference position of the line of sight is converted into a coordinate system with the origin. That is, the conversion unit 14 converts the coordinate system (X, Y, Z) of the virtual space corresponding to the real space into the coordinate system (X', Y', Z') of the user's viewpoint (temporary coordinate system). The coordinate system after conversion may be an orthogonal coordinate system as described above, or may be another coordinate system (for example, a spherical coordinate system).

[0036] The transformation of the coordinate system itself may be performed by a conventional method. The transformation unit 14 also calculates the position (coordinates) of the display information in the transformed coordinate system (X', Y', Z'). The transformation unit 14 outputs information indicating the transformed coordinate system (X', Y', Z') to the movement unit 15.

[0037] The movement unit 15 is a functional unit that moves display information included in an area corresponding to the position and direction in the virtual space set by the setting unit 13 in the coordinate system converted by the conversion unit 14, and restores and converts the coordinate system of the virtual space to the original coordinate system. The movement unit 15 may move display information included in a fan-shaped or strip-shaped area corresponding to the position and direction in the virtual space set by the setting unit 13. The movement unit 15 may move each piece of display information to be moved at a speed corresponding to the position of the display information in the above-mentioned area. The movement unit 15 may reduce or enlarge the display information in accordance with the movement of the display information. The movement unit 15 performs, for example, the following process.

[0038] The movement unit 15 inputs information indicating the transformed coordinate system (X', Y', Z') from the conversion unit 14. The movement unit 15 sets an area (range) in the transformed coordinate system to be used for moving the display information. For example, as shown in FIG. 2(a), the movement unit 15 sets a fan-shaped area 200 in the transformed coordinate system. More specifically, the area 200 is an area spreading in a cone or pyramid shape. When viewed from a direction perpendicular to the spreading direction of the area 200 (for example, from above), the area 200 spreads in a fan shape as shown in FIG. 2(a). The fan shape may spread infinitely or may have a fixed size.

[0039] The moving unit 15 sets the above-mentioned region 200 according to the position and direction in the virtual space set by the setting unit 13. Specifically, the moving unit 15 sets the above-mentioned region 200 with the origin of the transformed coordinate system (i.e., the reference position of the line of sight in the virtual space) corresponding to the position set by the setting unit 13 as a vertex. The moving unit 15 also sets the above-mentioned region 200 with the direction of the transformed coordinate system (i.e., the line of sight direction in the virtual space) corresponding to the direction set by the setting unit 13 as the direction of the center of the angle spreading from the origin of the above-mentioned region 200. That is, the moving unit 15 sets the region 200 corresponding to the range displayed on the display 10, that is, the region 200 corresponding to the user's field of view, in the transformed coordinate system. Note that the set region 200 does not have to match the range displayed on the display 10. When the set region 200 and the range displayed on the display 10 match and the display 10 displays a rectangle, the set region 200 becomes a region spreading in a pyramid shape accordingly.

[0040] The moving unit 15 determines the display information 100 included in the set region 200. The display information 100 included in the region 200 may be the whole display information 100 included in the region 200, or a central axis preset for each display information 100 may be included in the region 200. The moving unit 15 sets the display information 100 included in the set region 200 as the display information 100 to be moved. As shown in FIG. 2(b), the moving unit 15 moves the display information 100 to be moved in a preset direction. As shown in FIG. 2(b), the preset direction is, for example, a direction toward the origin, which is the apex of the region 200 (i.e., the reference position of the line of sight in the virtual space). That is, in the display on the display 10, the display information 100 is moved so as to approach the user (is drawn to the user).

[0041] Since the movement of the display information 100 is toward the origin, the coordinate values ​​in the coordinate system after the transformation of the display information 100 are multiplied by t (t is a positive value less than 1). When the movement unit 15 moves the display information 100, it performs a restoration transformation of the coordinate system of the virtual space to the original coordinate system. The restoration transformation of the coordinate system itself may be performed by a conventional method. The display unit 11 reflects the moved display information 100 in the display on the display 10. Therefore, the user can see the moved and displayed display information 100.

[0042] The movement unit 15 may also move the display information 100 at a constant speed set in advance. For example, a plurality of values ​​of the above t may be prepared, and the movement unit 15 may calculate the converted coordinates in order, so that the display information 100 gradually moves (comes closer to the user) in the display on the display 10. Also, a user operation to stop the movement may be accepted, and the display information 100 may continue to move until the operation is accepted.

[0043] Note that the moving direction of the display information 100 may not be the direction toward the origin, but the direction away from the origin, that is, the direction away from the user. Also, the moving direction of the display information 100 may be a direction other than the above. Further, the type of trigger detected by the trigger detection unit 12 and the moving direction of the display information 100 may be associated in advance, and the display information 100 may be moved in a direction corresponding to the type of trigger detected. Also, the movement of the display information 100 in the coordinate system after conversion may be performed by a method other than the above.

[0044] Also, the moving unit 15 may move the display information 100 at a speed corresponding to the position of the display information 100 in the above region 200 for each display information 100 to be moved. For example, as shown in FIG. 2(a), the moving unit 15 sets a partial region corresponding to the angle extending from the origin of the region 200. Specifically, the moving unit 15 sets a partial region 210 of a central angle Θ extending from the origin of the region 200 and a partial region 220 of an angle Θ´ excluding the central angle Θ. The above angle Θ is, for example, 1 to 2°, which is the angle of the central vision of a human. The above angle Θ´ is, for example, 4 to 20°, which is the angle of the range of the effective visual field of a human.

[0045] The moving unit 15 moves the display information 100 included in the partial region 210 at a speed v and moves the display information 100 included in the partial region 220 at a speed sv. Note that v and s are preset values, and 0 < s < 1. That is, the display information 100 included in the inner partial region 210 is moved quickly, and the display information 100 included in the outer partial region 210 is moved slowly. As a result, the display information 100 moves quickly in the portion close to the center of the display screen of the display 10 and moves slowly in the portion outside thereof. By moving the display information 100 in this way, the movement of the display information 100 can be made to conform to the user's visual sense.

[0046] The movement direction of the above-mentioned region 200 and the display information 100 is not limited to the above. For example, as shown in FIG. 3, the movement unit 15 may set a strip-shaped region 200 according to the position and direction in the virtual space set by the setting unit 13, and use the set region to move the display information 100. Specifically, the movement unit 15 sets a strip-shaped region 200 that includes the origin of the transformed coordinate system corresponding to the position set by the setting unit 13 at its end and extends in the direction set by the setting unit 13. The movement unit 15 also moves the display information 100 included in the set region 200 in parallel with the direction set by the setting unit 13. The entire transformed coordinate system may be the above-mentioned region 200.

[0047] The movement of display information will be explained again with reference to Fig. 4. In Fig. 4, display information 100 is arranged in a virtual space, and the line of sight in the virtual space is from left to right, i.e., toward the arranged display information 100. When the line of sight in the virtual space moves with 6DoF, as shown in Fig. 4(a), the display information 100 in the back may be hidden by other display information 100 and may not be visible or may be difficult to see. In this case, since the distance is large, the appearance of the display information 100 in the back does not change much even if the line of sight in the virtual space is slightly tilted.

[0048] When the display information is moved by the function of the present embodiment described above, each piece of display information 100 approaches the reference position of the line of sight in the virtual space, as shown in FIG. 4(b). In this case, the movement of the display information 100 changes the distance u in the depth direction (the direction of the line of sight in the virtual space) to tu as described above, and the height v of the display information 100 is not changed. However, the display information 100 may be moved so as to change the height v. As shown in FIG. 4(b), when the display information 100 approaches the reference position of the line of sight in the virtual space as a result of the movement of the display information, the rear display information 100 can also be confirmed by moving the line of sight in the virtual space a little. In other words, the rear display information 100 can also be displayed on the display 10 so that the user can appropriately recognize it.

[0049] Similarly, two pieces of display information 100 that overlap in the line of sight, as indicated by the double arrows in FIG. 3, can be moved closer to the reference position of the line of sight, making it possible to check the piece of display information 100 that is hidden by the other piece of display information 100, and to perform operations such as selecting that piece of display information 100.

[0050] The movement unit 15 may also reduce or enlarge the display information 100 in response to the movement of the display information 100. For example, the movement unit 15 stores a reduction ratio or enlargement ratio of the display information 100 in response to the movement direction and the amount of movement, and reduces or enlarges the display information 100 in response to the movement of the display information 100 based on the stored information. When reducing the display information 100, an arbitrary minimum size may be set in advance and the display information 100 may be reduced to that size. When enlarging the display information 100, an arbitrary maximum size may be set in advance and the display information 100 may be enlarged to that size. The reduction or enlargement of the display information 100 is performed, for example, for the purpose of preventing the display information 100 from becoming difficult to view due to the movement of the display information 100. The above is the function of the display 10 according to this embodiment.

[0051] Next, a process executed by the display 10 according to the present embodiment (a method of operation performed by the display 10) will be described with reference to the flowchart of Fig. 5. This process is performed when display is performed by the display unit 11 on the display 10.

[0052] In this process, the opportunity detection unit 12 detects an opportunity to move the display information in the virtual space (S01). Then, the setting unit 13 sets a position and a direction in the virtual space used for moving the display information in the virtual space (S02). Then, the conversion unit 14 converts the coordinate system of the virtual space based on the position and direction in the virtual space set by the setting unit 13 (S03). Then, the movement unit 15 moves the display information 100 included in the area corresponding to the position and direction in the virtual space set by the setting unit 13 in the converted coordinate system (S04). Then, the movement unit 15 restores and converts the coordinate system of the virtual space to the original coordinate system (S05). The movement of the display information 100 by the above process is reflected in the display by the display unit 11 on the display 10. The above is the process executed by the display 10 according to this embodiment.

[0053] In this embodiment, the display information 100 included in the area 200 according to the position and direction in the virtual space used to move the display information 100 is moved. Therefore, the display information 100, which could not be easily moved by the conventional method such as, for example, the designation of the display information by the line of sight and the user's operation, can be easily moved. In addition, when the display information 100 is moved, the coordinate system of the virtual space is converted. Therefore, the display information 100 can be moved after being converted into a coordinate system in which the display information is easily moved. For example, as described above, the display information 100 can be easily moved by multiplying the coordinate value by t. In this way, according to this embodiment, the display information can be easily and appropriately moved in the display using the virtual space. As a result, for example, by making the display information 100 appear near the user as described above, it is possible to improve visibility and ease of selection.

[0054] Also, as in the above-described embodiment, the setting unit 13 may set the position and direction of the line of sight in the virtual space to the position and direction in the virtual space used to move the display information 100 in the virtual space. With this configuration, the display information 100 can be moved appropriately according to the position and direction of the line of sight in the virtual space. However, the position and direction in the virtual space used to move the display information 100 in the virtual space may be any position and direction other than the position and direction of the line of sight in the virtual space.

[0055] Furthermore, as in the above-described embodiment, the movement unit 15 may move the display information 100 included in the sector-shaped or strip-shaped area 200 according to the position and direction in the virtual space set by the setting unit 13. With this configuration, it is possible to make the display information 100 to be moved appropriate. However, as described above, the above-described area 200 is not limited to the above and may have any shape.

[0056] Furthermore, as in the above-described embodiment, the movement unit 15 may move each piece of display information 100 to be moved at a speed according to the position of the display information 100 in the area 200. According to this configuration, as described above, for example, the movement of the display information 100 can be made to match the visual sense of the user.

[0057] Furthermore, as in the above-described embodiment, the movement unit 15 may reduce or enlarge the display information 100 in response to the movement of the display information 100. With this configuration, for example, it is possible to prevent the display information 100 from becoming difficult to view due to the movement of the display information 100. However, the display information 100 does not necessarily need to be reduced or enlarged.

[0058] In the above embodiment, the display control device has been described as a display 10 having a display function, but it does not necessarily have to have a display function. The display control device is a device (system) connected to a display that displays display information arranged in a virtual space according to the line of sight in the virtual space (i.e., equipped with a display unit 11) and controls the display on the display, and may be equipped with the above-mentioned opportunity detection unit 12, setting unit 13, conversion unit 14, and movement unit 15. For example, some or all of the above-mentioned functional units 12 to 15 may be provided in a device such as a server that can transmit and receive information to and from the display. In this case, each functional unit 12 to 15 provided in the device such as the server may transmit and receive input and output information to and from the display.

[0059] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. The method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically combined, or may be realized by using two or more devices that are physically or logically separated and directly or indirectly connected (for example, by wire, wirelessly, etc.). The functional blocks may be realized by combining the one device or the multiple devices with software.

[0060] Functions include, but are not limited to, judgment, determination, judgment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs the function of transmission is called a transmitting unit or a transmitter. In either case, as described above, there is no particular limitation on the method of realization.

[0061] For example, the display 10 according to an embodiment of the present disclosure may function as a computer that performs the information processing of the present disclosure. Fig. 6 is a diagram showing an example of a hardware configuration of the display 10 according to an embodiment of the present disclosure. The above-mentioned display 10 may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

[0062] In the following description, the term "apparatus" may be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the display 10 may be configured to include one or more of the devices shown in the drawings, or may be configured to exclude some of the devices.

[0063] Each function of the display 10 is realized by loading a specific software (program) onto hardware such as a processor 1001 and a memory 1002, causing the processor 1001 to perform calculations, control communication via a communication device 1004, and control at least one of the reading and writing of data in the memory 1002 and the storage 1003.

[0064] The processor 1001, for example, operates an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, each function of the display 10 described above may be realized by the processor 1001.

[0065] Furthermore, the processor 1001 reads out a program (program code), a software module, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to the read out programs. As the program, a program that causes a computer to execute at least a part of the operations described in the above-mentioned embodiment is used. For example, each function of the display 10 may be realized by a control program stored in the memory 1002 and operated by the processor 1001. Although the above-mentioned various processes have been described as being executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The program may be transmitted from a network via a telecommunication line.

[0066] The memory 1002 is a computer-readable recording medium, and may be composed of at least one of, for example, a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store a program (program code), software modules, etc. that are executable to perform information processing according to an embodiment of the present disclosure.

[0067] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, and the like. Storage 1003 may be called an auxiliary storage device. The storage medium provided in display 10 may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0068] The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via at least one of a wired network and a wireless network, and is also called, for example, a network device, a network controller, a network card, or a communication module.

[0069] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that performs output to the outside. The input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0070] In addition, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0071] Furthermore, the display 10 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc., and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0072] The order of the steps, sequences, flow charts, etc. of each aspect / embodiment described in this disclosure may be changed unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0073] The input and output information may be stored in a specific location (e.g., memory) or may be managed using a management table. The input and output information may be overwritten, updated, or added to. The output information may be deleted. The input information may be transmitted to another device.

[0074] The determination may be based on a value represented by a single bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0075] Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to execution. In addition, notification of specific information (e.g., notification that "X is the case") is not limited to being done explicitly, but may be done implicitly (e.g., not notifying the specific information).

[0076] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0077] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0078] Additionally, software, instructions, information, etc. may be transmitted or received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave, etc.), then these wired and / or wireless technologies are included within the definition of transmission media.

[0079] As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0080] Furthermore, the information, parameters, etc. described in this disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information.

[0081] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in a memory), and the like. In addition, "judgment" and "decision" can include considering resolving, selecting, choosing, establishing, comparing, etc., to be a "judgment" or "decision." In other words, "judgment" and "decision" can include considering some action to be a "judgment" or "decision." In addition, "judgment" can be interpreted as "assuming," "expecting," "considering," etc.

[0082] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0083] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0084] Any reference to an element using a designation such as "first," "second," etc., used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must precede the second element in some way.

[0085] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Further, when used in this disclosure, the term "or" is not intended to be an exclusive or.

[0086] In this disclosure, where articles have been added due to translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0087] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different." [Explanation of symbols]

[0088] 10...display, 11...display unit, 12...trigger detection unit, 13...setting unit, 14...conversion unit, 15...movement unit, 1001...processor, 1002...memory, 1003...storage, 1004...communication device, 1005...input device, 1006...output device, 1007...bus.

Claims

1. A display control device that controls display on a display that displays display information arranged in a virtual space according to a line of sight in the virtual space, an opportunity detection unit that detects an opportunity to move display information in a virtual space; a setting unit that sets a position and a direction in the virtual space used for moving the display information in the virtual space; a conversion unit that converts a coordinate system of a virtual space based on a position and a direction in the virtual space set by the setting unit when the trigger is detected by the trigger detection unit; a moving unit that moves display information included in an area corresponding to the position and direction in the virtual space set by the setting unit in the coordinate system converted by the conversion unit, thereby converting the coordinate system of the virtual space back into the original coordinate system; Equipped with The movement unit is a display control device that moves each piece of display information to be moved at a speed corresponding to a position of the display information in the area.

2. The display control device according to claim 1 , wherein the setting unit sets the position and direction of the line of sight in the virtual space to a position and direction in the virtual space used for moving display information in the virtual space.

3. The display control device according to claim 1 , wherein the movement unit moves the display information included in a sector-shaped or strip-shaped area according to a position and direction in the virtual space set by the setting unit.

4. The display control device according to claim 1 , wherein the movement unit reduces or enlarges the display information in response to the movement of the display information.

Images