Information sharing system, wearable device, information sharing method, and information sharing program

Abstract

To provide an information sharing system, a display device, an information sharing method, and an information sharing program, where an instruction is expressed three-dimensionally.SOLUTION: An information sharing system 1 includes a wearable device 30 and an information processor 40. The wearable device 30 comprises: a sensor unit 31 for identifying a position and a sight line direction of a user; a camera unit 32 for capturing a moving image; a data acquisition unit 34 for acquiring moving image data on the moving image in a state associated with information for identifying the position and the sight line direction; and a moving image data transmission unit 33 for transmitting the moving image data. The information processor 40 comprises: a moving image data acquisition unit 51; an instruction setting unit 41 for setting an instruction content to the moving image data; and a transmission / reception unit 52 for transmitting instruction information including the instruction content and information on a direction and a position at which the instruction content is set to the wearable device 30. The wearable device 30 displays a locus instruction to the position at which the instruction content is set and, at the time of arrival to the set position, displays a sight line direction instruction.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to an information sharing system, a wearable device, an information sharing method, and an information sharing program. [Background technology]

[0002] Display devices, particularly Augmented Reality (AR) glasses, are known that display digital images such as images and videos on lenses superimposed on the user's field of vision. The digital display on the AR glasses may display instructions issued by a PC (Personal Computer) that shares its screen with the AR glasses. Summary of the Invention [Problem to be solved by the invention]

[0003] However, the conventional method described above had the disadvantage that the instructions issued from the PC were only displayed in two dimensions on the AR glasses. This caused a problem in that it was difficult for users wearing the AR glasses to recognize the instructions.

[0004] The present disclosure has been made in consideration of the above circumstances, and has an object to provide an information sharing system, a display device, an information sharing method, and an information sharing program in which instructions are expressed in three dimensions. [Means for solving the problem]

[0005] In order to solve the above problems, the information sharing system, wearable device, information sharing method, and information sharing program disclosed herein employ the following solutions. One aspect of the present disclosure is an information sharing system having a wearable device worn by a user and an information processing device operated by a user other than the user, the wearable device comprising a plurality of sensors for identifying at least the position and gaze direction of the user, a camera for capturing video in accordance with the movement of the user and changes in the gaze direction, a data acquisition means for acquiring video data of the video captured by the camera in a state associated with information identifying the position and gaze direction of the user acquired by the sensor at each point in the video, and a transmission means for transmitting at least the video data, and the information processing device comprises an information acquisition means for acquiring the video data. the wearable device is provided with a display means for displaying information guiding the user to the position of the user identified based on the instruction information and information indicating the gaze direction of the user identified based on the instruction information. The information sharing system comprises: an information acquisition means for receiving instructions for the user from another user at a specific point in the video data; and a transmission means for transmitting instruction information including information identifying the specific point in time or at least one of information identifying the position and gaze direction of the user corresponding to the specific point in time, and instructions for the user.

[0006] One aspect of the present disclosure is a wearable device comprising a plurality of sensors for identifying at least a user's position and gaze direction, a camera that captures video as the user moves and the gaze direction changes, a data acquisition means for acquiring video data of the video captured by the camera in a state associated with information identifying the position and gaze direction of the user acquired by the sensor at each point in the video, and a transmission means for transmitting at least the video data, and comprising a display means for displaying, when instruction information including at least one of information identifying a specific point in the video data of the video, or information identifying the position and gaze direction of the user corresponding to the specific point in time, and instructions for the user, information guiding the user to the position of the user identified based on the instruction information and information indicating the gaze direction of the user identified based on the instruction information.

[0007] One aspect of the present disclosure is an information sharing method in which a computer executes the steps of: identifying at least a user's position and gaze direction; capturing a video in accordance with the movement of the user and changes in the gaze direction; acquiring video data of the video in a state in which the video is associated with information identifying the position and gaze direction of the user at each point in the video; transmitting at least the video data; acquiring the video data; accepting instructions for the user at a specific point in the video data from another user; and transmitting instruction information including at least one of information identifying the specific point in time or information identifying the position and gaze direction of the user corresponding to the specific point in time, and instructions for the user.

[0008] One aspect of the present disclosure is an information sharing program for causing a computer to function as the information sharing system. Effect of the Invention

[0009] According to the present disclosure, by displaying to a user who owns a wearable device information guiding the user to a location where instructions have been set, as well as instructions on the direction of gaze at the location where instructions have been set, the user can obtain three-dimensional information and even determine the direction of gaze, enabling information to be shared in a visually easy-to-understand manner. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing a display of an information processing device in some embodiments of the present disclosure. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of each device according to some embodiments of the present disclosure. [Diagram 3] FIG. 1 is a diagram illustrating an example of functions of an information sharing system in some embodiments of the present disclosure. [Figure 4] FIG. 2 illustrates a user's movement trajectory in some embodiments of the present disclosure. [Diagram 5] FIG. 2 illustrates a user's movement trajectory in some embodiments of the present disclosure. [Figure 6] FIG. 2 illustrates a control flow of an information sharing system in some embodiments of the present disclosure. [Figure 7] FIG. 1 is a diagram showing a display of an information processing device in some embodiments of the present disclosure. [Figure 8] 1A to 1C are diagrams illustrating display in the depth direction of an information processing device according to some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of an information sharing system, a wearable device, an information sharing method, and an information sharing program according to the present disclosure will be described with reference to the drawings.

[0012] FIG. 1 is a diagram showing a display of an information processing device according to some embodiments of the present disclosure. The information sharing system 1 according to the present disclosure includes AR glasses (Augmented Reality) (wearable device) 30, an information processing device (PC) 40, and a server 50. The AR glasses 30 and the information processing device 40 are each connected to the server 50. The AR glasses 30 include a plurality of sensors and a camera, and a video captured by the camera is shared with the information processing device 40 via the server 50 as video data 12. In the present embodiment, the wearable device 30 is the AR glasses 30, but the type of the wearable device is not important as long as it is a wearable device capable of displaying videos.

[0013] The AR glasses 30 are, for example, in the form of glasses, and can display images and videos on transparent lenses. Because the lenses are transparent, the user can recognize the scenery of the outside world. The images and videos displayed on the lenses are superimposed on the scenery of the outside world, and the user's field of vision is integrated with the digital display on the lenses.

[0014] 1, an application 11 is used in an information processing device 40 to display video data 12 captured by a camera of the AR glasses 30. A seek bar (time bar) 13 is displayed below the video data 12 of the application 11, and by sliding a slider 14, the video data 12 at any time is displayed in the application 11.

[0015] FIG. 2 is a diagram illustrating an example of a hardware configuration of each device in some embodiments of the present disclosure. 2, the AR glasses 30, the information processing device 40, and the server 50 are each a computer system, and include, for example, a CPU (Central Processing Unit: processor) 1100, a secondary storage device (ROM, Secondary storage: memory) 1200, a main storage device (RAM, Main Memory) 1300, a hard disk drive (HDD) 1400 as a large-capacity storage device, and a communication unit 1500 for connecting to a network or the like. Note that a solid-state drive (SSD) may be used as the large-capacity storage device. These units are connected via a bus 1800.

[0016] The CPU 1100 controls the AR glasses 30, the information processing device 40, and the server 50 as a whole using, for example, an operating system (OS) stored in a secondary storage device 1200 connected via a bus 1800, and executes various processes by executing various programs stored in the secondary storage device 1200. One or more CPUs 1100 may be provided, and may cooperate with each other to realize processes.

[0017] The main memory device 1300 is composed of writable memory such as cache memory or RAM (Random Access Memory), and is used as a working area for reading out programs executed by the CPU 1100 and writing data processed by the programs.

[0018] The secondary storage device 1200 is a non-transitory computer readable storage medium. The secondary storage device 1200 is, for example, a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Examples of the secondary storage device 1200 include a ROM (Read Only Memory), a HDD (Hard Disk Drive), and a SSD (Solid State Drive) flash memory. The secondary storage device 1200 stores, for example, an OS for controlling the entire information processing device such as Windows (registered trademark), iOS (registered trademark), Android (registered trademark), a BIOS (Basic Input / Output System), various device drivers for operating peripheral devices as hardware, various application software, and various data and files. In addition, the secondary storage device 1200 stores programs for implementing various processes and various data required for implementing various processes. A plurality of secondary storage devices 1200 may be provided, and the above-mentioned programs and data may be divided and stored in each secondary storage device 1200.

[0019] The AR glasses 30, the information processing device 40, and the server 50 may also include an input unit such as a keyboard or a mouse, a display unit such as a liquid crystal display device that displays data, etc. Also, the AR glasses 30, the information processing device 40, and the server 50 may also include a notification unit such as a speaker that includes a display unit and outputs a lamp, sound, and in particular an alarm sound.

[0020] FIG. 3 is a diagram illustrating an example of functions of an information sharing system according to some embodiments of the present disclosure. 3, the information sharing system 1 includes AR glasses 30, an information processing device 40, and a server 50. The AR glasses 30 include a sensor unit (sensor) 31, a camera unit (camera) 32, a video data transmission unit (transmission means) 33, a data acquisition unit (data acquisition means) 34, and a display unit (display means) 35. The information processing device 40 includes an instruction setting unit (input means) 41 and a transmission unit 42. The server 50 includes a video data acquisition unit (information acquisition means) 51 and a transmission / reception unit (transmission means) 52.

[0021] A series of processes for realizing the functions of the AR glasses 30, the information processing device 40, and the server 50 is stored in the secondary storage device 1200 (see FIG. 2) in the form of a program, for example, and the CPU (processor) 1100 (see FIG. 2) reads this program into the main storage device 1300 (see FIG. 2) and executes information processing and arithmetic processing to realize various functions. Note that the program may be pre-installed in the secondary storage device 1200, provided in a state stored in another non-transient computer-readable storage medium, or distributed via wired or wireless communication means. Examples of non-transient computer-readable storage media include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, and semiconductor memories.

[0022] As described above, the information sharing system 1 includes the AR glasses 30, the information processing device 40, and the server 50. The AR glasses 30 are worn by a user, and acquire sensor information and video data 12, which are information that identify the user's position and line of sight in accordance with the user's movement and changes in line of sight, and transmit them to the server 50. In addition, when instruction information is received from the server 50, a digital display such as an image or video is displayed on the lens, superimposed on the user's field of vision. The server 50 acquires the video data 12 acquired by the AR glasses 30, and shares the video data 12 with the information processing device 40. When the server 50 receives an instruction for the user at a specific time point in the video data 12 from the information processing device 40, the server 50 transmits to the AR glasses 30 instruction information including at least one of information specifying the specific time point or information specifying the position and line of sight of the user corresponding to the specific time point, and an instruction for the user. The information processing device 40 is operated by an operator, who is a user other than the user wearing the AR glasses 30, and receives and sets instructions for the user wearing the AR glasses 30 for the shared video data 12. The instructions are set on the video data. The set instructions are transmitted to the server 50.

[0023] The sensor unit 31 of the AR glasses 30 shown in Fig. 3 acquires sensor information that is information for identifying the user's position and line of sight direction in accordance with the movement of the AR glasses 30 and changes in line of sight direction. The AR glasses 30 are provided with, for example, an acceleration sensor, a gyro sensor, and the like, and the sensor unit 31 acquires acceleration information, gyro information, and the like as sensor information. The sensor unit 31 may acquire GPS (Global Positioning System) information as sensor information. Although position information can be obtained from GPS information, it may not be possible to acquire such information indoors, and information regarding height can also be obtained from acceleration information, so it is preferable to use acceleration information instead of GPS information.

[0024] The camera unit 32 captures and acquires video in accordance with the movement of the AR glasses 30 and changes in the line of sight. Because it is AR glasses 30, the shooting direction of the camera unit 32 and the line of sight of the user wearing the AR glasses 30 are approximately the same direction, and it can be said that the video captured by the camera unit 32 is approximately the same as the field of view of the user wearing the AR glasses 30.

[0025] The video data transmission unit 33 transmits at least video data 12 of the video captured by the camera unit 32 to a video data acquisition unit 51 of the server 50, which will be described later. In addition to the video data 12, the video data transmission unit 33 may transmit to the video data acquisition unit 51 sensor information, which is information identifying the user's position and line of sight direction acquired by the sensor unit 31 at each point in time of the video captured by the camera unit 32.

[0026] The data acquisition unit 34 acquires the video data 12 of the video captured by the camera unit 32 in a state associated with information identifying the user's position and gaze direction acquired by the sensor unit 31 at each time point in the video. Specifically, the data acquisition unit 34 associates and records the shooting time, which is the time at each time point in the video data 12 of the video captured by the camera unit 32, with information identifying the user's position and gaze direction acquired by the sensor unit 31 at that time. Examples of sensor information identifying the user's position and gaze direction acquired by the sensor unit 31 include acceleration information acquired by an acceleration sensor, gyro information acquired by a gyro sensor, GPS information, etc. The data acquisition unit 34 may sequentially identify the position and direction at which the video data 12 was captured based on the information acquired by the sensor unit 31, and store the data in association with the time at which the sensor unit 31 acquired the information, i.e., the shooting time of the camera unit 32. The position at which the video data 12 was captured is identified based on acceleration information acquired by an acceleration sensor. The user's line of sight direction at the time the video data 12 was captured is identified based on gyro information acquired by a gyro sensor. Since the sensor information acquired by the sensor unit 31 includes the user's position information and line of sight direction information, the data acquisition unit 34 can obtain the trajectory of the movement of the AR glasses 30 from the sensor information.

[0027] The display unit 35 displays (outputs) data received from the server 50, which will be described later, on the AR glasses 30. As described above, the AR glasses 30 are in the shape of glasses, and digital displays such as videos and images are displayed superimposed on the user's field of vision. When the user wearing the AR glasses 30 consents to the display of instruction information, the display unit 35 acquires the user's position corresponding to the time (specific time point) specified by the slider 14 of the application 11 in FIG. 1 corresponding to the instruction information from the data acquisition unit 34, and displays it in the augmented reality space. The display unit 35 also displays information that guides the user to the user's position that is specified based on the instruction information. Examples of information that guides the user include a line indicating a route (trajectory) and an arrow indicating a direction of travel.

[0028] When the user wearing the AR glasses 30 moves to the user's position specified based on the instruction information and reaches the user's position or its vicinity specified based on the instruction information, the display unit 35 displays an instruction for the user's line of sight. Examples of the instruction for the line of sight include footprints (footprints) and an arrow indicating a direction.

[0029] FIG. 4 is a diagram illustrating a movement trajectory of a user in some embodiments of the present disclosure. 4, it is assumed that a user wearing the AR glasses 30 moves on a solid line passing through a point P on the XY plane of the augmented reality space. The footprint marks face the moving direction of the user. It is assumed that the point P is the position of the user corresponding to a specific time point when an operator operating the information processing device 40 sets an instruction.

[0030] FIG. 5 is a diagram illustrating a movement trajectory of a user in some embodiments of the present disclosure. When the user wearing the AR glasses 30 consents to the display of the instruction information, the display unit 35 displays the user's position (point P) specified based on the instruction information in the augmented reality space as shown in Fig. 5. Furthermore, when the user moves and reaches point P or its vicinity, the display unit 35 displays a footprint mark indicating an instruction of the user's line of sight.

[0031] The video data acquisition unit 51 in FIG. 3 acquires the video data 12 from the video data transmission unit 33 of the AR glasses 30.

[0032] When the transmitting / receiving unit 52 receives an instruction and time information at a specific point in time from the transmitting unit 42 of the information processing device 40 described later, it transmits the instruction information to the display unit 35 of the AR glasses 30.

[0033] The instruction setting unit 41 of the information processing device 40 acquires the video data 12 of the AR glasses 30 shared via the video data acquisition unit 51 of the server 50. The operator uses the application 11 of FIG. 1 to display the video data 12, and slides the slider 14 to specify and select a scene for which an instruction to the user is to be set. In the selected scene (image) of the video data 12, the operator writes information on the application 11. For example, the operator marks the structure M on the display image of the application 11 of FIG. 1, and inputs the instruction content of "check the text". In this way, the information processing device 40 sets the instruction content for the past video data 12, i.e., the recorded video data 12.

[0034] The transmission unit 42 transmits the instructions for the user set by the instruction setting unit 41 to the transmission / reception unit 52 of the server 50 together with information identifying a specific point in time, or information identifying the user's position and line of sight corresponding to the specific point in time, for example, time information of the specific point in time when the instructions for the video data 12 were set.

[0035] FIG. 6 is a diagram illustrating a control flow of an information sharing system in some embodiments of the present disclosure. As shown in FIG. 6, control of the information sharing system 1 is started when the wearable device (AR glasses) 30, the server 50, and the information processing device 40 start sharing (S101).

[0036] Next, in step S102, the AR glasses 30 start transmitting video data 12 of a video captured by the camera unit 32 in accordance with the movement and change in the line of sight of the user wearing the AR glasses 30 to the server 50 via the video data transmission unit 33. The video data of the video captured by the camera unit 32 is acquired by the data acquisition unit 34 in a state associated with information that specifies the position and line of sight of the user acquired by the sensor unit 31 at each point in time of the video.

[0037] In step S103, the server 50 that has received the video data 12 from the AR glasses 30 starts sharing the video data 12 with the information processing device 40.

[0038] In step S104, the instruction setting unit 41 of the information processing device 40 that has received the video data 12 from the server 50 acquires the video data 12. The information processing device 40 plays the video data 12 in response to an operation by an operator. The application 11 may be used to play the video data 12.

[0039] In step S105, when an instruction to the AR glasses 30 is generated, the process proceeds to step S106, where the operator writes information to the video data 12 on the application 11 and sets an instruction to the user.

[0040] In step S107, the transmission unit 42 transmits the instruction for the user set by the instruction setting unit 41 to the transmission / reception unit 52 of the server 50 together with time information of the specific point in time in the video data 12 at which the instruction was set.

[0041] In step S108, when the transmitting / receiving unit 52 of the server 50 receives the instruction and the time information from the transmitting unit 42 of the information processing device 40, it transmits the instruction and the time information to the display unit 35 of the AR glasses 30 as instruction information.

[0042] In step S109, a notification of instruction information occurs, and the display unit 35 of the AR glasses 30 receives the instruction information from the transmission / reception unit 52 of the server 50. The display unit 35 may notify the user wearing the AR glasses 30 whether or not to accept the display of the instruction information.

[0043] In step S110, the display unit 35 displays information for guiding the user to the user's position specified based on the instruction information, for example, a trajectory instruction to the position where the instruction is set, on the AR glasses 30. The display unit 35 also sets a target mark or the like at the position where the instruction is set. The display unit 35 acquires the user's position corresponding to the time information at the specific time point where the instruction is set from the data acquisition unit 34, and displays it in the augmented reality space. In step S109, if the user wearing the AR glasses 30 is notified of whether or not to accept the display of the instruction information, step S110 is executed if the user accepts.

[0044] When a user wearing the AR glasses 30 follows information that guides the user to the user's position identified based on the instruction information and reaches the position where the instruction is set or in its vicinity, the display unit 35 displays an instruction for the user's line of sight on the AR glasses 30 (S111).

[0045] In step S112, when the user wearing the AR glasses 30 follows the displayed gaze direction instruction and the corresponding direction comes into view, the instruction is displayed on the AR glasses 30. The instruction may be displayed in any manner that can notify the user, and examples of the instruction include displaying text, images, or videos on the AR glasses 30, and sound.

[0046] The instruction setting unit 41 of the information processing device 40 may be configured to allow the operator to select a distance in the depth direction in the video data 12. FIG. 7 is a diagram showing a display of an information processing device according to some embodiments of the present disclosure. 7, the depth distances of structures N, M, and F in the video data 12 are different from one another. When the depth distance of structure M is taken as a reference, the depth distance of structure N is short, and the depth distance of structure F is long.

[0047] FIG. 8 is a diagram showing a display in the depth direction of an information processing device according to some embodiments of the present disclosure. 8, the direction of the arrow pointing from left to right in the figure is the depth direction of the video data 12, and angles of view NV, MV, and FV indicate the angles of view at the distances of structures N, M, and F in FIG. 7, respectively.

[0048] As shown in Fig. 8, if the angle of view NV is selected with a short distance in the depth direction, the height of the base of the angle of view is lower than that of the angle of view MV, and the distance between the base and the ground is closer. Also, the angle of view NV has a wider relative range than the angle of view MV.

[0049] On the other hand, if an FV angle of view is selected that has a long depth distance, the height of the base of the FV angle of view is higher than that of the MV angle of view, and the distance between the base and the ground is greater. Also, the FV angle of view has a narrower relative range than the MV angle of view.

[0050] When the angle of view NV with a short distance in the depth direction is selected, it is possible to display larger objects near the user wearing the AR glasses 30. In addition, the operator operating the information processing device 40 can give detailed instructions to the user wearing the AR glasses 30.

[0051] On the other hand, when a field angle FV with a long distance in the depth direction is selected, the tolerance for deviations in position and line of sight is increased, and deviations can be suppressed.

[0052] In this way, the operator can select the distance in the depth direction, so that the distance corresponds to the instruction content, and appropriate instructions can be issued to the user wearing the AR glasses 30.

[0053] As described above, the information sharing system 1, the wearable device 30, the information sharing method, and the information sharing program according to the present embodiment provide the following advantages. The information sharing system 1 displays information to a user who owns a wearable device 30, guiding the user to a location where instructions have been set, as well as instructions on the direction of gaze at the location where instructions have been set, allowing the user to obtain three-dimensional information and even identify the direction of gaze, thereby enabling information sharing in a visually easy-to-understand manner.

[0054] Furthermore, according to the information sharing system 1 of this embodiment, instructions are displayed when the user who owns the wearable device 30 faces the direction in which the instructions are set, so that the instructions can be expressed in three dimensions, enabling information sharing to be performed in a visually easy-to-understand manner.

[0055] Furthermore, according to the information sharing system 1 of this embodiment, the three-dimensional position including the height of the wearable device 30 can be identified based on acceleration sensor information from the acceleration sensor, and the line of sight direction of the wearable device 30 can be identified based on gyro sensor information from the gyro sensor.

[0056] According to the information sharing system 1 of the present embodiment, the wearable device 30 is the AR glasses 30 that display augmented reality, so that the information to be shared can be displayed easily. Also, the user wearing the AR glasses 30 can intuitively grasp the information.

[0057] Furthermore, according to the information sharing system 1 of this embodiment, the operator can display the instructions at an appropriate position according to the instructions by setting the distance in the depth direction of the screen for the instructions to be displayed on the wearable device 30. For example, when the distance in the depth direction of the screen is set short, nearby objects are displayed large, and detailed instructions can be given.

[0058] Although the present disclosure has been described above using the embodiments, the technical scope of the present disclosure is not limited to the scope described in the above embodiments. Various modifications or improvements can be made to the above embodiments without departing from the gist of the disclosure, and the forms in which such modifications or improvements are made are also included in the technical scope of the present disclosure. In addition, the above embodiments may be appropriately combined. Furthermore, the processing flow described in the above embodiment is also one example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the present disclosure.

[0059] For example, in the embodiment of the present disclosure, the server 50 is used, but the functions of the server 50 may be provided in the information processing device 40 .

[0060] In the embodiment of the present disclosure, the wearable device 30 transmits the video data 12 to the server 50. However, in addition to this, information identifying the user's position and gaze direction acquired by the sensor unit 31 may be transmitted to the server 50. In this case, the video data 12 of the video captured by the camera unit 32 and information identifying the user's position and gaze direction acquired by the sensor unit 31 at each time point of the video are recorded in an associated state in the server 50. Furthermore, when the server 50 receives an instruction and time information that is information identifying a specific time point from the information processing device 40, the server 50 acquires the position and gaze direction corresponding to the time information from the recorded information and transmits them as instruction information together with the instruction to the display unit 35 of the wearable device 30. In this manner, the data acquisition unit 34 may be provided in the server 50. [Explanation of symbols]

[0061] 1. Information sharing system 30 AR Glasses (Wearable Devices) 31 Sensor section (sensor) 32 Camera section (camera) 33 Video data transmission unit (transmission means) 34 Data acquisition unit (data acquisition means) 35 Display section (display means) 40 Information processing device 41 Instruction setting unit (input means) 42 Transmitter 50 Servers 51 Video data acquisition unit (information acquisition means) 52 Transmitting / receiving unit (transmitting means) 1100 CPU 1200 ROM 1300 RAM 1400 HDD 1500 Communications Department 1800 Bus

Claims

1. An information sharing system having a wearable device worn by a user and an information processing device operated by a user other than the user, The wearable device includes: A plurality of sensors for identifying at least the user's position and gaze direction; A camera that captures video in accordance with the movement of the user and the change in the line of sight; a data acquisition means for acquiring video data of the video captured by the camera in a state associated with information identifying the position and the line of sight of the user acquired by the sensor at each time point of the video; A transmitting means for transmitting at least the video data, The information processing device includes: An information acquisition means for acquiring the video data; an input means for receiving an instruction for the user at a specific time point in the video data from the other user; a transmitting means for transmitting instruction information including at least one of information specifying the specific time point or information specifying the position and the line of sight direction of the user corresponding to the specific time point, and an instruction for the user; Equipped with the wearable device includes a display means for displaying information for guiding the user to the position of the user specified based on the instruction information, and information for instructing the line of sight of the user specified based on the instruction information; An information sharing system characterized by:

2. The information sharing system of claim 1 , wherein the wearable device displays instructions for the user when the gaze direction of the user identified based on the instruction information is displayed at the position of the user identified based on the instruction information.

3. The information sharing system according to claim 1 , wherein the wearable device comprises an acceleration sensor and a gyro sensor.

4. The information sharing system according to claim 1 , wherein the wearable device is an AR glass.

5. The information sharing system according to claim 1 , further comprising a depth distance setting unit that sets a distance in a depth direction of a screen at which instructions to the user are displayed in the wearable device.

6. A plurality of sensors for identifying at least a user's position and gaze direction; A camera that captures video in accordance with the movement of the user and the change in the line of sight; a data acquisition means for acquiring video data of the video captured by the camera in a state associated with information identifying the position and the line of sight of the user acquired by the sensor at each time point of the video; A transmitting means for transmitting at least the video data; Equipped with When receiving instruction information including at least one of information specifying a specific time point in the video data of the video, or information specifying the position and the line of sight direction of the user corresponding to the specific time point, and an instruction for the user, A wearable device comprising a display means for displaying information guiding the user to the position of the user identified based on the instruction information, and information indicating the line of sight of the user identified based on the instruction information.

7. Identifying at least a user's position and gaze direction; taking a video of the user's movement and the change in the line of sight; acquiring video data of the video in association with information identifying the position and the gaze direction of the user at each time point in the video; transmitting at least the video data; acquiring said video data; receiving an instruction for the user at a specific time point in the video data from the other user; An information sharing method executed by a computer, comprising: a step of transmitting instruction information including at least one of information identifying the specific time point, or information identifying the position and gaze direction of the user corresponding to the specific time point, and instructions for the user.

8. An information sharing program for causing a computer to function as the information sharing system according to claim 1.

Images