Remote location information presentation device, method, and program

Abstract

One aspect of the present invention involves: detecting, when presenting information indicating presence of an object in a first space to a second space, presence information including a position and posture of the object in the first space; generating shadow information indicating a shadow of the object on the basis of the posture included in the detected presence information; and presenting the generated shadow information to the second space on the basis of the position included in the presence information.

Description

Remote information presentation device, method, and program

[0001] One aspect of the present invention relates to a remote information presentation device, method, and program used to present the presence of, for example, a person, an animal, or the like in a remote location.

[0002] With the recent increase in single-person households, there is a growing need to sense the presence of others and to communicate one's own presence to others. To address this situation, technology that can communicate the presence of others in remote locations to one's current location in real time is being considered.

[0003] One proposed method involves capturing images of a person in a remote location using a camera, sending the image data to another location, and displaying the image data on a monitor such as a screen at the other location, thereby enabling the person in that location to know what the person in that location is doing (see, for example, Non-Patent Document 1). Another proposed method involves collecting the footsteps of a person in a remote location using a microphone, sending the sound to another location, and outputting it from a speaker, thereby enabling, for example, a person living alone to sense the presence of family members in remote locations by the sound of their footsteps (see, for example, Non-Patent Document 2).

[0004] Fish, RS, Kraut, RE, & Chalfonte, BL (nd). “The VideoWindow System in Informal Communications”. CSCW 90 Proceedings October 1990. Echigo, H., Kobayashi, M., “A Study on Footstep Transmission Methods for Awareness Support”, Information Processing Society of Japan Research Report, Vol. 2019_GN_106 No. 20, 2019 / 1 / 24

[0005] However, the methods proposed in Non-Patent Documents 1 and 2 directly present the video and audio of a person in a remote location at another location. Therefore, for example, although a person on one side can sense the presence of the person on the other side, the privacy of the person on the other side may not be protected.

[0006] The present invention has been made in light of the above circumstances, and aims to provide a technique that makes it possible to present the presence of an object in a remote location to others while protecting the object's privacy.

[0007] In order to solve the above problem, one aspect of the remote information presentation device or method of the present invention is such that, when presenting information representing the presence of an object in a first space in a second space, presence information including the position and posture of the object in the first space is detected, shadow information representing a shadow of the object is generated based on the posture included in the detected presence information, and the generated shadow information is presented in the second space based on the position included in the presence information.

[0008] According to one aspect of the present invention, for example, information representing an object such as a person in a first space is converted into information representing a shadow of the object based on the position and orientation of the object in the first space, and the information is presented in a second space. This makes it possible to sense the presence of a target person in a remote first space in the second space, and since the target person's presence is presented in the second space as a shadow, it is possible to protect the target person's privacy.

[0009] That is, according to one aspect of the present invention, it is possible to provide a technology that enables the presence of an object in a remote location to be presented to others while protecting the privacy of the object.

[0010] FIG. 1 is a diagram illustrating an example of the configuration of a remote information transmission system according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating an example of the hardware configuration of a first information processing device located in a first space at a remote location in the system illustrated in FIG. 1. FIG. 3 is a block diagram illustrating an example of the software configuration of a first information processing device located in a first space at a remote location in the system illustrated in FIG. 1. FIG. 4 is a block diagram illustrating an example of the hardware configuration of a second information processing device located in a second space different from the first space in the system illustrated in FIG. 1. FIG. 5 is a block diagram illustrating an example of the software configuration of a second information processing device located in a second space different from the first space in the system illustrated in FIG. 1. FIG. 6 is a flowchart illustrating an example of the processing procedure and processing content of a user presence information detection process executed by a control unit of the first information processing device illustrated in FIG. 3. FIG. 7 is a flowchart illustrating an example of the processing procedure and processing content of a user presence information presentation process executed by a control unit of the second information processing device illustrated in FIG. 5. FIG. 8 is a flowchart illustrating a first example of a shadow information generation process in the user presence information presentation process illustrated in FIG. 7. FIG. 9 is a flowchart illustrating a second example of a shadow information generation process in the user presence information presentation process illustrated in FIG. 7.

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] [One Embodiment] (Configuration Example) (1) System FIG. 1 is a diagram showing an example of the configuration of a remote information transmission system according to one embodiment of the present invention.

[0013] A remote information transmission system according to one embodiment connects a first information processing device TMA and a second information processing device TMB, which are respectively located at a point A and a point B that are spaced apart from each other, via a network NW. Presence information of a user US as an object present in a first space EA at point A is transmitted from the first information processing device TMA to the second information processing device TMB via the network NW, and shadow information of the user US is generated based on the presence information and presented in a second space EB at point B.

[0014] To achieve the above operation, a camera CM is installed in the first space EA. The camera CM captures an image of the first space EA to detect the presence of the user US in the first space EA.

[0015] On the other hand, a projector PJ is installed in the second space EB. The projector PJ is used to project shadow information of the user US into the second space EB.

[0016] The network NW is composed of a wide area network such as the Internet and an access network for accessing the wide area network. The access network may be a wired or wireless local area network (LAN), an optical transmission network, or a mobile communication network that adopts the 5G standard.

[0017] (2) First Information Processing Apparatus TMA FIGS. 2 and 3 are block diagrams showing an example of the hardware configuration and software configuration of the first information processing apparatus TMA, respectively.

[0018] The first information processing device TMA is, for example, a personal computer, and has a control unit 1A that uses a hardware processor such as a central processing unit (CPU), and this control unit 1A is connected to a memory unit that has a program memory unit 2A and a data memory unit 3A, a sensor interface (hereinafter, the interface will be abbreviated as I / F) unit 4A, and a communication I / F unit 5A via a bus 6A.

[0019] The camera CM is connected to the sensor I / F unit 4A, which receives the video data output from the camera CM.

[0020] The communication I / F unit 5A transmits and receives information data to and from the second information processing device TMB in accordance with a communication protocol defined by the network NW.

[0021] The program storage unit 2A is, for example, a combination of a non-volatile memory such as a HDD (Hard Disk Drive) or SSD (Solid State Drive) as a storage medium that can be written to and read from at any time, and a non-volatile memory such as a ROM (Read Only Memory), and stores application programs necessary to execute various processes related to one embodiment of the present invention, in addition to middleware such as an OS (Operating System).

[0022] The data storage unit 3A is, for example, a combination of a nonvolatile memory such as an HDD or SSD as a storage medium that can be written to and read from at any time, and a volatile memory such as a RAM (Random Access Memory), and its storage area includes a video data storage unit 31A, a position information storage unit 32A, and an attitude information storage unit 33A. The storage area also includes a buffer area for temporarily storing data when the control unit 1A executes various processes.

[0023] The control unit 1A includes a video data acquisition processing unit 11A, a user position detection processing unit 12A, a user posture estimation processing unit 13A, and a user presence information transmission processing unit 14A as control functions necessary to realize one embodiment of the present invention.

[0024] Each of the processing units 11A to 14A is realized by causing the processor of the control unit 1A to execute an application program stored in the program storage unit 2A. Note that some or all of the processing units 11A to 14A may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC (Application Specific Integrated Circuit).

[0025] The video data acquisition processing unit 11A receives video data of the first space EA captured by the camera CM via the sensor I / F unit 4A, samples the received video data at a predetermined frame period, and stores the sampled image data in chronological order in the video data storage unit 31A.

[0026] The user position detection processing unit 12A reads image data from the video data storage unit 31A, recognizes an image representing the user US from each of the read image data, and detects the position of the user US within the first space EA. At this time, if multiple users US are present in the first space EA, the user position detection processing unit 12A recognizes the image of each of these multiple users and detects their position. The user position detection processing unit 12A stores the position information of the user US detected as described above in the position information storage unit 32A.

[0027] The user posture estimation processing unit 13A estimates the posture of the user US based on the user image recognized from the video data storage unit 31A. If multiple users US are present in the first space EA, the user posture estimation processing unit 13A estimates the posture of each of the multiple users from the image, as in the case of the position detection described above. The user posture estimation processing unit 13A stores the posture information of the user US estimated as described above in the posture information storage unit 33A.

[0028] The user presence information transmission processing unit 14A reads the position information and posture information of the user US from the position information storage unit 32A and the posture information storage unit 33A at a predetermined cycle, generates user presence information including the read position information and posture information, and transmits the generated user presence information to the communication I / F unit 5A to the second information processing device TMB. Note that if there are multiple detected users US, the position information and posture information of these multiple users US are included in the user presence information. The user presence information may also include a recognition image of the user US.

[0029] (3) Second Information Processing Device TMB FIGS. 4 and 5 are block diagrams showing an example of the hardware configuration and software configuration of the second information processing device TMB, respectively.

[0030] The second information processing device TMB is also a personal computer, similar to the first information processing device TMA described above. The second information processing device TMB has a processor 1B constituting a central control unit (CPU), a storage unit including a program storage unit 2B and a data storage unit 3B, an output I / F unit 4B, and a communication I / F unit 5B, all connected via a bus 6B.

[0031] The output I / F unit 4B is connected to the projector PJ, and outputs the shadow image generated by the control unit 1B to the projector PJ so that the shadow image is projected into the second space EB.

[0032] The communication I / F unit 5B receives information data transmitted from the first information processing apparatus TMA in accordance with a communication protocol defined by the network NW.

[0033] Like the first information processing device TMA, the program memory unit 2B is a combination of a non-volatile memory such as an HDD or SSD that can be written to and read from at any time, and a non-volatile memory such as a ROM, and stores application programs necessary to execute various processes related to one embodiment of the present invention, in addition to middleware such as an OS.

[0034] The data storage unit 3B is, for example, a combination of a non-volatile memory such as an HDD or SSD that can be written to and read from as needed and a volatile memory such as RAM, and its storage area includes a user presence information storage unit 31B and a conversion information storage unit 32B. The conversion information storage unit 32B stores conversion information necessary to generate a shadow image of the user US. The storage area also includes a buffer area for temporarily storing data when the control unit 1B executes various processes.

[0035] The control unit 1B has a user presence information receiving processing unit 11B, a user selection processing unit 12B, a shadow information generating processing unit 13B, and a shadow information presenting processing unit 14B as control functions for realizing one embodiment of the present invention.

[0036] Each of the processing units 11B to 14B is realized by causing the processor of the control unit 1B to execute an application program stored in the program storage unit 2B. Note that some or all of the processing units 11B to 14B may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC.

[0037] The user presence information receiving processing unit 11B receives the user presence information transmitted from the first information processing device TMA via the communication I / F unit 5B, and stores the received user presence information in chronological order in the user presence information storage unit 31B.

[0038] The user selection processing unit 12B reads the user presence information from the user presence information storage unit 31B, and selects the users US one by one from the read user presence information.

[0039] The shadow information generation processing unit 13B generates a shadow image representing the posture of the user US based on the posture information of the user US included in the presence information of the selected user US and the conversion information read from the conversion information storage unit 32B. The shadow information generation processing unit 13B also determines the presentation position of the shadow image in the second space EB based on the position information of the user US included in the user presence information. An example of the shadow image generation process will be described in detail in the operation example.

[0040] The shadow information presentation processing unit 14B outputs the shadow image of the user US generated by the shadow information generation processing unit 13B from the output I / F unit 4B to the projector PJ, and projects it into the second space EB.

[0041] (Example of Operation) Next, an example of operation of the remote information presentation system configured as above will be described.

[0042] (1) Generation of User Presence Information FIG. 6 is a flowchart showing an example of the processing procedure and processing content of user presence information generation processing executed by the control unit 1A of the first information processing device TMA.

[0043] (1-1) Acquisition of video data The state within the first space EA is constantly captured by the camera CM, and the video data is output from the camera CM to the first information processing device TMA. Note that the capturing range of the camera CM for the first space EA may be the entire first space EA or may be limited to the area where the user US to be presented is located.

[0044] In step S10, the control unit 1A of the first information processing device TMA first acquires the video data output from the camera CM via the sensor I / F unit 4A under the control of the video data acquisition processing unit 11A. The video data acquisition processing unit 11A samples the acquired video data at a predetermined frame rate and sequentially stores the sampled image data in the video data storage unit 31A. The sampling rate can be set arbitrarily depending on the average movement speed of the user US.

[0045] (1-2) Detection of User Position Information When the video data is acquired, the control unit 1A of the first information processing device TMA, under the control of the user position detection processing unit 12A, first reads image data from the video data storage unit 31A in step S11 and recognizes an image representing the user US from the read image data. This user image recognition is performed using existing image recognition technology, such as pattern recognition. Note that a machine learning model for image recognition can also be used.

[0046] Next, in step S12, the user position detection processing unit 12A determines whether the user US is present in the first space EA based on the recognition result of the user image. If this determination determines that the user US is present in the first space EA, the user position detection processing unit 12A proceeds to step S13 and detects the position of the user US in the first space EA. For example, the user position detection processing unit 12A calculates the position of the user US by determining the position coordinates of the image of the user US in the image data and converting the position coordinates in the image data to spatial coordinates in the first space EA. The user position detection processing unit 12A stores the detected position information of the user US in the position information storage unit 32A, for example, in association with a timestamp indicating the detection timing.

[0047] If it is determined that the user US is not present in the first space EA, the control unit 1A of the first information processing device TMA ends the detection process of user presence information.

[0048] (1-3) Estimation of the Posture of the User US Next, in step S13, the control unit 1A of the first information processing device TMA, under the control of the user posture estimation processing unit 13A, estimates the posture of the user US based on the user image recognized from the video data. An existing posture estimation engine that detects a person's skeleton from an image can be used as a method for estimating the posture of the user US. The user posture estimation processing unit 13A stores information representing the estimated posture of the user US in the posture information storage unit 33A, along with the timestamp used when storing the position information.

[0049] The control unit 1A of the first information processing device TMA determines whether or not another user US is present in the first space EA in step S15 based on the result of the determination of the user presence in step S12. If another user US is present, the control unit 1A returns to step S13, and in steps S13 and S14, performs processing to detect the position of the other user US in the first space EA and estimate the posture of the user US.

[0050] If there are a plurality of other users US, the control unit 1A of the first information processing apparatus TMA repeatedly executes the position detection and posture estimation processes of steps S13 and S14 for all the users US.

[0051] (1-4) Generation and transmission of user presence information If it is determined in step S15 above that no other users exist, the control unit 1A of the first information processing device TMA proceeds to step S16 and generates user presence information under the control of the user presence information transmission processing unit 14A.

[0052] For example, the user presence information transmission processing unit 14A reads all of the position information and posture information of one or more users US, each of which has the same time stamp, from the position information storage unit 32A and the posture information storage unit 33A, and generates user presence information including the time stamp and the position information and posture information. Note that the user presence information also includes a user image of each of the recognized users US.

[0053] The user presence information transmission processing unit 14A transmits the generated user presence information from the communication I / F unit 5A to the second information processing device TMB.

[0054] (2) Presentation of User Shadow Information FIG. 7 is a flowchart showing an example of the processing procedure and processing content of a process for presenting user shadow information executed by the control unit 1B of the second information processing apparatus TMB.

[0055] (2-1) Receiving User Presence Information When the control unit 1B of the second information processing device TMB detects in step S20 that a reception request has been sent from the first information processing device TMA via the network NW, in step S21, under the control of the user presence information reception processing unit 11B, the control unit 1B receives the user presence information sent from the first information processing device TMA via the communication I / F unit 5B. Then, the user presence information reception processing unit 11B stores the received user presence information in the user presence information storage unit 31B in chronological order.

[0056] (2-2) Generation and Presentation of Shadow Information When the control unit 1B of the second information processing device TMB receives the user presence information, the control unit 1B selects one user US from the user presence information in step S22. Then, the control unit 1B proceeds to step S23 and executes the following process for generating shadow information of the user US under the control of the shadow information generation processing unit 13B.

[0057] The following two methods can be considered for generating shadow information: (2-2-1) Method for Generating Shadow Information Using an Avatar Fig. 8 is a flowchart showing an example of the processing procedure and processing content for generating a shadow image using an avatar.

[0058] First, in step S30, the shadow information generation processing unit 13B reads an avatar image corresponding to the user US from the conversion information storage unit 32B. At this time, an avatar image common to all users may be selected, or, for example, an avatar image corresponding to the size or silhouette of the user image included in the user presence information may be selected. In this way, for example, when the user US is a close friend such as a relative who lives far away, it is possible to present the user's atmosphere in addition to the presence of the user US.

[0059] However, since the reason for using an avatar is to protect the privacy of the user US, it is preferable to select an avatar that is not associated with the user himself.

[0060] Next, in step S31, the shadow information generation processing unit 13B reflects the posture of the user US included in the user presence information in the avatar image. For example, if the posture of the user US is a sitting posture, the avatar image is converted to a sitting posture, and if the posture of the user US is a standing posture or a walking posture, the avatar image is converted to a standing posture or a walking posture, respectively.

[0061] Next, in step S32, the shadow information generation processing unit 13B converts the avatar image into a shadow image. As a method for converting into a shadow image, for example, image processing such as affine transformation or filling in of a two-dimensional image of the avatar is used, but a method for performing calculations using a physics engine or the like may also be used.

[0062] Affine transformations are described in detail at the following website on the Internet: <URL: https: / / cvml-expertguide.net / terms / cv / image-transform / affine-transformation / >.

[0063] The shadow information generation processing unit 13B determines the presentation position of the shadow image in the second space EB based on the user position information included in the received user presence information.

[0064] When the shadow image is generated, the control unit 1B of the second information processing device TMB outputs the shadow image, whose presentation position has been determined, from the output I / F unit 4B to the projector PJ under the control of the shadow information presentation processing unit 14B in step S24. As a result, the shadow image SD is projected at the determined position in the second space EB, as shown in FIG. 1 , for example.

[0065] In this embodiment, the position of the user US in the first space EA is reflected in the projection position of the shadow image in the second space EB, so it is desirable to configure the layout of the second space EB to correspond to the layout of the first space EA.

[0066] Furthermore, when a method of generating a shadow image using an avatar is adopted, a user image is not required for generating the shadow image, so the first information processing device TMA does not need to insert the user image into the user presence information and transmit it, thereby reducing the risk of the user US's image being leaked.

[0067] (2-2-2) Method of Generating Shadow Information Using Generation AI FIG. 9 is a flowchart showing an example of the processing procedure and processing content of a process for generating shadow information using generation AI.

[0068] In step S40, the shadow information generation processing unit 13B first reads a user image included in the user presence information from the user presence information storage unit 31B. Then, in step S41, the shadow information generation processing unit 13B reads conversion taste information, for example, expressed as text, from the conversion information storage unit 32B. Then, using a generative network such as a generative adversarial network (GAN), the shadow information generation processing unit 13B converts the image taste of the user image and anonymizes the user image.

[0069] For more information on GAN, please see the following websites: Internet <URL: https: / / domoai.app / , https: / / aismiley.co.jp / ai_news / what-is-a-generative-adversarial-network / >.

[0070] Next, in step S43, the shadow information generation processing unit 13B converts the converted user image into a shadow image by using the above-mentioned affine transformation or image processing such as filling.

[0071] The shadow information generation processing unit 13B determines the presentation position of the shadow image in the second space EB based on the user position information included in the received user presence information.

[0072] In step S24, the control unit 1B of the second information processing device TMB outputs the shadow image, the presentation position of which has been determined, from the output I / F unit 4B to the projector PJ under the control of the shadow information presentation processing unit 14B. As a result, the shadow image SD is projected at the determined position in the second space EB, as shown in FIG.

[0073] When the control unit 1B of the second information processing device TMB has finished projecting a shadow image corresponding to one user US as described above, in step S25, it determines whether or not selection of all users US included in the user presence information has been completed.

[0074] If the result of this determination is that an unselected user remains, the control unit 1B returns to step S22 to select the next unselected user US, generates a shadow image of the user in step S23, and executes a process of projecting the generated shadow image into the second space EB in step S24. Thereafter, similarly, the process of generating shadow images of the users US and projecting them into the second space EB in steps S23 and S24 is repeatedly executed for all users US.

[0075] (Effect) As described above, in one embodiment, the first information processing device TMA generates user presence information for the user US in the first space EA, including the position and posture of the user US and a user image, and transmits the generated information to the second information processing device TMB. Meanwhile, the second information processing device TMB anonymizes the user using an avatar or taste conversion based on the posture or user image of the user US included in the user presence information transmitted from the first information processing device TMA, and generates a shadow image of the anonymized data. Then, the second information processing device TMB determines a presentation position for the shadow image based on the user position included in the user presence information, and projects the shadow image at the determined position in the second space EB using the projector PJ.

[0076] Therefore, the presence of the user US in the first space EA is presented in the second space EB by aligning the position of the shadow image of the user US, thereby making it possible to present the presence of the user US in the first space EA in the second space EB while protecting the user's privacy.

[0077] [Other embodiments] (1) In one embodiment, an example is described in which user presence information is detected in a first information processing device TMA, and user shadow information is generated in a second information processing device TMB based on the user presence information transmitted from the first information processing device TMA and projected into a second space EB.

[0078] However, the present invention is not limited to this. For example, the first information processing device TMA may detect user presence information, then generate shadow information based on this presence information and transmit it to the second information processing device TMB, and the second information processing device TMB may receive the shadow information transmitted from the first information processing device TMA and project it into the second space EB.

[0079] (2) In addition, the first information processing device TMA may transmit the video data of the first space EA acquired from the camera CM directly to the second information processing device TMB, and the second information processing device TMB may detect user presence information from the video data transmitted from the first information processing device TMA, generate shadow information based on the detected user material information, and project it into the second space EB.

[0080] (3) Furthermore, as another possible configuration, the functions of the remote information presentation device may be provided in a server computer on the Web or the cloud, and the server computer may detect user presence information from video data of the first space transmitted from the first information processing device, generate shadow information based on this user presence information, and distribute the generated shadow information to the second information processing device to project it into the second space.

[0081] (4) In the embodiment, the case where user presence information is detected from video data captured by the camera CM has been described. However, the user presence information may be detected using a sensor other than a camera.

[0082] (5) In the embodiment, the shadow image is projected into the second space EB by the projector PJ. However, the present invention is not limited to this. An aerial image of the shadow information may be generated and displayed in the second space EB by using an aerial image optical system.

[0083] (6) In the embodiment, a case where a person is used as an object has been described as an example, but the object may be an animal, a plant, a machine, etc. Furthermore, various modifications can be made to the processing functions, processing procedures, processing contents, and applications of the remote information presentation device without departing from the spirit and scope of the present invention.

[0084] Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.

[0085] In short, this invention is not limited to the above-described embodiments, and in the implementation stage, the components can be modified and embodied without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.

[0086] EA...First space EB...Second space NW...Network TMA...First information processing device TMB...Second information processing device CM...Camera PJ...Projector US...User SD...Shadow image 1A, 1B...Control unit 2A, 2B...Program storage unit 3A, 3B...Data storage unit 4A...Sensor I / F unit 4B...Output I / F unit 5A, 5B...Communication I / F unit 6A, 6B...Bus 11A...Video data acquisition processing unit 12A...User position detection processing unit 13A...User posture estimation processing unit 14A...User presence information transmission processing unit 11B...User presence information reception processing unit 12B...User selection processing unit 13B...Shadow information generation processing unit 14B...Shadow information presentation processing unit 31A...Video data storage unit 32A...Position information storage unit 33A...Posture information storage unit 31B...User presence information storage unit 32B...Conversion information storage unit

Claims

1. A remote information presentation device used in a system that presents information representing the presence of an object in a first space in a second space, the remote information presentation device comprising: a first processing unit that detects presence information including the position and orientation of the object in the first space; a second processing unit that generates shadow information representing a shadow of the object based on the orientation included in the presence information; and a third processing unit that presents the generated shadow information in the second space based on the position included in the presence information.

2. The remote information presentation device according to claim 1, wherein the second processing unit converts the object into an avatar image based on the posture, and converts the avatar image into a shadow image to generate the shadow information.

3. A remote information presentation method executed by an information processing device used in a system that presents information representing the presence of an object in a first space in a second space, the remote information presentation method comprising: a step of detecting presence information including the position and orientation of the object in the first space; a step of generating shadow information representing a shadow of the object based on the orientation included in the presence information; and a step of presenting the generated shadow information in the second space based on the position included in the presence information.

4. A program for causing a processor provided in a remote location information presentation device to execute the processes executed by the first, second and third processing units provided in the remote location information presentation device according to claim 1 or 2.

Images