Space sharing system and space sharing method

Abstract

To provide a space sharing system and a space sharing method for sharing the space to enable smooth communication.SOLUTION: A space sharing system 1 includes a first imaging device 11, a first display device 17, and a space sharing control apparatus 20 arranged in a first space, and a second imaging device 11, a second display device 17, and a space sharing control apparatus 20 arranged in a second space. The space sharing system includes: an information acquisition unit 21 which acquires a video captured and sound collected by the imaging device; a storage unit 14 which stores use terminal information indicating combinations of information terminal devices used by persons; a person state determination unit 25 which determines a person state indicating whether each person is ready to respond to a communication, based on information acquired from the information terminal devices; and an output control unit 27 which outputs the video and sound captured by the first and second imaging devices to other display devices. The output control unit is configured to control a display mode of a range of a person or a predetermined range around the person in the video to be output for indicating the person state.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a space sharing system and a space sharing method. [Background technology]

[0002] BACKGROUND ART A system is known in which an imaging device and a display device are used to virtually share a space between geographically separated spaces (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-056161 Summary of the Invention [Problem to be solved by the invention]

[0004] Such a space-sharing system is installed, for example, in different offices within the same company. The use of a space-sharing system has the effect of facilitating mutual communication. However, even when it is difficult to respond because people are congregating, a person in another space may use the space-sharing system to be called.

[0005] The present disclosure aims to enable smoother communication by sharing a space. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the space-sharing system of the present disclosure is a space-sharing system comprising a first imaging device and a first display device arranged in a first space, and a second imaging device and a second display device arranged in a second space, and comprising: an information acquisition unit that acquires video and audio captured by the first imaging device and the second imaging device; a memory unit that stores used device information indicating the combination of each information terminal device used by each person; a person state determination unit that determines a person state indicating whether each person using the information terminal device is in a state where they can respond to communication from the first space or the second space based on information acquired from the information terminal device; and an output control unit that outputs the video and audio captured by the first imaging device to the second display device and outputs the video and audio captured by the second imaging device to the first display device, and the output control unit controls the display form of the range of the person or a predetermined range around the person in the video output to the first display device and the second display device to indicate the person state.

[0007] The space-sharing method according to the present disclosure is a space-sharing system having a first imaging device and a first display device arranged in a first space, and a second imaging device and a second display device arranged in a second space, and includes an information acquisition step of acquiring video captured and audio picked up by the first imaging device and the second imaging device; a storage step of storing in a storage unit used terminal information indicating a combination of each information terminal device used by each person; a person state determination step of determining a person state indicating whether each person using the information terminal device is in a state where they are able to respond to communication from the first space or the second space, based on information acquired from the information terminal device; and an output control step of outputting the video captured and audio picked up by the first imaging device to the second display device and outputting the video captured and audio picked up by the second imaging device to the first display device, wherein the output control step is performed by the space-sharing system to control the display form of the range of the person or a predetermined range around the person in the video output to the first display device and the second display device in order to indicate the person state. [Effects of the Invention]

[0008] According to the present disclosure, communication can be carried out more smoothly by sharing a space. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram showing an example of installation of the space sharing device, and is a diagram showing installation in the first space. [Figure 2] FIG. 2 is a schematic diagram showing an example of installation of the space sharing device, and is a diagram showing installation in the first space. [Figure 3] FIG. 3 is a schematic diagram showing an example of installation of the space sharing device in the second space. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of the space sharing device according to the first embodiment. [Figure 5] FIG. 5 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. [Figure 6] FIG. 6 is a flowchart showing the space sharing method according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of a display screen of the space sharing device according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing another example of the display screen of the space sharing device according to the first embodiment. [Figure 9] FIG. 9 is a block diagram showing an example of the configuration of a space sharing device according to the second embodiment. [Figure 10] FIG. 10 is a flowchart showing a space sharing method according to the second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a display screen of the space sharing device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A space sharing system and a space sharing method according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0011] [First embodiment] (Space sharing system) The space-sharing system 1 constantly shares video and audio in real time across multiple real spaces. For example, when the space-sharing system 1 is applied to remote offices, it gives the impression that the office is being shared.

[0012] The space sharing system 1 includes a space sharing device 10 disposed in each of a plurality of spaces, and at least one information terminal device 30 disposed in each space. The number of spaces shared by the space sharing system 1 is not limited.

[0013] In the following description, as an example, the space sharing system 1 will be described as sharing two spaces, a first space A and a second space B. A first space sharing device 10A is disposed in the first space A. An information terminal device 30A1, an information terminal device 30A2, and the like are disposed in the first space A. The information terminal device 30A1 and the information terminal device 30A2 are connected to the first space sharing device 10A and the second space sharing device 10B so as to be able to communicate data with each other. A second space sharing device 10B is disposed in the second space B. An information terminal device 30B1, an information terminal device 30B2, and the like are disposed in the second space B. The information terminal device 30B1 and the information terminal device 30B2 are connected to the first space sharing device 10A and the second space sharing device 10B so as to be able to communicate data with each other. Specifically, the first space sharing device 10A, the second space sharing device 10B, the information terminal device 30A1, the information terminal device 30A2, the information terminal device 30B1, ... via an in-house network or the like. When there is no particular need to distinguish between the first space sharing device 10A and the second space sharing device 10B, they will be described as space sharing device 10. When there is no particular need to distinguish between the information terminal devices 30, they will be described as information terminal device 30. Similarly, in the description of each component, when there is no particular need to distinguish between the components provided in the first space sharing device 10A and the components provided in the second space sharing device 10B, the reference numeral will not be appended with A or B, and when there is a need to distinguish between the components provided in the first space sharing device 10A and the components provided in the second space sharing device 10B, the reference numeral will be appended with A or B.

[0014] An example of installation of the first space sharing device 10A and the information terminal device 30A in the first space A will be described with reference to FIG. 1. FIG. 1 is a schematic diagram showing an example of installation of the space sharing devices, for example, a diagram showing installation in a first space such as an office. The first space sharing device 10A is preferably placed in a position where it can capture an image of the entire space A and the range of departments where space sharing is useful. In the first space A, information terminal device 30A1 to information terminal device 30A 14Person u1, person u3 to person u6, person u9, person u10, person u12 to person u14 are located in front of information terminal device 30A1, information terminal device 30A3 to information terminal device 30A6, information terminal device 30A9, information terminal device 30A 10 , information terminal device 30A 12 or information terminal device 30A 14 , respectively. In other words, person ua is a user who is using the space sharing system 1. Also, person u1, person u3 to person u6, person u9, person u10, person u12 to person u14 are using information terminal device 30A1, information terminal device 30A3 to information terminal device 30A6, information terminal device 30A9, information terminal device 30A 10 , information terminal device 30A 12 or information terminal device 30A 14 The users log in to the information terminal device 30 using their respective account information. In other words, each information terminal device 30 is linked to the user using the information terminal device 30. The person u20 is located in the first space A but is a user who is not using the information terminal device 30. The person u20 is, for example, a person working near a bookshelf.

[0015] Space sharing in a first space A and a second space B will be described using Figures 2 and 3. Figure 2 is a schematic diagram showing an example of installation of a space-sharing device, installed in the first space. Figure 3 is a schematic diagram showing an example of installation of a space-sharing device, installed in the second space. Figures 2 and 3 also show a state in which communication is taking place using the space-sharing system 1. As shown in Figure 2, a person ua present in the first space A is using the space-sharing system 1 while facing a first display device 17A. A first space-sharing device 10A disposed in the first space A outputs video and audio of the second space B. When a person ub faces the second display device 17B, the first space-sharing device 10A displays an image of the person ub present in the second space B at approximately life-size. As shown in Figure 3, a person ub present in the second space B is using the space-sharing system 1 while facing the second display device 17B. A second space-sharing device 10B disposed in the second space B outputs video and audio of the first space A. When person a faces first display device 17A, second space sharing device 10B displays an image of person a located in first space A at approximately life-size. In this way, a virtual space is shared between first space A and second space B. Person ua present in first space A and person ub present in second space B communicate using space sharing system 1. Communication using space sharing system 1 can also be referred to as a phone call.

[0016] For example, the display device 17 may directly display an image captured by the imaging device 11 disposed in another space, or may display an illustrated virtual space, etc. For example, the display device 17 may display an AR (Augmented Reality) image in which a processed image is superimposed on an image captured by the imaging device 11 disposed in another space.

[0017] (Space sharing device) FIG. 4 is a block diagram showing an example of the configuration of a space sharing device according to the first embodiment. The space sharing device 10 is a general-purpose server device, including a distributed type, realized by a computer, or a personal computer. The space sharing device 10 controls space sharing in different spaces. In this embodiment, the space sharing device 10 controls space sharing between a first space A and a second space B.

[0018] The space sharing device 10 may have a space sharing control device 20 (described later) that centrally controls the imaging devices 11 and the display devices 17 installed in different spaces. The space sharing device 10 may have a configuration in which the space sharing control device 20 is arranged in each space and connected to each other via a network. In this embodiment, the space sharing device 10 is described as being arranged in each of the first space A and the second space B.

[0019] The space sharing device 10 includes an imaging device 11 , an operation unit 13 , a storage unit 14 , a display device 17 , a communication unit 19 , and a space sharing control device 20 .

[0020] The imaging device 11 captures images of the space in which it is placed and collects audio. More specifically, for example, a first imaging device 11A placed in a first space A captures images of the first space A and collects audio. For example, a second imaging device 11B placed in a second space B captures images of the second space B and collects audio. The imaging device 11 acquires the captured images and collected audio as information by an information acquisition unit 21. The imaging device 11 is placed in the vicinity of the display device 17. The imaging device 11 includes a camera 111 and a microphone 112.

[0021] The camera 111 captures an image of the space in which it is placed. The camera 111 is placed, for example, around the display device 17 or in front of the display device 17. The camera 111 captures an image of a person facing the display device 17 placed in the same space. More specifically, for example, the camera 111 of the first imaging device 11A placed in the first space A captures an image of the first space A. For example, the camera 111 of the second imaging device 11B placed in the second space B captures an image of the second space B. The camera 111 outputs the captured image to the image acquisition unit 221 of the space sharing control device 20.

[0022] The microphone 112 picks up sound in the space in which it is placed. The microphone 112 is placed, for example, around the display device 17 or in front of the display device 17. The microphone 112 picks up sound spoken by a person facing the display device 17 placed in the same space. More specifically, for example, the microphone 112 of the first imaging device 11A placed in the first space A picks up sound in the first space A. For example, the microphone 112 of the second imaging device 11B placed in the second space B picks up sound in the second space B. The microphone 112 outputs audio information related to the picked-up sound to the audio acquisition unit 212 of the space sharing control device 20.

[0023] The operation unit 13 is an input device capable of inputting various operations to the space sharing device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the space sharing control device 20. The operation unit 13 includes, for example, a touch panel, buttons, switches, etc., arranged over the display unit 171. The operation unit 13 can receive, for example, a key input operation, a click operation, or a touch operation.

[0024] In this embodiment, the operation unit 13 is a touch panel disposed on the display unit 171. The operation unit 13 can accept a touch operation on an information terminal device 30 or a person in another space being displayed on the display screen of the display unit 171 as a person designation operation for calling the information terminal device 30 or the person. More specifically, for example, the operation unit 13 provided on the display unit 171 of the first display device 17A disposed in the first space A can accept a person designation operation for calling the information terminal device 30 or the person present in the second space B. For example, the operation unit 13 provided on the display unit 171 of the second display device 17B disposed in the second space B can accept a person designation operation for calling the information terminal device 30 or the person present in the first space A.

[0025] A predetermined range including the range in which the information terminal device 30 or person included in the displayed video is detected may be set as the touch range selectable in the person designation operation.

[0026] The storage unit 14 stores information such as the calculation contents and programs of the space sharing device 10. The storage unit 14 is, for example, a storage device such as a RAM (Random Access Memory) or an SSD (Solid State Drive).

[0027] The storage unit 14 stores used terminal information indicating the combination of each information terminal device 30 used by each user. The storage unit 14 stores used terminal information indicating the information terminal devices 30 arranged within the imaging range of the imaging device 11 and the users using each information terminal device 30. The storage unit 14 may further store information indicating the faces of the users. The storage unit 14 acquires and stores operation status information indicating whether the information terminal device 30 is operating or whether each user is at work or not.

[0028] More specifically, for example, the storage unit 14 of the first space sharing device 10A arranged in the first space A stores information on the information terminal devices 30 arranged in the imaging range of the first imaging device 11A and the users using each information terminal device 30. The storage unit 14 also stores operation status information of the information terminal devices 30 in the first space A and attendance / non-attendance information of each user.

[0029] For example, the storage unit 14 of the second space sharing device 10B arranged in the second space B stores information about the information terminal devices 30 arranged in the imaging range of the second imaging device 11B and the terminal information indicating the users of each information terminal device 30. The storage unit 14 also stores operation status information about the information terminal devices 30 in the second space B and information about whether each user has arrived at work.

[0030] The display device 17 displays an image of the other party's space that shares the space and outputs audio. The display of the image and the output of the audio of the display device 17 are controlled by the output control unit 27. The display device 17 includes a display unit 171 and an audio output unit 172.

[0031] The display unit 171 displays various images including text and images. The display unit 171 is, for example, a display including a liquid crystal display, an organic EL (Electro-Luminescence) display, etc. The display unit 171 displays an image of the other space that shares the space. More specifically, for example, the display unit 171 of the first display device 17A arranged in the first space A displays an image of the second space B. For example, the display unit 171 of the second display device 17B arranged in the second space B displays an image of the first space A. The display of the display unit 171 is controlled by the display control unit 271.

[0032] The audio output unit 172 is an audio output device that outputs audio from the other party's space that shares the space. More specifically, for example, the audio output unit 172 of the first display device 17A arranged in the first space A outputs audio from the second space B. For example, the audio output unit 172 of the second display device 17B arranged in the second space B outputs audio from the first space A. The audio output of the audio output unit 172 is controlled by the audio output control unit 272.

[0033] The communication unit 19 is a communication unit for performing wired communication or wireless communication. The communication unit 19 performs communication using a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 19 is controlled by a communication control unit 29. The communication unit 19 communicates video and audio data with other space sharing devices 10.

[0034] (Space sharing control device) The space sharing control device 20 controls each part of the space sharing device 10. The space sharing control device 20 has, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM or ROM (Read Only Memory). The space sharing control device 20 may be realized by, for example, an integrated circuit such as an ASIC or an FPGA. The space sharing control device 20 may be realized by a combination of hardware and software. The space sharing control device 20 executes a program that controls the operation of the space sharing device 10 according to the present disclosure.

[0035] The space sharing control device 20 includes functional blocks realized by circuits and executed programs, such as an information acquisition unit 21, an operation reception unit 22, a person detection unit 23, an identification unit 24, a person state determination unit 25, an output control unit 27, and a communication control unit 29.

[0036] The information acquisition unit 21 acquires video captured by the imaging device 11 arranged in the same space. In this embodiment, the information acquisition unit 21 acquires video captured by the imaging device 11 arranged in the same space and audio collected by the imaging device 11 arranged in the same space. The information acquisition unit 21 also outputs the video captured by the imaging device 11 arranged in the same space to the communication control unit 29. The information acquisition unit 21 also outputs the video captured by the imaging device 11 arranged in the same space to the person detection unit 23. More specifically, for example, the information acquisition unit 21 of the first space sharing device 10A arranged in the first space A acquires video captured by the first imaging device 11A arranged in the first space A and audio collected by the first imaging device 11A. The information acquisition unit 21 of the first space sharing device 10A outputs the video captured by the first imaging device 11A and audio collected by the first imaging device 11A to the communication control unit 29 of the first space sharing device 10A. The information acquisition unit 21 of the first space sharing device 10A outputs the video captured by the first imaging device 11A to the person detection unit 23 of the first space sharing device 10A. For example, the information acquisition unit 21 of the second space sharing device 10B arranged in the second space B acquires the video captured and the collected audio by the second imaging device 11B arranged in the second space B. The information acquisition unit 21 of the second space sharing device 10B outputs the video captured and the collected audio by the second imaging device 11B to the communication control unit 29 of the second space sharing device 10B. The information acquisition unit 21 of the second space sharing device 10B outputs the video captured by the second imaging device 11B to the person detection unit 23 of the second space sharing device 10B. The information acquisition unit 21 includes a video acquisition unit 211 and an audio acquisition unit 212.

[0037] The video acquisition unit 211 acquires video captured by the camera 111 of the imaging device 11 arranged in the same space. More specifically, the video acquisition unit 211 acquires video captured of people and the like present in the vicinity of the display device 17 arranged in the same space. More specifically, for example, the video acquisition unit 211 of the first space sharing device 10A arranged in the first space A acquires video captured of people and the like present in the vicinity of the first display device 17A. For example, the video acquisition unit 211 of the second space sharing device 10B arranged in the second space B acquires video captured of people and the like present in the vicinity of the second display device 17B. The video data acquired by imaging with the camera 111 is a moving image.

[0038] The voice acquisition unit 212 acquires voice detected by the microphone 112 arranged in the same space. The voice acquisition unit 212 acquires voice, such as voice spoken by a person around the display device 17 arranged in the same space. More specifically, for example, the voice acquisition unit 212 of the first space sharing device 10A arranged in the first space A acquires voice spoken by a person present around the first display device 17A. For example, the voice acquisition unit 212 of the second space sharing device 10B arranged in the second space B acquires voice spoken by a person present around the second display device 17B.

[0039] The operation reception unit 22 acquires an operation signal corresponding to an operation on the operation unit 13 from the operation unit 13. The operation reception unit 22 outputs a control signal corresponding to the acquired operation signal to each unit.

[0040] The person detection unit 23 detects people present in the video captured by the first imaging device 11A and the second imaging device 11B. The person detection unit 23 may further detect the position of the detected person in the video. The person detection unit 23 may recognize the face of the detected person to identify the individual. The person detection unit 23 detects the whole body, upper body, face, etc. of a person from the video acquired by the video acquisition unit 211. The method by which the person detection unit 23 detects people and faces from the video can be any known method and is not limited.

[0041] The person detection unit 23 detects, for example, not only people seated in seats, but also people standing away from their seats, people moving around, and the like.

[0042] The person detection unit 23 further outputs a person detection result that is a result of detecting whether the detected person is working. The person detection unit 23 determines whether, for example, a standing person, a moving person, etc. is working. For example, if it is detected that a person is carrying luggage such as files, it determines that the person is working, and if it is detected that the person is not carrying luggage such as files or documents, it determines that the person is not working.

[0043] The identification unit 24 outputs an identification result that indicates which information terminal device 30 the person detected by the person detection unit 23 is using, based on the terminal information stored in the storage unit 14.

[0044] The identification unit 24 may identify which person is using which information terminal device 30, using the positions of the information terminal devices 30 and the detected positions of the people detected by the person detection unit 23. That is, the identification unit 24 may identify a person who is within a predetermined distance from the information terminal device 30 as the user of the information terminal device 30.

[0045] The position of each information terminal device 30 in the image, in other words, the position of each information terminal device 30 in the imaging range of the imaging device 11, is associated in advance. For example, in the case of fixed seats where work is performed in a specific seat, the coordinate range of the image and the person sitting in the seat are associated in advance and stored in the storage unit 14. The person is associated with the information terminal device 30 that has logged in based on the seat corresponding to the coordinate range in which the person is recognized from the image. For example, in the case of a free address seating system where seats can be freely selected, the position information of the information terminal device 30 is obtained from a beacon device, GPS, or the like provided in each information terminal device 30. The person is associated with the information terminal device 30 that has logged in based on the acquired position information of the information terminal device 30 and the coordinates and orientation of the person in the image.

[0046] The person state determination unit 25 determines the person state indicating whether each user using the information terminal device 30 is in a state where they can respond to communication from the first space or the second space, based on information obtained from the information terminal device 30.

[0047] The information acquired from the information terminal device 30 is, for example, at least one of operation information for the information terminal device 30 and an image captured by the camera 311 arranged on the information terminal device 30.

[0048] The operation information for the information terminal device 30 is, for example, a mouse operation or a keyboard operation provided in the information terminal device 30. When such an operation is being performed, the person state determination unit 25 may determine that the user of the information terminal device 30 is unable to respond.

[0049] The image captured by the camera 311 is, for example, an image showing the line of sight of the user of the information terminal device 30. If the user's line of sight moves within the screen of the information terminal device 30 a predetermined number of times or more, it is deemed that the level of concentration is high. If such a line of sight movement is detected, the person state determination unit 25 may determine that the user of the information terminal device 30 is unable to respond.

[0050] Conversely, if it is detected that the direction of the user's gaze has continuously deviated from the screen of the information terminal device 30 for a predetermined period of time or more, it is determined that the user of the information terminal device 30 is not concentrating. If such a movement of the gaze is detected, the person state determination unit 25 may determine that the user of the information terminal device 30 is available to respond.

[0051] Furthermore, the person state determination unit 25 may determine the person state, indicating whether each user using the information terminal device 30 is in a state where they can respond to communication from the first space or the second space, based on information obtained from the information terminal device 30, the person detection result by the person detection unit 23, and the identification result by the identification unit 24.

[0052] For example, when no operation on the information terminal device 30 is detected (for example, when the user of the information terminal device 30 is away from his / her desk), the person state determination unit 25 may determine that the user of the information terminal device 30 is unable to respond when the person detection unit 23 detects a person working near a bookshelf in the space from the image captured by the camera 111 of the imaging device 11 arranged in the space and identifies the person as the user of the information terminal device 30 for which no operation is detected.

[0053] When no operation on the information terminal device 30 is detected, the person state determination unit 25 may determine that the user of the information terminal device 30 is able to respond when the person detection unit 23 detects a person who is not working in the space from the image captured by the camera 111 of the imaging device 11 arranged in the space and identifies the person as the user of the information terminal device 30 for which no operation is detected.

[0054] A case where no operation on the information terminal device 30 is detected refers to, for example, a case where the information obtained from the information terminal device 30 used by a person detected in the images captured by the first imaging device 11A and the second imaging device 11B is operation information indicating that no operation has been performed on the information terminal device 30, or a case where no person is detected in the images captured by the camera 311 arranged on the information terminal device 30.

[0055] Even if an operation on the information terminal device 30 is detected, the person state determination unit 25 may make a determination using the person detection result and the identification result. For example, a certain information terminal device 30 is defined as terminal A, and the user of terminal A is defined as user A. Assume that terminal A is being used by someone other than user A. In this case, the person detection unit 23 outputs a person detection result that detects a person operating terminal A, and the identification unit 24 outputs an identification result that identifies, from the used terminal information, that the person in the person detection result is not user A. Furthermore, the person detection unit 23 detects user A if user A is present in the images captured by the first imaging device 11A and the second imaging device 11B, and the identification unit 24 identifies user A using terminal A from the used terminal information. In other words, the person state determination unit 25 may determine whether the user is unable to respond using the person detection result and the identification result without using operation information.

[0056] For example, the person state determination unit 25 may determine that a user of the information terminal device 30 who is not detected in either the video captured by the camera 311 placed on the information terminal device 30 or the video captured by the imaging device 11 placed in the same space is unable to respond.

[0057] The output control unit 27 outputs the video captured by the first imaging device 11A and the collected audio to the second display device 17B, and outputs the video captured by the second imaging device 11B and the collected audio to the first display device 17A.

[0058] The output control unit 27 controls the display format of the range of the person or a predetermined range around the person in the video output to the first display device 17A and the second display device 17B in order to indicate the person state determined by the person state determination unit 25. The output control unit 27 changes the display format of the range of the person or a predetermined range around the person in the video output to the first display device 17A and the second display device 17B in accordance with the person state determined by the person state determination unit 25.

[0059] For example, the output control unit 27 causes the image output to the first display device 17A and the second display device 17B to be displayed in a display format that obscures the range of a person whose status is unable to respond or a predetermined range around the person.

[0060] Obscuring means making the person's face difficult to recognize from the image, for example, by processing the image by lowering brightness, lowering resolution, changing color, displaying an outline, or hiding the area of ​​the person or a specified area around the person.

[0061] For example, the output control unit 27 displays the range of people whose person status is responsive and a predetermined range around the people in the video output to the first display device 17A and the second display device 17B as is without processing.

[0062] For example, the output control unit 27 distinguishably displays a person whose status is unavailable from a person whose status is available in the video output to the first display device 17A and the second display device 17B. For example, the output control unit 27 may display an image indicating the person's status in a color such as blue (available), yellow (absent), or red (unable to respond) near the person in the video output to the first display device 17A and the second display device 17B.

[0063] For example, the output control unit 27 may display the range of a person whose status is available to respond or a predetermined range around the person in an emphasized display form in the video output to the first display device 17A and the second display device 17B. In this case, the range of a person whose status is available to respond or a predetermined range around the person may be displayed more prominently than a person whose status is unavailable to respond.

[0064] The output control unit 27 may display a list image showing a list of people who are set as unavailable for response, for example, on the side edges of the display screens of the first display device 17A and the second display device 17B.

[0065] The output control unit 27 outputs the video captured and the audio collected by the imaging device 11 disposed in the other space, which are received by the communication control unit 29, to the display device 17. More specifically, for example, the output control unit 27 of the space sharing device 10A disposed in the first space A outputs the video captured and the audio collected by the second imaging device 11B, which are received by the communication control unit 29, to the first display device 17A disposed in the first space A. For example, the output control unit 27 of the space sharing device 10B disposed in the second space B outputs the video captured and the audio collected by the first imaging device 11A, which are received by the communication control unit 29, to the second display device 17B disposed in the second space B.

[0066] The display control unit 271 controls the display of the image on the display unit 171. For example, the display control unit 271 controls the display unit 171 to display an image of another space. When a person is captured in the image of the other space, the display control unit 271 displays an image including the person present in the other space. More specifically, for example, the display control unit 271 of the first space sharing device 10A arranged in the first space A displays an image of the second space B. For example, the display control unit 271 of the second space sharing device 10B arranged in the second space B displays an image of the first space A.

[0067] For example, when the display control unit 271 receives a person designation operation to designate a person, it displays a message such as "Mr. / Ms. XX is being called" on the display unit 171 of the display device 17 placed in the space where the designated person is present.

[0068] The audio output control unit 272 controls the output of audio in the audio output unit 172. For example, the audio output control unit 272 controls the audio output unit 172 to output audio collected in another space. When the audio collected in another space includes the audio of a person present in the other space, the audio output control unit 272 outputs audio including the audio of the person present in the other space. More specifically, for example, the audio output control unit 272 of the first space sharing device 10A arranged in the first space A outputs the audio collected in the second space B. For example, the audio output control unit 272 of the second space sharing device 10B arranged in the second space B outputs the audio collected in the first space A.

[0069] For example, when the audio output control unit 272 receives a person designation operation to designate a person, it outputs audio such as "Mr. / Ms. XX is being called" from the audio output unit 172 of the display device 17 placed in the space where the designated person is present.

[0070] The communication control unit 29 controls the communication unit 19 to control transmission and reception of data including video and audio with other space sharing devices 10. More specifically, the communication control unit 29 controls, for example, the communication unit 19 to control communication with other space sharing devices 10. The communication control unit 29 controls, for example, the communication unit 19 to receive video captured in another space and audio collected from other space sharing devices 10. The communication control unit 29 controls, for example, the communication unit 19 to transmit video captured by the imaging device 11 and audio collected to the other space sharing devices 10.

[0071] More specifically, for example, communication control unit 29 of first space sharing device 10A arranged in first space A controls to transmit video and audio of first space A acquired by information acquisition unit 21 so that they can be output on second display device 17B arranged in second space B, and to receive video captured by second imaging device 11B and collected audio from second space sharing device 10B arranged in second space B. For example, communication control unit 29 of space sharing device 10B arranged in second space B controls to transmit video and audio of second space B acquired by information acquisition unit 21 so that they can be output on first display device 17A arranged in first space A, and to receive video captured by first imaging device 11A and collected audio from first space sharing device 10A arranged in first space A.

[0072] When the communication control unit 29 receives a person designation operation that designates a person who is away from their desk, it may control the communication unit 19 to send call information by voice or message to a mobile terminal device (not shown) carried by the person.

[0073] (Information terminal device) FIG. 5 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. The information terminal device 30 is used in a space shared by the space sharing system 1. In this embodiment, the information terminal device 30 is, for example, a terminal device used by a user present in the first space A and the second space B. The information terminal device 30 is, for example, an information terminal device such as a general-purpose desktop or notebook personal computer, a smartphone, or a tablet terminal used by the user. The information terminal device 30 is connected to the space sharing device 10 via a network so as to be able to communicate data therewith. More specifically, the information terminal device 30 arranged in the first space A is connected to the first space sharing device 10A arranged in the first space A via the network so as to be able to communicate data therewith. The information terminal device 30 arranged in the second space B is connected to the second space sharing device 10B arranged in the second space B via the network so as to be able to communicate data therewith.

[0074] The information terminal device 30 acquires user information of the information terminal device 30 based on account information of the person who is logged in to the information terminal device 30, etc.

[0075] The information terminal device 30 includes an imaging device 31 , an operation unit 33 , a display unit 37 , an audio output unit 38 , a communication unit 39 , and a terminal control device 40 .

[0076] The imaging device 31 captures images and collects sounds around the information terminal device 30. The imaging device 31 includes a camera 311 and a microphone 312.

[0077] The camera 311 captures an image in a direction facing the information terminal device 30. The camera 311 captures an image in a direction facing the display unit 37 of the information terminal device 30. In other words, the camera 311 captures an image in a direction toward the user who is using the information terminal device 30. The camera 311 is disposed, for example, near the display unit 37. The camera 311 outputs the captured image to the image acquisition unit 411 of the terminal control device 40.

[0078] The microphone 312 picks up sounds around the information terminal device 30. The microphone 312 may also pick up sounds from a direction facing the display unit 37 of the information terminal device 30. In other words, the microphone 312 picks up sounds spoken by a user using the information terminal device 30. The microphone 312 outputs audio information related to the picked-up audio to the audio acquisition unit 412 of the terminal control device 40.

[0079] The operation unit 33 is an input device capable of inputting various operations to the information terminal device 30. The operation unit 33 outputs an operation signal corresponding to the received input operation to the terminal control device 40. The operation unit 33 includes, for example, a keyboard, a mouse, a touch panel arranged over the display unit 37, buttons, switches, etc. The operation unit 33 can receive, for example, a key input operation, a click operation, or a touch operation.

[0080] The display unit 37 displays various types of video including text and images. The display unit 37 is, for example, a display including a liquid crystal display, an organic EL display, etc. The display unit 37 displays a video of the space of the other party sharing the space. In this embodiment, when a call is received from an information terminal device 30 present in another space, the display unit 37 displays a video captured by the imaging device 11 of the space sharing device 10 present in the other space. The display unit 37 may also display a video captured by the imaging device 11 of the space sharing device 10 present in the same space. The display on the display unit 37 is controlled by the display control unit 471.

[0081] The audio output unit 38 is an audio output device that outputs audio from the other space that shares the space. In this embodiment, when a call is made from an information terminal device 30 that exists in another space, the audio output unit 38 outputs audio picked up by the imaging device 11 of the space sharing device 10 that exists in the other space. The audio output unit 38 may also output audio picked up by the imaging device 11 of the space sharing device 10 in the same space. The audio output of the audio output unit 38 is controlled by the audio output control unit 472.

[0082] The communication unit 39 is a communication unit for performing wired communication or wireless communication. The communication unit 39 performs communication using a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 39 is controlled by a communication control unit 49. The communication unit 39 communicates data such as video and audio with the space sharing device 10 arranged in the space where the information terminal device 30 exists. The communication unit 39 communicates data such as user information and operating status information of the information terminal device 30 with the space sharing device 10 arranged in the space where the information terminal device 30 exists.

[0083] (Terminal Control Device) The terminal control device 40 controls each part of the information terminal device 30. The terminal control device 40 has, for example, a control device such as a CPU or MPU, and a storage device such as a RAM or ROM. The terminal control device 40 executes a program that controls the operation of the information terminal device 30 according to the present disclosure. The terminal control device 40 may be realized by, for example, an integrated circuit such as an ASIC or FPGA. The terminal control device 40 loads a stored program into memory and executes instructions included in the program. The terminal control device 40 includes an internal memory such as the RAM described above, and the internal memory is used for temporary storage of data in the terminal control device 40. The terminal control device 40 may be realized by a combination of hardware and software.

[0084] The terminal control device 40 has an information acquisition unit 41, an operation reception unit 42, an output control unit 47, and a communication control unit 49 as functional blocks realized by circuits and programs that are executed.

[0085] The information acquisition unit 41 acquires the video captured by the imaging device 31 and the audio collected by the imaging device 31. The information acquisition unit 41 includes a video acquisition unit 411 and an audio acquisition unit 412.

[0086] The video acquisition unit 411 acquires video captured by the camera 311. More specifically, the video acquisition unit 411 acquires video captured by the camera 311 of a user facing the information terminal device 30, etc. The video data acquired by the camera 311 is a moving image.

[0087] The voice acquisition unit 412 acquires the voice detected by the microphone 312. The voice acquisition unit 412 acquires voice such as a voice spoken by a user present in the vicinity of the information terminal device 30.

[0088] The operation reception unit 42 acquires an operation signal corresponding to an operation on the operation unit 33 from the operation unit 33. The operation reception unit 42 outputs a control signal corresponding to the acquired operation signal to each unit.

[0089] The output control unit 47 may output video captured and audio collected by a space sharing device 10 in another space to the display unit 37 and audio output unit 38. The output control unit 47 may also output video captured and audio collected by a space sharing device 10 in the same space to the display unit 37 and audio output unit 38. More specifically, the output control unit 47 may output video captured and audio collected by an imaging device 11 arranged in another space or the same space, which have been received by the communication control unit 49, to the display unit 37 and audio output unit 38.

[0090] The output control unit 47 may output the video captured by the imaging device 31 and the audio collected by the imaging device 31 to the display unit 37 and the audio output unit 38. The output control unit 47 includes a display control unit 471 and an audio output control unit 472.

[0091] The display control unit 471 controls the display of the video on the display unit 37. For example, the display control unit 471 may control the display unit 37 to display the video captured by a space sharing device 10 in another space. The display control unit 471 may also control the display unit 37 to display the video captured by a space sharing device 10 in the same space.

[0092] The audio output control unit 472 controls the output of audio in the audio output unit 38. The audio output control unit 472 may, for example, control the audio output unit 38 to output audio picked up by a space sharing device 10 in another space. The audio output control unit 472 may also output audio picked up by a space sharing device 10 in the same space.

[0093] The communication control unit 49 controls the communication unit 39 to control communication of data such as video and audio with a space sharing device 10 located in another space. More specifically, the communication control unit 49 controls, for example, the communication unit 39 to control communication with a space sharing device 10 located in another space. The communication control unit 49 controls, for example, the communication unit 39 to receive video and audio from a space sharing device 10 located in another space. The communication control unit 49 controls, for example, the communication unit 39 to transmit video and audio of a person facing the display unit 37 of the information terminal device 30, acquired by the information acquisition unit 41, to the space sharing device 10 located in the other space. The communication control unit 49 may also control the communication unit 39 to control communication of data such as video and audio with a space sharing device 10 located in the same space.

[0094] The communication control unit 49 controls the communication unit 39 to transmit presence information indicating the user's work status, absence status, etc. of the information terminal device 30 to the space sharing device 10 arranged in the same space.

[0095] (Space sharing method) Next, a space sharing method will be described with reference to FIG. 6. FIG. 6 is a flowchart showing a space sharing method according to the first embodiment. The processing shown in FIG. 6 is executed while space is being shared by the space sharing system 1. While space is being shared, a first space sharing device 10A arranged in the first space A outputs video and audio of the second space B. A second space sharing device 10B arranged in the second space B outputs video and audio of the first space A. FIG. 6 shows processing executed by each of the space sharing devices 10 arranged in the first space A and the second space B.

[0096] The space sharing control device 20 starts acquiring video and audio from a space sharing device in another space (step S101). The space sharing control device 20 proceeds to step S102.

[0097] The space sharing control device 20 starts displaying the video and detecting people (step S102). More specifically, the space sharing control device 20 starts detecting people present in the video captured by the imaging device 11 using the person detection unit 23. The space sharing control device 20 proceeds to step S103.

[0098] The space sharing control device 20 determines whether a person in an unresponsive state has been detected from the video (step S103). More specifically, the space sharing control device 20 uses the identification unit 24 to identify which information terminal device 30 the detected person is using, based on the detection result from the person detection unit 23 and the used terminal information stored in the storage unit 14. The space sharing control device 20 uses the person state determination unit 25 to determine whether each user using the information terminal device 30 is in a state where they can respond to communication from the first space or the second space, based on the information acquired from the information terminal device 30 and the identification result from the identification unit 24. These processes are performed for all detected people. If the space sharing control device 20 determines that a person in an unresponsive state has been detected from the video (Yes in step S103), the process proceeds to step S105. If the space sharing control device 20 does not determine that a person in an unresponsive state has been detected from the video (No in step S103), the process proceeds to step S104.

[0099] If it is not determined that a person in an unresponsive state has been detected from the video (No in step S103), the space sharing control device 20 displays the video without changing the display mode of all people (step S104). In this case, the video displayed in step S102 is displayed in its original display mode without being processed.

[0100] When it is determined that a person in an unresponsive state has been detected from the video (Yes in step S103), the space sharing control device 20 displays a video in which the display mode of the person in an unresponsive state has been changed (step S105). More specifically, the space sharing control device 20 causes the output control unit 27 to output to the display device 17 a video in which the range of the person determined to be in an unresponsive state or a predetermined range around the person has been processed after receiving the video captured by the imaging device 11 arranged in another space via the communication control unit 29.

[0101] The space sharing control device 20 determines whether or not to end this process (step S106). More specifically, the space sharing control device 20 determines to end this process when, for example, the operation receiving unit 22 receives an operation to end space sharing. When the space sharing control device 20 determines to end this process (Yes in step S106), it ends the process of this flowchart. When the space sharing control device 20 does not determine to end the process (No in step S106), it executes the process of step S103 again.

[0102] In this way, the space sharing system 1 allows the first space A and the second space B to virtually share a space, and allows the information terminal device 30 to participate in the sharing of the space.

[0103] 7 and 8, the video of the first space A displayed on the second display device 17B arranged in the second space B will be described. FIG. 7 is a diagram showing an example of a display screen of the space sharing device according to the first embodiment. FIG. 8 is a diagram showing another example of a display screen of the space sharing device according to the first embodiment. It is assumed that a person u14 and a person u20 exist in the first space A. The person u14 is connected to the information terminal device 30A at his / her desk. 14 The person u14 is facing the person u14. It is assumed that the person state determination unit 25 has determined that the person u14 is in a state where he or she can respond. The person u20 is working near a bookshelf in the office, holding a file. It is assumed that the person state determination unit 25 has determined that the person u20 is in a state where he or she cannot respond.

[0104] FIG. 7 shows an image of the first space A displayed on the second display device 17B, in an initial display state in which no person has changed the display mode.

[0105] In Fig. 8, the image of the person u20 is displayed in a display mode in which the resolution and clarity of the image are reduced compared to the image shown in Fig. 7. In step S103 of the flowchart shown in Fig. 6, the person u20 is in a state where he or she cannot respond, so the determination is Yes.

[0106] (effect) As described above, in this embodiment, in order to indicate the person's status, which indicates whether the person is available to respond to communication, the display mode of the range of the person or a predetermined range around the person in the video output to the first display device 17A and the second display device 17B is controlled. According to this embodiment, it is possible to display whether the person is available to respond at a glance. According to this embodiment, when a person is in a state where it is difficult for them to respond, it is possible to reduce the number of times they are called by a person in another space using the space sharing system. In this way, according to this embodiment, space can be shared to enable smoother communication.

[0107] In this embodiment, the person status, which indicates whether a person is in a state where they can respond to communication, is determined based on information acquired from the information terminal device 30 and the identification result of identifying which information terminal device 30 a person detected in an image captured by the camera 111 of the imaging device 11 arranged on the display device 17 is using. According to this embodiment, it is possible to determine whether a person present in a space is in a state where they can respond. According to this embodiment, it is possible to determine whether a person present in a space is in a state where they can respond even if they are away from their desk.

[0108] In this embodiment, an image of a person captured by a camera 311 installed in an information terminal device 30 used by the person is acquired, and whether or not the person is in a state where they cannot respond is determined using the image. According to this embodiment, the person's concentration level can be detected from an image of the person's face, and whether or not they are in a state where they can respond can be determined.

[0109] [Second embodiment] A space sharing device 10X according to the second embodiment will be described using Figs. 9 to 11. Fig. 9 is a block diagram showing an example of the configuration of a space sharing device according to the second embodiment. Fig. 10 is a flowchart showing a space sharing method according to the second embodiment. Fig. 11 is a diagram showing an example of a display screen by the space sharing device according to the second embodiment. In the following description, components similar to those in the space sharing device 10 are given the same or corresponding reference numerals, and detailed description thereof will be omitted. The same applies to the following embodiments. The space sharing device 10X differs from the first embodiment in that it includes a communication status acquisition unit 26X and in the processing of a person state determination unit 25X and an output control unit 27X.

[0110] The communication status acquisition unit 26X acquires, from the information terminal device 30, a communication status indicating whether the information terminal device 30 is communicating with another information terminal device 30. The communication status acquisition unit 26X acquires the communication status indicating whether the information terminal device 30 is communicating with another information terminal device 30, for example, from a communication application running on the information terminal device 30. The communication status acquisition unit 26X determines that the information terminal device 30 is communicating with another information terminal device 30 when, for example, the information terminal device 30 is participating in a web conference or chatting using an application.

[0111] When the communication status acquisition unit 26X is communicating with another information terminal device 30, the communication status acquisition unit 26X may further acquire information indicating the number of other information terminal devices 30 with which the communication is being performed and the attributes of the people corresponding to the users of the other information terminal devices 30 with which the communication is being performed. This information can be acquired, for example, from a communication application, schedule information of a scheduler that can be referenced in the information terminal device 30, employee information stored in a database of in-house employees, etc.

[0112] When the communication status acquired by the communication status acquisition unit 26X indicates that communication is in progress, the person status determination unit 25X determines that the person is in a state where he or she cannot respond.

[0113] The person state determination unit 25X may determine whether or not the person is in a state where he or she cannot respond, based on the communication state acquired by the communication state acquisition unit 26X and depending on the importance of the communication.

[0114] The importance of communication is determined, for example, in three levels: "high," "medium," and "low." For example, if there is one other information terminal device 30, the importance is determined to be "low." For example, if there are 100 or more other information terminal devices 30, the importance is determined to be "high." For example, if there are two or more but fewer than 100 other information terminal devices 30, the importance is determined to be "medium." For example, if the communication partner has a higher position than the communication partner, the importance is determined to be "high." For example, if the communication partner belongs to the same department as the communication partner, the importance is determined to be "medium." For example, if the communication partner is not stored in a communication application or employee database, the importance is determined to be "low."

[0115] For example, the person state determination section 25X determines that a response is not possible when the importance is "medium" or "high," and determines that a response is possible when the importance is "low."

[0116] When the person is in a state where he / she cannot respond, the output control unit 27X controls the display form to indicate that the person is in a state where he / she cannot respond. More specifically, when the person is communicating with another information terminal device 30, the output control unit 27X controls the display form to indicate that the person is in a state where he / she cannot respond.

[0117] (Space sharing method) Next, a space sharing method will be described with reference to Fig. 10. The processes in steps S111 to S112 and steps S114 to S116 in the flowchart shown in Fig. 10 are similar to those in steps S101, S102, and steps S104 to S106 in the flowchart shown in Fig. 6.

[0118] The space sharing control device 20A determines whether a person in an unresponsive state has been detected from the communication status (step S113). More specifically, the space sharing control device 20 acquires, from the information terminal device 30, a communication status indicating whether the information terminal device 30 is communicating with another information terminal device 30, using the communication status acquisition unit 26X. The space sharing control device 20 determines, using the person status determination unit 25, that a person is in an unresponsive state when the communication status acquired by the communication status acquisition unit 26X indicates that communication is in progress. When the space sharing control device 20 determines that a person in an unresponsive state has been detected from the communication status (Yes in step S113), the process proceeds to step S115. When the space sharing control device 20 does not determine that a person in an unresponsive state has been detected from the communication status (No in step S113), the process proceeds to step S114.

[0119] In Fig. 11, the image of person u14 is displayed in a display mode in which the resolution and clarity of the image are reduced compared to the image shown in Fig. 7. In step S113 of the flowchart shown in Fig. 11, since person u14 is in a state where he or she cannot respond, the determination is Yes.

[0120] (effect) As described above, in this embodiment, when the information terminal device 30 used by a person is communicating with another information terminal device 30, it is determined that the person is in a state where the person cannot respond. In this embodiment, when the information terminal device 30 used by a person is communicating with another information terminal device 30, the display mode can be controlled to indicate that the person is in a state where the person cannot respond. According to this embodiment, it is possible to display whether or not a person is in a state where the person is in a state where the person cannot respond so that the person can see at a glance. According to this embodiment, when a person is in a state where it is difficult for the person to respond, it is possible to reduce the number of times the person is called by a person in another space using the space sharing system. In this way, according to this embodiment, it is possible to share a space and communicate more smoothly.

[0121] In this embodiment, it is possible to determine whether a person is in a state where they cannot respond, depending on the importance of the communication. [Explanation of symbols]

[0122] 1. Space sharing system 10 Space sharing device 10A First space sharing device 10B Second space sharing device 11 Imaging device 11A First imaging device 11B Second imaging device 111 Camera 112 microphones 13 Control section 14 Storage section 17 Display device 17A First display device 17B Second display device 171 Display section 172 Audio output section 19 Communications Department 20 Space sharing control device 21 Information Acquisition Department 211 Video Acquisition Unit 212 Voice Acquisition Unit 22 Operation reception section 23 Person detection unit 24 Specific section 25 Person status determination unit 27 Output control section 271 Display control unit 272 Audio output control unit 29 Communication control section 30 Information terminal device 31 Imaging device 311 Camera 312 Microphone 33 Operation section 37 Display section 38 Audio output section 39 Communications Department 40 Terminal control device 41 Information Acquisition Department 411 Video Acquisition Unit 412 Audio acquisition unit 42 Operation reception section 47 Output control section 471 Display control unit 472 Audio output control unit 49 Communication control section A first space B Second space

Claims

1. A space-sharing system including a first imaging device and a first display device arranged in a first space, and a second imaging device and a second display device arranged in a second space, an information acquisition unit that acquires images captured by the first imaging device and the second imaging device and sounds collected by the first imaging device and the second imaging device; a storage unit for storing used terminal information indicating a combination of information terminal devices used by each person; a person state determination unit that determines a person state indicating whether each of the people using the information terminal device is in a state where they can respond to communication from the first space or the second space, based on information acquired from the information terminal device; an output control unit that outputs the image captured by the first imaging device and the collected sound to the second display device, and outputs the image captured by the second imaging device and the collected sound to the first display device; Equipped with the output control unit controls a display form of a range of the person or a predetermined range around the person in the images output to the first display device and the second display device in order to indicate the state of the person. Space sharing system.

2. a person detection unit that detects a person present in the images captured by the first imaging device and the second imaging device, and outputs a person detection result that is a result of detecting whether the person is working; and an identification unit that outputs an identification result that identifies which of the information terminal devices the detected person uses based on the used terminal information stored in the storage unit; Furthermore, the person state determination unit determines a person state indicating whether each of the persons using the information terminal device is in a state where they can respond to communication from the first space or the second space, based on at least one of information acquired from the information terminal device, the person detection result, and the identification result; The space sharing system according to claim 1 .

3. a communication status acquisition unit that acquires, from the information terminal device, a communication status indicating whether the information terminal device is communicating with another information terminal device; Furthermore, the person state determination unit determines that the person is in a state where they cannot respond when the communication status is in communication; the output control unit controls a display form when the person is in a state where he or she cannot respond so as to indicate that the person is in a state where he or she cannot respond. The space sharing system according to claim 1 .

4. the person state determination unit acquires an image of the person from the information terminal device, and determines whether the person is in a state where he or she cannot respond using the image; The space sharing system according to claim 1 .

5. A space sharing method including a first imaging device and a first display device disposed in a first space, and a second imaging device and a second display device disposed in a second space, an information acquisition step of acquiring images captured by the first imaging device and sounds collected by the second imaging device; a storage step of storing in a storage unit used terminal information indicating a combination of each information terminal device used by each person; a person state determination step of determining a person state indicating whether each of the persons using the information terminal device is in a state where they can respond to communication from the first space or the second space, based on information acquired from the information terminal device; an output control step of outputting the image captured by the first imaging device and the collected sound to the second display device, and outputting the image captured by the second imaging device and the collected sound to the first display device; Including, the output control step includes controlling a display form of a range of the person or a predetermined range around the person in the images output to the first display device and the second display device in order to indicate the state of the person; The space sharing system executes the space sharing method.

Images