Space sharing device or space sharing method
The space sharing device addresses the challenge of maintaining concentration by using a person detection unit to control video clarity, ensuring clarity is only reduced when the device is not in use, thus minimizing distractions.
Patent Information
- Application Number
- JP2024059150
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-30
- Filing Date
- 2024-04-01
- Publication Date
- 2025-06-11
AI Technical Summary
Existing space sharing systems face challenges in maintaining concentration around the device due to concerns about voices or lines of sight in shared spaces, leading to potential distractions and reduced focus.
A space sharing device equipped with an information acquisition unit for real-time video capture, an output control unit that reduces video clarity when no one is using the device, and a person detection unit that cancels clarity reduction when a person is detected using the device.
This solution effectively suppresses the inhibition of concentration around the space sharing device by ensuring that video clarity is only reduced when the device is not in use, thereby minimizing distractions and maintaining focus.
Smart Images

Figure 2025088685000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a space sharing device or a space sharing method.
Background Art
[0002] In geographically or spatially separated spaces, a system for pseudo-space sharing using a photographing device and a display device is known (see, for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] Such a space sharing system is arranged, for example, in different offices within the same company. By using the space sharing system, there is an effect that mutual communication becomes easy. However, concerns such as voices or lines of sight in the other space to be shared may arise, and the concentration of people around the space sharing device may be inhibited.
[0005] An object of the present disclosure is to suppress the inhibition of the concentration of people around a space sharing device when sharing a space by the space sharing device.
Means for Solving the Problems
[0006] In order to solve the above-described problems and achieve the object, a space sharing device according to the present disclosure includes an information acquisition unit that acquires video captured by an imaging device disposed in another space, an output control unit that causes the display unit to display the video acquired by the information acquisition unit in real time, and a person detection unit that detects a person using the space sharing device. The output control unit reduces the clarity of the video and outputs it to the display unit. When the person detection unit detects a person using the space sharing device, the output control unit cancels the reduction in the clarity of the video and starts outputting to the display unit.
[0007] A space sharing method according to the present disclosure includes steps of: acquiring video captured by an imaging device disposed in another space; displaying the acquired video in real time on a display unit with the clarity of the video reduced; detecting a person using the space sharing device; and when a person using the space sharing device is detected, canceling the reduction in the clarity of the video and starting outputting to the display unit, which are executed by a space sharing device.
Effect of the Invention
[0008] According to the present disclosure, when sharing a space by a space sharing device, it is possible to suppress inhibiting the concentration of a person around the space sharing device.
Brief Description of the Drawings
[0009]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
DETAILED DESCRIPTION OF THE INVENTION
[0010] With reference to the accompanying drawings, embodiments of the space sharing device or space sharing method according to the present invention will be described in detail. Note that the present invention is not limited by the following embodiments.
[0011] [First Embodiment] (Space Sharing System) The space sharing system always shares video and audio in real time in a plurality of real spaces. The space sharing system, for example, when applied to remote offices, makes it feel as if the offices are being shared. The space sharing system includes space sharing devices 10 respectively arranged in a plurality of spaces. The number of spaces shared by the space sharing system is not limited.
[0012] In the following description, as an example, the space sharing system will be described as sharing two spaces, a first space A and a second space B. A first space sharing device 10A is arranged in the first space A. A second space sharing device 10B is arranged in the second space B. Specifically, the first space sharing device 10A and the second space sharing device 10B are connected by an in-house network or the like. When there is no particular need to distinguish between the first space sharing device 10A and the second space sharing device 10B, it will be described as the space sharing device 10. Similarly, in the description of each component, when there is no particular need to distinguish between the components provided in the first space sharing device 10A and the components provided in the second space sharing device 10B, no A or B is attached to the reference numeral, and when it is necessary to distinguish between the components provided in the first space sharing device 10A and the components provided in the second space sharing device 10B, it will be described with A or B attached to the reference numeral.
[0013] Using FIGS. 1 and 2, the space sharing in the first space A and the second space B will be described. FIG. 1 is a schematic diagram showing an arrangement example of the space sharing device, and is a view arranged in the first space. FIG. 2 is a schematic diagram showing an arrangement example of the space sharing device, and is a view arranged in the second space. Also, FIGS. 1 and 2 are in a state where communication is being performed using the space sharing system. The first space sharing device 10A is preferably arranged at a position where it can image the entire first space A or the range of departments where space sharing is useful. As shown in FIG. 1, the person ua existing in the first space A is using the space sharing system while facing the first display device 17A in the vicinity of the first display device 17A. The first space sharing device 10A arranged in the first space A outputs the video and audio of the second space B. When a person ub is facing the second display device 17B, the video of the person ub located in the second space B is displayed at approximately life size on the first space sharing device 10A. The second space sharing device 10B is preferably arranged at a position where it can image the entire second space B or the range of departments where space sharing is useful. As shown in FIG. 2, the person ub existing in the second space B is using the space sharing system while facing the second display device 17B in the vicinity of the second display device 17B. The second space sharing device 10B arranged in the second space B outputs the video and audio of the first space A. When a person ua is facing the first display device 17A, the video of the person ua located in the first space A is displayed at approximately life size on the second space sharing device 10B. In this way, the first space A and the second space B are pseudo-spatially shared. The person ua existing in the first space A and the person ub existing in the second space B communicate with each other using the space sharing system. The communication using the space sharing system may be paraphrased as a call.
[0014] (Space sharing device) FIG. 3 is a block diagram showing a configuration example of the space sharing device according to the first embodiment. The space sharing device 10 is realized by a general-purpose server device including a distributed type or a computer such as a personal computer. The space sharing device 10 controls space sharing in different spaces. In the present embodiment, the space sharing device 10 controls space sharing between the first space A and the second space B. When there is no person using the space sharing device 10, in other words, when there is no person trying to use or using the space sharing device 10, the space sharing device 10 displays the video of the other space with reduced clarity. The use of the space sharing device 10 can also be described as a call using the space sharing device 10. When there is a person using the space sharing device 10, the space sharing device 10 displays the video of the other space without reducing the clarity.
[0015] The space sharing device 10 may be such that the space sharing control device 20 described later centrally controls each imaging device 11 and each display device 17 arranged in different spaces. The space sharing device 10 may be configured such that the space sharing control devices 20 are arranged for each space and are interconnected via a network. In the present embodiment, the space sharing device 10 will be described as being arranged in the first space A and the second space B, respectively. Also, the space sharing device 10 arranged in the first space A is referred to as the first space sharing device 10A, and the space sharing device 10 arranged in the second space B is referred to as the second space sharing device 10B. Also, the other space sharing device 10 as seen from one of the space sharing devices 10 in the first space A or the second space B may be referred to as the other space sharing device 10.
[0016] The space sharing device 10 includes an imaging device 11, an operation unit 13, a display device 17, a communication unit 19, and a space sharing control device 20.
[0017] The imaging device 11 captures the video of the arranged space and picks up the sound. More specifically, for example, the first imaging device 11A arranged in the first space A captures the video of the first space A and picks up the sound. For example, the second imaging device 11B arranged in the second space B captures the video of the second space B and picks up the sound. The imaging device 11 acquires the captured video and the picked-up sound as information by the information acquisition unit 21. The imaging device 11 is arranged around the display device 17. The imaging device 11 includes a camera 111 and a microphone 112.
[0018] The camera 111 captures the video of the arranged space. The camera 111 is arranged, for example, around the display device 17 or in the front part of the display device 17. The camera 111 captures a person facing in the vicinity of the display device 17 arranged in the same space. More specifically, for example, the camera 111 of the first imaging device 11A arranged in the first space A captures the video of the first space A. For example, the camera 111 of the second imaging device 11B arranged in the second space B captures the video of the second space B. The camera 111 outputs the captured video to the video acquisition unit 211 of the space sharing control device 20.
[0019] The microphone 112 picks up the sound of the arranged space. The microphone 112 is arranged, for example, around the display device 17 or in the front part of the display device 17. The microphone 112 picks up the sound spoken by a person facing in the vicinity of the display device 17 arranged in the same space. More specifically, for example, the microphone 112 of the first imaging device 11A arranged in the first space A picks up the sound of the first space A. For example, the microphone 112 of the second imaging device 11B arranged in the second space B picks up the sound of the second space B. The microphone 112 outputs the audio information regarding the picked-up sound to the audio acquisition unit 212 of the space sharing control device 20.
[0020] The operation unit 13 is an input device capable of inputting various operations for the space sharing device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the space sharing control device 20. The operation unit 13 includes, for example, a touch panel, buttons, switches, etc. arranged overlapping the display unit 171. The operation unit 13 can receive, for example, a key input operation, a click operation, or a touch operation.
[0021] The display device 17 displays the video of the space on the other side that shares the space and outputs sound. The display of the video and the output of the sound of the display device 17 are controlled by the output control unit 27. The display device 17 includes a display unit 171 and an audio output unit 172.
[0022] The display unit 171 displays various videos including characters and images. The display unit 171 is, for example, a display including a liquid crystal display, an organic EL (Electro-Luminescence), etc. The display unit 171 displays the video of the space on the other side that shares the space. More specifically, for example, the display unit 171 of the first display device 17A arranged in the first space A displays the video of the second space B. For example, the display unit 171 of the second display device 17B arranged in the second space B displays the video of the first space A. The display of the display unit 171 is controlled by the display control unit 271.
[0023] The audio output unit 172 is an audio output device that outputs the audio of the space on the other side that shares the space. More specifically, for example, the audio output unit 172 of the first display device 17A arranged in the first space A outputs the audio of the second space B. For example, the audio output unit 172 of the second display device 17B arranged in the second space B outputs the audio of the first space A. The output of the audio of the audio output unit 172 is controlled by the audio output control unit 272.
[0024] The communication unit 19 is a communication unit for performing wired communication, wireless communication, or the like. The communication unit 19 communicates using, for example, a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication unit 19 is controlled for communication by the communication control unit 29. The communication unit 19 performs communication of video and audio data with other space sharing devices 10.
[0025] (Space sharing control device) The space sharing control device 20 controls each part of the space sharing device 10. The space sharing control device 20 includes, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The space sharing control device 20 may be realized by an integrated circuit such as an ASIC or an FPGA. The space sharing control device 20 may be realized by a combination of hardware and software. The space sharing control device 20 executes a program for controlling the operation of the space sharing device 10 according to the present disclosure.
[0026] When there is no person using the space sharing device 10, that is, no person is in a call or trying to make a call, the space sharing control device 20 controls to display the video of another space with reduced clarity. When there is a person using the space sharing device 10, that is, a person is in a call or trying to make a call, the space sharing control device 20 controls to display the video of another space without reducing the clarity. The space sharing control device 20 includes an information acquisition unit 21, an operation reception unit 22, a person detection unit 23, an output control unit 27, and a communication control unit 29 as functional blocks realized by a circuit or an executed program.
[0027] In the present embodiment, the space sharing control device 20 controls the imaging device 11 and the display device 17 arranged in each space. It is assumed that the space sharing control device 20 is arranged in the first space A and the second space B, respectively.
[0028] The information acquisition unit 21 acquires the video captured by the imaging device 11 arranged in the same space. In the present embodiment, the information acquisition unit 21 acquires the video captured and the sound recorded by the imaging device 11 arranged in the same space. Further, the information acquisition unit 21 outputs the video captured and the sound recorded by the imaging device 11 arranged in the same space to the communication control unit 29. Furthermore, the information acquisition unit 21 outputs the video captured by the imaging device 11 arranged in the same space to the person detection unit 23. More specifically, for example, the information acquisition unit 21 of the first space sharing device 10A arranged in the first space A acquires the video captured and the sound recorded by the first imaging device 11A arranged in the first space A. The information acquisition unit 21 of the first space sharing device 10A outputs the video captured and the sound recorded by the first imaging device 11A to the communication control unit 29 of the first space sharing device 10A. The information acquisition unit 21 of the first space sharing device 10A outputs the video captured by the first imaging device 11A to the person detection unit 23 of the first space sharing device 10A. For example, the information acquisition unit 21 of the second space sharing device 10B arranged in the second space B acquires the video captured and the sound recorded by the second imaging device 11B arranged in the second space B. The information acquisition unit 21 of the second space sharing device 10B outputs the video captured and the sound recorded by the second imaging device 11B to the communication control unit 29 of the second space sharing device 10B. The information acquisition unit 21 of the second space sharing device 10B outputs the video captured by the second imaging device 11B to the person detection unit 23 of the second space sharing device 10B. The information acquisition unit 21 includes a video acquisition unit 211 and an audio acquisition unit 212.
[0029] The video acquisition unit 211 acquires the video captured by the camera 111 arranged in the same space. More specifically, the video acquisition unit 211 acquires the video of a person or the like present around the display device 17 arranged in the same space. More specifically, for example, the video acquisition unit 211 of the first space sharing device 10A arranged in the first space A acquires the video of a person or the like present around the first display device 17A. For example, the video acquisition unit 211 of the second space sharing device 10B arranged in the second space B acquires the video of a person or the like present around the second display device 17B. The video data acquired by the imaging of the camera 111 is a moving image.
[0030] The audio acquisition unit 212 acquires the audio detected by the microphone 112 arranged in the same space. The audio acquisition unit 212 acquires the audio such as the speech of a person around the display device 17 arranged in the same space. More specifically, for example, the audio acquisition unit 212 of the first space sharing device 10A arranged in the first space A acquires the speech of a person present around the first display device 17A. For example, the audio acquisition unit 212 of the second space sharing device 10B arranged in the second space B acquires the speech of a person present around the second display device 17B.
[0031] The operation reception unit 22 acquires an operation signal corresponding to an operation on the operation unit 13 from the operation unit 13. The operation reception unit 22 outputs a control signal corresponding to the acquired operation signal to each unit.
[0032] The person detection unit 23 detects a person who uses the space sharing device 10. More specifically, the person detection unit 23 detects a person from the video of the same space acquired by the information acquisition unit 21. The person detection unit 23 detects a whole body, an upper body, a face, etc. of a person from the video acquired by the video acquisition unit 211. The person detection unit 23 detects, as a person who uses the space sharing device 10, a person who faces the imaging device 11 or the display device 17 in the vicinity of the display device 17, that is, a person who faces the imaging device 11 or the display device 17 in the vicinity of the imaging device 11 or the display device 17. The person who uses the space sharing device 10 includes a person who tries to use the space sharing device 10 and a person who is using the space sharing device 10. As a method for the person detection unit 23 to detect a person or a face from the video, a known method can be used and is not limited. In other words, the person detection unit 23 detects a person who is in front of the imaging device 11 or the display device 17 in order to use the space sharing device 10. The person detection unit 23 transmits or shares the result of detecting a person to the output control unit 27 and the space sharing device 10 in another space.
[0033] For example, the person detection unit 23 detects, from the detection result of the person detection unit 23, a person having a size equal to or larger than a predetermined size with respect to the image size as a person facing the imaging device 11 or the display device 17. When a state where the fluctuation of the position of a person detected as facing the imaging device 11 or the display device 17 is equal to or less than a threshold value continues for a predetermined period of about several seconds, for example, the person detection unit 23 may detect the person as a person facing the imaging device 11 or the display device 17. When the state where the fluctuation of the position of a person detected as facing the imaging device 11 or the display device 17 is equal to or less than a threshold value is less than a predetermined period, it is determined that the person is not a person who is in front of the imaging device 11 or the display device 17 in order to use the space sharing device 10, but a person who has only passed in front of the space sharing device 10.
[0034] In this embodiment, the output control unit 27 causes the display unit 171 to display the video and audio acquired by the communication control unit 29 in real time, and outputs them to the audio output unit 172 in real time. In this embodiment, the output control unit 27 outputs the video captured by the imaging device 11 arranged in another space and the audio picked up, which are received by the communication control unit 29, to the display device 17. More specifically, for example, the output control unit 27 of the first space sharing device 10A arranged in the first space A outputs the video captured by the second imaging device 11B and the audio picked up, which are received by the communication control unit 29, to the first display device 17A arranged in the first space A. For example, the output control unit 27 of the second space sharing device 10B arranged in the second space B outputs the video captured by the first imaging device 11A and the audio picked up, which are received by the communication control unit 29, to the second display device 17B arranged in the second space B. The output control unit 27 includes a display control unit 271 and an audio output control unit 272.
[0035] The display control unit 271 controls the display of video on the display unit 171. The display control unit 271, for example, controls the display unit 171 to display the video captured in another space. When a person is captured in the video captured in another space, the display control unit 271 displays the video including the person existing in the other space. More specifically, for example, the display control unit 271 of the first space sharing device 10A arranged in the first space A displays the video captured in the second space B. For example, the display control unit 271 of the second space sharing device 10B arranged in the second space B displays the video captured in the first space A.
[0036] FIG. 4 is a diagram showing an example of a display screen by the space sharing device according to the first embodiment. In the space displayed on the display screen, there are a person u1 and a person u2. The person u1 is facing the display screen near the imaging device 11 and is a person using the space sharing device 10. The person u2 is facing the display screen at a position away from the imaging device 11 and is not a person using the space sharing device 10. Such a video is not degraded in clarity by the space sharing device 10.
[0037] The display control unit 271 reduces the clarity of the video and causes it to be displayed on the display unit 171. When the person detection unit 23 does not detect a person using the space sharing device 10, such as a person facing in the vicinity of the imaging device 11 or a person facing in the vicinity of the display unit 171, the display control unit 271 reduces the clarity of the video and causes it to be displayed on the display unit 171. When there is no person on a call or attempting to make a call using the space sharing device 10, the display control unit 271 reduces the clarity of the video and causes it to be displayed on the display unit 171.
[0038] In the present embodiment, the display control unit 271 reduces the clarity of the video to such an extent that the presence of a person existing in the range captured by the imaging device 11 can be determined and the direction of the line of sight is difficult to recognize. The display control unit 271 reduces the clarity of the video to such an extent that it becomes difficult to identify the person. Thereby, when a call is not being made using the space sharing device 10, it is possible to suppress the concern about the line of sight of a person in another space.
[0039] The display control unit 271 reduces the clarity and causes it to be displayed on the display unit 171 by, for example, reducing the overall resolution of the video.
[0040] FIG. 5 is a diagram showing another example of a display screen by the space sharing device according to the first embodiment. A person u2 exists in the space displayed on the display screen. In this case, since no person using the space sharing device 10, such as a person facing in the vicinity of the imaging device 11 or a person facing the display unit 171 in the vicinity of the display unit 171, is detected, the display control unit 271 causes the display unit 171 to display a video with reduced clarity. The video in this case has reduced clarity by reducing the overall resolution of the video.
[0041] FIG. 6 is a diagram showing another example of a display screen by the space sharing device according to the first embodiment. In this case, similar to FIG. 5, the display control unit 271 causes the display unit 171 to display a video with reduced clarity. The video in this case has reduced clarity by applying mosaic processing to the entire video.
[0042] The display control unit 271 causes the display unit 171 to display with reduced clarity by, for example, reducing the overall brightness of the video or the brightness of the backlight, rather than reducing the clarity.
[0043] FIG. 7 is a diagram showing another example of a display screen by the space sharing device according to the first embodiment. In this case, similar to FIG. 5, the display control unit 271 causes the display unit 171 to display a video with reduced clarity. The video in this case has reduced clarity by reducing the overall brightness of the video or the brightness of the backlight of the display screen.
[0044] When the person detection unit 23 detects a person using the space sharing device 10, such as a person facing in the vicinity of the imaging device 11 or a person facing in the vicinity of the display unit 171, the display control unit 271 cancels the reduction in the clarity of the video and starts outputting to the display unit 171. When there is a person who is in a call or trying to make a call using the space sharing device 10, the display control unit 271 cancels the reduction in the clarity of the video and causes the display unit 171 to display a clear video.
[0045] The audio output control unit 272 controls the audio output in the audio output unit 172. The audio output control unit 272 causes, for example, the audio output unit 172 to output audio picked up in another space. More specifically, for example, the audio output control unit 272 of the first space sharing device 10A arranged in the first space A causes the audio picked up in the second space B to be output. For example, the audio output control unit 272 of the second space sharing device 10B arranged in the second space B causes the audio picked up in the first space A to be output.
[0046] The communication control unit 29 controls the communication unit 19 to control the transmission and reception of data including video and audio between the space sharing device 10 and other space sharing devices. For example, the communication control unit 29 controls the communication unit 19 to control the communication between the space sharing device 10 and other space sharing devices. For example, the communication control unit 29 controls the communication unit 19 to receive video and audio captured and recorded in other spaces from other space sharing devices 10. For example, the communication control unit 29 controls the communication unit 19 to transmit the video and audio captured and recorded by the imaging device 11 to other space sharing devices 10.
[0047] More specifically, for example, the communication control unit 29 of the first space sharing device 10A arranged in the first space A transmits the video and audio of the first space A acquired by the information acquisition unit 21 to the second display device 17B arranged in the second space B so that it can be output, and controls to receive the video and audio captured and recorded by the second imaging device 11B from the second space sharing device 10B arranged in the second space B. For example, the communication control unit 29 of the second space sharing device 10B arranged in the second space B transmits the video and audio of the second space B acquired by the information acquisition unit 21 to the first display device 17A arranged in the first space A so that it can be output, and controls to receive the video and audio captured and recorded by the first imaging device 11A from the first space sharing device 10A arranged in the first space A.
[0048] As described above, in the present embodiment, the space sharing device 10 has been described as being arranged in the first space A and the second space B respectively. When the space sharing control device 20 centrally controls each imaging device 11 and each display device 17 arranged in different spaces, it does not include the communication unit 19 and the communication control unit 29, and the information acquisition unit 21 acquires the video and audio captured and recorded by each imaging device 11 arranged in each space, and the output control unit 27 outputs, for example, the video and audio captured and recorded by the first imaging device 11A arranged in the first space A to the second display device 17B arranged in the second space B, and outputs the video and audio captured and recorded by the second imaging device 11B arranged in the second space B to the first display device 17A arranged in the first space A.
[0049] (Space sharing method) FIG. 8 is a flowchart showing the space sharing method according to the first embodiment. The process shown in FIG. 8 is executed when space sharing by the space sharing system is started. While space is being shared, the first space sharing device 10A arranged in the first space A outputs the video and audio of the second space B. The second space sharing device 10B arranged in the second space B outputs the video and audio of the first space A. FIG. 7 shows the processes executed by the space sharing devices 10 arranged in the first space A and the second space B, respectively.
[0050] When an operation such as starting space sharing is performed, the space sharing control device 20 starts acquiring video and audio by the space sharing device 10 in another space through the information acquisition unit 21 (step S101). More specifically, the space sharing control device 20 starts acquiring video captured by the camera 111 arranged in another space and showing a person or the like existing around the display device 17 through the video acquisition unit 211. The space sharing control device 20 starts acquiring the voice spoken by a person around the display device 17 arranged in another space through the voice acquisition unit 212. The space sharing control device 20 proceeds to step S102.
[0051] The space sharing control device 20 outputs the voice of another space, displays the video of another space with reduced clarity, and starts detecting people by the output control unit 27 (step S102). More specifically, the space sharing control device 20 causes the voice output control unit 272 to output the voice picked up in another space. The space sharing control device 20 causes the display control unit 271 to reduce the clarity of the video captured in another space and display it on the display unit 171. The space sharing control device 20 starts detecting, as a person using the space sharing device 10, a person facing the imaging device 11 near the imaging device 11 or a person facing the display unit 171 near the display unit 171, from at least one of the video of the same space acquired by the information acquisition unit 21 and the video of another space acquired by the communication control unit 29. The space sharing control device 20 may start acquiring the detection result of a person facing the display device 17 near the display device 17 in another space by the person detection unit 23 in the space sharing control device 20 of another space. The space sharing control device 20 proceeds to step S103.
[0052] The space sharing control device 20 determines whether there is a person using the space sharing device 10 (step S103). Based on the detection result of the person detection unit 23, the space sharing control device 20 detects a person facing the imaging device 11 or the display device 17 near the imaging device 11 or the display device 17, and if it is determined that there is a person using the space sharing device 10 (Yes in step S103), it proceeds to step S104. The case of Yes in step S103 means that there is a person who is on a call or trying to make a call. If the space sharing control device 20 determines that there is no person using the space sharing device 10 (No in step S103), it proceeds to step S105. The case of No in step S103 means that there is no person who is on a call or trying to make a call.
[0053] When it is determined that there is a person using the space sharing device 10 (Yes in step S103), the space sharing control device 20 causes the display control unit 271 to display a video that is captured in another space and has no reduced clarity (step S104). The display of a video with no reduced clarity means displaying the video captured in another space without performing a process to reduce the clarity. The space sharing control device 20 proceeds to step S106.
[0054] When it is determined that there is no person using the space sharing device 10 (No in step S103), the space sharing control device 20 causes the display control unit 271 to display a video with reduced clarity of the video captured in another space (step S105). The display of a video with reduced clarity means performing a process to reduce the clarity on the video captured in another space and then displaying it. The space sharing control device 20 proceeds to step S106.
[0055] When, after being determined as Yes in step S103, the use of the space sharing device 10 such as a call by the space sharing device 10 is started, and when it becomes No in step S103 after passing through No in step S106, it is when the use of the space sharing device 10 such as a call by the space sharing device 10 ends and the person who was using the space sharing device 10 is no longer detected.
[0056] The space sharing control device 20 determines whether to end the sharing of the space by the space sharing device 10 (step S106). More specifically, the space sharing control device 20 determines to end the sharing of the space, for example, when an operation to end the sharing of the space is received by the operation reception unit 22. When the space sharing control device 20 determines to end the sharing of the space (Yes in step S106), it ends the processing of this flowchart. When the space sharing control device 20 does not determine to end the sharing of the space (No in step S106), it executes the processing of step S103 again.
[0057] In this way, the first space A and the second space B virtually share the space by the space sharing system. If the answer is Yes in step S103, a clear video is displayed on the display unit 171 so that a call can be made. If the answer is No in step S103, a video with reduced clarity is displayed on the display unit 171 so that the line of sight of a person existing in another space is not a concern.
[0058] (Effect) As described above, in the present embodiment, the clarity of the video captured in another space is reduced and displayed on the display unit 171. In the present embodiment, when a person using the space sharing device 10, such as a person facing the imaging device 11 near the imaging device 11 or a person facing the display unit 171 near the display unit 171, is detected, the reduction in the clarity of the video captured in another space is cancelled and displayed on the display unit 171. According to the present embodiment, when a call is not being made by the space sharing device 10, it is possible to suppress a display that makes the line of sight of a person in another space a concern while maintaining the sense of presence due to space sharing. In this way, according to the present embodiment, when sharing the space by the space sharing device 10, it is possible to suppress inhibiting the concentration of a person around the space sharing device 10.
[0059] [Second Embodiment] The space sharing device 10 according to the second embodiment will be described with reference to FIGS. 9 and 10. FIG. 9 is a diagram showing an example of a display screen by the space sharing device according to the second embodiment. FIG. 10 is a flowchart showing the space sharing method according to the second embodiment. In the following description, the same reference numerals or corresponding reference numerals are given to the same components as those of the space sharing device 10, and the detailed description thereof is omitted. The same applies to the following embodiments. The processing of the person detection unit 23 and the display control unit 271 of the space sharing device 10 is different from that of the first embodiment.
[0060] The person detection unit 23 detects a person included in the video captured in another space by another space sharing device 10, which is acquired by the communication control unit 29. The person detection unit 23 calculates the range of the person detected in the video, in other words, the coordinate range indicating the detection position of the person.
[0061] When the display control unit 271 does not detect a person using the space sharing device 10, such as a person facing the imaging device 11 near the imaging device 11 or a person facing the display unit 171 near the display unit 171, the video captured by another space sharing device 10 in another space is displayed on the display unit 171 with the clarity reduced for the range of the person included in the video.
[0062] When the person detection unit 23 detects a person using the space sharing device 10, such as a person facing the imaging device 11 near the imaging device 11 or a person facing the display unit 171 near the display unit 171, the display control unit 271 displays the video captured by another space sharing device 10 in another space on the display unit 171 without reducing the clarity of the video. In this case, if a person using the space sharing device 10 is detected in the video captured by another space sharing device 10 in another space, the clarity of the video may be reduced for persons other than the person using the space sharing device 10.
[0063] In the example shown in FIG. 9, a person u2 is detected in the video captured by another space sharing device 10 in another space. Therefore, the display control unit 271 displays on the display unit 171 a video with the clarity reduced for the range corresponding to the person u2 detected from the video captured by another space sharing device 10 in another space. The display control unit 271 displays the area other than the range corresponding to the person detected from the video captured by another space sharing device 10 in another space without reducing the clarity.
[0064] Next, a space sharing method will be described with reference to FIG. 10. The processes of steps S111, S114, and S120 in the flowchart shown in FIG. 10 perform the same processes as steps S101, S103, and S106 in the flowchart shown in FIG. 8.
[0065] The space sharing control device 20 outputs the audio of another space, displays the video of another space, and starts person detection by the output control unit 27 (step S112). The space sharing control device 20 causes the display control unit 271 to display the video captured in another space on the display unit 171. At this time, it is displayed on the display unit 171 without reducing the clarity of the video of another space. The space sharing control device 20 proceeds to step S113.
[0066] The space sharing control device 20 determines whether a person has been detected (step S113). More specifically, the space sharing control device 20 determines whether a person included in the video has been detected by the person detection unit 23. When the space sharing control device 20 determines from the detection result of the person detection unit 23 that a person has been detected (Yes in step S113), it proceeds to step S114. When the space sharing control device 20 determines that a person has not been detected (No in step S113), it proceeds to step S118.
[0067] When the space sharing control device 20 determines that there is a person using the space sharing device 10 (Yes in step S114), the space sharing control device 20 determines whether a video with reduced clarity is being displayed by the display control unit 271 (step S115). When the space sharing control device 20 determines that a video with reduced clarity is being displayed (Yes in step S115), it proceeds to step S116. When the space sharing control device 20 determines that a video with reduced clarity is not being displayed (No in step S115), it proceeds to step S120.
[0068] When it is determined that a video with reduced clarity is being displayed (Yes in step S115), the space sharing control device 20 causes the display control unit 271 to display a video in which the reduction in clarity of the video captured in another space is cancelled (step S116). The space sharing control device 20 proceeds to step S120. When the process of step S116 is executed, after the process of step S117, step S120 becomes No, and this is the case where step S113 to step S115 are Yes. Therefore, in step S116, the space sharing control device 20 cancels the reduction in clarity of the video in which the clarity was reduced for the range of the person in step S117.
[0069] When the space sharing control device 20 determines that there is no person using the space sharing device 10 (No in step S114), the space sharing control device 20 causes the display control unit 271 to display a video in which the clarity of the range of the person detected in step S113 is reduced for the video captured in another space (step S117). The space sharing control device 20 proceeds to step S120. Since the video for which the clarity is reduced in the process of step S117 is a moving image, the position of the person detected in step S113 is tracked, and the clarity is reduced according to the position of the person.
[0070] When it is determined that no person is detected (No in step S113), the space sharing control device 20 determines whether a video with reduced clarity is being displayed by the display control unit 271 (step S118). When the space sharing control device 20 determines that a video with reduced clarity is being displayed (Yes in step S118), it proceeds to step S119. When the space sharing control device 20 determines that a video with reduced clarity is not being displayed (No in step S118), it proceeds to step S120.
[0071] When it is determined that a video with reduced clarity is being displayed (Yes in step S118), the space sharing control device 20 causes the display control unit 271 to display a video in which the reduction in clarity of the video captured in another space is cancelled (step S119). The space sharing control device 20 proceeds to step S120.
[0072] In the above flowchart, when it is determined that there is a person using the space sharing device 10 (Yes in step S114), a video with reduced clarity may be displayed on the display unit 171 for the range of persons other than the person using the space sharing device 10.
[0073] (Effect) As described above, in the present embodiment, when there is no person using the space sharing device 10, in other words, when the space sharing device 10 is not being used, the clarity of the video can be reduced for the range of persons included in the video captured by another space sharing device 10 in another space. In the present embodiment, when a person using the space sharing device 10 is detected, in other words, when the space sharing device 10 is being used, a video with no reduction in clarity can be displayed. According to the present embodiment, during a period when the space sharing device 10 is not being used, if a person is detected in another space, the clarity can be reduced for the range of the person. According to the present embodiment, while maintaining the sense of presence due to space sharing, it is possible to suppress the concern about the line of sight of a person in another space.
[0074] [Third Embodiment] The space sharing control device 20 according to the third embodiment will be described with reference to FIGS. 11 to 13. FIG. 11 is a diagram showing an example of a display screen by the space sharing device according to the third embodiment. FIG. 12 is a diagram showing another example of the display screen by the space sharing device according to the third embodiment. FIG. 13 is a flowchart showing the space sharing method according to the third embodiment. In the present embodiment, the processing of the person detection unit 23 and the display control unit 271 is different from that of the second embodiment.
[0075] The person detection unit 23 detects the face of a person included in the video acquired by the information acquisition unit 21, and detects a person facing the imaging device 11.
[0076] The person detection unit 23 may detect, for example, at least the eyes included in the face of a person from the detection result of the person detection unit 23, and detect a person with both eyes detected as a person facing the face.
[0077] When the person detection unit 23 detects a person facing the imaging device 11, the display control unit 271 reduces the clarity of the video with respect to the range of the person facing the face. More specifically, when there is no person using the space sharing device 10, the display control unit 271 reduces the clarity of the video with respect to the range of the person facing the imaging device 11 detected by the person detection unit 23. When there is a person using the space sharing device 10, the display control unit 271 may reduce the clarity of the video with respect to the range of the person facing the imaging device 11 among the persons other than those using the space sharing device 10.
[0078] FIG. 11 is an example of a video in which the overall clarity of the video is not reduced. In the example shown in FIG. 11, among the detected persons u1, u2, and u3, the person u1 is determined to be a person using the space sharing device 10 by the display control unit 271. For this reason, even if the person u2 facing the imaging device 11 is detected, the clarity of the video is not reduced.
[0079] In the example shown in FIG. 12, the display control unit 271 causes the display unit 171 to display a video in which the clarity is reduced only for the range corresponding to the person u2 facing the imaging device 11 among the detected persons u2 and u3. In the example shown in FIG. 12, although the clarity is reduced with respect to the range of the person facing the imaging device 11, the clarity may be reduced with respect to the range of the face of the person facing the imaging device 11.
[0080] Next, the space sharing method will be described with reference to FIG. 13. The processes of steps S121 to S123, steps S125 to S127, and steps S129 to S131 in the flowchart shown in FIG. 13 are the same as the processes of steps S111 to S113, steps S114 to S116, and steps S118 to S120 in the flowchart shown in FIG. 10.
[0081] The space sharing control device 20 determines whether a person facing the camera has been detected (step S124). More specifically, the space sharing control device 20 uses the person detection unit 23 to detect a person facing the imaging device 11 from the video. When the space sharing control device 20 determines from the detection result of the person detection unit 23 that a person facing the camera has been detected (Yes in step S124), it proceeds to step S125. When the space sharing control device 20 determines that a person facing the camera has not been detected (No in step S124), it proceeds to step S129.
[0082] When it is determined that there is no person using the space sharing device 10 (No in step S125), the space sharing control device 20 uses the display control unit 271 to display a video with reduced clarity of the range of the person facing the camera for the video captured in another space (step S128). The space sharing control device 20 proceeds to step S131.
[0083] (Effect) As described above, in this embodiment, when there is no person using the space sharing device 10, in other words, when the space sharing device 10 is not being used, the clarity of the video can be reduced for the range of the person facing the imaging device 11 among the people included in the video captured by another space sharing device 10 in another space. According to this embodiment, during the period when the space sharing device 10 is not being used, if a person facing the imaging device 11 is detected in another space, the clarity of the range of that person can be reduced. According to this embodiment, while maintaining the sense of presence due to space sharing, it is possible to suppress the concern about the line of sight of people in other spaces.
[0084] [Fourth Embodiment] With reference to FIG. 14, the space sharing control device 20 according to the fourth embodiment will be described. FIG. 14 is a flowchart showing the space sharing method according to the fourth embodiment. In the present embodiment, the space sharing device 10 outputs with reduced clarity of the sound in other spaces when there is no person using the space sharing device 10, that is, no person is in a call or trying to make a call. The space sharing device 10 outputs without reducing the clarity of the sound in other spaces when there is a person using the space sharing device 10, that is, a person is in a call or trying to make a call. In the present embodiment, the processing of the display control unit 271 and the voice output control unit 272 is different from that in the first embodiment.
[0085] The display control unit 271 may reduce the clarity of the video as in the first embodiment, or may not reduce the clarity of the video.
[0086] The voice output control unit 272 reduces the clarity of the voice and outputs it to the voice output unit 172. When the person detection unit 23 does not detect a person using the space sharing device 10, the voice output control unit 272 reduces the clarity of the voice and outputs it to the voice output unit 172. When there is no person in a call or trying to make a call using the space sharing device 10, the voice output control unit 272 reduces the clarity of the voice and outputs it to the voice output unit 172.
[0087] When the person detection unit 23 detects a person using the space sharing device 10, the voice output control unit 272 cancels the reduction in the clarity of the voice and starts output. When there is a person in a call or trying to make a call using the space sharing device 10, the voice output control unit 272 cancels the reduction in the clarity of the voice and outputs clear voice to the voice output unit 172.
[0088] In the present embodiment, the voice output control unit 272 reduces the clarity of the voice to such an extent that the content of the conversation is difficult to recognize from the voice.
[0089] The voice output control unit 272 outputs to the voice output unit 172 with reduced clarity, for example, by lowering the volume of the voice. The voice output control unit 272 may output to the voice output unit 172 with reduced clarity, for example, by lowering the volume of the voice and superimposing white noise. The voice output control unit 272 may output to the voice output unit 172 with reduced clarity, for example, by separating the component of the human voice and the component of noise from the voice and only lowering the volume of the component of the human voice or performing a cancellation process on the human voice.
[0090] Next, the space sharing method will be described with reference to FIG. 14. The processes of steps S201, S203, and S206 in the flowchart shown in FIG. 14 perform the same processes as steps S101, S103, and S106 in the flowchart shown in FIG. 8.
[0091] The space sharing control device 20 starts displaying the video of another space, outputting the voice with reduced clarity, and starting person detection by the output control unit 27 (step S202). More specifically, the space sharing control device 20 causes the display control unit 271 to display the video captured in another space on the display unit 171. The space sharing control device 20 causes the voice output control unit 272 to output the voice collected in another space with reduced clarity. The space sharing control device 20 starts detecting, as a person using the space sharing device 10, a person facing the imaging device 11 near the imaging device 11 or a person facing the display unit 171 near the display unit 171 from at least one of the video of the same space acquired by the information acquisition unit 21 and the video of another space acquired by the communication control unit 29 by the person detection unit 23. The space sharing control device 20 proceeds to step S203.
[0092] When it is determined that there is a person using the space sharing device 10 (Yes in step S203), the space sharing control device 20 outputs, by the voice output control unit 272, a voice whose clarity is not reduced from the voice picked up in another space (step S204). The output of a voice whose clarity is not reduced means outputting without performing a process of reducing the clarity of the voice acquired in another space. The space sharing control device 20 proceeds to step S206.
[0093] When it is determined that there is no person using the space sharing device 10 (No in step S203), the space sharing control device 20 outputs, by the voice output control unit 272, a voice whose clarity is reduced from the voice picked up in another space (step S205). The output of a voice whose clarity is reduced means performing a process of reducing the clarity of the voice acquired in another space and then outputting it. The space sharing control device 20 proceeds to step S206.
[0094] (Effect) As described above, in the present embodiment, the clarity of the voice picked up in another space is reduced and output to the voice output unit 172. In the present embodiment, when a person using the space sharing device 10, such as a person facing the imaging device 11 near the imaging device 11 or a person facing the display unit 171 near the display unit 171, is detected, the reduction in the clarity of the voice picked up in another space is cancelled and output to the voice output unit 172. According to the present embodiment, when a call is not being made by the space sharing device 10, it is possible to suppress a situation where the voice in another space becomes bothersome while maintaining the sense of presence due to space sharing. In this way, according to the present embodiment, when sharing a space by the space sharing device 10, it is possible to suppress inhibiting the concentration of a person around the space sharing device 10.
[0095] [Fifth Embodiment] Using FIGS. 15 and 16, the space sharing control device 20X according to the fifth embodiment will be described. FIG. 15 is a block diagram showing a configuration example of the space sharing device according to the fifth embodiment. FIG. 16 is a flowchart showing the space sharing method according to the fifth embodiment. In this embodiment, the difference from the fourth embodiment lies in that the speech detection unit 24X is provided and the processing of the voice output control unit 272X.
[0096] The speech detection unit 24X detects the speech included in the voice of another space acquired by the communication control unit 29. The speech detection unit 24X detects a human voice, that is, speech, from the voice. The speech detection unit 24X may detect the speech corresponding to the speech from the voice using an acoustic model or the like, or may detect the speech corresponding to the speech using sound source separation using AI (Artificial Intelligence).
[0097] The voice output control unit 272X reduces the clarity of the voice for the duration of the speech included in the voice acquired by the information acquisition unit 21. In this embodiment, when the person detection unit 23 does not detect a person, the voice output control unit 272X reduces the clarity of the voice for the duration of the speech and outputs it to the voice output unit 172. In this embodiment, when the person detected by the person detection unit 23 is not the person using the space sharing device 10X, the voice output control unit 272X reduces the clarity of the voice for the duration of the speech and outputs it to the voice output unit 172. When there is no person on the call or trying to make a call using the space sharing device 10X, the voice output control unit 272X reduces the clarity of the voice for the duration of the speech and outputs it to the voice output unit 172.
[0098] Next, the space sharing method will be described using FIG. 16. The processes of steps S211, S212, S214, S220, and S221 in the flowchart shown in FIG. 16 perform the same processes as steps S201, S202, S203, S205, and S206 in the flowchart shown in FIG. 14. The process of step S213 in the flowchart shown in FIG. 16 performs the same process as step S123 in the flowchart shown in FIG. 13.
[0099] When it is determined that there is a person using the space sharing device 10X (Yes in step S214), the space sharing control device 20X determines, by the voice output control unit 272X, whether a voice with reduced clarity is being output (step S215). When the space sharing control device 20X determines, by the voice output control unit 272X, that a voice with reduced clarity is being output (Yes in step S215), it proceeds to step S216. When the space sharing control device 20X does not determine, by the voice output control unit 272X, that a voice with reduced clarity is being output (No in step S215), it proceeds to step S221.
[0100] When it is determined that a voice with reduced clarity is being output (Yes in step S215), the space sharing control device 20X outputs, by the voice output control unit 272X, a voice with the reduction in clarity of the voice picked up in another space cancelled (step S216). The space sharing control device 20X proceeds to step S221.
[0101] When it is determined that a person has been detected (Yes in step S213) and when it is not determined that there is a person using the space sharing device 10X (No in step S214), the space sharing control device 20X determines, by the speech detection unit 24X, whether speech is being detected (step S217). When the space sharing control device 20X determines, by the speech detection unit 24X, that speech is being detected (Yes in step S217), it proceeds to step S220. When the space sharing control device 20X does not determine, by the speech detection unit 24X, that speech is being detected (No in step S217), it proceeds to step S218.
[0102] When the speech detection unit 24X determines that speech is not detected (No in step S217), the voice output control unit 272X determines whether the voice with reduced clarity is being output (step S218). If the space sharing control device 20X determines that the voice with reduced clarity is being output by the voice output control unit 272X (Yes in step S218), it proceeds to step S219. If the space sharing control device 20X determines that the voice with reduced clarity is not being output by the voice output control unit 272X (No in step S218), it proceeds to step S220.
[0103] When it is determined that the voice with reduced clarity is being output (Yes in step S218), the space sharing control device 20X causes the voice output control unit 272X to output the voice with the reduced clarity of the voice picked up in another space cancelled (step S219). The space sharing control device 20X proceeds to step S221.
[0104] When speech is detected (Yes in step S217) but it is determined that no person is detected (No in step S213), it means that no person is detected within the range imaged by the camera 111, but speech of a person existing outside the imaging range of the camera 111 is detected.
[0105] When speech is detected (Yes in step S217) but it is determined that no person using the space sharing device 10X exists (No in step S214), it means that speech of a person detected within the range imaged by the camera 111 or a person existing outside the imaging range of the camera 111 is detected.
[0106] (Effect) As described above, in this embodiment, when no call is being made using the space sharing device 10X, the clarity of the voice can be reduced for the duration of the speech included in the voice. According to this embodiment, it is possible to suppress the concern about the voice in other spaces while maintaining the sense of presence due to space sharing.
[0107] [Sixth Embodiment] With reference to FIGS. 17 and 18, the space sharing control device 20Y according to the sixth embodiment will be described. FIG. 17 is a block diagram showing a configuration example of the space sharing device according to the sixth embodiment. FIG. 18 is a flowchart showing the space sharing method according to the sixth embodiment. In the present embodiment, the point of including the volume detection unit 25Y and the processing of the voice output control unit 272Y are different from those in the fourth and fifth embodiments.
[0108] The volume detection unit 25Y detects the volume of the voice in other spaces acquired by the communication control unit 29. The volume detection unit 25Y detects the volume based on, for example, the input level of the microphone 112 installed in other spaces in the voice picked up in other spaces.
[0109] The voice output control unit 272Y reduces the clarity of the voice by suppressing the volume of the voice above a predetermined volume included in the voice in other spaces acquired by the communication control unit 29. In the present embodiment, when the person detection unit 23 does not detect a person, the voice output control unit 272Y suppresses the volume of the voice above the predetermined volume, thereby reducing the clarity of the voice and outputting it to the voice output unit 172. In the present embodiment, when the person detected by the person detection unit 23 is not the person using the space sharing device 10Y, the voice output control unit 272Y suppresses the volume of the voice above the predetermined volume, thereby reducing the clarity of the voice and outputting it to the voice output unit 172. When there is no person on a call or trying to make a call using the space sharing device 10Y, the voice output control unit 272Y suppresses the volume of the voice above the predetermined volume, thereby reducing the clarity of the voice and outputting it to the voice output unit 172. The predetermined volume is, for example, a volume of voice above a predetermined volume such as 40 to 50 dB of the input level of the microphone 112 installed in other spaces. The voice above the predetermined volume can be suppressed, for example, by performing compressor processing or the like.
[0110] Next, a space sharing method will be described with reference to FIG. 18. The processes of steps S231 to S236 and steps S238 to S241 in the flowchart shown in FIG. 18 are the same as the processes of steps S211 to S216 and steps S218 to S221 in the flowchart shown in FIG. 16.
[0111] The space sharing control device 20Y determines whether the voice volume in another space is equal to or greater than a predetermined volume by the volume detection unit 25Y (step S237). When the space sharing control device 20Y determines that the voice volume in another space is equal to or greater than a predetermined volume by the volume detection unit 25Y (Yes in step S237), it proceeds to step S240. When the space sharing control device 20Y determines that the voice volume equal to or greater than the predetermined volume is not detected by the volume detection unit 25Y (No in step S237), it proceeds to step S238.
[0112] (Effect) As described above, in this embodiment, when a call is not being made by the space sharing device 10Y, the clarity of the voice can be reduced by suppressing the volume of the voice equal to or greater than the predetermined volume. According to this embodiment, it is possible to suppress the situation where the voice in another space is distracting while maintaining the sense of presence due to space sharing.
[0113] [Seventh Embodiment] The space sharing control device 20Y according to the seventh embodiment will be described with reference to FIG. 19. FIG. 19 is a flowchart showing the space sharing method according to the seventh embodiment. In this embodiment, the processes of the person detection unit 23 and the display control unit 271 of the space sharing device 10 are different from those in the second embodiment.
[0114] The person detection unit 23 detects a person whose position is moving among the persons included in the video captured by another space sharing device 10 in another space, which the communication control unit 29 has acquired. The detection of a person whose position is moving is performed based on the change in the position for each imaging frame of the person detected from the video captured by another space sharing device 10 in another space. Specifically, when a person is moving at a moving speed equal to or higher than the walking speed of the person in another space, the person may be detected as a person whose position is moving. Therefore, the person detection unit 23 may detect a person who is moving at a speed equal to or higher than the walking speed among the persons included in the video captured by another space sharing device 10 in another space, which the communication control unit 29 has acquired.
[0115] When the display control unit 271 does not detect a person using the space sharing device 10, such as a person facing the imaging device 11 in the vicinity of the imaging device 11 or a person facing the display unit 171 in the vicinity of the display unit 171, the display control unit 271 causes the display unit 171 to display the video captured by another space sharing device 10 in another space with the brightness reduced for the range of the persons moving among the persons included in the video.
[0116] Next, a space sharing method will be described with reference to FIG. 19. The processes of steps S141 to S143, steps S145 to S147, and steps S149 to S151 in the flowchart shown in FIG. 19 perform the same processes as steps S111 to S113, steps S114 to S116, and steps S118 to S120 in the flowchart shown in FIG. 10.
[0117] The space sharing control device 20 determines whether a person whose position is moving has been detected (step S144). More specifically, the space sharing control device 20 detects, from the video, a person whose position is moving by the person detection unit 23. When the space sharing control device 20 determines from the detection result of the person detection unit 23 that a person whose position is moving has been detected (Yes in step S144), it proceeds to step S145. When the space sharing control device 20 determines that a person whose position is moving has not been detected (No in step S144), it proceeds to step S149.
[0118] When it is determined that there is no person using the space sharing device 10 (No in step S145), the space sharing control device 20 causes the display control unit 271 to display a video with reduced clarity of the range of the person whose position is moving for the video captured in another space (step S148). The space sharing control device 20 proceeds to step S151.
[0119] (Effect) As described above, in the present embodiment, when there is no person using the space sharing device 10, in other words, when the space sharing device 10 is not being used, it is possible to reduce the clarity of the video for the range of the person whose position is moving included in the video captured by another space sharing device 10 in another space. According to the present embodiment, during the period when the space sharing device 10 is not being used, if a person is detected in another space, it is possible to reduce the clarity for the range of the person whose position is moving. According to the present embodiment, while maintaining the sense of presence due to space sharing, it is possible to suppress the movement and line of sight of a person who is walking in another space, in other words, a person whose line of sight is likely to be directed towards the space sharing device 10 due to movement, which may cause concern.
[0120] [Eighth Embodiment] The space sharing control device 20Y according to the eighth embodiment will be described with reference to FIG. 20. FIG. 20 is a flowchart showing the space sharing method according to the eighth embodiment. In the present embodiment, the processing of the person detection unit 23 and the display control unit 271 of the space sharing device 10 is different from that of the second embodiment.
[0121] The person detection unit 23 detects standing persons among the persons included in the video captured by another space sharing device 10 in another space, which the communication control unit 29 has acquired. The detection of standing persons is performed based on the form of the persons detected from the video captured by another space sharing device 10 in another space, the aspect ratio of the detection range, and the like. The person detection unit 23 may detect sitting persons among the persons included in the video captured by another space sharing device 10 in another space, which the communication control unit 29 has acquired, and detect those other than the sitting persons as standing persons. In addition, the standing persons include not only the persons who are standing and not moving but also the persons who are standing and moving.
[0122] When the display control unit 271 does not detect a person using the space sharing device 10, such as a person facing the imaging device 11 in the vicinity of the imaging device 11 or a person facing the display unit 171 in the vicinity of the display unit 171, the display control unit 271 causes the display unit 171 to display the video captured by another space sharing device 10 in another space with the brightness reduced within the range of the standing persons among the persons included in the video.
[0123] Next, a space sharing method will be described with reference to FIG. 20. The processes of steps S161 to S163, steps S165 to S167, and steps S169 to S171 in the flowchart shown in FIG. 20 perform the same processes as steps S111 to S113, steps S114 to S116, and steps S118 to S120 in the flowchart shown in FIG. 10.
[0124] The space sharing control device 20 determines whether a standing person has been detected (step S164). More specifically, the space sharing control device 20 detects a standing person from the video by the person detection unit 23. When the space sharing control device 20 determines from the detection result of the person detection unit 23 that a standing person has been detected (Yes in step S164), it proceeds to step S165. When the space sharing control device 20 determines that a standing person has not been detected (No in step S164), it proceeds to step S169.
[0125] When it is determined that there is no person using the space sharing device 10 (No in step S165), the space sharing control device 20 causes the display control unit 271 to display a video with reduced clarity of the range of the standing person in the video captured in another space (step S168). The space sharing control device 20 proceeds to step S171.
[0126] (Effect) As described above, in the present embodiment, when there is no person using the space sharing device 10, in other words, when the space sharing device 10 is not being used, it is possible to reduce the clarity of the video for the range of the standing person included in the video captured by another space sharing device 10 in another space. According to the present embodiment, during the period when the space sharing device 10 is not being used, if a person is detected in another space, it is possible to lower the clarity for the range of the standing person. According to the present embodiment, while maintaining the sense of presence due to space sharing, it is possible to suppress the movement and line of sight of a person standing in another space, in other words, a person whose line of sight is likely to be directed towards the space sharing device 10 because they are standing, which may be concerning.
[0127] [Ninth Embodiment] The space sharing control device 20Y according to the ninth embodiment will be described with reference to FIG. 21. FIG. 21 is a flowchart showing the space sharing method according to the ninth embodiment. In the present embodiment, the processing of the display control unit 271 of the space sharing device 10 is different from that in the second embodiment.
[0128] The person detection unit 23 counts the number of persons included in the video captured by another space sharing device 10 in another space, which is acquired by the communication control unit 29. The persons to be counted include sitting persons, standing persons, moving persons, and the like. The persons to be counted may be persons existing within a range less than a predetermined distance from the other space sharing device 10 in another space. The persons existing within a range less than a predetermined distance from the other space sharing device 10 are determined by, for example, the overall body size or the head size of the persons detected from the video captured by the other space sharing device 10 in another space in the video. Specifically, persons existing within a range from 10 m to less than 20 m from the other space sharing device 10 may be counted.
[0129] When the display control unit 271 does not detect a person using the space sharing device 10, such as a person facing the imaging device 11 in the vicinity of the imaging device 11 or a person facing the display unit 171 in the vicinity of the display unit 171, if the number of persons included in the video captured by another space sharing device 10 in another space is equal to or more than a predetermined number, the display control unit 271 reduces the clarity of the range of the persons included in the video and causes the display unit 171 to display it. Specifically, when the number of persons included in the video captured by another space sharing device 10 in another space is less than 5, the clarity of the range of the persons included in the video is not reduced, and when the number is 5 or more, the clarity of the range of the persons included in the video is reduced and the display unit 171 is caused to display it.
[0130] Next, a space sharing method will be described with reference to FIG. 21. The processes of steps S181 to S183, steps S185 to S187, and steps S189 to S191 in the flowchart shown in FIG. 21 perform the same processes as steps S111 to S113, steps S114 to S116, and steps S118 to S120 in the flowchart shown in FIG. 10.
[0131] The space sharing control device 20 determines whether or not a predetermined number or more of people have been detected (step S184). More specifically, the space sharing control device 20 uses the person detection unit 23 to detect all people from the video or people existing within a range less than a predetermined distance. When the space sharing control device 20 determines from the detection result of the person detection unit 23 that a predetermined number or more of people have been detected (Yes in step S184), it proceeds to step S185. When the space sharing control device 20 determines that a predetermined number or more of people have not been detected (No in step S184), it proceeds to step S189.
[0132] The predetermined number is, for example, 4 to 5 people. This is because when multiple people are displayed on the display screen of the display device 17, there is a possibility that the line of sight will be concerning.
[0133] When it is determined that there is no person using the space sharing device 10 (No in step S185), the space sharing control device 20 uses the display control unit 271 to display a video with the clarity reduced for the range of the predetermined number or more of people detected in the video captured in another space (step S188). The space sharing control device 20 proceeds to step S191.
[0134] (Effect) As described above, in the present embodiment, when there is no person using the space sharing device 10, in other words, when the space sharing device 10 is not being used, it is possible to reduce the clarity of the video for the range of a predetermined number or more of people included in the video captured by another space sharing device 10 in another space. According to the present embodiment, during the period when the space sharing device 10 is not being used, if people are detected in another space, it is possible to lower the clarity for the range of a predetermined number or more of people. According to the present embodiment, it is possible to suppress displays that would cause concern about the line of sight of people in other spaces while maintaining the sense of presence due to space sharing.
[0135] Each component of the illustrated vehicle recording device is conceptually functional and does not necessarily have to be physically configured as shown. That is, the specific form of each device is not limited to that shown, and all or part of it may be functionally or physically distributed or integrated in any unit according to the processing load of each device, usage conditions, etc.
[0136] The configuration of the vehicle recording device is realized, for example, as software by a program loaded into a memory or the like. In the above embodiment, it has been described as a functional block realized by the cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.
[0137] The above-described components include those that can be easily assumed by those skilled in the art and substantially identical ones. Furthermore, the above-described configurations can be combined as appropriate. Also, various omissions, substitutions, or changes in the configuration are possible without departing from the gist of the present invention.
Explanation of Reference Numerals
[0138] 10 Space sharing device 10A First space sharing device 10B Second space sharing device 11 Imaging device 11A First imaging device 11B Second imaging device 111 Camera 112 Microphone 13 Operation unit 17 Display device 17A First display device 17B Second display device 171 Display section 172 Audio output section 19 Communication section 20 Space sharing control device 21 Information acquisition section 211 Video acquisition section 212 Audio acquisition section 22 Operation reception section 23 Person Detection Unit 27 Output Control Unit 271 Display Control Unit 272 Audio Output Control Unit 29 Communication Control Unit A First Space B Second Space
Claims
1. A space sharing device, an information acquisition unit that acquires an image captured by an imaging device disposed in another space; an output control unit that causes a display unit to display the video acquired by the information acquisition unit in real time; A person detection unit that detects a person using the space sharing device; Equipped with The output control unit is reducing the clarity of the image and outputting it to the display unit; When the person detection unit detects a person using the space sharing device, the person detection unit cancels the reduction in clarity of the image and starts outputting the image to the display unit. Space sharing device.
2. The output control unit reduces the clarity of the image to such an extent that the presence of a person present within the range photographed by the imaging device can be discerned and the direction of the person's line of sight is difficult to recognize. The spatial sharing device according to claim 1 .
3. The person detection unit detects a person included in the video acquired by the information acquisition unit, The output control unit reduces clarity of the image for a range of the person detected by the person detection unit. The spatial sharing device according to claim 1 .
4. The person detection unit detects a person whose face is facing the imaging device and is included in the video acquired by the information acquisition unit, The output control unit reduces clarity of the image for a range of the person whose face is facing the imaging device, the range being detected by the person detection unit. The spatial sharing device according to claim 1 .
5. The person detection unit detects a person whose position is moving and is included in the video acquired by the information acquisition unit, The output control unit reduces clarity of the image in a range of a person whose position is moving and which is detected by the person detection unit. The spatial sharing device according to claim 1 .
6. The person detection unit detects a standing person included in the video acquired by the information acquisition unit, The output control unit reduces clarity of the image in a range of a standing person detected by the person detection unit. The spatial sharing device according to claim 1 .
7. The person detection unit counts the number of people included in the video acquired by the information acquisition unit, The output control unit reduces clarity of the image when the number of people counted by the person detection unit is equal to or greater than a predetermined number. The spatial sharing device according to claim 1 .
8. A space sharing method executed by a space sharing device, acquiring an image captured by an imaging device disposed in another space; displaying the acquired image on a display unit in real time with reduced image clarity; Detecting a person using the space sharing device; When a person using the space sharing device is detected, canceling the reduction in clarity of the image and starting output to the display unit; A space sharing method including:
Citation Information
Patent Citations
Multimedia communication system
JP2004056161A