Video provision system, video provision method, and video provision program

Abstract

To provide a video image provision system, a video image provision method, and a video image provision program, capable of providing an opportunity of a comfortable communication.SOLUTION: A video image provision system 1 comprises: an acquisition part 43; and a video image information creation part 45. The acquisition part 43 acquires imaging information of a first subject and imaging information of a second subject that are different from each other. The video image information creation part 45 creates first video image information and second video image information. The first video image information displays the first subject on the basis of the imaging information of the first subject. The second video image information displays the first and second subjects on the basis of the imaging information of the first subject and the imaging information of the second subject. An information amount of the first subject in the second video image information is smaller than the information amount of the first subject in the first video image information.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a video providing system, a video providing method, and a video providing program.

Background Art

[0002] Remote communication systems that allow multiple users to communicate remotely are known (for example, Patent Document 1, Patent Document 2, and Non-Patent Document 1). For example, a remote communication system includes a video providing system that provides video information of a plurality of users. As the video providing system, for example, a video providing system that acquires imaging information of a plurality of subjects and creates video information of each subject is conceivable.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Non-Patent Documents

[0004]

Non-Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0005] Remote communication systems are frequently used in situations where face-to-face communication is difficult, and are employed for both work and personal purposes. However, existing remote communication systems have elements that are inferior to face-to-face communication. For example, existing remote communication systems can lead to increased cognitive and communication effort due to the lack of body language, increased anxiety and cognitive effort due to mismatched eye contact, increased stress due to unnatural positional relationships between users, and increased stress due to self-assessment of the user's appearance as seen by others. As a result, there is a risk of a decline in the quality of communication and psychological overload such as fatigue or anxiety for users. By solving the above-mentioned problems in remote communication systems, it is possible to provide people with opportunities for comfortable communication even in situations where face-to-face communication is limited.

[0006] One aspect of the present invention aims to provide a video provision system, a video provision method, and a video provision program that can provide opportunities for comfortable communication. [Means for solving the problem]

[0007] An image provision system in one aspect of the present invention comprises an acquisition unit and an image information creation unit. The acquisition unit acquires imaging information of a first subject and a second subject, which are different from each other. The image information creation unit creates first image information based on the imaging information of the second subject. The first image information is information for displaying the image of the second subject. The image information creation unit creates second image information based on the imaging information of the first subject and the second subject. The second image information is information for displaying the images of the first subject and the second subject. The amount of information about the second subject in the second image information is less than the amount of information about the second subject in the first image information.

[0008] In another form of the present disclosure, the video provisioning system comprises an imaging unit for imaging a first subject, an acquisition unit, a first display unit, and a second display unit. The acquisition unit acquires first video information and second video information. The first video information includes imaging information of a second subject that is different from the first subject. The second video information includes imaging information of the first subject and imaging information of the second subject. The first display unit displays video based on the first video information. The second display unit is located away from the first display unit and displays video based on the second video information. The amount of information of the second subject displayed by the second display unit is less than the amount of information of the second subject displayed by the first display unit.

[0009] A video presentation method in yet another aspect of the present invention comprises acquiring imaging information of a first subject and a second subject that are different from each other, and creating first video information and second video information. The first video information is information for displaying the second subject based on the imaging information of the second subject. The second video information is information for displaying the first subject and the second subject based on the imaging information of the first subject and the second subject. The amount of information of the second subject in the second video information is less than the amount of information of the second subject in the first video information.

[0010] An image provisioning program in yet another aspect of the present invention causes a computer to perform the following actions: acquire imaging information of a first subject and a second subject that are different from each other, and create first image information and second image information. The first image information displays the second subject based on the imaging information of the second subject. The second image information displays the first subject and the second subject based on the imaging information of the first subject and the second subject. The amount of information of the second subject in the second image information is less than the amount of information of the second subject in the first image information. [Effects of the Invention]

[0011] One aspect of the present invention provides a video delivery system, a video delivery method, and a video delivery program that can provide opportunities for comfortable communication. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram of the video providing system in the present embodiment. [Figure 2] A part of the user system is shown. [Figure 3] A part of the user system is shown. [Figure 4] An example of the video displayed on the display unit is shown. [Figure 5] A modified example of the video displayed on the display unit is shown. [Figure 6] This is a diagram showing an example of a hardware configuration. [Figure 7] This is a graph showing questionnaire results. [Figure 8] This is a graph showing factor scores of the evaluation environment. [Figure 9] This is a graph showing questionnaire results. [Figure 10] This is a graph showing questionnaire results. [Mode for Carrying Out the Invention]

[0013] [Description of Embodiments of the Present Disclosure]

[0014] First, the embodiments of the present disclosure will be listed and described.

[0015] [1] The video providing system according to the embodiment of the present disclosure includes an acquisition unit and a video information generation unit. The acquisition unit acquires imaging information of a first subject and a second subject that are different from each other. The video information generation unit generates first video information based on the imaging information of the second subject. The first video information is information for displaying a video of the second subject. The video information generation unit generates second video information based on the imaging information of the first subject and the second subject. The second video information is information for displaying a video of the first subject and a video of the second subject. The information amount of the second subject in the second video information is smaller than the information amount of the second subject in the first video information.

[0016] In the video providing system according to the above [1], the video information generation unit generates first video information based on the imaging information of a second subject. The first video information is information for displaying a video of the second subject. The video information generation unit generates second video information based on the imaging information of a first subject and the second subject. The second video information is information for displaying a video of the first subject and a video of the second subject. The information amount of the second subject in the second video information is smaller than the information amount of the second subject in the first video information. In this case, the first video information and the second video information provide the user with a sense of sharing a space between the user of the first subject and the user of the second subject while reducing stress. In remote communication using the video providing system, comfortable communication can be provided to people.

[0017] [2] In the video providing system according to the above [1], the second video information may be configured to display the video of the first subject and the video of the second subject on a single background video. In this case, the user can more easily obtain the sense of sharing a space.

[0018] [3] The video providing system according to the above [1] or [2] may further include a transmission unit. The transmission unit may transmit the video information generated by the video information generation unit. The video information generation unit may further generate third video information for displaying the first subject based on the imaging information of the first subject. The transmission unit may transmit the first video information and the second video information to a first terminal, and transmit the third video information and the second video information to a second terminal. In this case, both the user using the first terminal and the user using the second terminal can obtain a sense of sharing a space while stress is reduced.

[0019] [4] Any one of the video provision systems described in [1] to [3] above may further include a first display unit and a second display unit. The first display unit may display a video based on first video information on a first display surface. The second display unit may display a video based on second video information on a second display surface. The first and second display surfaces may extend in directions that intersect each other. In this case, a sense of shared space can be obtained while stress can be further reduced.

[0020] [5] The video provisioning system described in [4] above may further include first and second imaging units that capture images of the first subject from different directions. The second imaging unit may be arranged such that its imaging direction is opposite to the normal direction of the second display surface. The video information creation unit may create first video information based on the imaging information of the first imaging unit. The video information creation unit may create second video information based on the imaging information of the first imaging unit and the imaging information of the second imaging unit. In this case, a sense of sharing space can be obtained while stress can be further reduced.

[0021] [6] In another form of the present disclosure, the video provisioning system comprises an imaging unit for imaging a first subject, an acquisition unit, a first display unit, and a second display unit. The acquisition unit acquires first video information and second video information. The first video information includes imaging information of a second subject that is different from the first subject. The second video information includes imaging information of the first subject and imaging information of the second subject. The first display unit displays video based on the first video information. The second display unit is located away from the first display unit and displays video based on the second video information. The amount of information of the second subject displayed by the second display unit is less than the amount of information of the second subject displayed by the first display unit.

[0022] [7] A further form of the present disclosure of a method for providing video comprises acquiring imaging information of a first subject and a second subject that are different from each other, and creating first video information and second video information. The first video information is information for displaying the second subject based on imaging information of the second subject. The second video information is information for displaying the first subject and the second subject based on imaging information of the first subject and the second subject. The amount of information of the second subject in the second video information is less than the amount of information of the second subject in the first video information.

[0023] [8] A video providing program in yet another form of the present disclosure causes a computer to acquire imaging information of a first subject and a second subject that are different from each other, and to create first video information and second video information. The first video information displays the second subject based on the imaging information of the second subject. The second video information displays the first subject and the second subject based on the imaging information of the first subject and the second subject. The amount of information of the second subject in the second video information is less than the amount of information of the second subject in the first video information. [Details of the embodiments of this disclosure]

[0024] Hereinafter, embodiments of the video provision system according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same or corresponding parts are denoted by the same reference numerals, and redundant descriptions are omitted.

[0025] First, the schematic configuration of the video provision system in the embodiment of this disclosure will be described with reference to Figures 1 to 5. Figure 1 is a block diagram of the video provision system 1 in this embodiment.

[0026] The video provision system 1 provides video for communication between multiple users. The video provision system 1 provides each of the multiple users with their video, for example, via the internet or an intranet. In addition to the user's video, the video provision system 1 may also provide each user with, for example, audio. The video provision system 1 corresponds to, for example, a web conferencing system. Figures 2 and 3 show a part of the video provision system 1 in this embodiment.

[0027] In this embodiment, the video provision system 1 provides video to multiple users U1 and U2. Users U1 and U2 are, for example, different users and people. The video provision system 1 comprises multiple user systems 3 and a server 5. User U1 corresponds to the first subject captured by the user system 3. User U2 corresponds to the second subject captured by the user system 3.

[0028] In this embodiment, the user systems 3 include user systems 7 and user systems 9. User system 7 is a user system for user U1. User system 7 is located, for example, in the same space S as user U1. User system 7 captures images of user U1 and provides the images to user U1. User system 9 is a user system for user U2. User system 9 is located, for example, in the same space S as user U2. User system 9 captures images of user U2 and provides the images to user U2.

[0029] For example, user systems 7 and 9 each include multiple imaging units 11 and 12, multiple display units 13 and 14, multiple shielding units 15 and 16, multiple drive units 17 and 18, and an information processing unit 19. User systems 7 and 9 have similar configurations. The following explanation will use user system 7 as an example.

[0030] The imaging unit 11 includes a camera 21. For example, the imaging unit 11 of the user system 7 uses the camera 21 to image user U1 as the subject. The imaging unit 12 includes a camera 22. For example, the imaging unit 12 of the user system 7 uses the camera 22 to image user U1 as the subject. For example, the imaging units 11 and 12 of the user system 7 use cameras 21 and 22 to image user U1 from different directions. The imaging direction α1 of the imaging unit 11 and the imaging direction α2 of the imaging unit 12 intersect each other. The imaging unit 11 corresponds to the first imaging unit, and the imaging unit 12 corresponds to the second imaging unit.

[0031] Display unit 13 displays video V1. Display unit 13 includes a display surface 13a for displaying video V1. Display unit 14 displays video V2, which is different from video V1. For example, display unit 14 is separated from display unit 13. Display unit 14 includes display surfaces 14a and 14b for displaying video V2. Display surfaces 14a and 14b are aligned horizontally and each displays a part of video V2. For example, display surfaces 14a and 14b are in contact with each other horizontally. For example, display surfaces 14a and 14b are formed flush with each other. Display surfaces 14a and 14b display a single video V2.

[0032] For example, the image V1 displayed in user system 3 is an image based on imaging information from the imaging unit 11 of user system 3 and another user system 3. The image V2 displayed in user system 3 is an image based on imaging information from the imaging unit 12 of user system 3 and imaging information from the imaging unit 12 of user system 3 and another user system 3. For example, the image V2 is an image based on imaging information from different users.

[0033] For example, video V1 displayed on user system 7 is video based on imaging information from the imaging unit 11 of user system 9. Video V2 displayed on user system 7 is video based on imaging information from the imaging unit 12 of user system 7 and imaging information from the imaging unit 12 of user system 3 other than user system 7. For example, user system 3 other than user system 7 is user system 9. With respect to the same subject, the amount of information about the subject displayed on display unit 14 is less than the amount of information about the subject displayed on display unit 13. With respect to the same subject, the amount of information about the subject in video V2 is less than the amount of information about the subject in video V1.

[0034] Video V1 includes, for example, an image of a subject. In this specification, "image" refers to an image captured by a camera and output from the camera. Video V2 includes an image processed from the image to reduce the amount of information about the subject in the image. Video V2 includes, for example, an image that displays at least a portion of the subject's outline, the subject's silhouette, or a display resolution lower than the display resolution of the subject in Video V1. For example, the amount of information about the subject is the display resolution of the subject.

[0035] The video V1 displayed in user system 3 includes, for example, only the video of the user captured by user system 3 and another user system 3. The video V2 includes, for example, the video of the user and background video captured by each user system 3.

[0036] For example, as shown in Figures 2 and 3, the video V1 displayed in user system 7 includes, for example, only the video M2 of user U2 captured by user system 9. For example, as shown in Figures 2 to 4, the video V2 displayed in both user system 7 and user system 9 includes the videos M1 and M2 of users U1 and U2 captured by user systems 7 and 9 respectively, and the background video M3. For example, video V2 is a video that displays the video M1 of user U1 captured in user system 7 and the video M2 of user U2 captured in user system 9 on a single background video M3. In user system 7, the amount of information of user U2 displayed in display unit 14 is less than the amount of information of user U2 displayed in display unit 13. In user system 7, the amount of information of user U2 in video V2 is less than the amount of information of user U2 in video V1.

[0037] For example, in Figures 3 and 4, video V2 displays the outlines of users in multiple user systems 3. In Figures 3 and 4, video V2 includes video M1, which displays the outline of user U1, and video M2, which displays the outline of user U2. In Figures 3 and 4, the user outlines are shown in monochrome in video M1 and video M2. In Figures 3 and 4, the area enclosed by the user outlines shows background video M3.

[0038] For example, in Figure 5, video V2 displays the silhouettes of users of multiple user systems 3. In Figure 5, video V2 includes video M1, which displays the silhouette of user U1, and video M2, which displays the silhouette of user U2. In this specification, "silhouette" is, for example, an image in which the area enclosed by the contours of the user is shown in a single color.

[0039] For example, display surface 13a and display surfaces 14a, 14b extend in directions that intersect each other. For example, the normal direction β1 of display surface 13a and the normal direction β2 of display surfaces 14a, 14b intersect each other. For example, the camera 21 of the imaging unit 11 is positioned such that the imaging direction α1 of the imaging unit 11 is aligned with the normal direction β1 of display surface 13a. For example, the camera 22 of the imaging unit 12 is positioned such that the imaging direction α2 of the imaging unit 12 is opposite to the normal direction β2 of display surfaces 14a, 14b. For example, the camera 22 and display surfaces 14a, 14b are positioned such that the user U1 is located between the camera 22 and the display surfaces 14a, 14b. For example, the camera 22 images the back of the user U1.

[0040] In the user system 7, the imaging information of user U1 is displayed on the display surface 13a by the display unit 13. In the user system 7, the image M1 of user U1 is displayed on the display surface 14a by the display unit 14, and the image M2 of user U2 is displayed on the display surface 14b by the display unit 14.

[0041] In this embodiment, the display unit 13 includes, for example, a monitor 23. The monitor 23 is, for example, a life-size display. For example, the monitor 23 includes a display surface 13a. In Figure 2, the camera 21 is provided on the edge of the monitor 23. In Figure 3, the camera 21 is provided between the monitor 23 and user U1. The display unit 14 includes, for example, a projection device 24 and a screen 25. The screen 25 is large enough to display, for example, the entire bodies of user U1 and user U2. The projection device 24 displays an image V2 on the screen 25. For example, the screen 25 includes display surfaces 14a and 14b. The screen 25 may be a wall.

[0042] As a modification of this embodiment, the display unit 13 may include a projection device and a screen instead of a monitor. The display unit 14 may include a monitor instead of a projection device and a screen. In this case, the monitor of the display unit 14 includes display surfaces 14a and 14b. As a further modification of this embodiment, both the display unit 13 and the display unit 14 may include a monitor. Both the display unit 13 and the display unit 14 may include a projection device and a screen.

[0043] The shielding parts 15 and 16 shield the display surfaces 14a and 14b of the display unit 14. The shielding parts 15 and 16 are separate from each other. For example, the shielding parts 15 and 16 are a pair of curtains. Shielding part 15 shields the display surface 14a. Shielding part 16 shields the display surface 14b.

[0044] The drive unit 17 opens and closes the shielding part 15, switching between a state where the display surface 14a is covered by the shielding part 15 and a state where the display surface 14a is exposed from the shielding part 15. The drive unit 18 opens and closes the shielding part 16, switching between a state where the display surface 14b is covered by the shielding part 16 and a state where the display surface 14b is exposed from the shielding part 16. The drive units 17 and 18 are driven based on signals from the information processing unit 19. For example, the drive unit 17 is driven in response to an operation by user U1. The drive unit 18 is driven in response to an operation by user U2.

[0045] The information processing unit 19 processes information related to the imaging units 11 and 12, the display units 13 and 14, and the drive units 17 and 18. The information processing unit 19 includes a communication unit 27, an acquisition unit 28, and a control unit 29.

[0046] The communication unit 27 communicates with other user systems 3 and server 5. The communication unit 27 transmits information to other user systems 3 or server 5. The communication unit 27 receives information from other user systems 3 or server 5. For example, the communication unit 27 transmits imaging information captured by imaging units 11 and 12 to server 5. For example, the communication unit 27 transmits information received from server 5 to acquisition unit 28. For example, the communication unit 27 receives video information of videos V1 and V2 to be displayed on display units 13 and 14 from server 5.

[0047] The acquisition unit 28 acquires video information of the video to be displayed on the display units 13 and 14. For example, the acquisition unit 28 acquires video information of video V1 to be displayed on the display unit 13 and video information of video V2 to be displayed on the display unit 14. The video information of video V1 acquired by the acquisition unit 28 includes imaging information from the imaging unit 11 of the user system 3 displaying video V1 and another user system 3. The video information of video V2 acquired by the acquisition unit 28 includes imaging information from the imaging unit 12 of the user system 3 displaying video V2 and imaging information from the imaging unit 12 of the user system 3 displaying video V2 and another user system 3.

[0048] For example, the video information of video V1 acquired by the acquisition unit 28 of user system 7 includes the imaging information of the imaging unit 11 of user system 9. The video information of video V2 acquired by the acquisition unit 28 of user system 7 includes the imaging information of the imaging unit 12 of user system 7 and the imaging information of the imaging unit 12 of user system 3 other than user system 7. For example, user system 3 other than user system 7 is user system 9.

[0049] For example, the video information of video V2 contains imaging information from two different users. For example, in user system 7, the video information of video V1 contains imaging information from user U2 only. For example, in both user system 7 and user system 9, the video information of video V2 contains imaging information from both user U1 and user U2. In user system 9, the video information of video V1 contains imaging information from user U1 only.

[0050] The control unit 29 controls the imaging units 11 and 12, the display units 13 and 14, and the drive units 17 and 18. For example, the control unit 29 transmits the video information acquired by the acquisition unit 28 to the display units 13 and 14, causing the display units 13 and 14 to display a video based on the video information. For example, the control unit 29 of the user system 7 displays a video V1 on the display unit 13 based on video information including the imaging information of user U2. For example, the control unit 29 of the user system 7 displays a video V1 on the display unit 13 based on video information including the imaging information of user U1 and the imaging information of user U2.

[0051] The control unit 29 controls the drive units 17 and 18 based on information from the acquisition unit 28, for example. For example, the control unit 29 controls the drive unit 17 according to the operation information of user U1 provided by the acquisition unit 28. The control unit 29 controls the drive unit 18 according to the operation information of user U2 provided by the acquisition unit 28.

[0052] Server 5 communicates with the communication units 27 of multiple user systems 3 and processes the video information provided by the user systems 3. Server 5 includes a communication unit 41, an acquisition unit 43, and a video information creation unit 45.

[0053] The communication unit 41 communicates with multiple user systems 3. The communication unit 41 transmits information to multiple user systems 3. The communication unit 41 receives information from multiple user systems 3. For example, the communication unit 41 receives imaging information captured by the imaging units 11 and 12 from the user systems 3. For example, the communication unit 41 transmits the information received from the user systems 3 to the acquisition unit 43. For example, the communication unit 41 transmits video information of videos V1 and V2 to be displayed on the display units 13 and 14 of user systems 7 and 9 to user systems 7 and 9. The communication unit 41 corresponds to a transmission unit that transmits video information created by the video information creation unit 45 to user systems 7 and 9.

[0054] The acquisition unit 43 acquires imaging information of users in multiple user systems 3. The acquisition unit 43 acquires imaging information of users U1 and U2 in user systems 7 and 9, respectively. The acquisition unit 43 acquires imaging information of user U1 from user system 7. The acquisition unit 43 acquires imaging information of user U2 from user system 9.

[0055] The video information creation unit 45 creates video information for video V1 to be displayed on the display unit 13 and video information for video V2 to be displayed on the display unit 14. The video information creation unit 45 creates video information for video V1 to be displayed on the display unit 13 based on the user's imaging information captured by the imaging unit 11 of the user system 3. The video information creation unit 45 creates video information for video V2 to be displayed on the display unit 14 based on the user's imaging information captured by the imaging unit 12 of the user system 3. For example, the video information creation unit 45 creates video information such that the amount of user information in the video information for video V2 to be displayed on the display unit 14 is less than the amount of user information in the video information for video V1 to be displayed on the display unit 13.

[0056] In other words, the video information creation unit 45 creates video information such that, for the same subject, the amount of subject information in the video information of video V2 is less than the amount of user information in the video information of video V1. For example, the video information of video V1 includes information about the captured video of the subject. The video information of video V2 includes at least a part of the subject's outline, the subject's silhouette, and video information having a lower display resolution than the display resolution of the subject in video V1.

[0057] For example, the video information creation unit 45 creates video information for displaying video V1 on the display unit 13 of user system 7, based on the imaging information of user U1 captured by the imaging unit 11 of user system 7, to display the video of user U1. The video information creation unit 45 creates video information for displaying video V1 on the display unit 13 of user system 9, based on the imaging information of user U2 captured by the imaging unit 11 of user system 9, to display the video of user U2. The video information creation unit 45 creates video information for displaying video V2 on the display units 14 of user systems 7 and 9, based on the imaging information of user U1 captured by the imaging unit 12 of user system 7 and the imaging information of user U2 captured by the imaging unit 12 of user system 9, to display the video of user U1 and user U2. The communication unit 41 transmits the video information for displaying user U2 and the video information for displaying user U1 and user U2 to the terminal of user system 7. The communication unit 41 transmits video information displaying the video of user U1, and video information displaying the video of user U1 and the video of user U2, to the terminal of the user system 9.

[0058] In the video information creation unit 45, the video information for video V2 to be displayed on the display unit 14 is configured to display the user's video and background video captured by each user system 3 on the display unit 14. For example, the video information for video V2 to be displayed on the display unit 14 is configured to display the videos M1 and M2 of users U1 and U2, captured by user systems 7 and 9 respectively, and the background video M3 on the display unit 14. For example, the video information for video V2 to be displayed on the display unit 14 is configured to display the video M1 of user U1 captured by user system 7 and the video M2 of user U2 captured by user system 9 on a single background video M3.

[0059] Next, with reference to Figure 6, the hardware configuration of the information processing unit 19 of the user system 3 will be described. Figure 6 is a diagram showing an example of the hardware configuration of the information processing unit 19.

[0060] The information processing unit 19 comprises a processor 101, a main memory 102, an auxiliary memory 103, a communication device 104, an input device 105, and an output device 106. The information processing unit 19 includes one or more computers composed of these hardware components and software such as programs. The communication unit 27, the acquisition unit 28, and the control unit 29 may each be composed of one computer or multiple computers. The information processing unit 19 is realized in cooperation with the hardware.

[0061] Server 5 also has the same hardware configuration as the information processing unit 19. The communication unit 41, acquisition unit 43, and video information creation unit 45 may each be configured by one computer or by multiple computers. Server 5 is realized in cooperation with the hardware.

[0062] When the information processing unit 19 and the video information creation unit 45 are composed of multiple computers, these computers may be connected locally or via a communication network such as the Internet or an intranet. This connection logically constructs one information processing unit 19. This connection logically constructs one video information creation unit 45.

[0063] The processor 101 executes the operating system and application programs. The main memory 102 consists of ROM (Read Only Memory) and RAM (Random Access Memory). For example, at least some of the various functional units of the information processing unit 19 and the video information creation unit 45 can be implemented by the processor 101 and the main memory 102.

[0064] The auxiliary storage device 103 is a storage medium composed of a hard disk and flash memory, among other things. The auxiliary storage device 103 generally stores a larger amount of data than the main memory 102. For example, at least a part of the acquisition unit 28 and the acquisition unit 43 can be implemented by the auxiliary storage device 103.

[0065] The communication device 104 consists of a network card or a wireless communication module. For example, at least a portion of the communication unit 27 and the communication unit 41 may be implemented by the communication device 104. The input device 105 consists of an input port, a keyboard, a mouse, and a touch panel, etc. For example, at least a portion of the acquisition unit 28 and the acquisition unit 43 may be implemented by the input device 105. The output device 106 consists of an output port, a display, and a projection device such as a projector, etc.

[0066] The auxiliary storage device 103 stores the program and data necessary for processing in advance. The video provision program causes the computer to execute each functional element of the information processing unit 19 and the video information creation unit 45. Through this program, for example, each process performed in the video provision method is executed on the computer. The video provision method is, for example, the process performed in the video provision system described above. This program may be provided on a tangible recording medium such as a CD-ROM, DVD-ROM, or semiconductor memory. This program may also be provided as a data signal via a communication network.

[0067] Next, the effects of the video provision system, video provision method, and video provision program according to the above-described embodiment will be explained.

[0068] In the video provision system 1, the video information creation unit 45 creates first video information based on the imaging information of user U2. The first video information is information for displaying user U2's image. The video information creation unit 45 creates second video information based on the imaging information of user U1 and user U2. The second video information is information for displaying user U1's image and user U2's image. The amount of information about user U2 in the second video information is less than the amount of information about user U2 in the first video information. User U1 and user U2 each correspond to subjects. In this case, the first and second video information provide users with a sense of sharing space with user U1 and user U2 while reducing stress. Comfortable communication can be provided to people in remote communication using the video provision system.

[0069] The second video information may be configured to display the video of user U1 and the video of user U2 on a single background video M3. In this case, users are more likely to get a sense of sharing a space.

[0070] The video information creation unit 45 may further create third video information that displays user U1 based on the imaging information of user U1. The communication unit 41 may transmit the first video information and the second video information to the terminal of user system 7, and transmit the third video information and the second video information to the terminal of user system 9. In this case, both the user using the first terminal and the user using the second terminal can get a sense of sharing space while reducing stress.

[0071] The display unit 13 may display an image based on the first video information on the display surface 13a. The display unit 14 may display an image based on the second video information on the display surfaces 14a and 14b. The display surfaces 13a and 14a and 14b may extend in directions that intersect each other. In this case, a sense of sharing space can be obtained while further reducing stress.

[0072] The imaging units 11 and 12 capture images of the user U1 from different directions. The imaging unit 12 may be positioned so that its imaging direction α2 is opposite to the normal direction β2 of the display surfaces 14a and 14b. The video information creation unit 45 may create first video information based on the imaging information from the imaging unit 11. The video information creation unit 45 may create second video information based on the imaging information from the imaging unit 11 and the imaging information from the imaging unit 12. In this case, a sense of sharing space can be obtained while further reducing stress.

[0073] Next, an example of the verification of the video delivery system 1 described above will be explained. The verification was conducted in pairs of eight subjects in their 20s (four males and four females). First, in each pair, the subjects communicated for three minutes in a face-to-face environment (hereinafter simply referred to as the "face-to-face environment") where they faced each other in the same space. Next, the subjects from each pair entered separate rooms and communicated freely for three minutes each in two evaluation environments: the existing web conferencing system environment and the environment of video delivery system 1. The rooms correspond to space S of user system 3.

[0074] Each participant completed a questionnaire using Google Forms after each communication session in a face-to-face setting, a web conferencing system setting, and a video delivery system 1 setting. The total time spent on communication and completing the questionnaire was approximately 30 minutes.

[0075] The questionnaire included Question Q1, designed to measure individuals' impressions of the evaluation environment described above and to clarify its semantic structure and image. Specifically, Question Q1 consisted of multiple items, each to be evaluated on a 5-point scale. Each item was paired with words that had opposing meanings. Participants evaluated which word was closer to their own for each item. The questionnaire also included Question Q2 about fatigue and Question Q3 about shortcomings in online interactions. Questions Q2 and Q3 were also to be evaluated on a 5-point scale.

[0076] Factor analysis was performed on each item of Question Q1 to understand the characteristics of Video Delivery System 1. For Questions Q2 and Q3, t-tests were performed to demonstrate the usefulness of Video Delivery System 1. The above factor analysis and t-tests were performed using IBM's statistical analysis software SPSS.

[0077] For the factor analysis of the items in Question Q1, standardized data for each item (24 data points in total, based on 8 participants x 3 patterns) was entered into SPSS and analyzed. The adjustment of items to be analyzed and the factor analysis were repeated until each item showed a relatively high loading in only one factor. The principal component method was used for factor extraction, and Promax rotation was used for rotation. The validity of the collected data for factor analysis was also examined by checking the sample validity measure of KMO.

[0078] Furthermore, SPSS was used, similar to factor analysis, to determine whether the items constituting the factors were consistent. Cronbach's alpha coefficient was calculated, confirming the internal consistency of the factors. An alpha coefficient of 0.8 or higher indicates sufficient internal consistency. Subsequently, factor analysis was performed again using SPSS, and factor score coefficients were calculated. In calculating factor identification, the factor score coefficient for each item was multiplied by the standardized mean, and all items were summed up. The factor scores are used to confirm how each factor influences the environment in face-to-face settings, web conferencing systems, and video provision system 1.

[0079] For questions Q2 and Q3, 24 standardized data points were entered into SPSS for each item and analyzed. Before performing the t-test, a test for data normality was conducted, confirming that all items followed a normal distribution. By checking the significance probability, it was examined whether there was a significant difference in the mean values ​​of each item between the web conferencing system environment and the video provision system 1 environment.

[0080] First, the factor analysis results for each evaluation environment are shown. Figure 7 shows the results for question Q1 from the questionnaire in a graph. In Figure 7, data D1 shows the data for the face-to-face environment, data D2 shows the data for the web conferencing system environment, and data D3 shows the data for the video provision system 1 environment. It is possible that the evaluation criteria differed due to individual differences such as the preferences of the subjects. For this reason, in the graph in Figure 7, the results for question Q1 have been standardized so that the mean of the variables is 0 and the standard deviation is 1.

[0081] Factor analysis was repeatedly performed on the data collected through Question Q1 to determine which items to remove from the multiple items shown in Figure 7. The four items to be removed were "fun-boring," "relaxing-tense," "comfortable-uncomfortable," and "bright-dark atmosphere."

[0082] The KMO's measure of sample validity was 0.851, which is above 0.50. Therefore, it was determined that there was justification for performing factor analysis. Furthermore, the significance level of Bartlett's sphericity test was less than 0.05. Therefore, it was determined that there is a correlation between the variables.

[0083] The number of factors was examined from the perspective of eigenvalues. The first factor was 8.94, the second factor was 1.39, the third factor was 1.15, and the fourth factor and beyond were 1 or less. Therefore, according to the Kaiser criteria, it was determined that there should be up to the third factor. The cumulative contribution rate up to the third factor was 88.2%, which was above 50%. Therefore, it was determined that three factors were sufficient.

[0084] Based on the variance of the sum of squared loadings after rotation using Promax rotation, it was confirmed that Factor 1 explained 67.7% of the total, Factor 2 explained 9.28%, Factor 3 explained 7.28%, and the three factors explained 84.2% of the total. Factor 1 consists of six items: "easygoing," "easy to talk to," "calming," "convenient," "safe," and "friendly," with items related to comfort with respect to the space and the other person showing high loadings. Hereafter, Factor 1 will also be referred to as "comfort." Factor 2 consists of four items: "spacious," "open," "high degree of shared space," and "no feeling of confinement," with items related to a sense of openness with respect to the space showing high loadings. Hereafter, Factor 2 will also be referred to as "openness." Factor 3 consists of three items: "immersive," "close presence of the other person," and "high degree of connection," with items related to connection with the other person and the space they are in showing high loadings. Hereafter, Factor 3 will also be referred to as "sense of connection." A correlation of 0.688 was observed between factor 1 and factor 2, 0.657 between factor 1 and factor 3, and 0.531 between factor 2 and factor 3.

[0085] Cronbach's alpha coefficient confirmed that all three factors, "comfort," "openness," and "sense of connection," possessed sufficient internal consistency. Using these three factors, the above evaluation environments were examined from the perspective of factor scores. Figure 8 is a graph showing the factor score results for each evaluation environment. In Figure 8, data D1 shows data for the face-to-face environment, data D2 shows data for the web conferencing system environment, and data D3 shows data for the video provision system 1 environment. Data D11, D21, and D31 show data related to "comfort." Data D12, D22, and D32 show data related to "openness." Data D13, D23, and D33 show data related to "sense of connection."

[0086] As shown in Figure 8, it was confirmed that the video provision system 1 scored higher than the web conferencing system in all three factors: "comfort," "openness," and "sense of connection." Regarding "comfort," it is thought that the body language was expressed by the user's video M1 and M2 in video V2 displayed on the display unit 14, the appropriate state such as distance was expressed by video V1 displayed on the display unit 13, and a natural communication environment similar to a face-to-face environment was created.

[0087] Regarding "openness," it was confirmed that video delivery system 1 performed better than the web conferencing system in terms of evaluation values ​​indicating the size of space using the magnitude estimation method. This is thought to be because a common space was shared in real time, allowing participants to perceive the expansion of the communication space not only through the separate spaces visible to each other in the web conferencing system, but also through this additional space.

[0088] Regarding the "sense of connection," it is thought that the following factors contributed to this: the use of the user's images M1 and M2 in the video V2 displayed on the display unit 14 expressed body language and presence; a sense of side-by-side viewing was induced; and the images of oneself and the other person side-by-side in a single common space S gave the user the feeling of being in the same space.

[0089] Next, we present the results of the t-test for fatigue. Figure 9 shows a graph of the results for question Q2 from the questionnaire. In Figure 9, data D4 represents data from the face-to-face environment, data D5 represents data from the web conferencing system environment, and data D6 represents data from the video provision system 1 environment. In the graph in Figure 9, the results for question Q2 have been standardized so that the mean of the variables is 0 and the standard deviation is 1.

[0090] Figure 9 shows that for all questionnaire items, fatigue levels were lower in the video delivery system 1 environment than in the web conferencing system environment. For each item, the mean values ​​for the two environments—the web conferencing system environment and the video delivery system 1 environment—were compared, and a t-test was used to quantitatively confirm whether there was a significant difference between the two environments. In Figure 9, items with a significance probability of less than 0.05 are indicated by *, and items with a significance probability of less than 0.01 are indicated by **.

[0091] In Figure 9, a significant difference was observed between the average values ​​in the web conferencing system environment and the average values ​​in the video delivery system 1 environment for all items in Question Q2. Regarding physical and mental fatigue after use, it was confirmed that fatigue experienced with video delivery system 1 was less than fatigue experienced with the web conferencing system. It was confirmed that video delivery system 1 is useful in alleviating Zoom fatigue.

[0092] Next, we present the results of the t-test for missing elements online. Figure 10 shows a graph of the results corresponding to question Q3 from the survey. In Figure 10, data D7 represents data from the web conferencing system environment, and data D8 represents data from the video provision system 1 environment. In the graph in Figure 10, the results for question Q3 have been standardized so that the mean of the variables is 0 and the standard deviation is 1.

[0093] Figure 10 shows that, in all aspects except for eye contact, the sense of connection in the video delivery system 1 environment was superior to the sense of connection in the web conferencing system environment. A t-test was also performed for question Q3, similar to question Q2, to confirm whether there was a significant difference between the web conferencing system environment and the video delivery system 1 environment.

[0094] In Figure 10, significant differences were observed between the average values ​​in the web conferencing system environment and the average values ​​in the video provision system 1 environment for the following items from Question Q3: sense of distance from the other person, self-awareness, the other person's gestures and body language, perceived proximity of the other person's presence, gap with real space, and feeling of being monitored.

[0095] The user's images M1 and M2 in the video V2 displayed on the display unit 14 supplement body language, making the other person's presence feel closer. The display unit 13 maintains a natural sense of distance from the other person, and because the user is not directly facing them, they do not feel like they are being watched. The user's own image is displayed with relatively little information through the user's images M1 and M2. As a result, self-awareness and self-evaluation may be suppressed. According to the video provision system 1, the missing elements in online interactions are supplemented, the gap felt due to the difference from real space is suppressed, and natural communication can be realized.

[0096] While embodiments and modifications of the present invention have been described above, the present invention is not necessarily limited to the embodiments and modifications described above, and various modifications are possible without departing from the spirit of the invention.

[0097] For example, the video provisioning system 1 may include user systems 3 other than user systems 7 and 9. In this case, the video information creation unit 45 may create video information for video V2 that includes images of three or more users captured by different user systems 3. In this case, for example, the video information for video V2 created by the video information creation unit 45 may be configured to display images of three or more users on a single background image. [Explanation of Symbols]

[0098] 1...Video provision system, 11,12...Imaging unit, 28,43...Acquisition unit, 45...Video information creation unit, M1,M2,V1,V2...Video, α1,α2...Imaging direction, β1,β2...Normal direction.

Claims

1. An acquisition unit that acquires imaging information of a first subject and a second subject that are different from each other, The system includes a video information creation unit that creates first video information displaying the image of the second subject based on the imaging information of the second subject, and a video information creation unit that creates second video information displaying the image of the first subject and the image of the second subject based on the imaging information of the first subject and the second subject, The amount of information about the second subject in the second video information is less than the amount of information about the second subject in the first video information. The video provision system wherein the second video information is a video showing at least a portion of the contours of the first subject and the second subject, or the silhouettes of the first subject and the second subject.

2. The second video information is configured to display the video of the first subject and the video of the second subject on a single background video, The video provision system according to claim 1, wherein the video of the first subject and the video of the second subject are videos showing the outline of the subject and the background video in the area enclosed by the outline, or silhouettes showing the area enclosed by the outline of the subject in a single color.

3. The system further comprises a transmission unit that transmits the video information created in the aforementioned video information creation unit, The aforementioned video information creation unit further creates third video information that displays the first subject based on the imaging information of the first subject, The video provision system according to claim 1, wherein the transmitting unit transmits the first video information and the second video information to a first terminal, and transmits the third video information and the second video information to a second terminal.

4. The system further comprises a first display unit that displays an image based on the first video information on a first display surface, and a second display unit that displays an image based on the second video information on a second display surface. The video provisioning system according to any one of claims 1 to 3, wherein the first display surface and the second display surface extend in directions that intersect each other.

5. The system further comprises a first imaging unit and a second imaging unit that image the first subject from different directions. The second imaging unit is arranged such that the imaging direction of the second imaging unit is opposite to the normal direction of the second display surface. The video information creation unit creates third video information that displays the first subject based on the imaging information of the first imaging unit, and creates second video information based on the imaging information of the second imaging unit, according to claim 4.

6. The first subject is captured by the imaging unit, An acquisition unit that acquires first video information including imaging information of a second subject different from the first subject, and second video information including imaging information of the first subject and imaging information of the second subject. A first display unit that displays an image based on the first video information, It comprises a second display unit which is separated from the first display unit and displays an image based on the second image information, The amount of information about the second subject displayed by the second display unit is less than the amount of information about the second subject displayed by the first display unit. The video provision system wherein the second video information is a video showing at least a portion of the contours of the first subject and the second subject, or the silhouettes of the first subject and the second subject.

7. Acquiring imaging information of a first subject and a second subject that are different from each other, The system includes creating first video information that displays the second subject based on the imaging information of the second subject, and second video information that displays the first subject and the second subject based on the imaging information of the first subject and the second subject. The amount of information about the second subject in the second video information is less than the amount of information about the second subject in the first video information. A method for providing video, wherein the second video information is a video showing at least a part of the outlines of the first subject and the second subject, or the silhouettes of the first subject and the second subject.

8. Acquiring imaging information of a first subject and a second subject that are different from each other, The computer is instructed to create first video information that displays the second subject based on the imaging information of the second subject, and second video information that displays the first subject and the second subject based on the imaging information of the first subject and the second subject. The amount of information about the second subject in the second video information is less than the amount of information about the second subject in the first video information. The video provision program wherein the second video information is a video showing at least a portion of the outlines of the first subject and the second subject, or the silhouettes of the first subject and the second subject.

Images