Information processing device, method, and program

Abstract

To improve technique of reducing fatigue felt in a videoconference.SOLUTION: A control unit of an information processing device 10 adjusts a virtual distance Lv2 so that the total value of an actual distance Lr1 from a display 20 disposed in a real space to a user U1 in the real space and a virtual distance Lv2 from a predetermined reference position in a virtual space to an object O2 in the virtual space equivalent to the speech opposite party U2 of the user U1 becomes a predetermined value.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, a method, and a program. [Background technology]

[0002] Conventionally, there are known techniques for realizing a video conference using a communication line. For example, Patent Document 1 discloses a technique in which a user distance L1 between a user and a video call device is transmitted to another video call device, and a distance information control means instructs a display image conversion means to convert an image so that a virtual image of the user is generated at a position obtained by adding L1 and the user distance L2 at the other video call device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-282431 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is room for improvement in technology to reduce fatigue during video conferencing.

[0005] In view of the above circumstances, an object of the present disclosure is to improve technology for reducing fatigue during video conferencing. [Means for solving the problem]

[0006] An information processing device according to one embodiment of the present disclosure includes a control unit that adjusts the virtual distance so that the sum of a real distance from a display placed in a real space to a user in the real space and a virtual distance from a predetermined reference position in a virtual space to an object in the virtual space that corresponds to the user's conversation partner becomes a predetermined value.

[0007] A method according to an embodiment of the present disclosure is a method executed by an information processing device, This includes adjusting the virtual distance so that the sum of a real distance from a display placed in a real space to a user in the real space and a virtual distance from a predetermined reference position in a virtual space to an object in the virtual space that corresponds to the user's conversation partner becomes a predetermined value.

[0008] A program according to an embodiment of the present disclosure includes: On the computer, The virtual distance is adjusted so that the sum of a real distance from a display placed in a real space to a user in the real space and a virtual distance from a predetermined reference position in the virtual space to an object in the virtual space that corresponds to the user's conversation partner becomes a predetermined value. Effect of the Invention

[0009] According to an embodiment of the present disclosure, techniques for reducing fatigue during video conferencing can be improved. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a schematic configuration of a system according to an embodiment of the present disclosure. [Diagram 2] 1 is a block diagram showing a schematic configuration of an information processing device according to an embodiment of the present disclosure. [Diagram 3] 10 is a flowchart illustrating an operation of an information processing device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present disclosure will be described.

[0012] An overview of a system 1 according to an embodiment of the present disclosure will be described with reference to FIG.

[0013] The system 1 includes an information processing device 10, a first display 20, a first camera 30, a second display 40, and a second camera 50. The information processing device 10, the first display 20, and the second display 40 are connected to a network 60 so as to be able to communicate with each other.

[0014] The information processing device 10 is a computer such as a server that belongs to a cloud computing system or other computing system.

[0015] The first display 20 and the second display 40 are, for example, light field displays that employ a light field method capable of reproducing light emitted by any object, but are not limited to this. The first display 20 and the second display 40 may be conventional displays such as LCD (liquid crystal display) or organic EL (electro luminescence).

[0016] The first camera 30 and the second camera 50 are, for example, but not limited to, RGB-D cameras capable of acquiring distance images in addition to color images. In this embodiment, the first camera 30 is provided in the center of the lower side of the screen of the first display 20, but is not limited to this. Also, in this embodiment, the second camera 50 is provided in the center of the lower side of the screen of the second display 40, but is not limited to this.

[0017] The network 60 includes the Internet, at least one wide area network (WAN), at least one metropolitan area network (MAN), or any combination thereof. The network 60 may also include at least one wireless network, at least one optical network, or any combination thereof. The wireless network may be, for example, an ad-hoc network, a cellular network, a local area network (LAN), a satellite communication network, or a terrestrial microwave network.

[0018] The present embodiment will be outlined with reference to FIG.

[0019] The control unit 11 of the information processing device 10 adjusts the second virtual distance Lv2 so that the sum of the first real distance Lr1 from the first display 20 arranged in the first real space to the first user U1 in the first real space and the second virtual distance Lv2 from a predetermined reference position in the second virtual space to the second object O2 in the second virtual space corresponding to the conversation partner of the first user U1 becomes a predetermined value. Similarly, the control unit 11 of the information processing device 10 adjusts the first virtual distance Lv1 so that the sum of the second real distance Lr2 from the second display 40 arranged in the second real space to the second user U2 in the second real space and the first virtual distance Lv1 from a predetermined reference position in the first virtual space to the first object O1 in the first virtual space corresponding to the conversation partner of the second user U2 becomes a predetermined value.

[0020] In this way, according to the present embodiment, for example, when a first user U1 whose personal space is 1m and a second user U2 whose personal space is 2m hold a video conference, the second object O2 is displayed as being 1m away from the first user U1. On the other hand, the first object O1 is displayed as being 2m away from the second user U2. Therefore, the personal space of the first user U1 and the personal space of the second user U2 are protected. Therefore, the technology for reducing fatigue during a video conference can be improved.

[0021] The configuration of the information processing device 10 according to this embodiment will be described with reference to FIG.

[0022] The information processing device 10 includes a control unit 11, a communication unit 12, and a storage unit 13.

[0023] The control unit 11 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a central processing unit (CPU) or a graphics processing unit (GPU), or a dedicated processor specialized for a specific process. The programmable circuit is, for example, a field-programmable gate array (FPGA). The dedicated circuit is, for example, an application specific integrated circuit (ASIC). The control unit 11 executes processes related to the operation of the information processing device 10 while controlling each unit of the information processing device 10. In this embodiment, the control unit 11 controls the operation of a first virtual camera capable of capturing a subject image of an arbitrary object arranged in a first virtual space. Similarly, the control unit 11 controls the operation of a second virtual camera capable of capturing a subject image of an arbitrary object arranged in a second virtual space.

[0024] The communication unit 12 includes at least one communication interface. The communication interface corresponds to, for example, a mobile communication standard, a wired LAN standard, or a wireless LAN standard, but is not limited to these, and may correspond to any communication standard. The communication unit 12 receives data used in the operation of the information processing device 10. In addition, the communication unit 12 transmits data obtained by the operation of the information processing device 10.

[0025] The storage unit 13 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a random access memory (RAM) or a read only memory (ROM). The RAM is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM is, for example, an electrically erasable programmable read only memory (EEPROM). The storage unit 13 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 13 stores data used in the operation of the information processing device 10 and data obtained by the operation of the information processing device 10. In this embodiment, the data used in the operation of the information processing device 10 includes a system program, an application program, a database, and a texture image, etc.

[0026] An operation of the information processing device 10 according to the present embodiment will be described with reference to Fig. 3. This operation corresponds to a method according to an embodiment of the present disclosure.

[0027] In this example, a first user U1 in a first real space and a second user U2 in a second real space are engaged in a video conference via a network 60. Therefore, the first user U1 corresponds to a conversation partner for the second user U2. The second user U2 corresponds to a conversation partner for the first user U1. The coordinate system of the first real space has an origin at the center of the screen of the first display 20, an x-axis in the right direction of the screen, a y-axis in the upper direction of the screen, and a z-axis in the front direction of the screen. The coordinate system of the second real space has an origin at the center of the screen of the second display 40, an x-axis in the right direction of the screen, a y-axis in the upper direction of the screen, and a z-axis in the front direction of the screen. However, the present disclosure is not limited to these.

[0028] Step S100: The control unit 11 of the information processing device 10 acquires a first real distance Lr1 from a first display 20 arranged in a first real space to a first user U1 in the first real space. Similarly, the control unit 11 acquires a second real distance Lr2 from a second display 40 arranged in a second real space to a second user U2 in the second real space.

[0029] Specifically, the control unit 11 of the information processing device 10 identifies, for example, the center position (x1, y1, z1) of the head of the first user U1 using the first camera 30. Then, the control unit 11 determines, for example, the length of a vector (x1, 0, z1) as the first actual distance Lr1. Similarly, the control unit 11 identifies, for example, the center position (x2, y2, z2) of the head of the second user U2 using the second camera 50. Then, the control unit 11 determines, for example, the length of a vector (x2, 0, z2) as the second actual distance Lr2.

[0030] Step S110: The control unit 11 of the information processing device 10 generates a second object O2 corresponding to the second user U2. Similarly, the control unit 11 generates a first object O1 corresponding to the first user U1.

[0031] Specifically, the control unit 11 of the information processing device 10 generates a second object O2 consisting of polygons onto which a texture image is projected by, for example, texture mapping technology, based on an image of the second user U2 acquired by the second camera 50. Similarly, the control unit 11 generates a first object O1 consisting of polygons onto which a texture image is projected by, for example, texture mapping technology, based on an image of the first user U1 acquired by the first camera 30.

[0032] Step S120: The control unit 11 of the information processing device 10 adjusts the second virtual distance Lv2 so that the sum of the first real distance Lr1 acquired in step S100 and the second virtual distance Lv2 from a predetermined reference position in the second virtual space to the second object O2 generated in step S110 becomes a predetermined value. Similarly, the control unit 11 adjusts the first virtual distance Lv1 so that the sum of the second real distance Lr2 acquired in step S100 and the first virtual distance Lv1 from a predetermined reference position in the first virtual space to the first object O1 generated in step S110 becomes a predetermined value.

[0033] Specifically, the control unit 11 of the information processing device 10 calculates the predetermined value based on the distance secured between the first user U1 and the second user U2, which is stored in advance in the storage unit 13, for example. Then, the control unit 11 adjusts the second virtual distance Lv2 so that the sum of the first real distance Lr1 and the second virtual distance Lv2 becomes the calculated predetermined value. Similarly, the control unit 11 calculates the predetermined value based on the distance secured between the first user U1 and the second user U2 by the second user U2. Then, the control unit 11 adjusts the first virtual distance Lv1 so that the sum of the second real distance Lr2 and the first virtual distance Lv1 becomes the calculated predetermined value. Note that the distance may be an interpersonal distance (personal space) that can be estimated by monitoring the first user U1 and the second user U2 by any method, and the predetermined value may be equal to the interpersonal distance.

[0034] Additionally or alternatively, the control unit 11 may calculate the predetermined value based on, for example, an amount of speech by the first user U1 to the second user U2 stored in advance in the storage unit 13. For example, the greater the amount of speech, the smaller the predetermined value may be set, and the smaller the amount of speech, the larger the predetermined value may be set. Then, the control unit 11 may adjust the second virtual distance Lv2 so that the sum of the first real distance Lr1 and the second virtual distance Lv2 becomes the calculated predetermined value. Similarly, the control unit 11 may calculate the predetermined value based on an amount of speech by the second user U2 to the first user U1. Then, the control unit 11 may adjust the first virtual distance Lv1 so that the sum of the second real distance Lr2 and the first virtual distance Lv1 becomes the calculated predetermined value. Note that the amount of speech may be an amount of speech that can be analyzed by monitoring a video conference in which the first user U1 and the second user U2 participate by any method.

[0035] Additionally or alternatively, the control unit 11 may calculate a score indicating the intimacy of the first user U1 with the second user U2 based on the distance or the amount of speech. The control unit 11 may set the predetermined value to be smaller as the score indicating the intimacy of the first user U1 with the second user U2 is higher, and may set the predetermined value to be larger as the score indicating the intimacy of the first user U1 with the second user U2 is lower. Similarly, the control unit 11 may calculate a score indicating the intimacy of the second user U2 with the first user U1 based on the distance or the amount of speech. The control unit 11 may set the predetermined value to be smaller as the score indicating the intimacy of the second user U2 with the first user U1 is higher, and may set the predetermined value to be larger as the score indicating the intimacy of the second user U2 with the first user U1 is lower. The score indicating the intimacy may be a graded index such as "high, medium, low" or may be a continuous index such as 0% to 100%.

[0036] Step S130: The control unit 11 of the information processing device 10 places the second object O2 generated in step S110 at a position in the second virtual space that is separated from a predetermined reference position by the second virtual distance Lv2 adjusted in step S120. Similarly, the control unit 11 places the first object O1 generated in step S110 at a position in the first virtual space that is separated from a predetermined reference position by the first virtual distance Lv1 adjusted in step S120.

[0037] Here, the predetermined reference position may be a three-dimensional coordinate position in the second virtual space corresponding to the screen center position (0,0,0) of the first display 20 for the second object O2, and may be a three-dimensional coordinate position in the first virtual space corresponding to the screen center position (0,0,0) of the second display 40 for the first object O1. The coordinate system of the first real space is associated with the coordinate system of the second virtual space by a coordinate transformation predetermined by any method. The coordinate system of the second real space is associated with the coordinate system of the first virtual space by a coordinate transformation predetermined by any method.

[0038] Step S140: The control unit 11 of the information processing device 10 generates an image including a subject image of the second object O2 placed in step S130 by the second virtual camera placed in the second virtual space. Also, the control unit 11 generates an image including a subject image of the first object O1 placed in step S130 by the first virtual camera placed in the first virtual space.

[0039] Specifically, the control unit 11 of the information processing device 10 places a second virtual camera at a three-dimensional coordinate position (X1, Y1, Z1) in the second virtual space corresponding to, for example, the center position (x1, y1, z1) of the head of the first user U1 identified in step S100. Then, the control unit 11 generates (renders) an image including a subject image of a second object O2 existing within the field of view (imaging range) of the second virtual camera. Similarly, the control unit 11 places a first virtual camera at a three-dimensional coordinate position (X2, Y2, Z2) in the first virtual space corresponding to, for example, the center position (x2, y2, z2) of the head of the second user U2 identified in step S100. Then, the control unit 11 generates (renders) an image including a subject image of a first object O1 existing within the field of view (imaging range) of the first virtual camera.

[0040] Step S150: The control unit 11 of the information processing device 10 outputs an image including the subject image of the second object O2 generated in step S140 to the first display 20 arranged in the first real space. The control unit 11 also outputs an image including the subject image of the first object O1 generated in step S140 to the second display 40 arranged in the second real space.

[0041] Specifically, the control unit 11 of the information processing device 10 outputs an image including the subject image of the second object O2 generated in step S140 to the first display 20 arranged in the first real space via the communication unit 12. The control unit 11 also outputs an image including the subject image of the first object O1 generated in step S140 to the second display 40 arranged in the second real space via the communication unit 12. Note that the transmission method of the images from the information processing device 10 to the first display 20 and the second display 40 may each be a serial transmission method using HDMI (registered trademark).

[0042] As described above, the control unit 11 of the information processing device 10 according to this embodiment adjusts the second virtual distance Lv2 so that the sum of the first real distance Lr1 from the first display 20 arranged in the first real space to the first user U1 in the first real space and the second virtual distance Lv2 from a predetermined reference position in the second virtual space to the second object O2 in the second virtual space corresponding to the conversation partner of the first user U1 becomes a predetermined value. In addition, the control unit 11 of the information processing device 10 adjusts the first virtual distance Lv1 so that the sum of the second real distance Lr2 from the second display 40 arranged in the second real space to the second user U2 in the second real space and the first virtual distance Lv1 from a predetermined reference position in the first virtual space to the first object O1 in the first virtual space corresponding to the conversation partner of the second user U2 becomes a predetermined value.

[0043] According to this configuration, for example, when a first user U1 whose personal space is 1 m and a second user U2 whose personal space is 2 m hold a video conference, the second object O2 is displayed as being 1 m away from the first user U1. On the other hand, the first object O1 is displayed as being 2 m away from the second user U2. Therefore, the personal space of the first user U1 and the personal space of the second user U2 are protected. Therefore, the technology for reducing fatigue during video conferences can be improved.

[0044] Although the present disclosure has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each component or step can be rearranged so as not to be logically inconsistent, and multiple components or steps can be combined or divided into one.

[0045] As a modified example, the configuration and operation of the information processing device 10 may be distributed among multiple computers that can communicate with each other. For example, among the processes in the above-described embodiment, the process on the first user U1 side and the process on the second user U2 side may be distributed and executed among two computers that can communicate with each other.

[0046] As a modified example, the control unit 11 of the information processing device 10 may execute control to prevent the conversation partner from recognizing that the virtual distance has been adjusted. Specifically, the control unit 11 may not notify the first user U1 in step S150 that the distance (=Lr2+Lv1) between the second user U2 and the first object O1 recognized by the second user U2 is different from the distance (=Lr1+Lv2) between the first user U1 and the second object O2 recognized by the first user U1. Similarly, the control unit 11 may not notify the second user U2 in step S150 that the distance (=Lr1+Lv2) between the first user U1 and the second object O2 recognized by the first user U1 is different from the distance (=Lr2+Lv1) between the second user U2 and the first object O1 recognized by the second user U2.

[0047] As a modified example, the control unit 11 of the information processing device 10 may adjust the layout of the images displayed on the first display 20 and the second display 40, respectively, based on the score indicating the intimacy in the above-described embodiment. For example, the lower the score indicating the intimacy of the first user U1 to the second user U2, the closer the window in which the image including the subject image of the second object O2 is displayed may be positioned to the edge of the screen of the first display 20. Similarly, the lower the score indicating the intimacy of the second user U2 to the first user U1, the closer the window in which the image including the subject image of the first object O1 is displayed may be positioned to the edge of the screen of the second display 40.

[0048] In addition, as a variant example, the control unit 11 of the information processing device 10 may adjust the virtual distance for either the first user U1 or the second user U2 in the same manner as in step S120 described above, and may not adjust the virtual distance for the other user.

[0049] As a modified example, an embodiment is also possible in which a general-purpose computer functions as the information processing device 10 according to the above-described embodiment. Specifically, a program describing the processing contents for realizing each function of the information processing device 10 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor, or a non-transitory computer-readable medium that stores the program. [Explanation of symbols]

[0050] 1 System 10. Information processing device 11 Control section 12 Communications Department 13 Storage section 20 First Display 30 First Camera 40 Second Display 50 Second Camera 60 Network

Claims

1. An information processing device comprising: a control unit that adjusts a virtual distance so that a sum of a real distance from a display disposed in a real space to a user in the real space and a virtual distance from a predetermined reference position in a virtual space to an object in the virtual space corresponding to a conversation partner of the user becomes a predetermined value; The control unit calculates the predetermined value based on an amount of speech by the user to the conversation partner.

2. 2. The information processing device according to claim 1, The control unit calculates the predetermined value based on a distance secured between the user and the conversation partner.

3. 3. The information processing device according to claim 1, The control unit executes control to prevent the conversation partner from recognizing that the virtual distance has been adjusted.

4. A method executed by an information processing device, comprising: adjusting the virtual distance so that a sum of a real distance from a display disposed in a real space to a user in the real space and a virtual distance from a predetermined reference position in a virtual space to an object in the virtual space corresponding to a conversation partner of the user becomes a predetermined value; calculating the predetermined value based on an amount of speech by the user to the conversation partner; A method comprising:

5. On the computer, adjusting the virtual distance so that a sum of a real distance from a display disposed in a real space to a user in the real space and a virtual distance from a predetermined reference position in a virtual space to an object in the virtual space corresponding to a conversation partner of the user becomes a predetermined value; calculating the predetermined value based on an amount of speech by the user to the conversation partner; A program to execute.

Images