Terminal device and program

Abstract

To make a user easily have a feeling of being present in a same space as a partner.SOLUTION: A terminal device displays a user image 60 that is an image of a first user, for a second user who is present in a second space different from a first space where the first user is present. The terminal device includes a control unit that displays a first image 61 that is an image of a desk or floor, together with the user image 60 on a vertical display surface 47 extending in a vertical direction; displays a second image 62 that is an image contiguous to the first image 61, on a horizontal display surface 48 adjacent to a lower end of the vertical display surface 47 and extending in a horizontal direction; and when displaying the first image 61 and the second image 62, draws a pattern of the first image 61 and a pattern of the second image 62 as patterns that are contiguous to each other.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to a terminal device, a program, and an image display method. [Background technology]

[0002] In the system disclosed in Patent Document 1, first, an image of the hand of the user's interlocutor is displayed on a display on the user's side. Next, the image is switched to an image from a video camera installed behind the display. When the user reaches his / her hand behind the display, an image of the user's hand is displayed on the display through the video camera. After that, a robotic hand that is formed to resemble the part of the interlocutor's arm from the hand to the elbow and installed under the display moves and enters the field of view of the video camera. When the user reaches his / her hand further to shake hands with the robotic hand, an image of the user shaking hands with the robotic hand is displayed on the display through the video camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-218830 A Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional systems attempt to create the illusion that the user is in the same space as the other person by placing a robot hand under the display or by switching the image displayed on the display, but it is unclear whether the user actually experiences this illusion. Moreover, conventional systems have many restrictions, such as the need to place a robot hand or switch images, and have low flexibility in application.

[0005] The objective of the present disclosure is to make it easier for users to feel as if they are in the same space as the other person. [Means for solving the problem]

[0006] A terminal device according to the present disclosure includes: A terminal device that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, The display device includes a control unit that displays a first image, which is an image of a desk or floor, together with the user image on a vertical display surface extending vertically, and displays a second image, which is an image continuous with the first image, on a horizontal display surface adjacent to the bottom end of the vertical display surface and extending horizontally, and draws the pattern of the first image and the pattern of the second image as patterns continuous with each other when displaying the first image and the second image.

[0007] The program according to the present disclosure is A computer that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, Displaying a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction; displaying a second image, which is an image consecutive to the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction; When displaying the first image and the second image, a pattern of the first image and a pattern of the second image are drawn as patterns continuous with each other. The method executes an operation including:

[0008] The image display method according to the present disclosure includes: 1. An image display method for displaying a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, comprising: Displaying a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction; displaying a second image, which is an image consecutive to the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction; When displaying the first image and the second image, a pattern of the first image and a pattern of the second image are drawn as patterns continuous with each other. Includes. Effect of the Invention

[0009] According to the present disclosure, it becomes easier for a user to have the feeling that he or she is in the same space as the other person. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a configuration of a communication system according to an embodiment of the present disclosure. [Diagram 2] 1A to 1C are diagrams illustrating examples of image display on a vertical display surface and a horizontal display surface according to an embodiment of the present disclosure. [Diagram 3] 1A to 1C are diagrams illustrating examples of image display on a vertical display surface and a horizontal display surface according to an embodiment of the present disclosure. [Figure 4] 1A to 1C are diagrams illustrating examples of image display on a vertical display surface and a horizontal display surface according to an embodiment of the present disclosure. [Diagram 5] 1A to 1C are diagrams illustrating examples of image display on a vertical display surface and a horizontal display surface according to an embodiment of the present disclosure. [Figure 6] 10 is a flowchart illustrating an operation of a terminal device according to an embodiment of the present disclosure. [Figure 7] 7 is a flowchart showing the procedure of a process executed when the first image and the second image are displayed in step S102 of FIG. 6. [Figure 8] 13 is a flowchart illustrating a modified example of the operation of the terminal device according to the embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.

[0012] In each drawing, the same or corresponding parts are denoted by the same reference numerals. In the description of this embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate.

[0013] The configuration of a communication system 10 according to this embodiment will be described with reference to FIG.

[0014] The communication system 10 includes a server device 20, a first terminal device 30, and a second terminal device 40. The server device 20 is capable of communicating with the first terminal device 30 and the second terminal device 40 via a network 50. The first terminal device 30 may be capable of communicating with the second terminal device 40 via the network 50.

[0015] The server device 20 is installed in a facility such as a data center and operated by a service provider. The server device 20 is a server computer that belongs to a cloud computing system or other computing system.

[0016] The first terminal device 30 is installed in the first space V1 where the first user U1 is located, and is used by the first user U1. The first terminal device 30 is, for example, a general-purpose computer such as a PC, or a dedicated computer specialized for a specific calculation. "PC" is an abbreviation for personal computer.

[0017] The second terminal device 40 is installed in a second space V2 separate from the first space V1 in which the second user U2 is present, and is used by the second user U2. The second terminal device 40 is, for example, a general-purpose computer such as a PC, or a dedicated computer specialized for a specific calculation.

[0018] Network 50 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. Network 50 may include at least one wireless network, at least one optical network, or any combination thereof. A wireless network may be, for example, an ad-hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0019] The present embodiment will be outlined with reference to FIG. 1 and FIG.

[0020] The second terminal device 40 is a terminal device that displays a user image 60 toward a second user U2. The user image 60 is an image of the first user U1. The second terminal device 40 displays a first image 61 together with the user image 60 on a vertical display surface 47 that extends in the vertical direction. The first image 61 is an image of a desk or a floor. The second terminal device 40 displays a second image 62 on a horizontal display surface 48 that is adjacent to the lower end of the vertical display surface 47 and extends in the horizontal direction. The second image 62 is an image that is continuous with the first image 61. When displaying the first image 61 and the second image 62, the second terminal device 40 draws the pattern of the first image 61 and the pattern of the second image 62 as patterns that are continuous with each other.

[0021] In this embodiment, the second user U2 is easily misled as if he or she were sharing the same desk or room with the other user because the pattern of the other user's desk or floor and the pattern of the user's desk or floor are continuous. Therefore, according to this embodiment, the second user U2 is easily made to feel as if he or she is in the same space as the first user U1. Moreover, this embodiment has fewer constraints than conventional systems, so it has a high degree of freedom in application. For example, this embodiment can be applied to general-purpose applications for online communication using video, such as web conferencing applications. As a result, when users in different spaces communicate with each other, they are more likely to feel as if they are in the same space as the other user.

[0022] In this embodiment, when the second terminal device 40 displays the first image 61 and the second image 62, it draws a shadow 63 of the first user U1 reflected on a desk or floor in the first image 61, and draws an extension 64 of the shadow 63 in the second image 62.

[0023] In this embodiment, the second user U2 sees the shadow 63 of the other person reflected on the desk or floor as if it is extending toward the second user U2, which makes the second user U2 feel as if he or she is sharing the same desk or room with the other person. Therefore, this embodiment makes it easier for the second user U2 to have the feeling that he or she is in the same space as the first user U1.

[0024] In the example of FIG. 2, a display 46 having an L-shape in a side view and a vertical display surface 47 and a horizontal display surface 48 is used. The display 46 is, for example, an LCD or an organic EL. "LCD" is an abbreviation of liquid crystal display. "EL" is an abbreviation of electro luminescent. On the vertical display surface 47, an image of a virtual three-dimensional space including an avatar of the other party as a user image 60 and an object of a desk placed in front of the avatar of the other party as a first image 61 is displayed. A pattern such as wood grain is drawn on the top surface of the desk. On the horizontal display surface 48, an image of the top surface of a desk that is continuous with the desk displayed on the vertical display surface 47 is displayed as a second image 62. In this image, a pattern that is continuous with the pattern of the top surface of the desk displayed on the vertical display surface 47 is drawn. On the top surface of the desk displayed on the vertical display surface 47, a shadow 63 of the other party is displayed. On the top surface of the desk displayed on the horizontal display surface 48, an extension 64 of the shadow 63 of the other party is displayed.

[0025] Instead of the desk pattern, a floor pattern may be drawn so as to be continuous. In such a modified example, an image of a virtual three-dimensional space including the other party's avatar as a user image 60 and an object of the floor on which the other party's avatar is standing as a first image 61 is displayed on the vertical display surface 47. A pattern such as the grain of the flooring boards or the way the boards are laid is drawn on the surface of the floor. An image of the floor surface that is continuous with the floor displayed on the vertical display surface 47 is displayed on the horizontal display surface 48 as a second image 62. A pattern that is continuous with the pattern of the floor surface displayed on the vertical display surface 47 is drawn on this image. A shadow 63 of the other party is displayed on the surface of the floor displayed on the vertical display surface 47. An extension 64 of the shadow 63 of the other party is displayed on the surface of the floor displayed on the horizontal display surface 48.

[0026] A projector may be used instead of the display 46. In such a modification, an image of a virtual three-dimensional space including a user image 60 and a first image 61 is projected onto a vertical screen or wall as a vertical display surface 47. A second image 62 is projected onto a horizontal screen, a desk, or a floor as a horizontal display surface 48.

[0027] As a modified example of this embodiment, as shown in Fig. 3, the second terminal device 40 may further display an image 65 of an object placed on a desk or a floor on the vertical display surface 47. As shown in Fig. 4 and Fig. 5, the second terminal device 40 may move the image 65 of the object from the vertical display surface 47 to the horizontal display surface 48 in response to an operation by the first user U1 to slide the object in front of the first user U1.

[0028] According to this modification, it becomes possible to hand over an object such as a note on a desk or on the floor.

[0029] In the example of FIG. 3, an object such as paper is additionally displayed on the top surface of the desk displayed on the vertical display surface 47 at the position where the left hand of the avatar of the first user U1 is placed. The first user U1 can write letters or draw pictures on this object. When the first user U1 slides the object forward with his / her left hand, the object moves from the vertical display surface 47 to the horizontal display surface 48 as in the example of FIG. 4. In the example of FIG. 5, the object is displayed on the top surface of the desk displayed on the horizontal display surface 48.

[0030] Instead of the top surface of the desk, an object may be displayed on the surface of the floor. In such a modified example, an object is additionally displayed on the surface of the floor displayed on the vertical display surface 47. When the first user U1 slides the object forward with his / her hand or foot, the object moves from the vertical display surface 47 to the horizontal display surface 48. As a result, the object is displayed on the surface of the floor displayed on the horizontal display surface 48.

[0031] The configuration of a first terminal device 30 according to this embodiment will be described with reference to FIG.

[0032] The first terminal device 30 includes a control unit 31, a storage unit 32, a communication unit 33, an input unit , and an output unit .

[0033] The control unit 31 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for a specific process. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. The control unit 31 executes processes related to the operation of the first terminal device 30 while controlling each part of the first terminal device 30.

[0034] The storage unit 32 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM, a ROM, or a flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. The RAM is, for example, an SRAM or a DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. The ROM is, for example, an EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The flash memory is, for example, an SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, an HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 32 functions, for example, as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 32 stores data used in the operation of the first terminal device 30 and data obtained by the operation of the first terminal device 30.

[0035] The communication unit 33 includes at least one communication interface. The communication interface is, for example, an interface compatible with a wired LAN communication standard such as Ethernet (registered trademark), a wireless LAN communication standard such as IEEE802.11, or an interface compatible with a mobile communication standard such as LTE, 4G standard, or 5G standard. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. The communication unit 33 communicates with the server device 20. The communication unit 33 may also communicate with the second terminal device 40. The communication unit 33 receives data used in the operation of the first terminal device 30, and transmits data obtained by the operation of the first terminal device 30.

[0036] The input unit 34 includes at least one input interface. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen integral with a display, a camera, LiDAR, or a microphone. "LiDAR" is an abbreviation for light detection and ranging. The input unit 34 accepts an operation to input data used for the operation of the first terminal device 30. The input unit 34 may be connected to the first terminal device 30 as an external input device instead of being provided in the first terminal device 30. As the connection interface, an interface compatible with a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0037] The output unit 35 includes at least one output interface. The output interface is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. The output unit 35 outputs data obtained by the operation of the first terminal device 30. The output unit 35 may be connected to the first terminal device 30 as an external output device instead of being provided in the first terminal device 30. As the connection interface, an interface compatible with standards such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0038] The functions of the first terminal device 30 are realized by executing a program according to this embodiment on a processor serving as the control unit 31. That is, the functions of the first terminal device 30 are realized by software. The program causes a computer to execute the operations of the first terminal device 30, thereby causing the computer to function as the first terminal device 30. That is, the computer functions as the first terminal device 30 by executing the operations of the first terminal device 30 in accordance with the program.

[0039] The program may be stored in a non-transitory computer-readable medium. Examples of the non-transitory computer-readable medium include a flash memory, a magnetic recording device, an optical disk, a magneto-optical recording medium, or a ROM. The program may be distributed, for example, by selling, transferring, or lending a portable medium such as an SD card, DVD, or CD-ROM on which the program is stored. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program may be distributed by storing the program in the storage of a server and transferring the program from the server to another computer. The program may be provided as a program product.

[0040] A computer temporarily stores in a main storage device, for example, a program stored in a portable medium or a program transferred from a server. Then, the computer reads the program stored in the main storage device with a processor, and executes processing according to the read program with the processor. The computer may read the program directly from a portable medium and execute processing according to the program. The computer may execute processing according to the received program each time a program is transferred from the server to the computer. Processing may be executed by a so-called ASP-type service that realizes functions only by execution instructions and result acquisition without transferring a program from the server to the computer. "ASP" is an abbreviation for application service provider. A program is information used for processing by a computer, and includes those equivalent to a program. For example, data that is not a direct command to a computer but has the property of defining computer processing falls under "those equivalent to a program."

[0041] A part or all of the functions of the first terminal device 30 may be realized by a programmable circuit or a dedicated circuit as the control unit 31. In other words, a part or all of the functions of the first terminal device 30 may be realized by hardware.

[0042] The configuration of a second terminal device 40 according to this embodiment will be described with reference to FIG.

[0043] The second terminal device 40 includes a control unit 41, a storage unit 42, a communication unit 43, an input unit 44, and an output unit 45.

[0044] The control unit 41 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or a GPU, or a dedicated processor specialized for a specific process. The programmable circuit is, for example, an FPGA. The dedicated circuit is, for example, an ASIC. The control unit 41 executes processes related to the operation of the second terminal device 40 while controlling each part of the second terminal device 40.

[0045] The storage unit 42 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM, a ROM, or a flash memory. The RAM is, for example, an SRAM or a DRAM. The ROM is, for example, an EEPROM. The flash memory is, for example, an SSD. The magnetic memory is, for example, an HDD. The storage unit 42 functions, for example, as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 42 stores data used in the operation of the second terminal device 40 and data obtained by the operation of the second terminal device 40.

[0046] The communication unit 43 includes at least one communication interface. The communication interface is, for example, an interface compatible with a wired LAN communication standard such as Ethernet (registered trademark), a wireless LAN communication standard such as IEEE802.11, or a mobile communication standard such as LTE, 4G, or 5G. The communication unit 43 communicates with the server device 20. The communication unit 43 may also communicate with the first terminal device 30. The communication unit 43 receives data used in the operation of the second terminal device 40, and transmits data obtained by the operation of the second terminal device 40.

[0047] The input unit 44 includes at least one input interface. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen integrally provided with the display 46, a camera, a LiDAR, or a microphone. The input unit 44 accepts an operation for inputting data used for the operation of the second terminal device 40. The input unit 44 may be connected to the second terminal device 40 as an external input device instead of being provided in the second terminal device 40. As the connection interface, an interface compatible with a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0048] The output unit 45 includes at least one output interface. The output interface is, for example, a display 46 or a speaker. The output unit 45 outputs data obtained by the operation of the second terminal device 40. The output unit 45 may be connected to the second terminal device 40 as an external output device instead of being provided in the second terminal device 40. As the connection interface, an interface compatible with standards such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0049] The functions of the second terminal device 40 are realized by executing another program according to this embodiment on a processor serving as the control unit 41. That is, the functions of the second terminal device 40 are realized by software. The program causes a computer to execute the operations of the second terminal device 40, thereby causing the computer to function as the second terminal device 40. That is, the computer functions as the second terminal device 40 by executing the operations of the second terminal device 40 in accordance with the program.

[0050] A part or all of the functions of the second terminal device 40 may be realized by a programmable circuit or a dedicated circuit as the control unit 41. In other words, a part or all of the functions of the second terminal device 40 may be realized by hardware.

[0051] The operation of the second terminal device 40 according to the present embodiment will be described with reference to Fig. 6. This operation corresponds to the image display method according to the present embodiment.

[0052] The processes of steps S101 and S102 are repeatedly executed while the first user U1 and the second user U2 are using the first terminal device 30 and the second terminal device 40, respectively, to carry out video communication such as a web conference.

[0053] In step S101, the control unit 41 of the second terminal device 40 receives first data D1 including a user image 60 and a first image 61 from the server device 20 via the communication unit 43, and transmits an image of the second user U2 to the server device 20 via the communication unit 43. The user image 60 is an image of the first user U1. The first image 61 is an image of a desk or a floor. The first data D1 may further include the voice of the first user U1. The control unit 41 may further transmit the voice of the second user U2 to the server device 20 via the communication unit 43. The process of step S101 is specifically performed in the following procedure.

[0054] The control unit 31 of the first terminal device 30 takes an image of the first user U1 using a camera serving as the input unit 34. The control unit 31 transmits the captured image to the server device 20 via the communication unit 33. The control unit 31 may obtain the voice of the first user U1 via a microphone serving as the input unit 34, and may further transmit the obtained voice to the server device 20 via the communication unit 33. The server device 20 receives an image of the first user U1 from the first terminal device 30 via the network 50. The server device 20 generates a user image 60 by appropriately processing the received image. In the example of FIG. 2, the server device 20 uses the received image to generate an avatar of the first user U1 existing in a virtual three-dimensional space as the user image 60. As another example, the server device 20 may use the received image as it is as the user image 60. The server device 20 further generates a first image 61. In the example of FIG. 2, the server device 20 generates, as the first image 61, an object of a desk placed in front of the avatar of the first user U1 in the virtual three-dimensional space. As another example, the server device 20 may generate, as the first image 61, an image of a desk that appears to be placed in front of the first user U1 by being superimposed on the user image 60. The server device 20 transmits the generated user image 60 and first image 61 as first data D1 to the second terminal device 40 via the network 50. When the server device 20 receives the voice of the first user U1 from the first terminal device 30, the server device 20 may include the received voice in the first data D1. The control unit 41 of the second terminal device 40 receives the first data D1 from the server device 20 via the communication unit 43.

[0055] The control unit 41 of the second terminal device 40 takes an image of the second user U2 using a camera serving as the input unit 44. The control unit 41 transmits the captured image to the server device 20 via the communication unit 43. The control unit 41 may obtain the voice of the second user U2 via a microphone serving as the input unit 44, and may further transmit the obtained voice to the server device 20 via the communication unit 43. The server device 20 receives an image of the second user U2 from the second terminal device 40 via the network 50. The server device 20 appropriately processes the received image to generate an image similar to the user image 60. The server device 20 further generates an image similar to the first image 61. The server device 20 transmits second data D2 including the generated image to the first terminal device 30 via the network 50. When the server device 20 receives the voice of the second user U2 from the second terminal device 40, the server device 20 may include the received voice in the second data D2. The control unit 31 of the first terminal device 30 receives the second data D2 from the server device 20 via the communication unit 33.

[0056] In step S102, the control unit 41 of the second terminal device 40 displays the user image 60 and the first image 61 included in the first data D1 received in step S101 on the vertical display surface 47 of the display 46 serving as the output unit 45, and displays the second image 62 on the horizontal display surface 48 of the display 46. The second image 62 is an image continuous with the first image 61. If the first data D1 includes the voice of the first user U1, the control unit 41 outputs the voice of the first user U1 from the speaker serving as the output unit 45.

[0057] The procedure of the process executed when the first image 61 and the second image 62 are displayed in step S102 will be described with reference to FIG.

[0058] In step S201, the control unit 41 of the second terminal device 40 draws the pattern of the first image 61 and the pattern of the second image 62 as a pattern that is continuous with each other. In the example of FIG. 2, when the control unit 41 displays, as the first image 61, an object of a desk placed in front of the avatar of the first user U1 in the virtual three-dimensional space on the vertical display surface 47, the control unit 41 draws a pattern such as a wood grain on the top surface of the desk. When the control unit 41 displays, as the second image 62, an image of the top surface of the desk that is continuous with the pattern of the top surface of the desk displayed on the vertical display surface 47 on the horizontal display surface 48, the control unit 41 draws, on the image, a pattern that is continuous with the pattern of the top surface of the desk displayed on the vertical display surface 47. As another example, when the first data D1 includes an image taken by the first terminal device 30 as the user image 60 as it is, the control unit 41 may draw a pattern such as a wood grain on the top surface of the desk when displaying, as the first image 61, an image of a desk that appears to be placed in front of the first user U1 by overlapping the user image 60 on the vertical display surface 47. When displaying, as the second image 62, an image of the top surface of a desk that is continuous with the desk displayed on the vertical display surface 47 on the horizontal display surface 48, the control unit 41 may draw, on that image, a pattern that is continuous with the pattern of the top surface of the desk displayed on the vertical display surface 47. The patterns of the first image 61 and the second image 62 may be set and drawn independently by the control unit 41 so as to be continuous with each other, or may be set by the server device 20 so as to be continuous with each other and drawn by the control unit 41 according to this setting. The second image 62 may be generated independently by the control unit 41, or may be generated by the server device 20 and received by the control unit 41 from the server device 20 via the communication unit 43 in step S101.

[0059] In step S202, the control unit 41 of the second terminal device 40 draws a shadow 63 of the first user U1 reflected on the desk or floor in the first image 61, and draws an extension 64 of the shadow 63 in the second image 62. In the example of FIG. 2, when the control unit 41 displays a desk object placed in front of the avatar of the first user U1 on the vertical display surface 47, the control unit 41 calculates the shape, size, and orientation of the shadow 63 and its extension 64 from the positional relationship of the light source, the avatar of the first user U1, and the desk object in the virtual three-dimensional space. Then, the control unit 41 draws the shadow 63 and its extension 64 on the top surface of the desk displayed on the vertical display surface 47 and the horizontal display surface 48 so that the shadow 63 and its extension 64 have the calculated shape, size, and orientation, respectively. The shape, size, and orientation of the shadow 63 and its extension 64 may be calculated by the server device 20 instead of being calculated by the control unit 41 independently. As another example, when the first data D1 includes an image captured by the first terminal device 30 as the user image 60, the control unit 41 may draw a shadow 63 and its extension 64 on the top surface of a desk to be displayed on the vertical display surface 47 and the horizontal display surface 48 so that the shadow 63 and its extension 64 each have a predetermined shape, size, and orientation.

[0060] In the first terminal device 30, when the second data D2 is received from the server device 20, a process similar to that of step S102 is executed. That is, the control unit 31 of the first terminal device 30 displays an image included in the received second data D2 on a vertical display surface of a display that is L-shaped in a side view as the output unit 35, and also displays an image similar to the second image 62 on a horizontal display surface of the display. When the second data D2 includes the voice of the second user U2, the control unit 31 outputs the voice of the second user U2 from a speaker as the output unit 35.

[0061] A modified example of the operation of the second terminal device 40 according to the present embodiment will be described with reference to FIG.

[0062] The processing from step S111 to step S113 is repeatedly executed while the first user U1 and the second user U2 are using the first terminal device 30 and the second terminal device 40, respectively, to communicate using video, such as a web conference.

[0063] The process of step S111 is the same as the process of step S101 in FIG. 6, except that the first data D1 further includes an image 65 of an object placed on a desk or a floor.

[0064] The control unit 31 of the first terminal device 30 displays an image of a desk or a floor on the horizontal display surface of the L-shaped display in a side view as the output unit 35 as an image similar to the second image 62. When the control unit 31 accepts an operation to add an object onto the desk or the floor via the input unit 34, the control unit 31 further displays an image 65 of the object on the horizontal display surface. In the example of FIG. 3, the control unit 31 additionally displays an object such as a paper at a position on the horizontal display surface where the actual left hand of the first user U1 is placed. The control unit 31 may accept an operation to write a character or draw a picture on the object via a touch screen as the input unit 34. The control unit 31 transmits the image 65 of the object displayed on the horizontal display surface to the server device 20 via the communication unit 33 together with meta information indicating the display position. The server device 20 receives the image 65 of the object and the meta information from the first terminal device 30 via the network 50. The server device 20 appropriately processes the received image 65, includes it in the first data D1 together with the received meta-information, and transmits it to the second terminal device 40 via the network 50.

[0065] The process of step S112 is the same as the process of step S102 in FIG. 6, and therefore the description thereof will be omitted.

[0066] In step S113, the control unit 41 of the second terminal device 40 further displays an image 65 of an object placed on a desk or floor, which is included in the first data D1 received in step S111, on the vertical display surface 47 of the display 46. The control unit 41 sets the display position of the image 65 on the vertical display surface 47 by referring to the meta information included in the first data D1. In the example of Fig. 3, the control unit 41 additionally displays an object such as a piece of paper on the top surface of the desk displayed on the vertical display surface 47 at the position where the left hand of the avatar of the first user U1 is placed.

[0067] In this modified example, the control unit 41 of the second terminal device 40 may move the image 65 of the object from the vertical display surface 47 to the horizontal display surface 48 in response to an operation of the first user U1 sliding an object placed on a desk or floor in front of the first user U1. In the example of FIG. 4 and FIG. 5, when the control unit 31 of the first terminal device 30 accepts an operation of the first user U1 sliding an object such as a paper in front of the first user U1 with his / her left hand via the touch screen as the input unit 34, the control unit 31 gradually changes the display position of the object in response to the operation, and transmits the image 65 of the object together with meta information indicating the changed display position to the server device 20 via the communication unit 33. Each time the server device 20 receives the image 65 and meta information of the object from the first terminal device 30 via the network 50, the server device 20 appropriately processes the received image 65, includes it in the first data D1 together with the received meta information, and transmits it to the second terminal device 40 via the network 50. Each time the control unit 41 of the second terminal device 40 receives the first data D1 in step S111, the control unit 41 displays the image 65 included in the received first data D1 on the vertical display surface 47, the horizontal display surface 48, or both of the display 46. The control unit 41 sets the display position of the image 65 on the vertical display surface 47, the horizontal display surface 48, or both, by referring to the meta information included in the first data D1. In the example of FIG. 4, the control unit 41 displays a paper-like object on the boundary between the top surface of the desk displayed on the vertical display surface 47 and the top surface of the desk displayed on the horizontal display surface 48. In the example of FIG. 5, the control unit 41 displays a paper-like object on the top surface of the desk displayed on the horizontal display surface 48.

[0068] The operations of the first terminal device 30 and the second terminal device 40 may be reversed. That is, when the control unit 41 of the second terminal device 40 receives an operation to add an object onto the desk or floor via the input unit 44 while the second image 62 is being displayed on the horizontal display surface 48 of the display 46, the control unit 41 may further display an image of the object on the horizontal display surface 48. In response to an operation by the second user U2 to slide the object in front of the second user U2, the control unit 41 may move the image of the object from the horizontal display surface 48 to the vertical display surface 47.

[0069] As a modified example of this embodiment, the control unit 41 of the second terminal device 40 may display the user image 60 on the vertical display surface 47 by setting an offset so that the first user U1 appears closer to the second user U2 than in reality, and when the first user U1 extends his / her hand forward, an image of the hand of the first user U1 may be displayed on the horizontal display surface 48 of the display 46 so that the hand appears to be floating above the horizontal display surface 48. Any conventional method may be used as a method for giving the second user U2 the illusion that the hand appears to be floating.

[0070] Some of the embodiments of the present disclosure will be described below as examples. However, it should be noted that the embodiments of the present disclosure are not limited to these examples. [Appendix 1] A terminal device that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, A terminal device having a control unit that displays a first image, which is an image of a desk or floor, together with the user image on a vertical display surface extending vertically, and displays a second image, which is an image continuous with the first image, on a horizontal display surface adjacent to the bottom end of the vertical display surface and extending horizontally, and when displaying the first image and the second image, draws the pattern of the first image and the pattern of the second image as patterns that are continuous with each other. [Appendix 2] The terminal device described in Appendix 1, wherein, when displaying the first image and the second image, the control unit draws a shadow of the first user reflected on the desk or the floor in the first image and draws an extension of the shadow in the second image. [Appendix 3] The control unit further displays an image of an object placed on the desk or the floor on the vertical display surface, and moves the image of the object from the vertical display surface to the horizontal display surface in response to an operation by the first user to slide the object in front of the first user. [Appendix 4] The control unit further displays an image of an object on the horizontal display surface, and moves the image of the object from the horizontal display surface to the vertical display surface in response to an operation by the second user to slide the object in front of the second user. [Appendix 5] the user image includes an avatar of the first user existing in a virtual three-dimensional space; The terminal device according to any one of Supplementary Note 1 to Supplementary Note 4, wherein the first image includes a desk object placed in front of the first user's avatar in the virtual three-dimensional space, or a floor object on which the first user's avatar is standing in the virtual three-dimensional space. [Appendix 6] 6. The terminal device according to claim 1, further comprising an L-shaped display in a side view having the vertical display surface and the horizontal display surface. [Appendix 7] A computer that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, Displaying a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction; displaying a second image, which is an image consecutive to the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction; When displaying the first image and the second image, a pattern of the first image and a pattern of the second image are drawn as patterns continuous with each other. A program that causes an operation to be performed, including [Appendix 8] 1. An image display method for displaying a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, comprising: Displaying a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction; displaying a second image, which is an image consecutive to the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction; When displaying the first image and the second image, a pattern of the first image and a pattern of the second image are drawn as patterns continuous with each other. An image display method comprising:

[0071] The present disclosure is not limited to the above-mentioned embodiment. For example, two or more blocks shown in the block diagram may be integrated, or one block may be divided. Instead of executing two or more steps shown in the flowchart in chronological order as described, they may be executed in parallel or in a different order depending on the processing capacity of the device executing each step, or as necessary. Other modifications are possible without departing from the spirit of the present disclosure. [Explanation of symbols]

[0072] 10. Communication Systems 20 Server device 30 First terminal device 31 Control Unit 32 Storage section 33 Communications Department 34 Input section 35 Output section 40 Second terminal device 41 Control section 42 Storage section 43 Communications Department 44 Input section 45 Output section 46 Display 47 Vertical display surface 48 Horizontal display surface 50 Network 60 User Images 61 1st image 62 2nd image 63 Shadow 64 Extension part 65 images

Claims

1. A terminal device that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, a control unit that displays a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction, and displays a second image, which is an image continuous with the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction, and draws a pattern of the first image and a pattern of the second image as patterns continuous with each other when displaying the first image and the second image; The control unit of the terminal device, when displaying the first image and the second image, draws the shadow of the first user reflected on the desk or the floor in the first image and draws an extension of the shadow in the second image.

2. A terminal device that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, a control unit that displays a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction, and displays a second image, which is an image continuous with the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction, and draws a pattern of the first image and a pattern of the second image as patterns continuous with each other when displaying the first image and the second image; The control unit of the terminal device further displays an image of an object placed on the desk or the floor on the vertical display surface, adds characters or pictures to the image of the object in response to the first user's operation of writing characters or drawing a picture on the object, and moves the image of the object with the characters or pictures added from the vertical display surface to the horizontal display surface in response to the first user's operation of sliding the object in front of the first user.

3. A terminal device that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, a control unit that displays a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction, and displays a second image, which is an image continuous with the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction, and draws a pattern of the first image and a pattern of the second image as patterns continuous with each other when displaying the first image and the second image; The control unit displays the user image on the vertical display surface by setting an offset so that the first user appears closer to the second user than in reality, and when the first user extends his / her hand forward, the control unit displays an image of the first user's hand on the horizontal display surface so that the hand appears to protrude from the horizontal display surface.

4. The terminal device according to claim 1 , further comprising a display having an L-shape in a side view and having the vertical display surface and the horizontal display surface.

5. A computer that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, Displaying a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction; displaying a second image, which is an image consecutive to the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction; When displaying the first image and the second image, a pattern of the first image and a pattern of the second image are drawn as patterns continuous with each other; When displaying the first image and the second image, a shadow of the first user reflected on the desk or the floor is drawn on the first image, and an extension of the shadow is drawn on the second image. A program that causes an operation to be performed, including

6. A computer that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, Displaying a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction; displaying a second image, which is an image consecutive to the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction; When displaying the first image and the second image, a pattern of the first image and a pattern of the second image are drawn as patterns continuous with each other; further displaying an image of an object placed on the desk or the floor on the vertical display surface; Adding characters or pictures to an image of the object in response to an operation of the first user writing characters or drawing a picture on the object; moving an image of the object to which the character or the picture has been added from the vertical display surface to the horizontal display surface in response to an operation by the first user of sliding the object in front of the first user; A program that causes an operation to be performed, including

7. A computer that displays a user image, which is an image of a first user, to a second user in a second space separate from a first space in which the first user is present, Displaying a first image, which is an image of a desk or a floor, together with the user image on a vertical display surface extending in a vertical direction; displaying a second image, which is an image consecutive to the first image, on a horizontal display surface adjacent to a lower end of the vertical display surface and extending in a horizontal direction; When displaying the first image and the second image, a pattern of the first image and a pattern of the second image are drawn as patterns continuous with each other; displaying the user image on the vertical display surface by setting an offset so that the first user appears closer to the second user than in reality, and when the first user extends his / her hand forward, displaying an image of the hand of the first user on the horizontal display surface so that the hand appears to protrude from the horizontal display surface; A program that causes an operation to be performed, including

Images