Terminal device

Abstract

To improve reality and convenience in virtual face-to-face communication.SOLUTION: A terminal device includes a communication unit, a display unit, an input unit having a touch panel overlapped on the display unit, an imaging unit for imaging a user, and a control unit that performs communication by the communication unit. The control unit receives, from another terminal device, information for generating a model image representing another user based on a captured image of the other user taken using the other terminal device, and information on a drawn image drawn by the other user on the touch panel of the other terminal device, and causes the display unit to display an image for display in which the model image with the left and right sides reversed and the drawn image with the left and right sides reversed are superimposed on each other.SELECTED DRAWING: Figure 4B

Description

Technical Field

[0001] The present disclosure relates to a terminal device.

Background Art

[0002] There is known a technique in which users of computers connected via a network send and receive each other's images and voices to make a call. For example, Patent Document 1 discloses a video display system that generates a three-dimensional video of a user from a video of the user captured by a camera and displays the three-dimensional video of a conversation partner located at a remote location on a display on the interlocutor side.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a technique in which users send and receive each other's images and voices to perform virtual face-to-face communication, there is room for improving the reality of communication and the convenience of users.

[0005] The present disclosure provides a terminal device and the like that enable improvement in reality and convenience in virtual face-to-face communication.

Means for Solving the Problems

[0006] The terminal device in the present disclosure is a terminal device having a communication unit, a display unit, an input unit having a touch panel superimposed on the display unit, an imaging unit for imaging a user, and a control unit that communicates via the communication unit. The control unit receives, from the other terminal device, information for generating a model image representing the other user based on an imaging image of the other user using the other terminal device, and information on a drawn image drawn by the other user on the touch panel of the other terminal device, and causes the display unit to display a display image in which the model image with left and right reversed and the drawn image with left and right reversed are superimposed on each other.

Effect of the Invention

[0007] According to the terminal device and the like in the present disclosure, it is possible to improve the reality and convenience in virtual face-to-face communication.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2A

Figure 2B

Figure 3

Figure 4A

Figure 4B

Figure 5A

Figure 5B

Figure 6A

Figure 6B

Figure 6C

Figure 6D

Best Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described.

[0010] FIG. 1 is a diagram showing a configuration example of a call system 1 in one embodiment. The call system 1 includes a server device 10 and a plurality of terminal devices 12 that are connected to each other via a network 11 so as to be able to communicate information. The call system 1 is a system that enables users to send and receive images, voices, etc. using the terminal device 12 and perform virtual face-to-face communication (hereinafter referred to as virtual face-to-face communication) with each other.

[0011] The server device 10 belongs to, for example, a cloud computing system or other computing systems, and is a server computer that functions as a server for implementing various functions. The server device 10 may be configured by two or more server computers that are connected to be able to communicate information and operate in cooperation. The server device 10 executes transmission and reception of information and information processing necessary for providing virtual face-to-face communication.

[0012] The terminal device 12 is an information processing device having a communication function and input / output functions for images, voices, etc., and is used by a user. The terminal device 12 is, for example, a smartphone, a tablet terminal, a personal computer, a digital signage, etc.

[0013] The network 11 is, for example, the Internet, but includes an ad hoc network, a LAN (Local Area Network), a MAN (Metropolitan Area Network), or other networks or any combination thereof.

[0014] In this embodiment, the terminal device 12 receives, from another terminal device 12, information for generating a model image representing another user based on a captured image of another user who uses the other terminal device 12, and information on an image (hereinafter referred to as a drawn image) drawn by the other user on the touch panel of the other terminal device 12, and displays a display image in which the model image with left and right reversed and the drawn image are superimposed on each other. The self-user of the terminal device 12 (hereinafter referred to as the self-user) experiences a reality as if having a face-to-face communication with another user through a transparent panel while drawing on the transparent panel, because when the other user (hereinafter referred to as the other user) draws a drawn image such as characters or figures on the touch panel in a virtual face-to-face communication with the other user, the model image and the drawn image are displayed on the own terminal device 12. Also, in the self-user, since the model image and the drawn image of the other user are displayed in a state where they are reversed left and right, the sense of incongruity is reduced when recognizing the drawn image, so the convenience is improved. Thus, according to this embodiment, it is possible to improve the reality and convenience in virtual face-to-face communication.

[0015] The configurations of the server device 10 and the terminal device 12 will be described in detail.

[0016] The server device 10 includes a communication unit 101, a storage unit 102, a control unit 103, an input unit 105, and an output unit 106. These configurations are appropriately arranged in two or more computers when the server device 10 is composed of two or more server computers.

[0017] The communication unit 101 includes one or more communication interfaces. The communication interface is, for example, a LAN interface. The communication unit 101 receives information used for the operation of the server device 10 and transmits information obtained by the operation of the server device 10. The server device 10 is connected to the network 11 by the communication unit 101 and performs information communication with the terminal device 12 via the network 11.

[0018] The storage unit 102 includes, for example, one or more semiconductor memories that function as a main memory device, an auxiliary memory device, or a cache memory, one or more magnetic memories, one or more optical memories, or a combination of at least two of these. The semiconductor memory is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The RAM is, for example, an SRAM (Static RAM) or a DRAM (Dynamic RAM). The ROM is, for example, an EEPROM (Electrically Erasable Programmable ROM). The storage unit 102 stores information used for the operation of the server device 10 and information obtained by the operation of the server device 10.

[0019] The control unit 103 includes one or more processors, one or more dedicated circuits, or a combination of these. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit), or a dedicated processor such as a GPU (Graphics Processing Unit) specialized for specific processing. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), etc. The control unit 103 executes information processing related to the operation of the server device 10 while controlling each part of the server device 10.

[0020] The input unit 105 includes one or more input interfaces. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch panel provided integrally with a display, or a microphone that receives voice input. The input unit 105 receives an operation for inputting information used for the operation of the server device 10 and sends the input information to the control unit 103.

[0021] The output unit 106 includes one or more output interfaces. The output interface is, for example, a display or a speaker. The display is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display. The output unit 106 outputs information obtained by the operation of the server device 10.

[0022] The functions of the server device 10 are realized by a processor included in the control unit 103 executing a control program. The control program is a program for causing a computer to function as the server device 10. Also, some or all of the functions of the server device 10 may be realized by a dedicated circuit included in the control unit 103. Further, the control program may be stored in a non-transitory recording and storage medium readable by the server device 10, and the server device 10 may read it from the medium.

[0023] The terminal device 12 includes a communication unit 111, a storage unit 112, a control unit 113, an input unit 115, a display / output unit 116, and an imaging unit 117.

[0024] The communication unit 111 includes a communication module corresponding to a wired or wireless LAN standard, a module corresponding to a mobile communication standard such as LTE, 4G, 5G, etc. The terminal device 12 is connected to the network 11 via the communication unit 111 through a nearby router device or a mobile communication base station, and performs information communication with the server device 10 etc. via the network 11.

[0025] The storage unit 112 includes one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two of these. The semiconductor memory is, for example, a RAM or a ROM. The RAM is, for example, an SRAM or a DRAM. The ROM is, for example, an EEPROM. The storage unit 112 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 112 stores information used for the operation of the control unit 113 and information obtained by the operation of the control unit 113.

[0026] The control unit 113 includes, for example, one or more general-purpose processors such as a CPU or an MPU (Micro Processing Unit), or one or more dedicated processors such as a GPU specialized for specific processing. Alternatively, the control unit 113 may include one or more dedicated circuits such as an FPGA or an ASIC. The control unit 113 comprehensively controls the operation of the terminal device 12 by operating according to a control / processing program or by operating according to an operation procedure implemented as a circuit. Then, the control unit 113 transmits and receives various information to and from the server device 10 etc. via the communication unit 111, and executes the operation according to the present embodiment.

[0027] The input unit 115 includes a touch panel provided integrally with the display and one or more input interfaces. The input unit 15 detects the input of a drawn image based on the displacement of the contact position of a finger, a pointing device, etc. on the touch panel, and sends the detected information to the control unit 113. The input interface includes, for example, physical keys, capacitive keys, and pointing devices. The input interface also includes a microphone for receiving voice input. Further, the input interface may include a scanner or a camera for scanning an image code, or an IC card reader. The input unit 115 receives an operation for inputting information used for the operation of the control unit 113, and sends the input information to the control unit 113.

[0028] The display / output unit 116 includes a display for displaying an image and one or more output interfaces. The display is, for example, an LCD or an organic EL display. The output interface includes, for example, a speaker. The display / output unit 116 outputs the information obtained by the operation of the control unit 113.

[0029] The imaging unit 117 includes a camera that captures a captured image of a subject using visible light, and a distance measurement sensor that measures the distance to the subject to obtain a distance image. The camera captures the subject, for example, at 15 to 30 frames per second, and generates a moving image composed of continuous captured images. The distance measurement sensor includes a ToF (Time Of Flight) camera, LiDAR (Light Detection And Ranging), and a stereo camera, and generates a distance image of the subject including distance information. The imaging unit 117 sends the captured image and the distance image to the control unit 113.

[0030] The functions of the control unit 113 are realized by a processor included in the control unit 113 executing a control program. The control program is a program for causing the processor to function as the control unit 113. Also, some or all of the functions of the control unit 113 may be realized by a dedicated circuit included in the control unit 113. Further, the control program may be stored in a non-transitory recording and storage medium readable by the terminal device 12, and the terminal device 12 may read it from the medium.

[0031] Figures 2A and 2B show modes in which a user conducts face-to-face communication using the terminal device 12.

[0032] Figure 2A shows the mode of the self-user using the terminal device 12. The self-user 20 makes a call while drawing characters, patterns, etc. on the touch panel of the input unit 115 provided superimposed on the display of the display / output unit 116. The display / output unit 116 displays information such as an image corresponding to contact with a pointing device or the like. The imaging unit 117 is provided at a position where at least the upper body of the self-user 20 can be imaged, such as above the display or, when the display is composed of a transmissive display, behind the display.

[0033] The control unit 113 acquires the captured image and the distance image of the own user 20 by the imaging unit 117. Also, the control unit 113 collects the speech of the own user 20 with the microphone of the input unit 115. Further, the control unit 113 acquires from the input unit 115 the information of the drawn image drawn by the own user 20 on the touch panel of the input unit 115. The control unit 113 encodes the captured image and the distance image of the own user 20, the drawn image drawn by the own user 20, and the voice information for reproducing the voice of the own user 20 to generate encoded information. The model image is, for example, a 3D model, a 2D model, etc. Hereinafter, the 3D model will be described as an example. When encoding, the control unit 113 may perform arbitrary processing (for example, resolution change, trimming, complement of non-depicted parts, etc.) on the captured image and the like. Also, the control unit 113 derives the position of the drawn image with respect to the own user 20 based on the captured image of the own user 20. For example, the position of the drawn image with respect to the own user 20 is derived based on the positional relationship between the imaging unit 117 and the touch panel, and the position of the own user 20 with respect to the imaging unit 117 and the position of the drawn image. Then, the control unit 113 determines the position to superimpose the drawn image on the 3D model of the own user 20 so as to correspond to the derived position. The control unit 113 sends the encoded information to the other terminal device 12 via the server device 10 by the communication unit 111.

[0034] Figure 2B shows the mode of the other user displayed on the terminal device 12. The rendering image 22 including the 3D model of the other user 21 is displayed on the display of the display / output unit 116 together with the drawn image 23 drawn by the other user 21.

[0035] The control unit 113 receives, via the server device 10, the encoded information sent from another terminal device 12 by the communication unit 111. When the control unit 113 decodes the encoded information received from another terminal device 12, it generates a 3D model representing another user 21 who uses another terminal device 12 using the decoded information. When generating the 3D model, the control unit 113 generates a polygon model using the distance image of another user 21, and generates a 3D model of another user 21 by applying texture mapping using the captured image of another user 21 to the polygon model. However, the generation of the 3D model is not limited to the example shown here, and any method can be adopted. The control unit 113 generates a rendering image 22 of a virtual space including the 3D model as seen from a virtual viewpoint. The virtual viewpoint is, for example, the position of the eyes of the own user 20. The control unit 113 derives the spatial coordinates of the eyes with respect to an arbitrary reference from the captured image of the own user 20 and associates them with the spatial coordinates in the virtual space. The arbitrary reference is, for example, the position of the imaging unit 117. The 3D model of another user 21 is arranged at a position and angle where eye contact can be made with respect to the virtual viewpoint. Further, the control unit 113 superimposes a drawn image 23 on the rendering image 22 to generate a display image. The drawn image 23 is arranged so as to correspond to the position of the hand holding a pen or the like of the 3D model. The control unit 113 displays the display image by the display / output unit 116 and outputs the speech of another user 21 based on the voice information of another user 21.

[0036] FIG. 3 is a sequence diagram for explaining the operation procedure of the call system 1. This sequence diagram shows the procedure related to the cooperative operation of the server device 10 and a plurality of terminal devices 12 (when distinguishing each of them, for convenience, referred to as terminal devices 12A and 12B). This procedure is the procedure when the terminal device 12A calls the terminal device 12B. When a plurality of terminal devices 12B are called, the operation procedure related to the terminal device 12B shown here is executed by each of the plurality of terminal devices 12B, or by each of the plurality of terminal devices 12B and the server device 10.

[0037] The steps related to various information processes of the server device 10 and the terminal device 12 in FIG. 3 are executed by the respective control units 103 and 113. Also, the steps related to the transmission and reception of various information between the server device 10 and the terminal device 12 are executed by the respective control units 103 and 113 transmitting and receiving information to and from each other via the communication units 101 and 111, respectively. In the server device 10 and the terminal device 12, the control units 103 and 113 respectively appropriately store the information to be transmitted and received in the storage units 102 and 112. Further, the control unit 113 of the terminal device 12 receives the input of various information by the input unit 115 and outputs various information by the display / output unit 116.

[0038] In step S300, the terminal device 12A receives the input of setting information from its user. The setting information includes a call schedule, a list of call partners, etc. The list includes the user names of call partners and the email addresses of each user. Then, in step S301, the terminal device 12A sends the setting information to the server device 10. The server device 10 receives the information sent from the terminal device 12A. For example, the terminal device 12A acquires an input screen for setting information from the server device 10 and displays the input screen to the user. Then, when the user inputs the setting information on the input screen, the setting information is sent to the server device 10.

[0039] In step S302, the server device 10 identifies the call partner based on the setting information. The control unit 103 associates the setting information with the information of the call partner and stores it in the storage unit 102.

[0040] In step S303, the server device 10 sends authentication information to the terminal device 12B. The authentication information is information such as an ID and a password for identifying and authenticating the call partner using the terminal device 12B. These information are sent attached to an email, for example. The terminal device 12B receives the information sent from the server device 10.

[0041] In step S305, the terminal device 12B sends the authentication information received from the server device 10 and the information of the authentication application to the server device 10. The calling party operates the terminal device 12B to apply for authentication using the authentication information sent from the server device 10. For example, the terminal device 12B accesses a website for calls provided by the server device 10, obtains an input screen for the authentication information and the information for the authentication application, and displays the input screen to the calling party. Then, the terminal device 12B receives the information input by the calling party and sends it to the server device 10.

[0042] In step S306, the server device 10 authenticates the calling party. In the storage unit 102, the identification information of the terminal device 12B and the identification information of the calling party are stored in association with each other.

[0043] In steps S308 and S309, the server device 10 sends a call start notification to the terminal devices 12A and 12B, respectively. When the terminal devices 12A and 12B receive the information sent from the server device 10, they start imaging the user and collecting the voice of the uttered speech, respectively.

[0044] In step S310, virtual face-to-face communication including a call between users is executed by the terminal devices 12A and 12B via the server device 10. The terminal devices 12A and 12B send and receive to each other, via the server device 10, information for generating a 3D model representing each user, a drawn image, and information of the uttered speech. In addition, the terminal devices 12A and 12B output, to each user, an image including a 3D model representing the other user and the uttered speech of the other user.

[0045] Figures 4A and 4B are flowchart diagrams for explaining the operation procedure of the terminal device 12 related to the execution of virtual face-to-face communication. The procedure shown here is a procedure common to the terminal devices 12A and 12B, and will be described without distinguishing between the terminal devices 12A and 12B.

[0046] FIG. 4A relates to the operation procedure of the control unit 113 when each terminal device 12 transmits information for generating a 3D model of the self-user who uses the terminal device 12.

[0047] In step S402, the control unit 113 acquires a visible light image, a distance image, a drawn image, and collects sound. The control unit 113 causes the imaging unit 117 to capture a visible light image of the self-user and acquire a distance image at a frame rate arbitrarily set. Further, the control unit 113 acquires a drawn image by the input unit 115. Furthermore, the control unit 113 collects the voice of the self-user's speech by the input unit 115.

[0048] In step S404, the control unit 113 encodes the captured image, the distance image, the drawn image, and the audio information, and generates encoded information.

[0049] In step S406, the control unit 113 packets the encoded information by the communication unit 111 and transmits it to the server device 10 for other terminal devices 12.

[0050] In step S407, the control unit 113 transmits display magnification information to the server device 10 for other terminal devices 12. The display magnification information is information indicating the display magnification of the image by the display / output unit 116. The display magnification is set by the control unit 113 in response to an operation on the input unit 115 of the self-user, for example. Alternatively, the control unit 113 may acquire the resolution of the display from the display / output unit 116 and determine the display magnification according to the resolution. For example, the control unit 113 increases the display magnification as the resolution is higher. The control unit 113 acquires the display magnification from the display / output unit 116 and transmits the display magnification information to the server device 10 for other terminal devices 12 by the communication unit 101.

[0051] When the control unit 113 obtains information input in response to an operation by the self-user for interrupting imaging and sound collection or for exiting virtual face-to-face communication (Yes in S408), it ends the processing procedure of FIG. 4A and executes steps S402 to S407 while not obtaining information corresponding to an operation for interruption or exit (No in S408), and sends information for generating a 3D model representing the self-user, a drawn image, and information for outputting sound to the server device toward the other terminal device 12.

[0052] FIG. 4B relates to the operation procedure of the control unit 113 when the terminal device 12 outputs an image of a 3D model of another user, a drawn image, and sound. When the control unit 113 receives a packet sent by the other terminal device 12 executing the procedure of FIG. 4A via the server device 10, it executes steps S410 to S413.

[0053] In step S410, the control unit 113 decodes the encoded information included in the packet received from the other terminal device 12 to obtain a captured image, a distance image, a drawn image, and sound information.

[0054] In step S411, the control unit 113 sets the display magnification when displaying the 3D model of another user. The control unit 113 sets the display magnification in its own terminal device 12 based on the display magnification of that terminal device 12 sent from the other terminal device 12. When the display magnification of the other terminal device 12 is N times (N is an arbitrary positive number), the control unit 113 sets its own display magnification to (1 / N) times. When information on different display magnifications is sent from a plurality of other terminal devices 12, the control unit 113 sets the display magnification for each 3D model from each terminal device 12.

[0055] In step S412, the control unit 113 generates a 3D model representing the own user of another terminal device 12 based on the captured image and the distance image. When receiving information from a plurality of other terminal devices 12, the control unit 113 executes steps S410 to S412 for each of the other terminal devices 12 to generate a 3D model of each own user. At this time, the control unit 113 generates each 3D model by inverting its left and right. For example, the control unit 113 generates a 3D model with its left and right inverted by inverting the left-right coordinates of the polygons constituting the 3D model with respect to an arbitrary center.

[0056] In step S413, the control unit 113 arranges a 3D model representing another user in the virtual space. In the storage unit 112, coordinate information of the virtual space and information on the coordinates where the 3D model should be arranged for each other user, for example, according to the authenticated order, are stored in advance. The control unit 113 arranges the generated 3D model at the coordinates in the virtual space. At that time, the control unit 113 may generate a virtual space with the left and right of the real space inverted from the captured image of the real space where another user exists, and arrange the 3D model with its left and right inverted in that virtual space.

[0057] In step S414, the control unit 113 generates a display image. The control unit 113 generates a rendering image obtained by imaging the 3D model arranged in the virtual space from a virtual viewpoint. Note that, instead of generating a 3D model with its left and right inverted in step S412 and arranging the 3D model with its left and right inverted in the virtual space with the left and right of the real space inverted in step S413, the control unit 113 may generate a 3D model without inverting its left and right in step S412, arrange the 3D model in the virtual space corresponding to the real space in step S414 to generate a rendering image, and invert the left and right of the rendering image. Then, the control unit 113 may generate a display image by superimposing a left-right inverted drawing image at a position corresponding to the inverted 3D model.

[0058] In step S416, the control unit 113 causes the display / output unit 116 to display the display image and output sound.

[0059] By repeatedly executing steps S410 to S416 by the control unit 113, the own user can listen to the voice of the other user while viewing a video including the 3D model of the other user and the drawing image drawn by the 3D model. At this time, since the 3D model and the drawing image are horizontally flipped, convenience is improved for the own user. For example, as shown in FIG. 5A, when the 3D model of the other user 20 and the drawing image 23 as detected by the input unit 115 are displayed on the display / output unit 116, especially when the drawing image includes characters, there is a possibility that it is difficult to recognize with the left and right being flipped. In this regard, according to the present embodiment, as shown in FIG. 5B, since the 3D model of the other user 20 and the drawing image 23 are displayed on the display / output unit 116 in a horizontally flipped state, it becomes easy for the own user to recognize the drawing image 23. Therefore, convenience is improved for the own user.

[0060] Also, by setting the display magnification in the terminal device 12 according to the display magnification in the other terminal device 12, it becomes easy for users to have eye contact with each other.

[0061] FIGS. 6A to 6D schematically show changes in the display magnification in virtual face-to-face communication.

[0062] FIG. 6A shows a case where users 64 and 65 communicate with the display magnification in their respective terminal devices 12 being 1:1. In this case, while the line of sight 66 of user 64 is directed toward the eye position of the 3D model of user 65 in the own display / output unit 116, the line of sight 67 of user 65 is directed toward the eye position of the 3D model of user 64 in the own display / output unit 116, so that eye contact is established. Here, the case where user 64 sets the display magnification to M times (M>1) is shown in FIGS. 6B and 6C.

[0063] FIG. 6B shows a mode in which the 3D model of user 65 is displayed at M times the size on the display / output unit 116 of user 64. Then, the line of sight 66 of user 64 is directed upward at an elevation angle to the eye position of the 3D model of user 65 that has been magnified by M times. On the other hand, FIG. 6C shows a mode in which the 3D model of user 64 is displayed at a size of 1 times on the display / output unit 116 of user 65. At this time, since the line of sight 66 of the 3D model of user 64 is directed upward, it does not coincide with the line of sight 67 of user 65, and eye contact is lost. Therefore, by setting the display magnification to (1 / M) times on the display / output unit 116 of user 65, eye contact is restored.

[0064] FIG. 6D shows a mode in which the 3D model of user 65 is displayed at M times the size on the display / output unit 116 of user 64, and the 3D model of user 64 is displayed at (1 / M) times the size on the display / output unit 116 of user 65. On the display / output unit 116 of user 65, the 3D model of user 64 is displayed at a display magnification of (1 / M) times, that is, reduced, so that the line of sight 66 of the 3D model of user 64 directed upward is directed toward the eye position of user 65. On the other hand, user 65 directs the line of sight 67 to the eye position of the reduced 3D model of user 64 on the display / output unit 116 of user 65, so that eye contact is restored.

[0065] Although the case where the display magnification of the other terminal device 12 is increased has been described as an example, when the display magnification of the other terminal device 12 is decreased, it is possible to restore eye contact with other users by increasing the display magnification.

[0066] As described above, by changing the display magnification in the terminal device 12 according to the display magnification in the other terminal device 12, it is possible to surely establish eye contact between users. Therefore, it is possible to improve the reality and convenience in virtual face communication.

[0067] In the above example, after the terminal device 12 receives information for generating a 3D model of another user, that is, a captured image, a distance image, etc. from another terminal device 12, it generates a 3D model and generates a rendering image in which the 3D model is arranged in a virtual space. However, processes such as the generation of the 3D model and the generation of the rendering image may be appropriately distributed among the terminal devices 12. For example, a 3D model of another user may be generated by another terminal device 12 based on a captured image or the like, and the terminal device 12 that has received the information of the 3D model may generate a rendering image using the 3D model.

[0068] In the above, the embodiments have been described based on the drawings and examples, but it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these modifications and corrections are included in the scope of the present disclosure. For example, the functions included in each means, each step, etc. can be rearranged so as not to be logically contradictory, and a plurality of means, steps, etc. can be combined into one or divided.

Description of Reference Numerals

[0069] 1 Call system 10 Server device 11 Network 12 Terminal device 101, 111 Communication unit 102, 112 Storage unit 103, 113 Control unit 105, 115 Input unit 106 Output unit 116 Display / output unit 117 Imaging unit

Claims

1. A communication unit, A display unit, An input unit having a touch panel that overlays the display unit, An imaging unit that images a user, In a terminal device having a control unit that communicates via the communication unit, The control unit receives, from the other terminal device, information for generating a model image representing the other user based on an imaged image of the other user using the other terminal device, and information on a drawn image drawn by the other user on the touch panel of the other terminal device, and causes the display unit to display a display image in which the model image with left - right reversed and the drawn image with left - right reversed are superimposed on each other. The control unit decreases the first display magnification of the display image by the display unit when the second display magnification of the display image in the other terminal device increases, and increases the first display magnification when the second display magnification decreases. A terminal device.

2. In Claim 1, The control unit generates a rendering image in which the model image with left - right reversed and the model image are arranged in a virtual space with left - right reversed corresponding to the real space where the other user exists, and generates the display image by superimposing the drawn image with left - right reversed on the rendering image. A terminal device.

3. In Claim 1, The control unit generates a rendering image in which the model image and the model image are arranged in a virtual space corresponding to the real space where the other user exists, and generates the display image by reversing the left - right of the rendering image and superimposing it on the image with left - right reversed. A terminal device.

Images