Method, program, and terminal device

Abstract

To improve a technique for providing remote dialogue services using communication lines.SOLUTION: A method performed by a terminal apparatus 10 configured to communicate with a server 20 that provides a remote dialogue service, includes: displaying, on a screen, a plurality of objects including first objects indicating the faces of other users who are interlocutors of a user of the terminal apparatus; detecting an object on the screen at which the user is gazing, as a user's gaze object; transmitting information indicating the user's gaze object to the server 20; receiving information indicating each interlocutor's gaze object from the server 20; and controlling orientation of each of the first objects and arrangement of the plurality of objects so as to satisfy, on the screen, a first condition that each interlocutor's line of sight is directed to the interlocutor's gaze object, and a second condition that there are no objects, in each interlocutor's line of sight, other than the interlocutor's gaze object.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a method, a program, and a terminal device. [Background technology]

[0002] Conventionally, there is known a technology for providing a remote dialogue service using a communication line. For example, Patent Document 1 discloses a communication system in which a plurality of users can talk to each other while viewing each other's video, in which the users displayed on the screen are corrected or changed to be looking at the camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6849133 Summary of the Invention [Problem to be solved by the invention]

[0004] There is room for improvement in the technology for providing remote dialogue services using communication lines.

[0005] In view of the above circumstances, an object of the present disclosure is to improve the technology for providing remote dialogue services using communication lines. [Means for solving the problem]

[0006] According to one embodiment of the present disclosure, the method comprises: A method executed by a terminal device communicating with a server providing a remote dialogue service, comprising: displaying on a screen a plurality of objects including a first object showing a face of each of other users who is a conversation partner of the user of the own device; detecting an object on the screen that the user is gazing at as the user's gaze object; transmitting information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; The method includes controlling the orientation of each of the first objects and the arrangement of the multiple objects so as to satisfy a first condition that the gaze of each of the dialogue partners is directed toward a gaze object on the screen, and a second condition that no object other than the gaze object is present in the line of sight of each of the dialogue partners.

[0007] A program according to an embodiment of the present disclosure includes: A terminal device that communicates with a server that provides a remote dialogue service, displaying on a screen a plurality of objects including a first object showing a face of each of other users who is a conversation partner of the user of the own device; detecting an object on the screen that the user is gazing at as the user's gaze object; transmitting information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; The device executes controlling the orientation of each of the first objects and the arrangement of the multiple objects so as to satisfy a first condition that the gaze of each of the dialogue partners is directed toward the gaze object on the screen, and a second condition that no object other than the gaze object is present in the gaze of each of the dialogue partners.

[0008] A terminal device according to an embodiment of the present disclosure includes: A terminal device comprising: a communication unit that communicates with a server that provides a remote dialogue service; a display unit that displays a screen; a camera unit that generates an image of a face of a user of the terminal device; and a control unit, The control unit is displaying on a screen a plurality of objects including a first object showing a face of each of the other users who is a conversation partner of the user; Detecting an object on the screen that is determined to be gazed at by the user based on the image as a gaze object of the user; Sending information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; The orientation of each of the first objects and the arrangement of the multiple objects are controlled so as to satisfy a first condition that the gaze of each of the dialogue partners is directed toward a gaze object on the screen, and a second condition that no object other than the gaze object exists in the gaze of each of the dialogue partners. Effect of the Invention

[0009] According to one embodiment of the present disclosure, a technique for providing remote dialogue services using a communication line is improved. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a schematic configuration of a system according to an embodiment of the present disclosure. [Diagram 2] FIG. 4 is a diagram showing a first example of a screen displayed on the terminal device. [Diagram 3] FIG. 2 is a block diagram showing a schematic configuration of a terminal device. [Figure 4] FIG. 2 is a block diagram showing a schematic configuration of a server. [Diagram 5] FIG. 4 is a sequence diagram showing a first operation of the system. [Figure 6] FIG. 11 is a sequence diagram showing a second operation of the system. [Figure 7] FIG. 11 is a diagram showing a second example of a screen displayed on the terminal device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present disclosure will be described.

[0012] (Overview of the embodiment) An overview of a system 1 according to an embodiment of the present disclosure will be described with reference to Fig. 1. The system 1 includes a plurality of terminal devices 10 and a server 20. Each of the terminal devices 10 and the server 20 can communicate with each other via a communication line 30 including, for example, the Internet and a mobile communication network.

[0013] The terminal device 10 is a computer such as a PC (Personal Computer), a smartphone, or a tablet terminal. The server 20 includes one or more computers that can communicate with each other. The server 20 provides a remote dialogue service using a communication line 30. In this embodiment, a user can use his / her terminal device 10 to have a remote dialogue with one or more dialogue partners. In this embodiment, the user's terminal device 10 executes a remote dialogue while displaying an object (hereinafter, also referred to as a "first object") showing the face of each dialogue partner on the screen. In this embodiment, the first object is a 3D object generated in real time using a visible light image and a depth image of the face of the dialogue partner, and is displayed in conjunction with the actual movement of the dialogue partner. However, the first object is not limited to this example, and may be, for example, a 3D object of an avatar such as a character. Alternatively, the first object may be a 2D object including an image of the dialogue partner or character.

[0014] In addition to the first object, one or more second objects different from the first object may be displayed on the screen. The second object may be, for example, a 3D object or a 2D object including at least one of a text and an image, but is not limited thereto. In one example, a shared document or the like in a remote conference using the remote dialogue service may be displayed on the screen as the second object.

[0015] First, an overview of the present embodiment will be described, and details will be described later. The terminal device 10 displays a plurality of objects including a first object showing the face of each user who is a dialogue partner of the user of the device on a screen, and detects an object on the screen that the user is gazing at as the user's gaze object. The terminal device 10 transmits information showing the user's gaze object to the server 20, and receives information showing the gaze object of each dialogue partner from the server 20. Then, the terminal device 10 controls the orientation of each first object and the arrangement of the plurality of objects so as to satisfy a first condition that the gaze of each dialogue partner is directed to the gaze object on the screen, and a second condition that no object other than the gaze object exists in the line of sight of each dialogue partner.

[0016] With reference to FIG. 2, the control based on the first and second conditions described above will be described. FIG. 2 shows a screen of a terminal device 10 of a user having a remote conversation with three conversation partners A to C. Three first objects showing the faces of the conversation partners A to C, respectively, are displayed on the screen. In the following description, the "first object of the conversation partner" is also simply referred to as the "conversation partner". Here, the gaze object of each of the conversation partners A and B is the first object showing the face of the conversation partner C. In other words, each of the conversation partners A and B is gazing at the conversation partner C displayed on the screen of their own terminal device 10.

[0017] The terminal device 10 of the user controls, for example, the orientation of the dialogue partners A and B on the screen so as to satisfy the above-mentioned first condition (for example, so that the gazes of the dialogue partners A and B are directed toward the dialogue partner C). Here, when the dialogue partner B is at the position P on the screen, the dialogue partner B is present in the gaze of the dialogue partner A. In such a case, the user of the terminal device 10 cannot recognize at a glance which of the dialogue partners B and C the dialogue partner A is gazing at. In contrast, in the present embodiment, the terminal device 10 moves the dialogue partner B from the position P to a lower position Q, for example, so as to further satisfy the above-mentioned second condition (for example, so that no object other than the dialogue partner C is present in the gaze of the dialogue partner A), thereby removing the dialogue partner B from the gaze of the dialogue partner A. In such a case, the user of the terminal device 10 can recognize at a glance that the dialogue partner A is gazing at the dialogue partner C, not the dialogue partner B. Thus, according to the present embodiment, the technology for providing a remote dialogue service using a communication line is improved in that the user can recognize the gaze object of each dialogue partner from the screen at a glance.

[0018] Next, each of the components of the system 1 will be described in detail.

[0019] (Terminal Device Configuration) As shown in FIG. 3, the terminal device 10 includes a communication unit 11, a display unit 12, a camera unit 13, a storage unit 14, and a control unit 15.

[0020] The communication unit 11 includes one or more communication interfaces connected to the communication line 30. The communication interface corresponds to, for example, a mobile communication standard such as 4G (4th Generation) and 5G (5th Generation), a wired LAN (Local Area Network) standard, or a wireless LAN standard, but is not limited to these and may correspond to any communication standard.

[0021] The display unit 12 includes one or more displays and may also include an interface to which an external display can be connected.

[0022] The camera unit 13 includes one or more pairs of visible light cameras and depth cameras. The camera unit 13 may also include an interface to which an external visible light camera and depth camera can be connected. Each pair of visible light cameras and depth cameras is provided so as to be able to capture the face of a user using the terminal device 10 from a predetermined direction. In this embodiment, the camera unit 13 includes at least one pair of visible light cameras and depth cameras that can capture the face of a user viewing the screen of the terminal device 10 from the front. The visible light image and depth image obtained from the visible light camera and the depth camera are used to generate a first object showing the user's face. Hereinafter, the visible light image and the depth image obtained from the visible light camera and the depth camera are also referred to as "camera images".

[0023] The storage unit 14 includes one or more memories. The memories are, for example, but not limited to, semiconductor memories, magnetic memories, optical memories, etc. Each memory included in the storage unit 14 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 14 stores any information used in the operation of the terminal device 10. For example, the storage unit 14 may store system programs, application programs, etc.

[0024] The control unit 15 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination of these. The processor is, for example, but is not limited to, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process. The programmable circuit is, for example, but is not limited to, an FPGA (Field-Programmable Gate Array). The dedicated circuit is, for example, but is not limited to, an ASIC (Application Specific Integrated Circuit). The control unit 15 controls the operation of the entire terminal device 10.

[0025] (Server configuration) As shown in FIG. 4, the server 20 includes a communication unit 21, a storage unit 22, and a control unit .

[0026] The communication unit 21 includes one or more communication interfaces that connect to the communication line 30. The communication interface corresponds to, for example, a mobile communication standard, a wired LAN standard, or a wireless LAN standard, but is not limited to these and may correspond to any communication standard.

[0027] The storage unit 22 includes one or more memories. Each memory included in the storage unit 22 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 22 stores any information used in the operation of the server 20. For example, the storage unit 22 may store a system program, an application program, embedded software, a database, and the like.

[0028] The control unit 23 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. The control unit 23 controls the operation of the server 20 as a whole.

[0029] (System Operation) A first operation of the system 1 will be described with reference to Fig. 5. In summary, the first operation is an operation of generating each first object to be displayed on the screen of the terminal device 10, and is repeatedly executed at a predetermined frame rate during execution of a remote dialogue. Here, the operation of the terminal device 10 of the user and the server 20 in a scene where the user has a remote dialogue with three dialogue partners A to C will be described. The operation of the terminal device 10 of each dialogue partner is similar to that of the terminal device 10 of the user, and therefore description thereof will be omitted.

[0030] Step S100 : The control unit 15 of the terminal device 10 generates a camera image of the user using the camera unit 13 , and transmits the image to the server 20 via the communication unit 11 .

[0031] As described above, the camera image is a visible light image and a depth image generated by at least one pair of a visible light camera and a depth camera included in the camera unit 13. Here, it is assumed that a camera image is generated that includes at least one pair of a visible light image and a depth image that captures the user's face from the front.

[0032] Step S101: The control unit 23 of the server 20 generates first object information based on camera images of each of the user's conversation partners received from the terminal device 10 of each of the user's conversation partners, and transmits the first object information to the terminal device 10 of the user via the communication unit 21.

[0033] The first object information includes any information used to generate each first object to be displayed on the screen of the user's terminal device 10. For example, the first object information may include the camera image of each conversation partner itself, or may include data obtained by cropping only the portion corresponding to the person from the camera image of each conversation partner.

[0034] Note that when the control unit 23 receives, for example, text and / or an image in advance as a shared material during a remote dialogue from the terminal device 10 of any of the participants in the remote dialogue (here, the user or any of the dialogue partners A to C), the control unit 23 may generate second object information in addition to the first object information and transmit it to the user's terminal device 10. The second object information includes any information (for example, the text and / or image received as a shared material) used to generate a second object to be displayed on the screen of the user's terminal device 10.

[0035] Step S102: The control unit 15 of the terminal device 10 generates a first object showing the face of each conversation partner based on the first object information received from the server 20, and displays it on the screen of the display unit 12. Furthermore, when the control unit 15 receives second object information from the server 20, it generates a second object in addition to the first object, and displays it on the screen of the display unit 12.

[0036] Specifically, when the first object information includes the camera image of each conversation partner itself, the control unit 15 trims only the portion corresponding to the person from the camera image of each conversation partner. The control unit 15 generates a 3D model showing the shape of the conversation partner's face from the depth image of each conversation partner, and generates a first object showing the face of each conversation partner by texture mapping the visible light image onto the 3D model. The control unit 15 then displays each generated first object on the screen of the display unit 12. The control unit 15 also generates a second object showing the text and / or image included in the second object information, and displays it on the screen of the display unit 12.

[0037] The second operation of the system 1 will be described with reference to Fig. 6. In summary, the second operation is an operation for controlling the orientation and arrangement of each object on the screen of the terminal device 10, and is executed in parallel with the above-mentioned first operation while a remote dialogue is being performed. Here, the operation of the terminal device 10 of the user and the server 20 in a scene where the user has a remote dialogue with three dialogue partners A to C will be described. The operation of the terminal device 10 of each dialogue partner is similar to that of the terminal device 10 of the user, and therefore the description will be omitted.

[0038] Step S200: The control unit 15 of the terminal device 10 detects an object on the screen that the user is gazing at as the gazed-at object of the user.

[0039] Specifically, the control unit 15 detects the user's gaze based on the camera image of the user's face generated in step S100 of the first operation described above. Any method can be adopted for detecting the gaze. For example, the control unit 15 may detect the orientation of the user's face and the positions of the eyes and pupils on the visible light image included in the camera image by image recognition such as feature point extraction or pattern matching.

[0040] Then, the control unit 15 detects the user's gaze based on the detected face direction and the position of the eyes and pupils. The detected gaze may be indicated by a three-dimensional vector. Next, the control unit 15 identifies an object on the screen to which the user's gaze is directed, and detects the object as the user's gaze object. Here, the control unit 15 may detect the object as the user's gaze object when the user continues to gaze at the object on the screen for a predetermined time. With this configuration, for example, when the user shifts his / her gaze from the object he / she is gazing at for just an instant, the occurrence of inconveniences such as the object no longer being the gaze object or the gaze object being frequently switched is reduced.

[0041] Step S201: The control unit 15 transmits information indicating the user's gaze object to the server 20 via the communication unit 11.

[0042] Step S202: The control unit 23 of the server 20 transmits, via the communication unit 21, information indicating the gaze object of each dialogue partner received from the terminal device 10 of each dialogue partner of the user to the terminal device 10 of the user.

[0043] Step S203: The control unit 15 of the terminal device 10 controls the orientation of each first object and the arrangement of a plurality of objects on the screen of the display unit 12 so as to satisfy the first condition and the second condition.

[0044] Here, the first condition is a condition that the gaze of each dialogue partner is directed to the gaze object, as described above. For example, among three dialogue partners A to C, the gaze objects of dialogue partners A and B are the first object of dialogue partner C, and the gaze object of dialogue partner C is the first object of the user. In this case, in order to satisfy the first condition, the control unit 15 controls the orientation of the first object of each of dialogue partners A to C on the screen so that the gazes of dialogue partners A and B are directed to dialogue partner C, and the gaze of dialogue partner C is directed to the user (specifically, in front of the screen).

[0045] As described above, the second condition is that no object other than the gaze object exists in the line of sight of each dialogue partner. For example, in the screen shown in FIG. 2, when dialogue partner B exists at position P, an object (here, dialogue partner B) other than dialogue partner C, which is the gaze object, exists in the line of sight of dialogue partner A. In such a case, in order to satisfy the second condition, the control unit 15 controls the arrangement of multiple objects on the screen, for example, by moving dialogue partner B from position P to a lower position Q to remove dialogue partner B from the line of sight of dialogue partner A.

[0046] In addition, when controlling the arrangement of the plurality of objects on the screen, the control unit 15 may control the arrangement of the plurality of objects so as to satisfy, in addition to the above-mentioned first and second conditions, a third condition regarding the total movement amount associated with the change in the arrangement of the plurality of objects on the screen. For example, the third condition may be a condition that the total movement amount of the plurality of objects on the screen associated with the change in the arrangement is minimized. According to such a configuration, when the arrangement is changed, for example, the occurrence of an inconvenience that the object of the user's gaze moves relatively greatly and visibility is reduced is reduced. The movement amount of the object may be, for example, the movement amount on the screen. Alternatively, when the screen displayed during the remote dialogue is a screen showing a three-dimensional virtual space in which each object is arranged, the movement amount of the object may be the movement amount within the virtual space. For example, the screen shown in FIG. 7 is a screen showing a three-dimensional virtual space in which the first objects of the dialogue partners A to C are arranged, and unlike the screen shown in FIG. 2, the dialogue partner B is moved toward the back of the screen.

[0047] As described above, the terminal device 10 according to the present embodiment displays a plurality of objects including a first object showing the face of each user who is a dialogue partner of the user of the device on the screen, and detects an object on the screen that the user is gazing at as the user's gaze object. The terminal device 10 transmits information showing the user's gaze object to the server 20, and receives information showing the gaze object of each dialogue partner from the server 20. Then, the terminal device 10 controls the orientation of each first object and the arrangement of the plurality of objects so as to satisfy a first condition that the gaze of each dialogue partner is directed to the gaze object on the screen, and a second condition that no object other than the gaze object exists in the line of sight of each dialogue partner.

[0048] According to this configuration, the gaze of each dialogue partner is directed to the gaze object without being blocked on the screen of the user's terminal device 10. This improves the technology for providing a remote dialogue service using a communication line in that the user can recognize the gaze object of each dialogue partner at a glance from the screen.

[0049] Although the present disclosure has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each component or step can be rearranged so as not to be logically inconsistent, and multiple components or steps can be combined or divided into one.

[0050] For example, in the above-described embodiment, an embodiment is also possible in which the configuration and operation of the terminal device 10 or the server 20 are distributed among a plurality of computers that can communicate with each other. Also, for example, an embodiment is also possible in which one of the terminal device 10 and the server 20 executes a part of the processing executed by the other. For example, in the above-described embodiment, the terminal device 10 executes the processing for generating objects to be displayed on the screen of the terminal device 10 (step S102) and the processing for controlling the orientation of each first object and the arrangement of a plurality of objects on the screen of the terminal device 10 (step S203), but the server 20 may execute the processing and transmit the processing result to the terminal device 10.

[0051] Also, for example, an embodiment is possible in which a general-purpose computer functions as the terminal device 10 or the server 20 according to the above-described embodiment. Specifically, a program describing the processing contents for realizing each function of the terminal device 10 or the server 20 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor, or a non-transitory computer-readable medium that stores the program.

[0052] Some of the embodiments of the present disclosure will be described below as examples. However, it should be noted that the embodiments of the present disclosure are not limited to these examples. [Appendix 1] A method executed by a terminal device communicating with a server providing a remote dialogue service, comprising: displaying on a screen a plurality of objects including a first object showing a face of each of other users who is a conversation partner of the user of the own device; detecting an object on the screen that the user is gazing at as the user's gaze object; transmitting information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; Controlling the orientation of each of the first objects and the arrangement of the plurality of objects so as to satisfy a first condition that the gaze of each of the conversation partners is directed to a gaze object on the screen, and a second condition that no object other than the gaze object exists in the gaze of each of the conversation partners. A method comprising: [Appendix 2] 2. The method according to claim 1, comprising: The method of claim 1, wherein, when controlling the arrangement of the plurality of objects, the terminal device controls the arrangement of the plurality of objects so as to satisfy the first condition, the second condition, and a third condition related to a total amount of movement associated with a change in the arrangement of the plurality of objects. [Appendix 3] 3. The method according to claim 2, comprising: The method, wherein the third condition is a condition that minimizes a total amount of movement of the plurality of objects resulting from a rearrangement. [Appendix 4] 4. The method according to any one of claims 1 to 3, comprising: The method, in which, when detecting an object gazed upon by the user, the terminal device detects the object as the user's gazed upon object on the screen if the user continues to gaze upon the object for a predetermined period of time. [Appendix 5] 5. The method according to any one of claims 1 to 4, comprising: A method, wherein the plurality of objects include a first object showing a face of each of the other users who is a conversation partner, and a second object showing at least one of text and an image. [Appendix 6] A terminal device that communicates with a server that provides a remote dialogue service, displaying on a screen a plurality of objects including a first object showing a face of each of other users who is a conversation partner of the user of the own device; detecting an object on the screen that the user is gazing at as the user's gaze object; transmitting information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; Controlling the orientation of each of the first objects and the arrangement of the plurality of objects so as to satisfy a first condition that the gaze of each of the conversation partners is directed to a gaze object on the screen, and a second condition that no object other than the gaze object exists in the gaze of each of the conversation partners. A program to execute. [Appendix 7] A terminal device comprising: a communication unit that communicates with a server that provides a remote dialogue service; a display unit that displays a screen; a camera unit that generates an image of a face of a user of the terminal device; and a control unit, The control unit is displaying on a screen a plurality of objects including a first object showing a face of each of the other users who is a conversation partner of the user; Detecting an object on the screen that is determined to be gazed at by the user based on the image as a gaze object of the user; Sending information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; A terminal device that controls the orientation of each of the first objects and the arrangement of the multiple objects so as to satisfy a first condition that the gaze of each of the dialogue partners is directed toward a gaze object on the screen, and a second condition that no objects other than the gaze object are present in the line of sight of each of the dialogue partners. [Explanation of symbols]

[0053] 1 System 10 Terminal Equipment 11 Communications Department 12 Display section 13 Camera section 14 Storage section 15 Control section 20 Servers 21 Communications Department 22 Memory section 23 Control Unit 30 Communication Lines

Claims

1. A method executed by a terminal device communicating with a server providing a remote dialogue service, comprising: displaying on a screen a plurality of objects including a first object showing a face of each of the other users who is a conversation partner of the user of the own device; detecting an object on the screen that the user is gazing at as the user's gaze object; transmitting information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; Controlling the orientation of each of the first objects and the arrangement of the plurality of objects so as to satisfy a first condition that the gaze of each of the conversation partners is directed to a gaze object on the screen, a second condition that no object other than the gaze object exists in the gaze of each of the conversation partners, and a third condition that a total amount of movement accompanying a change in the arrangement of the plurality of objects is minimized. A method comprising:

2. 2. The method of claim 1 , The method, in which, when detecting an object gazed upon by the user, the terminal device detects the object as the user's gazed upon object on the screen if the user continues to gaze upon the object for a predetermined period of time.

3. 2. The method of claim 1 , A method according to claim 1, wherein the plurality of objects includes a first object showing a face of each of the other users with whom the conversation is with, and a second object showing at least one of text and an image.

4. A terminal device that communicates with a server that provides a remote dialogue service, displaying on a screen a plurality of objects including a first object showing a face of each of the other users who is a conversation partner of the user of the own device; detecting an object on the screen that the user is gazing at as the user's gaze object; transmitting information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; Controlling the orientation of each of the first objects and the arrangement of the plurality of objects so as to satisfy a first condition that the gaze of each of the conversation partners is directed to a gaze object on the screen, a second condition that no object other than the gaze object exists in the gaze of each of the conversation partners, and a third condition that a total amount of movement accompanying a change in the arrangement of the plurality of objects is minimized. A program to execute.

5. A terminal device comprising: a communication unit that communicates with a server that provides a remote dialogue service; a display unit that displays a screen; a camera unit that generates an image of a face of a user of the terminal device; and a control unit, The control unit is displaying on a screen a plurality of objects including a first object showing a face of each of the other users who is a conversation partner of the user; Detecting an object on the screen that is determined to be gazed at by the user based on the image as a gaze object of the user; Sending information indicating a gaze object of the user to the server; receiving information indicating a gaze object of each of the dialogue partners from the server; A terminal device that controls the orientation of each of the first objects and the arrangement of the multiple objects so as to satisfy a first condition that the gaze of each of the dialogue partners is directed toward the gaze object on the screen, a second condition that there are no objects other than the gaze object in the line of sight of each of the dialogue partners, and a third condition that minimizes the total amount of movement associated with changes in the arrangement of the multiple objects.

Images