Display Control Device

Abstract

To provide a display control apparatus configured to improve the power of expression while changing the expression of an agent in real time.SOLUTION: A PU 22 executes control to display an agent image 14 on a display unit 12. The PU 22 uses data obtained by mapping 2D texture data 24d onto a 2D model, for the torso and head of the agent image 14. The PU 22 uses data obtained by mapping 3D texture data 24e onto a 3D model defined by 3D model data 24c, for the eyes, mouth, and eyebrows of the agent image 14.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a display control device. [Background technology]

[0002] For example, Patent Document 1 below describes a display control device that displays a virtual character. In this display control device, textures that match the vowels "a," "i," "u," "e," and "o" are stored in advance in a memory. The display control device then extracts the vowels from the input voice. The display control device then changes the mouth shape of the virtual character by pasting a mouth shape texture that matches the extracted vowel onto the mouth shape of the virtual character. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-56818 Summary of the Invention [Problem to be solved by the invention]

[0004] However, if the virtual character's lip sync cannot be performed in real time during a conversation between a human and a virtual character, it will lead to delays in the conversation and misunderstandings. However, drawing a highly detailed three-dimensional character places a very heavy computational load on the computer. For this reason, it is difficult to draw a highly detailed three-dimensional character in real time. [Means for solving the problem]

[0005] Means for solving the above problems and their effects will be described below. 1. A display control device comprising: a storage device; and an execution device, wherein the storage device stores 2D texture data which is a plurality of texture data relating to an agent; and 3D texture data which is data separate from the 2D texture data and includes texture data of the agent's eyes and mouth, wherein the agent is a person who interacts with a user, the 2D texture data includes a plurality of data indicating different postures of the agent, and the 3D texture data includes a plurality of data of the eyes and mouth which indicate different facial expressions of the agent, wherein the execution device executes 2D mapping processing, 3D mapping processing, and display processing, wherein the 2D mapping processing is processing for mapping one data selected from the plurality of posture data included in the 2D texture data onto a 2D model, the 3D mapping processing is processing for mapping one facial expression data selected from the plurality of facial expressions included in the 3D texture data onto a 3D model, and the display processing is processing for displaying image data obtained by combining the image data subjected to the 2D mapping processing and the image data subjected to the 3D mapping processing on a display unit.

[0006] In the above configuration, the agent's posture is expressed by mapping a 2D texture onto a 2D model, which reduces the computational load on the execution device compared to mapping a texture onto a 3D model. Meanwhile, in the above configuration, the texture is mapped onto a 3D model for the eyes and mouth. This allows the agent's facial expression to be more expressive compared to using a 2D model for the eyes and mouth.

[0007] 2. The display control device according to claim 1, wherein the 3D texture data includes a plurality of data of eyebrows showing different facial expressions of the agent. In the above configuration, by using a 3D model for eyebrows as well, it is possible to improve the expressiveness of the agent's facial expressions compared to when a 2D model is used.

[0008] 3. A display control device as described in 1 or 2 above, wherein the storage device stores 3D model data onto which the 3D texture data is mapped, and the data for the mouth area in the 3D texture data includes data for the jaw area, and the data for the jaw area includes data for a closed mouth and data for an open mouth, and the 3D model onto which the data for the jaw area with the mouth closed is mapped and the 3D model onto which the data for the jaw area with the mouth open is mapped are the same model.

[0009] The position of the tip of the chin is different when the mouth is open and closed. However, in the above configuration, the same 3D model is used when the mouth is open and closed. This reduces the computational load for display compared to when the 3D model is deformable according to whether the mouth is open or closed. Moreover, by using a 3D model, the expressiveness around the mouth can be improved compared to when a 2D model is used.

[0010] 4. The display control device according to any one of 1 to 3 above, wherein the storage device stores specification data that specifies the position and rotation angle of the 3D model for each of different postures of the agent indicated by the 2D texture data, and the 3D mapping process is a process of mapping the 3D texture data onto the 3D model based on the specification data.

[0011] In the above configuration, by using the definition data that defines the position and rotation angle of the 3D model for each posture of the agent, the 3D model can be adjusted even if the posture of the agent changes. Therefore, the mapped data of the 3D texture data can be adjusted to the change in the posture of the agent.

[0012] 5. The display control device according to any one of 1 to 4 above, wherein the 3D texture data stored in the storage device is pre-rendered data. In the above configuration, by storing pre-rendered data, it is possible to save the time required for rendering when displaying an image of an agent.

[0013] 6. The display control device according to any one of 1 to 5 above, wherein the storage device includes a first storage device and a second storage device, the first storage device constantly stores the 3D texture data, the execution device executes a write process, the write process is a process of writing the 3D texture data stored in the first storage device to the second storage device, and the 3D mapping process is a process of mapping the 3D texture data to the 3D model using the 3D texture data written to the second storage device.

[0014] In the above configuration, if the time required for the data read process from the second storage device is short, the agent can be displayed quickly. Therefore, the demands on the read operation of the first storage device that constantly stores the 3D texture data can be reduced.

[0015] 7. The execution device is a display control device described in any one of 1 to 6 above, which executes a 2D selection process that selects data to be used for the 2D mapping process from a plurality of data showing different poses of the agent in response to a dialogue with the user, and a 3D selection process that selects data to be used for the 3D mapping process from a plurality of data showing different facial expressions of the agent in response to a dialogue with the user.

[0016] According to the above configuration, the posture and facial expression of the agent can be made appropriate according to the dialogue with the user. [Brief description of the drawings]

[0017] [Figure 1] FIG. 2 is a block diagram showing a configuration of a dialogue unit according to an embodiment. [Diagram 2]4 is a flowchart showing a procedure of a process executed by a control device according to the embodiment. [Diagram 3] FIG. 2 is a diagram showing a 3D model according to the embodiment. [Figure 4] FIG. 11 is a diagram showing 2D texture data according to the embodiment. [Diagram 5] FIG. 11 is a diagram showing 3D texture data according to the embodiment. [Figure 6] 4 is a flowchart showing a procedure of a process executed by a control device according to the embodiment. [Figure 7] 11(a) to 11(e) are diagrams illustrating an example of the use of 3D texture data according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, an embodiment will be described with reference to the drawings. The dialogue unit 10 shown in Fig. 1 includes a display unit 12. The display unit 12 is a display panel configured with, for example, an LCD, an LED, etc. The display unit 12 displays an agent image 14, which is an image of a virtual person who dialogues with the user.

[0019] The display control device 20 controls the image displayed on the display unit 12 by operating the display unit 12. At this time, the display control device 20 refers to RGB image data Drgb output by the RGB camera 30 in order to control the image. The RGB camera 30 is arranged facing the direction in which the user is assumed to be located. The RGB image data Drgb includes brightness data for each of the three primary colors of red, green, and blue. In addition, the display control device 20 refers to infrared image data Dir output by the infrared camera 32 in order to control the image. The infrared camera 32 is also arranged facing the direction in which the user is assumed to be located. In addition, the display control device 20 refers to an audio signal Ss output by the microphone 34 in order to control the image. The microphone 34 is provided to sense an audio signal generated by the user.

[0020] The display control device 20 operates the speaker 36 in accordance with the movement of the agent image 14 to output an audio signal. The display control device 20 includes a PU 22, a storage device 24, and a storage device 26. The PU 22 is a software processing device including at least one of a CPU, a GPU, a TPU, and the like. A display control program 24a and scenario data 24b are stored in the storage device 24. The storage device 26 is a device with a faster operating speed than the storage device 24. The operating speed includes a read speed of stored data and a write speed of data.

[0021] The scenario data 24b is composed of a finite automaton. The scenario data 24b is data that defines a plurality of states that define the agent's speech content and behavior. The PU22 makes the agent talk to the user according to the scenario data 24b. That is, the PU22 performs voice recognition using the voice signal Ss as input, and generates text data that indicates the user's speech content. The PU22 also recognizes the user's behavior using the RGB image data Drgb and the infrared image data Dir. The PU22 then uses the text data and the recognition result of the user's behavior as input, and determines whether or not the transition condition of the state defined by the scenario data 24b is satisfied. If the PU22 determines that the transition condition is satisfied, the PU22 operates the display unit 12 according to the agent's behavior defined in the transition destination state. This controls the agent image 14. The PU22 also operates the speaker 36 according to the speech content defined in the transition destination state. This causes the agent to speak to the user.

[0022] The agent image 14 expresses a wide range of facial expressions in real time in response to dialogue with the user. This is achieved by "pre-processing for image display" and "processing related to image display." These will be explained in order below.

[0023] "Preprocessing for image display" Fig. 2 shows the procedure of pre-processing for image display. The process shown in Fig. 2 is realized by the PU 22 repeatedly executing the display control program 24a stored in the storage device 24, for example, at a predetermined interval. In the following, the step number of each process is represented by a number preceded by "S".

[0024] In the series of processes shown in FIG. 2, the PU 22 first creates a drawing window for displaying the agent image 14 on the display unit 12 (S10). Next, the PU 22 reads out a 2D model for generating the agent image 14 from the storage device 24 (S12). This process includes a process in which the PU 22 writes data defining the 2D model into the storage device 26. The 2D model is a two-dimensional model that is mainly used to display the torso and head of the agent shown in the agent image 14. The PU 22 also reads out 3D model data 24c defining the 3D model from the storage device 24 (S14). This process includes a process in which the PU 22 writes the 3D model data 24c into the storage device 26. The 3D model is a three-dimensional model that is used to generate images of the eyes, mouth, and eyebrows of the agent image 14, which particularly affect the agent's facial expression. FIG. 3 illustrates the 3D model data 24c.

[0025] As shown in Fig. 3, the 3D model data 24c is data that defines an upper face model 60 and a lower face model 62. The upper face model 60 is a model for expressing the agent's eyes and eyebrows. The lower face model 62 is a part that includes the agent's mouth. The lower face model 62 includes the chin and cheeks. The 3D model data 24c is a polygon model. In Fig. 3, a polygon with three vertices is illustrated as an example of the lower face model 62.

[0026] It should be noted that the 3D model data 24c does not represent the actual shape of the agent. For example, the lower face model 62 includes the tip of the chin when the agent has its mouth open. However, image data when the agent's mouth is closed is also generated using the same lower face model 62.

[0027] Returning to Fig. 2, the PU 22 reads out the 2D texture data 24d and the 3D texture data 24e stored in the storage device 24 (S16). This process includes a process in which the PU 22 writes the 2D texture data 24d and the 3D texture data 24e to the storage device 26. Both the 2D texture data 24d and the 3D texture data 24e are pre-rendered data. This is intended to reduce the time required for the PU 22 to execute the rendering process.

[0028] The 2D texture data 24d is data that is mapped onto a 2D model. An example of the 2D texture data 24d is shown in FIG. As shown in Fig. 4, the 2D texture data 24d includes a plurality of data selectively designated by the state defined by the scenario data 24b. Each of these data is data when the agent is in a predetermined posture and motion. The posture and motion of the agent defined by each of the plurality of data differs from one another.

[0029] The 3D texture data 24e is data that is mapped onto a 3D model defined by the 3D model data 24c. An example of the 3D texture data 24e is shown in FIG.

[0030] As shown in Fig. 5, the 3D texture data 24e includes eye data 70 and jaw data 72. The eye data 70 is data including the agent's eyes and eyebrows. The eye data 70 includes a plurality of data selectively designated according to a state defined by the scenario data 24b. Each of the data is data when the agent has a predetermined facial expression. The facial expressions of the agent defined by each of the plurality of data differ from each other.

[0031] The jaw data 72 includes a part of the agent's mouth, jaw, and nose. The jaw data 72 includes a plurality of data selectively designated by a state defined by the scenario data 24b. Each of the data is data when the agent has a predetermined facial expression. The facial expressions of the agent defined by each of the plurality of data are different from each other.

[0032] Returning to FIG. 2, the PU 22 reads out the specification data 24f stored in the storage device 24 (S18). This process includes a process in which the PU 22 writes the specification data 24f to the storage device 26. The specification data 24f is data that specifies the position and rotation angle of the 3D data for each of the data that specifies various postures and actions of the agent, which are included in the 2D texture data 24d. The specification data 24f is data for matching the posture of the agent indicated by the 2D texture data 24d with the 3D model. This is because, for example, if the position and rotation angle of the 3D model are fixed when the agent faces diagonally and when the agent faces forward, the posture of the agent indicated by the 2D texture data 24d does not match with the 3D model.

[0033] When completing the process of S18, the PU 22 temporarily ends the series of processes shown in FIG. "Image display processing" The procedure of the process relating to image display is shown in Fig. 6. The process shown in Fig. 6 is realized by the PU 22 repeatedly executing the display control program 24a, for example, at a predetermined interval.

[0034] 6, the PU 22 first reads a command for the posture and movement of the agent, which is determined by the current state of the states indicated by the scenario data 24b (S20). Next, based on the command, the PU 22 reads data to be used for display among the 2D texture data 24d and data to be used for display among the 3D texture data 24e from the storage device 26 (S22).

[0035] Next, the PU 22 maps the texture read by the process of S22 onto the 2D model (S24). Then, the PU 22 stores the data of the mapped texture in the storage device 26 (S26). Here, the storage area in which the data is stored is a part of the area in which image data to be displayed on the display unit 12 is stored.

[0036] Next, the PU 22 sets the position of the 3D model based on the data read out by the process of S22 from the 2D texture data 24d and the stipulated data 24f (S28). Then, the PU 22 maps the jaw data 72 from the 3D texture data read out by the process of S22 onto the 3D model (S30). Next, the PU 22 performs a process of projecting the texture mapped onto the 3D model onto the 2D model, and then stores the texture in the storage device 26 (S32). Here, a part of the area in which data is stored by the process of S26 becomes the target area for storage. The process of S32 is a process of superimposing the data generated by the projection process onto the data stored in the target area by the process of S26. More specifically, the contribution of the data stored in the target area by the process of S26 is increased as the data generated by the projection process is stored in the area closer to the boundary portion. This can be realized by alpha blending or the like.

[0037] Furthermore, the PU 22 maps data of the eye portion defined in the eye portion data 70 read by the process of S22 from the 3D texture data 24e onto the 3D model (S34). Next, the PU 22 performs a process of projecting the texture mapped onto the 3D model onto 2D, and then stores the texture in the storage device 26 (S36). The process of S36 is the same as the process of S32.

[0038] Furthermore, the PU 22 maps data of the eyebrow portion defined in the eye data 70 read by the process of S22 from the 3D texture data 24e onto the 3D model (S38). Next, the PU 22 performs a process of projecting the texture mapped onto the 3D model onto 2D, and then stores the texture in the storage device 26 (S40). The process of S40 is the same as the process of S32.

[0039] Then, the PU 22 operates the display unit 12 to display the data stored in the storage device 26 by the processes of S26, S32, S36, and S40 on the display unit 12 (S42). When completing the process of S42, the PU 22 temporarily ends the series of processes shown in FIG.

[0040] Here, the operation and effects of this embodiment will be described. The PU 22 controls the agent's posture and speech according to the state defined in the scenario data 24b.

[0041] FIG. 7 illustrates some of five agent images 14 with different facial expressions. FIG. 7(d) shows a state in which the agent is making eye contact with the user. In contrast, FIG. 7(a) to FIG. 7(c) and FIG. 7(e) show states in which the agent is looking away from the user. However, FIG. 7(a) to FIG. 7(c) and FIG. 7(e) show states in which the agents have different gazes. The agent images 14 shown in FIG. 7(a) to FIG. 7(e) are examples of changes in facial expressions defined by the scenario data 24b.

[0042] Here, the PU 22 does not generate the entire agent image 14 using a 3D model, but uses a 2D model and a 3D model in combination. That is, for the eyes, mouth, and eyebrows, which have a particularly large effect on the agent's facial expression, image data showing the agent image 14 is generated using a 3D model. This reduces the computation load compared to the case where the entire head of the agent, or the entire head and torso, are texture-mapped onto a dedicated 3D model. On the other hand, if the mouth, eyes, and eyebrows are also 2D models, the computation load can be reduced compared to this embodiment. However, in that case, the reality of the agent image 14 is reduced.

[0043] Therefore, according to this embodiment, it is possible to achieve a good compromise between updating the agent image 14 in real time and maintaining a high level of reality. According to the present embodiment described above, the following actions and effects can be obtained.

[0044] (1) The texture of the jaw part when the mouth is open and the texture of the jaw part when the mouth is closed, which are included in the 3D texture data 24e, are mapped onto a common lower face model 62. This reduces the computational load for display, compared to when the 3D model is allowed to deform in response to the opening and closing of the mouth.

[0045] (2) The PU 22 determines the position and rotation angle of the 3D model based on the stipulation data 24f in accordance with the selected texture of the 2D texture data 24d. This allows the 3D model to be consistent even if the posture of the agent represented by the 2D texture data 24d changes. Therefore, the posture of the agent represented by the 2D texture data 24d can be consistent with the data used for display in the 3D texture data 24e.

[0046] (3) The 2D texture data 24d and the 3D texture data 24e are pre-rendered data, which makes it possible to save the time required for rendering when displaying the agent image 14 on the display unit 12.

[0047] (4) Prior to displaying the agent image 14 on the display unit 12, the PU 22 wrote the 2D texture data 24d, the 3D texture data 24e, and the definition data 24f into the storage device 26. Since the operating speed of the storage device 26 is faster than the operating speed of the storage device 24, the above process makes it possible to quickly display and update the agent image 14.

[0048] (5) Different postures and actions of the agent are defined by the scenario data 24b according to the dialogue with the user. This allows the agent's posture and actions to be appropriate according to the dialogue with the user.

[0049] <Correspondence> The correspondence between the matters in the above embodiment and the matters described in the "Means for solving the problem" column is as follows. In the following, the correspondence is shown for each number of the means for solving the problem described in the "Means for solving the problem" column. [1,2] The storage device corresponds to the storage devices 24 and 26. The execution device corresponds to the PU 22. The 2D texture data corresponds to the 2D texture data 24d. The 3D texture data corresponds to the 3D texture data 24e. The 2D mapping process corresponds to the process of S24. The 3D mapping process corresponds to the processes of S30, S34, and S38. The display process corresponds to the processes of S26, S32, S36, S40, and S42. [3] The 3D model data corresponds to the 3D model data 24c. This corresponds to the fact that there is only one lower face model 62 shown in FIG. 3. [4] The prescribed data corresponds to the prescribed data 24f. [5] This corresponds to the fact that the data read from the storage device 24 in the process of S16 is pre-rendered data. [6] The first storage device corresponds to the storage device 24. The second storage device corresponds to the storage device 26. The write process corresponds to the processes of S12 and S14. [7] The 2D selection process corresponds to the process of S22. The 3D selection process corresponds to the process of S22.

[0050] <Other embodiments> This embodiment can be modified as follows: This embodiment and the following modifications can be combined with each other to the extent that no technical contradiction occurs.

[0051] "About 3D texture data" The jaw data 72 may be data that does not include a texture for the nose area. In the above embodiment, the 3D texture data 24e is configured from the eye data 70 and the jaw data 72, but this is not limited to this. For example, the eyebrow texture data and the eye texture data may be separate data.

[0052] It is not essential that the 3D texture data 24e has textures for each of the eyebrows, eyes, and mouth. For example, the 3D texture data 24e may have textures for each of the eyes and mouth, but not for the eyebrows.

[0053] "About 3D model data" In the above embodiment, the 3D model data 24c is configured by the upper face model 60 and the lower face model 62, but this is not limited thereto. For example, the 3D model data 24c may be configured to include data on the eyebrows, the eyes, and the chin. For example, as described in the above section "About 3D texture data," if the texture of the eyebrows is not provided, the data on the eyebrows may be deleted. For example, as described in the above section "About 3D texture data," if the texture of the nose is not provided, the data on the nose may not be provided.

[0054] The 3D model data 24c does not necessarily have to include data corresponding to each of a plurality of regions of the face. For example, the 3D model data 24c may include a single piece of data relating to a portion of the face. The 3D model data is not limited to data that does not change shape. For example, the data may be data in which the jaw can change shape according to the movement of the mouth. Also, for example, the data may be different from each other according to several groups of the 2D texture data 24d.

[0055] Polygons are not limited to having three vertices. About User Interaction The method of dialogue with the user is not limited to the method using the scenario data 24b. For example, a map may be used that searches a knowledge database for text data related to the user's speech and outputs the text data. The map may be configured, for example, using an encoder-decoder model. It may also be configured, for example, by a neural network equipped with an attention mechanism.

[0056] "About 2D and 3D selection processing" The 2D selection process is not limited to a process of selecting data specified by the scenario data 24b from the 2D texture data 24d. For example, as described in the "Dialogue with the User" section, when an agent speaks text data searched from a knowledge database, the process may be a process of selecting data according to the content of the spoken text.

[0057] The 3D selection process is not limited to a process of selecting data specified by the scenario data 24b from the 3D texture data 24e. For example, as described in the "Dialogue with the User" section, when an agent speaks text data retrieved from a knowledge database, the process may select data according to the contents of the spoken text.

[0058] "About storage devices" In the above embodiment, the 3D texture data 24e written in the storage device 26 is used in processes such as texture mapping, but this is not limited to the above. For example, texture mapping may be performed using the 3D texture data 24e stored in the storage device 24 without providing the storage device 26.

[0059] "About display control devices" It is not essential that the display control device has a storage device in which the 3D texture data 24e is stored. For example, the 3D texture data 24e may not be stored in the storage device 24, and the 3D texture data 24e may be received from an external device and stored in the storage device 26 in the process of S14.

[0060] "About the execution device" The execution device is not limited to a device that executes software processing such as a CPU, GPU, or TPU. For example, it may be equipped with a dedicated hardware circuit that performs hardware processing of at least a part of what was processed by software in the above embodiment. The dedicated hardware circuit may be, for example, an ASIC. That is, the execution device may have any of the following configurations (a) to (c). (a) It includes a processing device that executes all of the above processing according to a program, and a program storage device that stores the program. (b) It includes a processing device and a program storage device that execute part of the above processing according to a program, and a dedicated hardware circuit that executes the remaining processing. (c) It includes a dedicated hardware circuit that executes all of the above processing. Here, at least one of the software execution device equipped with a processing device and a program storage device and the dedicated hardware circuit may be multiple. [Explanation of symbols]

[0061] 10…Dialogue Unit 12...Display section 14. Agent Image 20...Display control device 24…Storage device 26…Storage device 60…Upper face model 62…Lower face model 70...Eye data 72...Jaw data

Claims

1. A storage device and an execution device, the storage device stores 2D texture data which is a plurality of texture data related to an agent, and 3D texture data which is data different from the 2D texture data and includes texture data of the eyes and mouth of the agent, The agent is a person who interacts with the user; the 2D texture data includes a plurality of data representing different poses of the agent, the 3D texture data includes a plurality of data of eyes and a mouth showing different facial expressions of the agent, the execution device performs 2D mapping processing, 3D mapping processing, and display processing; the 2D mapping process is a process of mapping one piece of data selected from a plurality of pieces of posture data included in the 2D texture data onto a 2D model; the 3D mapping process is a process of mapping data of one facial expression selected from a plurality of facial expressions included in the 3D texture data onto a 3D model; The display control device, wherein the display processing is processing for displaying image data obtained by combining the image data subjected to the 2D mapping processing and the image data subjected to the 3D mapping processing on a display unit.

2. 2. The display control device according to claim 1, wherein the 3D texture data includes a plurality of data of eyebrows showing different facial expressions of the agent.

3. the storage device stores 3D model data onto which the 3D texture data is mapped; The data of the mouth part in the 3D texture data includes data of the jaw part, the jaw data includes data of a closed mouth and data of an open mouth, 3. The display control device according to claim 1, wherein the 3D model onto which data of the jaw portion when the mouth is closed is mapped and the 3D model onto which data of the jaw portion when the mouth is open is mapped are the same model.

4. the storage device stores definition data that defines a position and a rotation angle of the 3D model for each of different postures of the agent represented by the 2D texture data; 4. The display control device according to claim 1, wherein the 3D mapping process is a process of mapping the 3D texture data onto the 3D model based on the definition data.

5. 5. The display control device according to claim 1, wherein the 3D texture data stored in the storage device is pre-rendered data.

6. The storage device includes a first storage device and a second storage device, the first storage device constantly stores the 3D texture data; The execution device executes a write process; the writing process is a process of writing the 3D texture data stored in the first storage device to the second storage device, 6. The display control device according to claim 1, wherein the 3D mapping process is a process of mapping the 3D texture data onto the 3D model using the 3D texture data written to the second storage device.

7. The execution device is a 2D selection process for selecting data to be used in the 2D mapping process from a plurality of data showing different poses of the agent in response to a dialogue with the user; a 3D selection process for selecting data to be used in the 3D mapping process from a plurality of data showing different facial expressions of the agent in response to a dialogue with the user; The display control device according to any one of claims 1 to 6, which executes the above.

Images