Virtual assistant device and program for virtual assistant device

Abstract

To provide a technique that facilitates the use of content by a user who uses a virtual assistant device.SOLUTION: In a virtual assistant device 10, a control unit 11 executes control to perform a predetermined notification via an interface 13 when a communication unit 12 receives content information distributed from the outside. When receiving an input instructing provision of content via the interface 13 after performing the notification, the control unit 11 causes a display unit 15 to display the content based on the content information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a virtual assistant device and a program for a virtual assistant device. [Background technology]

[0002] Patent Document 1 discloses an example of an agent device. The agent device in Patent Document 1 uses a display device and a speaker to display an agent as an image and sound, and asks questions to determine the user's personality that are natural according to the situation. Furthermore, this agent device determines the user's personality from the user's answers inputted through a microphone, and changes the agent's personality to match the user's personality. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-133728 A Summary of the Invention [Problem to be solved by the invention]

[0004] The device of Patent Document 1 cannot secure sufficient opportunities for conversation unless the user speaks, so it is difficult for users who are not proactive to secure sufficient opportunities to receive content. In this respect, there is room for improvement in the conventional technologies, including the device of Patent Document 1.

[0005] One object of the present invention is to provide a technology that can easily promote the use of content by users who use virtual assistant devices. [Means for solving the problem]

[0006] The virtual assistant device according to the present invention is A virtual assistant device comprising an interface for receiving and outputting input from a user, a communication unit for communicating with an external device, and a control unit for displaying a character embodied in a display unit constituting the interface, When the communication unit receives content information distributed from outside, the control unit controls the communication unit to make a predetermined notification via the interface, and after making the notification, when an input instructing the provision of content is received via the interface, the control unit causes the display unit to display content based on the content information.

[0007] The above virtual assistant device can inform the user that content has been distributed because it issues a predetermined notification via an interface when the communication unit receives content information distributed from the outside. Therefore, this device can actively give the user an opportunity to receive content, making it easy for the user to secure an opportunity to receive content. Moreover, this device can display content based on the distributed content information when it receives an "input instructing the provision of content" after the above notification, making it easy for the user to receive the desired topic at the desired time. Therefore, this virtual assistant device is easy to promote the use of content by the user. In addition, it is economical because there is no need to provide a sensing system for recognizing the user, such as a human sensor, in addition to this device.

[0008] In the virtual assistant device, the interface may have at least one of a motion detection unit that detects an input motion from the user by contact or non-contact, or a voice input unit that acquires a voice signal indicating the voice of the user. After making the notification, the control unit may determine whether or not the instruction input has been received based on at least one of the motion detected by the motion detection unit or the voice acquired by the voice input unit.

[0009] The above virtual assistant device can more accurately confirm whether or not there has been an "input instructing the provision of content" in response to a notification informing of distribution by detecting motion or voice.

[0010] In the above virtual assistant device, if the instruction input is not made even after a predetermined time has elapsed after the notification, the control unit may cause the display unit to display notification information indicating that the content information has been delivered.

[0011] If the user does not notice the notification or does not wish to receive the content at the time of notification, the above-mentioned virtual assistant device can notify the user of the delivery of content information through notification information, making it easier to respond after the fact.

[0012] The type of information desired by the user may be registered in a registration unit provided in the virtual assistant device or outside the virtual assistant device. The control unit may control output of the content of the type registered in the registration unit via the interface.

[0013] The above-mentioned virtual assistant device can select and provide the type of content that the user desires or that is meaningful to the user, which makes it easier for the user to become interested and increases the user's satisfaction.

[0014] In the above virtual assistant device, the control unit may switch between a standby mode in which the control unit monitors whether a wake word has been input to the interface and whether a motion has been detected by the motion detection unit, and a conversation mode in which at least words other than the wake word are detected. If input of the wake word is detected during the standby mode, the control unit may switch to the conversation mode. During the standby mode, the control unit may display an image of the character performing a standby motion on the display unit while outputting the conversation uttered by the character to the interface, and may operate to switch to the conversation mode until a predetermined time has elapsed since the conversation was output.

[0015] In the above virtual assistant device, since the character performs standby actions during standby mode, the character's actions are likely to leave an impression on the user even during standby mode. Furthermore, since the character can be operated to spontaneously start a conversation during standby mode, a situation can be created in which the character invites the user to a conversation while performing a standby action. Moreover, while the above virtual assistant device is premised on switching to a conversation mode upon detection of a wake word or switching by operating an operation unit such as a touch panel, after the character starts a conversation, it can automatically switch to the conversation mode until a predetermined time has passed, so that the user can enter into a conversation without uttering a wake word, and the conversation can proceed in a more natural flow.

[0016] The virtual assistant device according to the present invention is A virtual assistant device comprising an interface for receiving and outputting input from a user, a communication unit for communicating with an external device, and a control unit for displaying a character embodied in a display unit constituting the interface, The control unit is a standby mode for at least one of monitoring whether a wake word has been input to the interface and monitoring whether a motion has been detected by a motion detection unit, and a conversation mode for detecting at least words other than the wake word, and switching to the conversation mode when input of the wake word is detected during the standby mode; During the standby mode, an image of the character performing a standby action is displayed on the display unit while a conversation uttered by the character is output to the interface as voice; The mode is switched to the conversation mode until a predetermined time has elapsed since the conversation was output.

[0017] In the above virtual assistant device, since the character performs standby actions during standby mode, the character's actions are likely to leave an impression on the user even during standby mode. Furthermore, since the character can be operated to spontaneously start a conversation during standby mode, a situation can be created in which the character invites the user to a conversation while performing a standby action. Moreover, while the above virtual assistant device is premised on switching to a conversation mode upon detection of a wake word or switching by operating an operation unit such as a touch panel, after the character starts a conversation, it can automatically switch to the conversation mode until a predetermined time has passed, so that the user can enter into a conversation without uttering a wake word, and the conversation can proceed in a more natural flow.

[0018] In the above virtual assistant device, the control unit may operate to switch to the standby mode if no words other than the wake word are detected during the conversation mode until the predetermined time has elapsed.

[0019] This virtual assistant device can return to standby mode if there is no response from the user during the conversation mode until the above-mentioned predetermined time has elapsed. For example, if the user is not nearby during the conversation mode after the character has spontaneously started a conversation, or if the user does not want to talk and does not respond, the device can be automatically returned to standby mode, thereby preventing the conversation mode from continuing for too long in a situation where the conversation mode is not necessary.

[0020] In the virtual assistant device, the control unit may operate, during the conversation mode until the predetermined time has elapsed, to cancel the standby image and display a basic image in which the character faces forward, while detecting words other than the wake word input to the interface.

[0021] This virtual assistant device can receive a response from a user while the character faces forward during a conversation mode until a predetermined time has elapsed, so that the user can be given the impression that the character is waiting for the user to speak while paying attention to the user.

[0022] In the virtual assistant device, the control unit detects words other than the wake word while displaying the image of the standby operation during the conversation mode until the predetermined time has elapsed.

[0023] This virtual assistant device can give the user the impression that the character is waiting to speak to the user while performing a standby action during the conversation mode.

[0024] In the above virtual assistant device, the control unit may operate to display a plurality of options on the display unit when a predetermined condition is met, and to determine which option was selected based on the input result into the interface after the plurality of options are displayed.

[0025] This virtual assistant device can simplify answer candidates by presenting options, making it easier to answer, and by determining which option the user has selected, it can be used in a way that makes it difficult to misinterpret the user's intentions.

[0026] A program for a virtual assistant device according to one embodiment of the present invention is A program used in a virtual assistant device equipped with an interface that accepts and outputs input from a user, a communication unit that communicates with an external device, and a control unit that displays a character embodied in a display unit that constitutes the interface, a step of executing control for performing a predetermined notification via the interface when the communication unit receives content information distributed from an external source; a step of executing control to cause the display unit to display content based on the content information when an input instructing provision of content is made via the interface after the notification is made; Includes.

[0027] The above-mentioned program for the virtual assistant device can notify the user of the content distribution by making a predetermined notification via the interface when the communication unit receives content information distributed from the outside. Therefore, the above-mentioned program can actively give the user an opportunity to receive the content, making it easier for the user to secure an opportunity to receive the content. Moreover, the above-mentioned program can display the content based on the distributed content information when it receives an "input instructing the provision of content" after the above-mentioned notification, making it easier for the user to receive topics at the time of his or her choice.

[0028] A program for a virtual assistant device according to one embodiment of the present invention is A program used in a virtual assistant device equipped with an interface that accepts and outputs input from a user, a communication unit that communicates with an external device, and a control unit that displays a character embodied in a display unit that constitutes the interface, switching the control unit between a standby mode in which the control unit at least one of monitors whether a wake word has been input to the interface and monitors whether a motion has been detected by a motion detection unit and a conversation mode in which the control unit detects at least words other than the wake word, and switching to the conversation mode when input of the wake word is detected during the standby mode; operating the control unit to cause the display unit to display an image of the character performing a standby action during the standby mode while outputting a conversation uttered by the character to the interface as voice; switching the control unit to the conversation mode until a predetermined time has elapsed since the conversation was output; Includes.

[0029] In the virtual assistant device operated by the above program, the character performs standby actions during standby mode, so that the character's actions are more likely to leave an impression on the user even during standby mode. Furthermore, during standby mode, the character can be operated to start a conversation spontaneously, so that a situation can be created in which the character invites the user into a conversation while performing standby actions. Moreover, while it is assumed that the conversation mode is switched to by detecting a wake word or by operating an operation unit such as a touch panel, after the character starts a conversation, the conversation mode can be automatically switched to until a predetermined time has passed, so that the user can enter into a conversation without uttering a wake word, and the conversation can proceed in a more natural flow. Effect of the Invention

[0030] According to the present invention, it is easy to promote the use of content by users who use virtual assistant devices. [Brief description of the drawings]

[0031] [Figure 1] FIG. 1 is a block diagram showing a simplified electrical configuration of a virtual assistant system including a virtual assistant device of the first embodiment. [Diagram 2] FIG. 2 is an explanatory diagram showing Example 1 of a normal display in the virtual assistant device of the first embodiment. [Diagram 3] FIG. 3 is an explanatory diagram conceptually illustrating an example of the data structure of user data stored in the management device. [Figure 4] FIG. 4 is an explanatory diagram conceptually illustrating an example of the data structure of content-related data stored in the management device. [Diagram 5] FIG. 5 is a flowchart illustrating a control flow in the virtual assistant device of the first embodiment. [Figure 6] FIG. 6 is an explanatory diagram showing Example 2 of a normal display in the virtual assistant device of the first embodiment. [Figure 7] FIG. 7 is an explanatory diagram showing Example 3 of a normal display in the virtual assistant device of the first embodiment. [Figure 8] FIG. 8 is an explanatory diagram showing Example 4 of a normal display in the virtual assistant device of the first embodiment. [Figure 9] FIG. 9 is an explanatory diagram illustrating an example of a "predetermined notification" in the virtual assistant device of the first embodiment. [Figure 10] FIG. 10 is an explanatory diagram showing Example 5 of a normal display in the virtual assistant device of the first embodiment, and is a diagram showing an example in which notification information is displayed. [Figure 11] FIG. 11 is an explanatory diagram showing a first example of content provision in the virtual assistant device of the first embodiment. [Figure 12] FIG. 12 is an explanatory diagram showing a second example of content provision in the virtual assistant device of the first embodiment, and is an example of a display following the display in FIG. [Figure 13]FIG. 13 is an explanatory diagram showing a third example of content provision in the virtual assistant device of the first embodiment, and is an example of a display following the display in FIG. [Figure 14] FIG. 14 is an explanatory diagram showing a fourth example of content provision in the virtual assistant device of the first embodiment, and is an example of a display following the display in FIG. [Figure 15] FIG. 15 is an explanatory diagram illustrating example 1 of starting a conversation with the virtual assistant device of the first embodiment. [Figure 16] FIG. 16 is an explanatory diagram illustrating example 2 of starting a conversation with the virtual assistant device of the first embodiment. [Figure 17] FIG. 17 is an explanatory diagram showing a fifth example of content provision in the virtual assistant device of the first embodiment. [Figure 18] FIG. 18 is an explanatory diagram showing a sixth example of content provision in the virtual assistant device of the first embodiment, and is an example of a display following the display in FIG. [Figure 19] FIG. 19 is an explanatory diagram showing an example of display of a list of accumulated contents in the virtual assistant device of the first embodiment. [Figure 20] FIG. 20 is an explanatory diagram showing an example of a display of a standby image in the virtual assistant device of the first embodiment. [Figure 21] FIG. 21 is an explanatory diagram showing a display example when a basic image is displayed in the virtual assistant device of the first embodiment. [Figure 22] FIG. 22 is an explanatory diagram showing an example of a display of a standby image in the virtual assistant device of the first embodiment, which is different from that in FIG. 20. [Figure 23] FIG. 23 is an explanatory diagram showing a first example of content provision in a virtual assistant device of another embodiment. [Figure 24] FIG. 24 is an explanatory diagram showing a second example of content provision in a virtual assistant device of another embodiment. [Diagram 25] FIG. 25 is an explanatory diagram showing a third example of content provision in a virtual assistant device of another embodiment. [Figure 26] FIG. 26 is an explanatory diagram showing an example of displaying a plurality of options in a virtual assistant device of another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0032] First Embodiment 1. Overview of Virtual Assistant System The virtual assistant system 1 shown in FIG. 1 includes a virtual assistant device 10 and a management device 90. In the following description, the virtual assistant system 1 is also simply referred to as system 1. In the representative example described below, the virtual assistant device 10 functions as a virtual assistant device for elderly people, and can be used by users in nursing homes, homes, hospitals, etc.

[0033] 2.Hardware configuration of virtual assistant device 1, the virtual assistant device 10 may be an information communication terminal in which an application program is installed and stored and made available on a general-purpose information terminal such as a tablet terminal, a smartphone, a personal computer, or a television configured to be able to communicate with an external device, or may be a dedicated device capable of realizing each function described below. The virtual assistant device 10 may be a portable information device having a communication function, or may be a stationary information device having a communication function.

[0034] 1, the virtual assistant device 10 includes a control unit 11, a communication unit 12, an interface 13, and a storage unit 14. A representative example of the virtual assistant device 10 described below is an example in which the virtual assistant device 10 is realized by a tablet terminal as shown in FIG.

[0035] The control unit 11 shown in Fig. 1 is configured as, for example, a known information processing device. The control unit 11 includes a known calculation device such as a CPU and other peripheral circuits, and can perform various controls and calculations. The control unit 11 has a function of displaying embodied characters on the display unit 15 constituting the interface 13.

[0036] The communication unit 12 shown in Fig. 1 is a device capable of directly accessing a wide area communication network or indirectly accessing a wide area communication network via another device by a known wired communication method or a known wireless communication method. The communication unit 12 may be configured to perform wireless communication with a base station and directly access a wide area communication network (e.g., the Internet) via a base station not shown. The communication unit 12 may be configured to perform wireless communication with an access point not shown and indirectly access a wide area communication network via the access point. The communication unit 12 may be configured to perform wired communication with a relay device (such as a router) and access a wide area communication network via the relay device.

[0037] 1 is a device for receiving and outputting input from a user. The interface 13 includes a display unit 15, a voice output unit 16, an operation unit 17, and a voice input unit 18.

[0038] The display unit 15 and the audio output unit 16 function as an output unit that outputs information. The display unit 15 is configured as a known image display device such as a liquid crystal display or an organic electroluminescence display. In the representative example described below, the display unit 15 forms a part of a touch panel type display device. The audio output unit 16 is configured by a sound output device such as a known speaker. The audio output unit 16 has a function of outputting various sounds in cooperation with the control unit 11.

[0039] The operation unit 17 and the voice input unit 18 function as input units for inputting information. The operation unit 17 corresponds to an example of a motion detection unit, and is an input device that allows input operations by a contact method. A suitable example of the operation unit 17 is a touch panel. The voice input unit 18 is composed of a voice input device such as a well-known microphone. The voice input unit 18 has a function of converting input sound into an electric signal and providing it to the control unit 11.

[0040] In a representative example described below, as shown in Fig. 2 etc., display unit 15 and operation unit 17 constitute a touch panel type display device 20. Touch panel type display device 20 is also simply referred to as a touch panel 20. In the example of Fig. 2 etc., operation unit 17 is configured to be able to transmit light from display unit 15, and a transparent panel covers display unit 15 in a configuration in which an image from display unit 15 can be viewed from the outside.

[0041] The storage unit 14 has a function of storing various information. A known storage device such as a semiconductor memory, HDD, or SSD is adopted as the storage unit 14. The control unit 11 has a function of writing various information to the storage unit 14 and a function of reading various information stored in the storage unit 14. Various programs such as application programs described below are stored in the storage unit 14. The storage unit 14 also stores identification information (e.g., URL (Uniform Resource Locator) and the like) for accessing sites, information, programs, etc. managed by the management device 90 via a wide area communication network.

[0042] 3.Management device The management device 90 shown in Fig. 1 has various information processing functions and various calculation functions. Specifically, the management device 90 has a function of registering various information, a function of distributing various information, and the like. The management device 90 may be any device having a communication function and an information processing function. The management device 90 is configured as a computer equipped with, for example, a CPU, a storage medium, a communication device, and the like. In the example of Fig. 1, the management device 90 includes a control device 91, a communication unit 92, a display unit 93, an input unit 94, and a storage unit 95.

[0043] The control device 91 is configured as, for example, a known information processing device. The control unit 11 includes a known arithmetic unit such as a CPU and other peripheral circuits, and can perform various controls and calculations.

[0044] The communication unit 92 is a device capable of directly accessing a wide area communication network or indirectly accessing the wide area communication network via another device by a known wired communication method or a known wireless communication method. The communication unit 92 may be configured to perform wireless communication with a base station and directly access the wide area communication network via a base station (not shown). The communication unit 92 may be configured to perform wireless communication with an access point (not shown) and indirectly access the wide area communication network via the access point. The communication unit 92 may be configured to perform wired communication with a relay device (router, etc.) and access the wide area communication network via the relay device.

[0045] The display unit 93 is configured as a known image display device. The input unit 94 is configured as a known input device such as a keyboard, a mouse, a touch panel, a voice input unit, etc., and allows information to be input by touch operation or voice. The storage unit 95 is a storage device that stores various information. A database may be configured in the storage unit 95.

[0046] 4. Distribution of content from the management device Information on users to whom information is to be delivered is registered in the management device 90. FIG. 3 shows an example of the data structure of user data stored in the storage unit 95 of the management device 90 shown in FIG. 1. As shown in FIG. 3, the user data stored in the management device 90 constitutes a database, and IDs, registration types, and user information are stored in association with each user. The ID is information that can identify each user and is identification information that can specify each user. The registration type is information for registering information desired by the user or types of information that are meaningful to the user. The user information is various information on the user, and may include personal information such as name, date of birth, email address, hobbies, health information, place of residence, and past episodes, and may include delivery destination information that specifies the delivery destination of the content. For example, in the user data of FIG. 3, if ID1 is specified as the user ID, the type of information desired by the user specified by "ID1" is specified by the information in "registration type 1", and the personal information of the user is specified by the information in "user information 1".

[0047] In the system 1 according to the present embodiment, various types can be registered as the "type of information desired by the user" or the "information meaningful to the user". Specifically, as the "type of information desired by the user" or the "information meaningful to the user", a plurality of types related to hobbies or meaning in life may be prepared in advance so as to be selectable, and any one or more types selected from the plurality of types may be included in the registered information. As the types related to hobbies or meaning in life, for example, various types such as gardening, sports, recreation, gymnastics, music, art, cooking, nostalgic photos, shopping information, etc. may be prepared. Alternatively, as the type of information desired by the user, a plurality of types related to illnesses may be prepared in advance so as to be selectable, and any one or more types selected from the plurality of types may be included in the registered information. Specifically, a plurality of types related to prevention of aging syndromes, rehabilitation, and relaxation may be prepared in advance so as to be selectable, and any one or more types selected from the plurality of types may be included in the registered information.

[0048] 3, assume that ID1 is information "00001", registration type 1 is information identifying "gardening, gymnastics", and user information 1 is information identifying "Yamada Taro" as the user name and "address information 1" as the destination address. In this case, by referring to the user data, the control device 91 can identify that the name of the user identified by the ID "00001" is "Yamada Taro", the destination address is "address information 1", and the type desired by this user is "gardening, gymnastics".

[0049] The management device 90 is capable of registering and distributing content. Fig. 4 shows an example of the data structure of content-related data stored in the storage unit 95 of the management device 90 shown in Fig. 1. As shown in Fig. 4, the content-related data stored in the management device 90 constitutes a database, and for each piece of content, content identification information, content data, distribution date and time, and content type are stored in association with each other. In this specification, content data corresponds to an example of content information, and is also simply referred to as content.

[0050] The content identification information may be any information capable of identifying and specifying each piece of content, and may be an identification number or a specific name. The content data is specific data for the content, and may include video data, still image data, audio data, etc., and may also include other data (e.g., program data, etc.). The distribution date and time is information that specifies the date and time when the associated content (content data) is distributed. The type information is information that specifies the type of the associated content (content data). The type of content specified by the type information may be one type, or multiple types.

[0051] The management device 90 distributes each content (content data) identified by each identification information to the virtual assistant device 10 of the user to whom each content should be distributed (the user who has registered each type of content) at each distribution date and time associated with each content. Note that in FIG. 1, only one virtual assistant device 10 owned by one user is illustrated, but in the system 1, many users can possess virtual assistant devices 10, and in FIG. 1, the illustration of virtual assistant devices 10 owned by other users is omitted. When distributing content, if there are multiple users to whom the content is to be distributed, the management device 90 can distribute the content to any of the virtual assistant devices 10 of the users.

[0052] For example, in the content-related data in FIG. 4, "identification information 1" is "0000A", "data 1" is "predetermined video data related to gardening", "date and time information 1" is "January 1, 2021, 10:00", and "type information 1" is information identifying "gardening". In this case, by referring to the content-related data in FIG. 4, the control device 91 can determine that the content data associated with "0000A" (data 1 "predetermined video data related to gardening") should be distributed as data of the type "gardening" at "January 1, 2021, 10:00". In this case, the management device 90 distributes the content data identified by the identification information 1 (0000A) (data 1 "predetermined video data related to gardening") to the virtual assistant device 10 of the user who registers data of the type "gardening" (the user who includes "gardening" as a registered type in the user data in FIG. 3) at "January 1, 2021, 10:00".

[0053] 5. Receiving control of virtual assistant devices 5-1. Basic control An application program is stored in the virtual assistant device 10. This application program is installed in the virtual assistant device 10. This application program is stored in the storage unit 14, and is read and executed by the control unit 11.

[0054] As described above, the management device 90 distributes content (content data) to the virtual assistant device 10. The content distributed from the management device 90 to the virtual assistant device 10 may be content belonging to a type registered in advance by the user who owns the virtual assistant device 10, or may be content selected by the management device 90 regardless of registration by the user. The virtual assistant device 10 receives content distributed to itself from the management device 90 via the communication unit 12. When the communication unit 12 receives content (content data) distributed from the outside (management device 90), the control unit 11 executes control to store the content data in the storage unit 14 and perform a "predetermined notification" via the interface 13. The "predetermined notification" may be performed before the content data is stored in the storage unit 14.

[0055] Specifically, the application program causes the control unit 11 to perform control in a flow as shown in Fig. 5. When a predetermined start condition is met (for example, when a predetermined start operation is performed on the operation unit 17), the control unit 11 executes the application program, and in step S1, causes the display unit 15 to display the character 70 embodied by an image.

[0056] FIG. 2 shows a specific example of the display made in step S1. In FIG. 2, the character 70 is a virtual assistant (anthropomorphic) imitating an ordinary person. The character 70 shown in FIG. 2 is merely an example, and may be a virtual assistant imitating a person of a specific profession such as a care worker, a nurse, or a doctor. The virtual assistant may also be an animal or a robot, not limited to a person. The application program may be provided with a program that realizes the function of a chatbot so that the character 70 shown in FIG. 2 automatically conducts a conversation. The content of the automatic conversation can be changed or selected according to the attributes (gender, family structure, housing environment, birthday, hobbies, etc.) registered in advance by the user. The image of the character 70 shown in FIG. 2 can be realized by a still image or a video, and during the period when the processes of steps S3 and S8 described later are not being executed, the facial expression, posture, movement, behavior, etc. of the character 70 may be changed in various ways according to the passage of time, as shown in FIG. 6, FIG. 7, and FIG. 8.

[0057] In steps S1, S3, S4, S8, etc., the control unit 11 displays the character 70 as shown in Fig. 2, Fig. 6 to Fig. 8. In this case, the display unit 15 may display the season, calendar, date, time, etc., or may display illustrations, photographs, computer graphics, and other images that evoke the time periods of morning, noon, evening, and night. For example, Fig. 6 shows an image of a predetermined daytime period, in which the color of the background outside the character 70 is shown in a light color (specifically, a predetermined light color) to indicate that it is the daytime period. On the other hand, Fig. 8 shows an image of a predetermined nighttime period, in which the color of the background outside the character 70 is shown in a dark color (predetermined dark color) to indicate that it is the nighttime period.

[0058] After step S1, in step S2, the control unit 11 determines whether or not a conversation start condition is satisfied. The conversation start condition is a condition that is predetermined as a condition for starting a conversation from the virtual assistant device 10. The conversation start condition may be that a predetermined voice is input to the voice input unit 18 (for example, that a predetermined wake word is input). In the example of FIG. 15, the name of the character 70 is set as the wake word, and the voice input of this wake word is set as one of the conversation start conditions. In the example of FIG. 16, a predetermined greeting (for example, the word "hello") is set as the wake word, and the voice input of this wake word is set as one of the conversation start conditions. The conversation start condition is not limited to these examples, and may be, for example, that a predetermined operation is performed on the operation unit 17 (for example, that an operation of tapping the vicinity of the display unit 15 is performed). The conversation start condition may be that a preset reservation time has arrived.

[0059] If the control unit 11 determines in step S2 that the conversation start condition is met, the process proceeds to step S3 and starts the conversation or provision of content. The conversation or provision of content in step S3 can be performed in the same manner as in step S8 described below. On the other hand, if the control unit 11 determines in step S2 that the conversation start condition is not met, the process proceeds to step S4 and continues normal display. Note that while the No determinations in steps S2 and S5 are repeated, the character display as shown in Figs. 2 and 6 to 8 is continued, and during this time, the facial expression, posture, movement, behavior, etc. of the character 70 are changed in various ways.

[0060] After step S3 or step S4, in step S5, the control unit 11 determines whether or not a new distribution has occurred. If the control unit 11 determines in step S5 that the communication unit 12 has not received the content (content data) distributed from the management device 90, the control unit 11 determines No in step S5 and returns the process to step S2, and performs the processes from step S2 onwards again. If the control unit 11 determines in step S5 that a new distribution has occurred, the control unit 11 determines Yes in step S5 and performs the processes from step S6 onwards.

[0061] 5-2. When a new broadcast occurs In step S5, the control unit 11 determines whether the communication unit 12 has received content (content data) distributed from the management device 90. If it is determined that the communication unit 12 has received the content, in step S6, the control unit 11 causes the interface 13 to perform a "predetermined notification." The "predetermined notification" is a display or audio output of "transmission information that informs the virtual assistant device 10 that new content has been distributed from the outside." The display or audio output of the transmission information may be a display or audio output of a message, an image display such as a symbol or a picture that informs the user that new content has been distributed, or an output of a notification sound (such as an alarm sound or a buzzer sound) that informs the user that new content has been distributed. As the notification sound, for example, a bell or a charm sound of a telephone that is familiar to hear in daily life is preferable. For example, FIG. 9 shows an example of a "predetermined notification." 9, as a "predetermined notification", a message image 72 indicating that a distribution specified by the distribution name has arrived is displayed on the display unit 15, but instead of or in combination with such a message display, a message notification by voice, an image display such as a picture, output of a notification sound, etc. may be performed. For example, the notification may be made by a character's conversation.

[0062] In this way, when the communication unit 12 receives content data (content information) distributed from the outside (management device 90), the above application program causes the control unit 11 to execute "control to make a predetermined notification via the interface 13" in step S6.

[0063] In step S6, the control unit 11 causes the interface 13 to perform a "predetermined notification," and then in step S7, the control unit 11 determines whether or not a provision instruction has been received. Specifically, in step S7, the control unit 11 determines whether or not an input instructing the provision of content has been received via the interface 13.

[0064] The "input instructing the provision of content" may be, for example, a predetermined operation on the operation unit 17, or a predetermined voice input. For example, in an example in which a "predetermined notification" as shown in FIG. 9 is made by the processing of step S6, two selection buttons (button images of "Don't watch" and "Watch") are displayed together with the message of the "predetermined notification". In this case, the operation of selecting "Watch" from among the selection buttons (for example, the operation of clicking image 72 of "Watch") corresponds to an example of an "input instructing the provision of content". Therefore, if an operation of selecting "Watch" is made after the display as shown in FIG. 9 is made in step S6, then in step S7 it is determined that an input instructing the provision of content has been received, and the processing of step S8 is executed.

[0065] When the control unit 11 determines in step S7 that the "input instructing the provision of content" has not been received, the control unit 11 stores the newly distributed content data in the storage unit 14 in step S9. For example, when the control unit 11 performs the "predetermined notification" in step S6 and there is no "input instructing the provision of content" until a predetermined time has elapsed, the control unit 11 causes the display unit 15 to display notification information indicating that content data (content information) has been distributed, as shown in FIG. 10. For example, when two new content data are distributed from the management device 90 and the "predetermined notification" is performed in step S6 as shown in FIG. 9, if the "view" button is not pressed even after a predetermined time has elapsed since the start of the "predetermined notification," the process proceeds to step S9, where the newly distributed content data is stored and an image as shown in FIG. 10 is displayed. In the image in FIG. 10, the number of unprovided contents among the newly distributed contents is displayed by an image 74 as notification information. In addition, when a "predetermined notification" is made in step S6 as shown in Figure 9, if the "Do not watch" button is selected (i.e., if an input is made to suspend the provision of content), the process proceeds to step S9 and similar processing is performed.

[0066] If the control unit 11 determines in step S7 that it has received an "input instructing the provision of content", it causes the display unit 15 to display a conversation or content to be provided in step S8. If the control unit 11 determines Yes in step S7 and performs the process of step S8, it causes the display unit 15 and the audio output unit 16 to output content based on content data (content information) newly distributed from the management device 90 (for example, playing a video or displaying a still image, outputting audio, etc., included in the newly distributed content data).

[0067] When the result of step S7 is Yes, the control performed in step S8 is to output "a conversation about the content received by the communication unit 12" via the interface 13. FIG. 11 to FIG. 14 show an example of the control performed by the control unit 11 in step S8 when the result of step S7 is Yes. FIG. 11 to FIG. 14 show an example of providing a new content "lively delivery" about "gardening" from the management device 90 in step S8. In this example, the delivered content data includes a video and conversation data about "gardening". In this case, the control unit 11 performs control so that a voice is generated for the conversation while playing back the action in step S8. For example, in the example of FIG. 13, when a sunflower field is displayed, the conversation "Sunflowers are a summer flower, and have a lively image" is generated. When this conversation is generated, the character 70 is displayed, so that the impression that the character 70 is speaking can be given. When the conversation is generated, the control unit 11 may generate the conversation using a nickname of the user registered in advance.

[0068] In step S8, the control unit 11 provides the content, and when a conversation is made to the user as shown in FIG. 13, the control unit 11 then attempts to "recognize a response from the user" based on at least one of the action detected by the action detection unit or the voice input to the voice input unit. For example, a predetermined response operation on the operation unit 17 (e.g., tapping the character 70 or other design) or a predetermined voice input to the voice input unit 18 (e.g., input of words) is defined as a "response from the user". When there is a "response from the user" in the interface 13, the control unit 11 performs control so that a further conversation in response to this response is output via the interface 13. The "further conversation in response to the response" may be a topic of the type of content being provided, or may be a topic different from that type. The "further conversation in response to the response" is preferably displayed as text and output as a voice, but may be either one of them. When the control unit 11 performs control so as to issue a "further conversation in response to the response", it is preferable to again attempt to "recognize a response from the user". Then, when there is a "response from the user", it is preferable to output the further conversation in response to this response via the interface 13. In this way, the conversation can be continued by repeating "further conversation in response to a response" and "recognition of a response from the user."

[0069] In this way, the control unit 11 outputs a "conversation about the content" via the interface 13, and then, when a "response from the user" is recognized via the interface 13, performs control so as to output a "conversation in response to the response" via the interface 13. Step S8 is a step for causing the control unit 11 to perform such control.

[0070] In addition, when a conversation is conducted in step S8, the control unit 11 may display the speech content (user's speech content) input by voice via the voice input unit 18 or the speech content of the virtual assistant device 10 (for example, the speech content of the character 70) in text on the display unit 15 in combination with voice input and output.

[0071] 11 to 14 show an example of providing content of a type (a type desired by the user) registered in association with the virtual assistant device 10, but the content and conversation provided in step S8 are not limited to this example. For example, when content related to "tomorrow's weather" is distributed as a new distribution from the management device 90, a conversation related to this content may be started in step S8 as shown in FIG. 17. Alternatively, when it is determined that the conversation start condition is satisfied in step S2, a conversation and content related to "tomorrow's weather" may be started in step S3 as shown in FIG. 17. Even if the conversation is started in step S8 as shown in FIG. 17, the control unit 11 attempts to "recognize a response from the user" based on at least one of the movement detected by the movement detection unit or the voice input to the voice input unit after the start. Then, when the "response from the user" described above is received in the interface 13 (for example, when there is a tap near the character 70), the control unit 11 performs control so that further conversation in response to this response is output via the interface 13 as shown in FIG. 18.

[0072] When the control unit 11 conducts a conversation via the interface 13, the control unit 11 may generate or change the display or audio output of any of the character's facial expression, character's action, telop, sound effect, and icon in at least one of the conversation regarding the content or the conversation in response to the response. For example, in the example of FIG. 18, a "new heart mark picture (icon)" and "excited characters (telop)" are generated from the example of FIG. 17 to visually indicate that the character 70 is in a good mood. The control unit 11 may output audio sound effects together with the display as shown in FIG. 18. In the display of FIG. 18, the control unit 11 may change the character 70's facial expression to a smile or cause the character 70 to perform an action such as jumping or skipping. FIG. 18 shows an example of the character 70 being in a good mood, but the character 70 may be changed to a gloomy expression, an angry expression, a sad expression, or the like, or the character 70 may be caused to perform a happy action or a crying action. In addition, the types of telop, sound effect, and icon are not limited to the example of FIG. 18, and may be changed in various ways.

[0073] In the control of Fig. 5, steps S1, S3, S4, and S8 correspond to an example of a step of causing the control unit 11 to perform "an operation of displaying the character 70 on the display unit 15". Step S8 corresponds to an example of a step of causing the control unit 11 to perform "control of outputting a conversation about the content via the interface 13". Step S8 corresponds to an example of a step of causing the control unit 11 to perform "control of causing the display unit to display the content based on the content information".

[0074] Although the control is omitted in the flowchart of FIG. 5, when a predetermined input is made to instruct the provision of the stored content, the provision of the stored content and a conversation regarding the content may be started. For example, when the above-mentioned notification information (image 74 in FIG. 10) is displayed as shown in FIG. 10 while the No determination in step S2 and the No determination in step S5 are repeated (while the normal display continues), when a predetermined operation (for example, an operation to select the image 74 showing the notification information or its vicinity) is performed, a list of contents (delivery history (incoming call history)) indicating that the notification information is stored may be displayed as shown in FIG. 19. Then, when an operation to select any content is performed in the list, the selected content may be provided and a conversation regarding the content may be started. When a content is selected in this way, the content and the conversation may be performed in the same manner as in the examples of FIG. 11 to FIG. 14, or in the same manner as in the examples of FIG. 17 and FIG. 18.

[0075] 5-3. Details of normal operation during periods when there are no new deliveries The following description relates to details of normal operation performed during a period when there is no new distribution (period when step S5 is judged as No). During this period, the control unit 11 mainly switches between a standby mode and a conversation mode. In this embodiment, a mode in which the processing of step S4 is continued during a period when there is no new distribution (period when step S5 is judged as No) is an example of the standby mode. Also, a mode in which the processing of step S3 is continued during the above period is an example of the conversation mode.

[0076] The conversation mode is a mode from when step S2 is judged as Yes until a termination condition for the conversation mode is satisfied. The termination condition for the conversation mode may be that the content executed in the conversation mode has ended, that a predetermined input (e.g., voice input or operation on a touch panel, etc.) has not been made to the interface for a certain period of time, or that a user has made an input to the interface instructing the interface to end (voice input or touch operation instructing the interface to end). Specifically, the conversation mode is a mode in which the control unit 11 detects words other than the wake word. When voice is input to the interface during the conversation mode, the control unit 11 analyzes the voice input to the interface and recognizes the words represented by the voice using a known method.

[0077] The standby mode is a mode during the period in which step S2 is determined to be No, and is a mode when the conversation mode is released. The standby mode is a mode in which the control unit 11 monitors whether or not a wake word has been input to the interface. When voice is input to the interface during the standby mode, the control unit 11 determines whether the voice is the wake word using a known method. However, the control unit 11 does not recognize voices other than the wake word from the voices input to the interface during the standby mode. In other words, in the standby mode, the control unit 11 does not need to recognize voices other than the wake word, and only needs to determine whether the voice is the wake word, so that voice recognition can be simplified compared to the conversation mode.

[0078] As shown in the flowchart of Fig. 5, control unit 11 is set to standby mode during the period in which the determination of No is repeated in steps S2 and S5, and during standby mode, it continuously attempts to detect the wake word. If control unit 11 detects that the wake word has been input by voice to interface 13 during standby mode, control unit 11 determines Yes in step S2 and switches to conversation mode, and proceeds to step S3. Then, conversation mode is continued until an end condition for the conversation mode is satisfied. When the end condition for the conversation mode is satisfied, control unit 11 switches to standby mode and continues the standby mode.

[0079] The control unit 11 can also display an image of a character performing a standby action on the display unit 15 during the standby mode. FIG. 20 is an example of an image of a character 70 performing a standby action, and the control unit 11 operates to display a standby image as shown in FIG. 20 on the display unit 15 during the standby mode. Note that the image in FIG. 20 is merely an example, and the standby image is not limited to this example. For example, the standby image may be as shown in FIG. 22, or may be another type of standby image. It may be a standby image selected according to the attributes of the user. Displaying the image of the character performing a standby action on the display unit 15 may be performed at regular intervals, at a specific time set in advance, or at random intervals.

[0080] During the standby mode, the control unit 11 not only displays a standby image as shown in FIG. 20, but also operates to output the conversation of the character 70 included in the standby image to the interface 13 as audio. The conversation of the character 70 included in the standby image is preferably a story related to the standby action performed by the character 70, a story including useful information for the user, and a story including a question for the user. For example, while displaying a standby image as shown in FIG. 20, or immediately after displaying the standby image, the conversation may be audio output so that the character 70 utters a story such as "This is my beloved dog Pochi. By interacting with dogs, I can forget the fatigue of today's work and feel kind. It seems that the effect of healing people's hearts by interacting with animals is called animal therapy. Did you know that?" (a story related to the action of the standby image, a story including useful information for the user, a story asking a question to the user). Note that the above conversation example is merely one example. For example, while displaying a standby image as shown in FIG. 20, or immediately after displaying the standby image, the above conversation may be output as audio, such as, "My dog ​​is a small toy poodle. I heard that 50 years ago, large dogs such as shepherds and collies were popular due to the influence of Western television programs."

[0081] This operation gives the user the impression that the character 70 performing the standby operation has invited him / her to have a conversation. Then, the control unit 11 temporarily switches to a conversation mode from the time the conversation (the conversation uttered by the character 70 performing the standby operation) is output until a predetermined time has elapsed. In other words, the control unit 11 detects words other than the wake word from the voice input to the interface 13 from the time the conversation is output until the predetermined time has elapsed. The predetermined time may be a predetermined fixed time or a changeable set time.

[0082] If the control unit 11 detects a word other than the wake word during the period from when the conversation (the conversation uttered by the character 70 during the standby mode) is output until the predetermined time has elapsed, the control unit 11 continues the conversation mode. In this case, the control unit 11 maintains the continued conversation mode until, for example, the above-mentioned condition for terminating the conversation mode is met.

[0083] On the other hand, the control unit 11 operates to switch to the standby mode if no words other than the wake word are detected during the predetermined time period from when the conversation (the conversation uttered by the character 70 during the standby mode) is output. For example, if the user is not nearby during the conversation mode after the character 70 spontaneously utters a conversation, or if the user does not want to talk and does not respond, the virtual assistant device 10 automatically returns to the standby mode, thereby preventing the conversation mode from continuing for too long in a situation where the conversation mode is not necessary.

[0084] The control unit 11 may operate to detect words other than the wake word input to the interface 13 while canceling the image of the standby operation and displaying a basic image in which the character 70 faces forward during the conversation mode from when the conversation (the conversation uttered by the character 70 during the standby mode) is output until the predetermined time has elapsed, as shown in FIG. 21. In this example, the virtual assistant device 10 can receive a response from the user with the character 70 facing forward during the conversation mode until the predetermined time has elapsed, so that the user can be given the impression that the character 70 is waiting for the user to speak while paying attention to the user.

[0085] Alternatively, the control unit 11 may operate to detect words other than the wake word while displaying an image of the standby action as shown in FIG. 22 during the conversation mode from when the conversation (a conversation uttered by the character 70 during the standby mode) is output until the predetermined time has elapsed. When uttering a conversation in the example of FIG. 22, for example, "I recently started learning flower arranging. It is a technique that has been developed independently in Japan for 700 years. Do you have experience with flower arranging?" (a story related to the action of the standby image, a story containing useful information for the user, a story containing a question for the user) may be output as voice. After uttering such a conversation, the control unit 11 may operate to detect words other than the wake word input to the interface 13 while continuing to display an image of the standby action (an action of performing flower arranging). In this example, the virtual assistant device 10 can give the user the impression that the character 70 is waiting for a story from the user while performing a standby action during the conversation mode.

[0086] 6. Example of effects For example, the device of Patent Document 1 cannot secure sufficient opportunities for conversation unless the user speaks, so it is difficult for users who are not proactive to secure sufficient opportunities to receive content. Moreover, the device of Patent Document 1 advances the conversation on the topic of the first message sent by the user, so the user cannot receive content on a topic decided by the other party.

[0087] In contrast, the virtual assistant device 10 can inform the user of the content delivery by issuing a predetermined notification via the interface 13 when the communication unit 12 receives content information delivered from the outside. Therefore, this device can actively give the user an opportunity to receive the content, making it easier for the user to secure an opportunity to receive the content. Moreover, after the notification, when the device receives an "input instructing the provision of content," it can display content based on the delivered content information, making it easier for the user to receive topics at the time of their choice.

[0088] The virtual assistant device 10 can more accurately confirm whether or not an "input instructing the provision of content" has been made in response to a notification informing of distribution by detecting motion or voice.

[0089] If the user does not notice the notification or does not wish to receive the content at the time of notification, the virtual assistant device 10 can notify the user of the delivery of content information by notification information, making it easier to take subsequent action. In addition to displaying the notification on the display unit, notification by the character's speech may be used as a means of notification. In addition, both displaying the notification on the display unit and notification by the character's speech may be used.

[0090] The virtual assistant device 10 can select and provide the type of content desired by the user, which makes it easier for the user to become interested and increases the user's satisfaction.

[0091] In the virtual assistant device 10, as shown in FIG. 20, the character 70 performs a standby operation during standby mode, so that the behavior of the character 70 is likely to leave an impression on the user even during standby mode. Furthermore, during standby mode, the character 70 can be operated so as to spontaneously start a conversation, so that a situation can be generated in which the character 70 invites the user to a conversation while performing a standby operation. Moreover, while the virtual assistant device 10 is premised on switching to a conversation mode upon detection of a wake word, after a conversation is uttered from the character 70, it can automatically switch to the conversation mode until a predetermined time has elapsed, so that the user can enter into a conversation without uttering a wake word, and the conversation can proceed in a more natural flow.

[0092] For example, the device of Patent Document 1 cannot secure sufficient opportunities for conversation unless the user speaks. Moreover, since the device of Patent Document 1 advances the conversation on the topic of the message first sent by the user, the user cannot accept an invitation to a conversation on a topic decided by the other party. The above-mentioned virtual assistant device 10 can solve such problems more effectively.

[0093] <Other embodiments> The present invention is not limited to the embodiments described above and in the drawings, and the following embodiments are also included in the technical scope of the present invention. In addition, the various features of the above-mentioned embodiments and the embodiments to be described later may be combined in any combination as long as they are not contradictory.

[0094] In the above-described embodiment, the operation unit 17, which corresponds to an example of the motion detection unit, is configured as a touch panel, but is not limited to this example. The operation unit 17 may be other known input devices (keyboard, mouse, touch pen, etc.). Alternatively, the motion detection unit may include other input devices (for example, input devices capable of input operations in a non-contact manner) instead of or in addition to the operation unit 17. Specifically, the motion detection unit may have a non-contact sensor such as an imaging unit or a motion sensor. In this case, the non-contact sensor and the control unit 11 may cooperate to detect the user's movements, gestures, etc.

[0095] In the above-described embodiment, the display unit 15 is configured as a display device that displays still images and videos in two dimensions, but is not limited to this example. The display unit 15 may be a three-dimensional display that can perform three-dimensional display.

[0096] In the above-described system 1, the type of information desired by the user is registered in a registration unit (storage unit 95) provided outside the virtual assistant device 10, and the control unit 11 controls to output a conversation regarding the type of content registered in the registration unit via the interface 13. However, this is not limited to this example. For example, a registration unit may be provided in the virtual assistant device 10, and the type of information desired by the user may be registered. For example, the virtual assistant device 10 may receive only the type of content registered in the virtual assistant device 10 (the type desired by the user) from the management device 90. Alternatively, when the virtual assistant device 10 receives content from the management device 90, if the content is of the type registered in the virtual assistant device 10 (the type desired by the user), it may be determined in step S2 that a new delivery has occurred. Then, in step S7, only the type of content registered in the virtual assistant device 10 (the type desired by the user) may be provided.

[0097] In addition to the above-described embodiment, the display unit 15 may be configured to display a history of past conversations. For example, the date and time of each conversation in step S7 may be recorded, and the history of the conversation may be stored in the storage unit 14. Then, when a predetermined operation is performed on the operation unit 17 to instruct the display of the history of the conversation, a part or all of the history of the conversation stored in the storage unit 14 may be displayed.

[0098] In the above-described embodiment, an example of the content is shown, but various kinds of content can be adopted as the content. For example, FIG. 23 is an example of recreation-related content (e.g., content displaying simple exercises), FIG. 24 is an example of reminiscence-related content (e.g., content displaying old images), and FIG. 25 is an example of natural sound-related content (e.g., content outputting images and sounds of a bonfire). In step S7, content such as those shown in FIGS. 23 to 25 may be provided, and a conversation may be conducted by the character 70 when providing such content or before and after the content is provided. For example, a conversation regarding the purpose or contents of the content may be conducted before the content is provided, and after the content is provided, questions may be asked about impressions or opinions on the experience of the content, or a conversation leading to another topic may be conducted.

[0099] In the above-described embodiment, the virtual assistant device 10 is configured as a virtual assistant device mainly for elderly people, but is not limited to this example. For example, it may be targeted at other categories of subjects such as children.

[0100] In the above-described embodiment, when the virtual assistant device 10 receives a new delivery from the management device 90, the virtual assistant device 10 displays information as shown in FIG. 9 immediately after the new delivery, but is not limited to this example. For example, when the virtual assistant device 10 receives a new delivery from the management device 90, the delivered content may be downloaded in the background and stored in the storage unit 14. In this way, when the delivered content is downloaded in the background, it may be notified as shown in FIG. 9 that the new delivery has been downloaded in response to the establishment of a predetermined notification condition. The predetermined notification condition in this case may be that a preset time has arrived, that the content (e.g., video display, etc.) that was being executed while downloading in the background has ended, or other conditions.

[0101] The information transmitted from the management device 90 to the virtual assistant device 10 is not limited to the above example. For example, when the day of the user's birthday arrives, the management device 90 may deliver information informing the virtual assistant device 10 of the user that it is the user's birthday or content related to the birthday. When the virtual assistant device 10 receives information informing the user that it is the user's birthday, it may display a message or image celebrating the user's birthday. Alternatively, the management device 90 may transmit information informing the virtual assistant device 10 of the content distribution schedule. Information informing the content distribution schedule may be, for example, schedule information in which the content content is associated with the date and time when the content is distributed, or a list of the schedule information.

[0102] In the above embodiment, the virtual assistant device 10 operates to display an image as shown in FIG. 14 when the content ends, but this is not limited to the example. For example, the control unit 11 may control the display unit 15 to display an image as shown in FIG. 26 instead of FIG. 14. In the example of FIG. 26, the control unit 11 operates to display multiple options on the display unit 15 when a predetermined condition is met, and to determine which option has been selected based on the input result to the interface after the multiple options are displayed. The predetermined condition may be, for example, that the content has ended, as in the examples of FIG. 14 and FIG. 26, or may be other conditions (such as a question to the user being output as voice). The example of FIG. 26 is an example of a case where a question to the user (specifically, a questionnaire) is output as voice and displayed as an image when the content ends, and answer candidates to the question are shown as multiple options. The control unit 11 operates the display unit 15 to display multiple options as images 81, 82, 83, and 84 as shown in FIG. 26, and operates to determine which option has been selected based on the input result to the interface 13 after the multiple options are displayed in this way. For example, when a touch operation or a voice instruction is made to the interface 13 to select one of the images 81, 82, 83, and 84 as a plurality of options as shown in FIG. 26, the virtual assistant device 10 identifies which option has been selected based on the input. The virtual assistant device 10 can simplify answer candidates by presenting options, and can be used in a manner that is less likely to mislead the user's intention by determining which option the user has selected. The mechanism of FIG. 26 can be used not only for questionnaires, but also for selecting answers to quizzes and for collecting information for various surveys. Based on the selected information, the content of the conversation to be provided can be changed or selected, or the content of the service can be improved in the future. By feeding back the collected results to the user, it is expected that the effect of increasing the user's sense of participation and motivation can be expected.

[0103] In the above embodiment, an example of the condition for switching from the standby mode to the conversation mode has been described, but the present invention is not limited to this example. For example, the condition for switching from the standby mode to the conversation mode may be "a predetermined operation is detected by the operation detection unit". The predetermined operation may be, for example, "a contact with the touch panel 20 (FIG. 2, etc.)", "a predetermined operation with respect to the touch panel 20", or other operations. When the above embodiment is modified in this way, "monitoring of the wake word in the standby mode" may be changed to "monitoring of the predetermined operation in the standby mode", and other configurations and controls may be the same as those of the above embodiment. In this example, the control unit 11 and the operation unit 17 can cooperate to function as the operation detection unit. Specifically, in the control of FIG. 5, the control unit 11 continuously attempts to monitor a predetermined operation (for example, a contact with the touch panel 20 (FIG. 2, etc.)) during the standby mode, and when it detects that the above predetermined operation has been performed during the standby mode, it may operate to determine Yes in step S2, switch to the conversation mode, and proceed to step S3.

[0104] It should be noted that the embodiments disclosed herein are illustrative and not restrictive in all respects. The scope of the present invention is not limited to the embodiments disclosed herein, and is intended to include all modifications within the scope indicated by the claims or within the scope equivalent to the claims. [Explanation of symbols]

[0105] 1. Virtual assistant system 10. Virtual assistant device 11...Control section 12…Communications Department 13. Interface 15...Display section 17...Operation unit (motion detection unit) 18…Audio input section

Claims

1. A virtual assistant device comprising an interface that accepts input from a user and outputs a conversation to the user, a communication unit that communicates with an external device, and a control unit that displays a character embodied in a display unit that constitutes the interface, The control unit is a standby mode in which at least one of monitoring whether a wake word has been input to the interface and monitoring whether a motion has been detected by a motion detection unit is performed, and a conversation mode in which at least words other than the wake word are detected, and when input of the wake word is detected during the standby mode, the mode is switched to the conversation mode; During the standby mode, an image of the character performing a standby action is displayed on the display unit while the conversation uttered by the character is output to the interface as voice; The mode is switched to the conversation mode until a predetermined time has elapsed since the conversation was output. Virtual assistant device.

2. When the control unit does not detect any words other than the wake word during the conversation mode until the predetermined time has elapsed, the control unit switches to the standby mode. The virtual assistant device according to claim 1.

3. The control unit detects words other than the wake word input to the interface while canceling the image of the standby action and displaying a basic image in which the character faces forward during the conversation mode until the predetermined time has elapsed.

3. A virtual assistant device according to claim 1 or 2.

4. The control unit detects words other than the wake word while displaying the image of the standby operation during the conversation mode until the predetermined time has elapsed.

3. A virtual assistant device according to claim 1 or 2.

5. The control unit displays a plurality of options on the display unit when a predetermined condition is met, and determines which option has been selected based on an input result to the interface after the plurality of options are displayed. A virtual assistant device according to any one of claims 1 to 4.

6. A program used in a virtual assistant device equipped with an interface that accepts input from a user and outputs a conversation to the user, a communication unit that communicates with an external device, and a control unit that displays a character embodied in a display unit that constitutes the interface, switching the control unit between a standby mode in which the control unit at least one of monitors whether a wake word has been input to the interface and monitors whether a motion has been detected by a motion detection unit and a conversation mode in which the control unit detects at least words other than the wake word, and switching to the conversation mode when input of the wake word is detected during the standby mode; operating the control unit to cause the interface to output the conversation uttered by the character as voice while displaying an image of the character performing a standby action on the display unit during the standby mode; switching the control unit to the conversation mode until a predetermined time has elapsed since the conversation was output; Programs for virtual assistant devices, including

Images