Information processing system, information processing method and program

Abstract

To provide an information processing system, etc. capable of enhancing presence of interactive AI.SOLUTION: There is provided an information processing system including at least one or more processors. The information processing system causes the processor to execute: an acquisition step of acquiring information representing whether a second user terminal functioning as a UI (User Interface) of an interactive artificial intelligence module is approaching or not, from a first user terminal functioning as the UI; and a behavior control step of controlling behavior of the UI, and when information representing the approach of the second user terminal is acquired from the first user terminal, changing the behavior of the UI of the first user terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses an AI chatbot technology that receives a question message from a user's communication terminal, sends an answer message to the question to the user's communication terminal, and stores knowledge information that combines questions and answers in a first database; analyzes the received question message, searches the first database for knowledge information corresponding to the question message, and generates an answer message using the knowledge information obtained by the message analysis unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-131755 Summary of the Invention [Problem to be solved by the invention]

[0004] In a service that enables interaction with an AI (artificial intelligence module) such as that in Patent Document 1, it is important to increase user awareness of the existence of interactive AI in order to increase the number of users.

[0005] In view of the above circumstances, the present invention provides an information processing system etc. that can enhance the presence of interactive AI. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing system including at least one processor. In this information processing system, the processor acquires, from a first user terminal functioning as a UI (User Interface) of an interactive artificial intelligence module, information indicating whether a second user terminal functioning as a UI is approaching. In a behavior control step, the processor controls the behavior of the UI, and when information indicating the approach of the second user terminal is acquired from the first user terminal, changes the behavior of the UI of the first user terminal.

[0007] According to this embodiment, the presence of the interactive AI can be enhanced. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing an example of the overall configuration of an automated dialogue system 1. FIG. [Figure 2] 2 is a diagram illustrating an example of a hardware configuration of a server device 10. FIG. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a user terminal 20. [Figure 4] FIG. 1 is an activity diagram illustrating an example of automatic interaction processing. [Figure 5] FIG. 10 is a diagram illustrating an example of a displayed login screen. [Figure 6] FIG. 10 is a diagram showing an example of an interactive AI screen. [Figure 7] FIG. 1 is a diagram illustrating an example of a dialogue with an interactive AI. [Figure 8] FIG. 10 is a diagram showing an example of an accumulated dialogue history. [Figure 9] FIG. 10 is a diagram illustrating an example of a specific sound. [Figure 10] FIG. 10 is a diagram illustrating an example in which a specific sound is detected. [Figure 11] FIG. 10 is a diagram showing an example of a dialogue during approach. [Figure 12] FIG. 10 is a diagram showing another example of dialogue during approach. [Figure 13] FIG. 10 is a diagram showing another example of dialogue during approach. [Figure 14]FIG. 10 is a diagram showing another example of dialogue during approach. [Figure 15] FIG. 10 is a diagram showing another example of dialogue during approach. [Figure 16] FIG. 10 is a diagram illustrating an example of a location notification. [Figure 17] FIG. 10 is a diagram showing another example of dialogue during approach. [Figure 18] FIG. 10 is a diagram showing an example of a dialogue material registration screen. [Figure 19] FIG. 10 is a diagram showing another example of dialogue during approach. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0010] Incidentally, the program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or may be provided so that it can be downloaded from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, various information processing according to an embodiment may realize input and output corresponding to the input. Here, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited as long as an output is obtained as a result of the input. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression formula constructed using a statistical method), a trained model that has previously trained the correlation between input and output, or a large-scale language model that can output a desired result by inputting a prompt.

[0012] In one embodiment, a "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented, for example, by physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations can be performed on a circuit in the broad sense.

[0013] Furthermore, a circuit in the broad sense is a circuit realized by at least an appropriate combination of a circuit, circuitry, processor, memory, etc. The processor may be a general-purpose processor or a dedicated circuit. That is, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0014] <Embodiment 1> Hereinafter, a first embodiment of an automatic dialogue system for realizing dialogue between a machine and a user will be described. 1. System Configuration Fig. 1 is a diagram showing an example of the overall configuration of an automated dialogue system 1. Fig. 1 shows an overview of each device included in the automated dialogue system 1 and the users who use those devices. The automated dialogue system 1 is an information processing system that executes automated dialogue processing to realize dialogue between a machine and a user.

[0015] The automated dialogue system 1 includes a communication line 2, a server device 10, and a plurality of user terminals 20. The communication line 2 is not particularly limited, but may be configured, for example, by the Internet network. The communication line 2 may also include a local area network, a mobile communication network, a VPN (Virtual Private Network), etc. The communication line 2 mediates the exchange of data between devices connected to the communication line. In the example of FIG. 1, the server device 10 is connected to the communication line 2 by wire, and a plurality of user terminals 20 are connected wirelessly. Note that the connection of each device to the communication line 2 may be wired or wireless.

[0016] The server device 10 is an information processing device that executes automatic dialogue processing. The server device 10 includes an AI module 3 and a dialogue history database 4. The AI ​​module 3 is a module that has been adjusted (tuned) using AI (Artificial Intelligence) technology to realize a dialogue function that, for example, when a statement is input from a person, outputs a reply corresponding to the statement. The virtual person with whom the user interacts using the dialogue function realized by the AI ​​module 3 is hereinafter referred to as "dialogue AI."

[0017] The AI ​​module 3 has a natural language processing model whose accuracy has been improved by machine learning using a large data set known as LLM (Large Language Models). By performing machine learning with LLM, the AI ​​module 3 can realize a variety of dialogues. The dialogue function realized by the AI ​​module 3 not only answers questions from the user, but can also, for example, respond to what the user says, expand on the current topic, change the topic, suggest new topics, and touch on past topics.

[0018] In addition to the dialogue function, the AI ​​module 3 is also adjusted to realize a task execution function that executes specific tasks instructed by a user in dialogue, as is realized in smart speakers, etc. Examples of specific tasks include searching the Internet, writing text, sending emails, and using services (such as reservation services) provided on specific sites. Note that the AI ​​module 3 can be adjusted to realize functions other than the dialogue function and the task execution function.

[0019] The dialogue history database 4 is a database that stores the history of dialogues between a user and the dialogue AI (AI module 3). For example, the dialogue history database 4 stores user utterances and dialogue AI utterances in association with time information at which the utterances were made. The dialogue history database 4 also stores information that the user terminal 20 can acquire when a dialogue is made (such as location information and weather information) in association with the dialogue history.

[0020] The user terminal 20 is a portable terminal used by a user, such as a smartphone or tablet terminal. The user terminal 20 functions as a UI (User Interface) for the interactive AI. The UI for the interactive AI is an interface that allows the user to recognize the appearance and behavior of the interactive AI, which is a simulated conversation partner, and is specifically realized by a display function that displays images (including text images), a pronunciation function that outputs sounds (including voice), a vibration function that vibrates the housing of the user terminal 20, and a light emission function that turns on a light source. The behavior of these UIs for the interactive AI is controlled by the server device 10.

[0021] The server device 10 executes an authentication process to authenticate a user who uses the user terminal 20. The server device 10 stores authentication information (such as a user ID and a password) for authenticating a user who uses the automated dialogue system 1, and authenticates a user who inputs the authentication information. By authenticating a user, the server device 10 can restrict access to data or assign identification information to data input by the user to make the data identifiable.

[0022] 2. Hardware Configuration The hardware configuration according to the first embodiment will be described below. 2 is a diagram showing an example of the hardware configuration of server device 10. Server device 10 includes a control unit 11, a storage unit 12, a communication unit 13, and a bus 14. Bus 14 electrically connects the various units included in server device 10.

[0023] (Control unit 11) The control unit 11 has at least one processor. The at least one processor may be configured by, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), one or more integrated circuits, one or more discrete circuits, or a combination thereof (not shown).

[0024] The control unit 11 is a computer that realizes various functions related to the automated dialogue system 1 by reading out predetermined programs stored in the storage unit 12. In other words, information processing by software stored in the storage unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11. Note that the control unit 11 is not limited to being a single unit, and it may be implemented with multiple control units 11 for each function. It may also be a combination of these.

[0025] (Storage unit 12) The memory unit 12 stores various pieces of information defined above. This can be implemented, for example, as a storage device such as a solid state drive (SSD) or a hard disk drive (HDD) that stores various programs and the like related to the automated dialogue system 1 executed by the control unit 11, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to program calculations. The memory unit 12 stores various programs, variables, etc. related to the automated dialogue system 1 executed by the control unit 11.

[0026] (Communications Department 13) The communication unit 13 is configured by a communication module. The communication module may be a wireless communication module conforming to standards such as IEEE802.11a / b / g / n / ac / ax, LTE, 5G, or 6G, or may be a wired communication module conforming to standards such as IEEE802.3. The communication unit 13 is configured to be able to transmit various electrical signals from the server device 10 to external components. The communication unit 13 is also configured to be able to receive various electrical signals from the external components to the server device 10. More preferably, the communication unit 13 has a network communication function, which allows various information to be communicated between the server device 10 and external devices via the communication line 2.

[0027] 3 is a diagram showing an example of the hardware configuration of user terminal 20. User terminal 20 includes control unit 21, storage unit 22, communication unit 23, input unit 24, output unit 25, and bus 26. Bus 26 electrically connects the various units included in user terminal 20. Control unit 21, storage unit 22, and communication unit 23 are similar hardware to control unit 11, storage unit 12, and communication unit 13 shown in FIG. 2, although their specifications, models, etc. may differ.

[0028] (Input unit 24) The input unit 24 has keys, buttons, a touch screen, a mouse, etc., and accepts input from the user. The input unit 24 also has a microphone, which is a sensor that detects sound, and outputs sound data indicating the sound detected by the microphone to the control unit 21. The input unit 24 uses the function of the microphone (sound detection function) to accept input such as, for example, a voice uttered by the user or a sound generated around the user terminal 20.

[0029] (Output section 25) The output unit 25 has a display, a speaker, etc., and outputs visual information generated in a manner that can be viewed by the user, such as a screen, an image, an icon, text, etc., on the display surface of the display (display function), and outputs sounds representing human voices, etc., from the speaker (sound generation function). The output unit 25 also has vibration means for outputting vibrations, and is controlled by the control unit 21 to vibrate the housing of the user terminal 20 (vibration function). The output unit 25 also has a light source such as an LED (Light Emitting Diode), and is controlled by the control unit 21 to output light (light emission function). The output unit 25 also has positioning means such as a GPS (Global Positioning System), and outputs location information indicating the location of the terminal itself (positioning function).

[0030] 3. Information Processing The following describes the above-mentioned automatic dialogue processing as information processing according to the embodiment. In the following description, the server device 10 and the user terminal 20 are described as the subjects of each automatic dialogue processing, but the information processing is executed by a processor included in the control unit of each device.

[0031] Fig. 4 is an activity diagram showing an example of automatic dialogue processing. Fig. 4 shows one user terminal 20, but it is assumed that multiple user terminals 20 are simultaneously logged in and using the automatic dialogue system 1. The automatic dialogue processing shown in Fig. 4 is started when a login screen for the automatic dialogue service is displayed on the user terminal 20.

[0032] Fig. 5 is a diagram showing an example of a displayed login screen. The login screen C1 shown in Fig. 5 displays a character string "Talk to an interactive AI!", a user ID input field D11, a password input field D12, and a login button B11. The user terminal 20 accepts input by the user into the input fields D11 and D12 and an operation on the login button B11 as a login operation by the user (activity A11). The user terminal 20 transmits the user ID and password entered through the login operation to the server device 10 as authentication information.

[0033] The server device 10 authenticates the user based on the transmitted authentication information (activity A12). Next, the server device 10 transmits instruction data to the user terminal 20 instructing the user to start dialogue-related processing (activity A13). The dialogue-related processing is processing related to dialogue with the dialogue AI, and includes dialogue processing and approach detection processing. The dialogue processing is processing performed when a user and the dialogue AI interact, and the approach detection processing is processing for detecting the approach of user terminals 20 that use the dialogue AI.

[0034] The user terminal 20 starts the dialogue processing in accordance with the instruction of A13 (activity A21). The dialogue processing includes a process of operating the UI of the dialogue AI possessed by the user terminal 20, and specifically includes a process of displaying an avatar representing an image of the appearance of the dialogue AI (a process of operating a display function), a process of displaying an image such as a character string indicating a statement made by the dialogue AI (a process of operating a display function), a process of outputting a sound indicating a statement made by the dialogue AI (a process of operating a sound production function), a process of vibrating the housing of the user terminal 20 (a process of operating a vibration function), and a process of turning on a light source (a process of operating a light emission function).

[0035] In addition, the dialogue processing includes a process of accepting dialogue input from the user, specifically a process of acquiring the user's voice and transmitting sound data representing the voice to the server device 10, and a process of accepting the user's operation and transmitting operation data representing the operation content to the server device 10.

[0036] The server device 10, in conjunction with the user terminal 20, executes a dialogue control process (activity A22) that controls the dialogue between the user and the interactive AI. The dialogue control process includes processes that control the behavior of the UI of the interactive AI, and specifically includes avatar processing that instructs the user terminal 20 on the display and movement of an avatar, display processing that displays character strings indicating the content of statements made by the interactive AI, speech processing that outputs sound indicating the content of statements made by the interactive AI, vibration processing that vibrates the housing of the user terminal 20, lighting processing that turns on a light source, speech processing that determines the content of statements made by the interactive AI based on voice or operation data transmitted from the user terminal 20, and behavior processing that determines the behavior of the UI of the interactive AI.

[0037] The above-mentioned avatar processing, display processing, etc. are all executed, for example, by the functions of the AI ​​module 3. In this case, the functions are realized by performing machine learning using the user's utterances as input and the processing to be performed by the dialogue AI as correct answer information. Note that some of the processing may be executed by functions other than the AI ​​module 3. In this case, the server device 10 executes the dialogue control processing, for example, using reference information that associates the situation, including the user's utterances, with the processing to be performed by the dialogue AI.

[0038] The dialogue control process by the server device 10 includes normal dialogue control processing and approaching dialogue processing. Approaching dialogue refers to a period when the user terminals 20 using the dialogue AI are close to each other. Normal dialogue refers to a period when the user terminals 20 using the dialogue AI are not close to each other, i.e., a period other than approaching dialogue. In the example of FIG. 4, the server device 10 first executes normal dialogue control processing.

[0039] The user terminal 20 starts an approach detection process (activity A31) in parallel with A21. Specifically, the user terminal 20 executes, as the approach detection process, a process of outputting a specific sound (hereinafter referred to as "specific sound") that is determined to notify the approach of user terminals 20 to each other. The specific sound will be explained in detail later. First, the following describes the self-introduction dialogue with the interactive AI that takes place when the user logs in for the first time. Through the dialogue process, the user terminal 20 displays an interactive AI screen, which is a screen on which a dialogue between the user and the interactive AI takes place.

[0040] Figure 6 is a diagram showing an example of an interactive AI screen. In the example of Figure 6, the user terminal 20 displays the interactive AI screen C2. Note that the display of the interactive AI screen by the user terminal 20 is performed under the control of the server device 10, so it can also be said that the server device 10 causes the user terminal 20 to display the interactive AI screen C2 (the same applies to subsequent displays). The interactive AI screen C2 displays a specific sound icon E21, an AI appearance image F21, and an end dialogue button B21.

[0041] The specific sound icon E21 is an image indicating that the user's own terminal (user terminal 20) is outputting a specific sound. The AI ​​appearance image F21 is an image that gives an impression of the appearance of the interactive AI, and is displayed during the conversation. Note that the AI ​​appearance image F21 is an image that resembles a human face, but an image of an animal or a graphic image may also be used as the AI ​​appearance image. The conversation end button B21 is an operation image that is operated when the conversation with the interactive AI is to be ended.

[0042] When the conversational AI is having its first conversation with a user, it makes a statement to introduce itself and ask the other person's name. In the example of FIG. 6, the user terminal 20 outputs a voice V21 saying, "Nice to meet you. I'm Alpha, the conversational AI. What's your name?" as a voice indicating the conversational AI's statement. Such a statement by the conversational AI is made under the control of the server device 10, so it can be said that the server device 10 is causing the conversational AI to make the statement (the same applies to subsequent statements). Upon hearing the voice V21, the user makes a self-introduction statement to the conversational AI, for example, including their own name. The conversational AI then makes a reply to the user's statement.

[0043] FIG. 7 is a diagram showing an example of a dialogue with a dialogue AI. In the example of FIG. 7, the user utters voice V11 indicating a statement, "Nice to meet you. My name is Tom." In response, the dialogue AI utters voice V22 indicating a reply, "Then I'll call you Tom!" When a dialogue between the user and the dialogue AI takes place in this way, the server device 10 stores the dialogue history in the dialogue history database 4 (activity A23).

[0044] Fig. 8 is a diagram showing an example of an accumulated dialogue history. Fig. 8 shows information stored in the dialogue history database 4. In the dialogue history database 4, "nickname," "AI name," "user attributes," "time information," "location information," "external information," "comment content," etc. are stored as dialogue history in association with authentication information such as a user ID and password. "Tom," who conversed with the dialogue AI in Fig. 7, is assumed to be a user with a user ID of "U0001."

[0045] The nickname is the name that the conversational AI calls the user, and in the example of Figure 8, the nickname "Tom" is stored. The AI ​​name stores the name of the conversational AI. In the example of Figure 8, the name "Alpha" is stored as the initial value. The user attributes are attributes such as the user's age, gender, residential area, and occupation. The user attributes are stored when the user speaks during a dialogue. The time information is information indicating the date and time when the dialogue history was stored, and is stored in association with each dialogue history. The location information is information indicating the location of the user terminal 20 when the dialogue took place.

[0046] External information is information that can be acquired from an external system when a dialogue takes place, such as weather information. For example, when a user asks about today's weather, the AI ​​module 3 acquires weather information by searching the Internet or using a weather information service using the task execution function described above, and the server device 10 stores the acquired weather information as external information in the dialogue history database 4. The server device 10 also stores text data indicating the content of statements made in the dialogue.

[0047] By repeatedly executing activities A21, A22, and A23, the dialogue between the user and the conversational AI is repeated, and a dialogue history is accumulated. The dialogue history is accumulated in association with each user's user ID. In the example of Figure 8, in addition to the user who calls the user "Tom," the dialogue history of users who call the user "Emma," "Mike," and "Sophia" is accumulated in association with each user ID. Note that the name, AI name, and user attributes are stored when they come up in a conversation with the conversational AI, but even after being stored, they can be changed through dialogue (such as asking the user to change the name).

[0048] When the server device 10 has the interactive AI converse with a user, it refers to the user's conversation history. For example, if the user logs off and logs back in, the server device 10 converses with the user by the name they initially chose. The server device 10 also refers to user attributes heard from the user and uses them as topics of conversation, or refers to utterances made in past conversations at the same time or location as the current time or current location.

[0049] Next, the above-mentioned specific sound will be described. FIG. 9 is a diagram showing an example of a specific sound. FIG. 9 shows a graph with the vertical axis representing wavelength and the horizontal axis representing time. In the example of FIG. 9, login is performed at time t0, and output of specific sound S1 begins. The user terminal 20 outputs specific sound S1 from time t0 to time t1, and outputs specific sound S2 from time t1 to time t2. Thereafter, the user terminal 20 alternately outputs specific sounds S1 and S2 at regular intervals at times t3 and t4. Both specific sounds S1 and S2 are sounds outside the audible range. The specific sound S1 is a sound with a wavelength lower than the audible range, and the specific sound S2 is a sound with a wavelength higher than the audible range.

[0050] While smartphones and the like often use speakers capable of outputting sounds within the audible range, the automated dialogue system 1 uses speakers that can also output sounds outside the audible range. By outputting sounds outside the audible range, it is possible to prevent the specific sounds from being heard by the user and people in the vicinity. Even if the speaker is not capable of outputting sounds outside the audible range, sounds near the upper and lower limits of the audible range are difficult to hear, so the user terminal 20 can output these sounds as specific sounds to prevent the specific sounds from being noticed by the user and people in the vicinity.

[0051] While continuing to output the specific sound, the user terminal 20 simultaneously acquires ambient sounds (sounds around the user terminal 20) using a microphone and transmits sound data indicating the acquired ambient sounds to the server device 10 (activity A32). The server device 10 receives the transmitted sound data and performs processing to detect approaching between terminals (user terminals 20) based on the received sound data (activity A33). In the example of FIG. 4, it is assumed that other user terminals 20 are also outputting the specific sounds S1 and S2 shown in FIG. 9. A case where approaching between terminals is detected will be described with reference to FIG. 10.

[0052] Fig. 10 is a diagram showing an example of a case where a specific sound is detected. The diagram shows two user terminals 20-1 and 20-2 moving and about to pass each other. Assume that user terminal 20-1 is the terminal used by Tom, and user terminal 20-2 is the terminal used by Emma shown in Fig. 8. Fig. 10 shows an area R1 in which the specific sound output by user terminal 20-1 can be acquired, and an area R2 in which the specific sound output by user terminal 20-2 can be acquired.

[0053] In Figure 10(a), each user terminal 20 is located outside each other's area, but then user terminals 20-1 and 20-2 move so as to pass each other, and as shown in Figure 10(b), each user terminal 20 is located within each other's area.

[0054] 10(a), the specific sound S1 or S2 is not included in the ambient sounds indicated by the sound data transmitted from the user terminals 20-1 and 20-2, so the server device 10 does not detect the proximity of these user terminals 20. In the state of Fig. 10(b), the specific sound S1 or S2 is included in the ambient sounds indicated by the sound data transmitted from the user terminals 20-1 and 20-2, so the server device 10 detects the proximity of these user terminals 20.

[0055] Depending on the arrangement of the speaker and microphone of the user terminal 20, a specific sound output by the user terminal (hereinafter referred to as "local terminal sound") may be included in the ambient sound. In this case, the server device 10 performs, for example, a process of removing the local terminal sound of the user terminal 20 that acquired the ambient sound from the ambient sound. For example, the server device 10 determines that a specific sound that has been included in the ambient sound from the beginning and whose intensity does not change is the local terminal sound, removes the local terminal sound from the ambient sound, and then determines whether the sound after removal includes the specific sound.

[0056] When the server device 10 detects that the terminals are approaching each other, it executes an approach interaction control process for the user terminal 20 that detected the approach (activity A41). The user terminal 20 executes an interaction process in accordance with the approach interaction control process executed by the server device 10 (activity A42). The server device 10 accumulates a history of interactions that have been carried out in cooperation with the user terminal 20 (activity A43). The interaction when approaching will be described with reference to FIG. 11 onwards.

[0057] FIG. 11 is a diagram illustrating an example of a dialogue during approach. In the example of FIG. 11, an approach detection icon E22 is displayed on the interactive AI screen C2. When the server device 10 detects approach to another user terminal 20, it displays the approach detection icon E22 to visually notify the user that the other user terminal 20 is approaching. The server device 10 also changes the AI ​​appearance image F21 to an image of a surprised expression and causes the interactive AI to output a voice V23 indicating a statement such as, "Hey! Emma and her fellow interactive AI friend, Beta, are nearby." In this way, the server device 10 changes the control of the interactive AI UI when it detects approach between the terminals.

[0058] The server device 10 refers to the dialogue history stored in the dialogue history database 4 in association with the user ID of "Emma," the user of the user terminal 20-2 that detected the approach of the user terminal 20-1, and causes the dialogue AI to make a statement including information about Emma. In the example of Fig. 11, the server device 10 refers to the "name" and "AI name" in Emma's dialogue history, causing the dialogue AI to make a statement including the names "Emma" and "Beta."

[0059] 12 is a diagram showing another example of a dialogue during approach. In the example of FIG. 12, the server device 10 switches the AI ​​appearance image F21 to an image of a winking expression, and causes the interactive AI to output a voice V24 indicating a statement such as, "It seems that Beta and his friends were talking about a new shop in front of the station!" By referring to the "statement content" in Emma's dialogue history, the server device 10 causes the interactive AI to make a statement that includes the content of the conversation between Emma and the interactive AI Beta.

[0060] FIG. 13 is a diagram illustrating another example of a dialogue during approach. In the example of FIG. 13, the server device 10 causes the interactive AI to output a voice V25 indicating a statement such as, "We passed each other the day before yesterday, Beta. It was raining then." When the server device 10 detects that the terminals have approached each other, it stores the dialogue history at the time of approach after assigning a proximity flag indicating the approaching party. If a proximity flag with Tom is assigned to Emma's dialogue history, the server device 10 determines the content of the statement by referring to the dialogue history to which the proximity flag is assigned. In the example of FIG. 13, the server device 10 refers to the "time information" and "external information" to which the proximity flag is assigned, and causes the interactive AI to make a statement including the time of past approach and the weather at that time.

[0061] Returning to Figure 4, the server device 10 determines whether the approach state has ended based on the ambient sound indicated by the sound data transmitted from the user terminal 20 performing the approach interaction control process (activity A44), and if it determines that the approach state has not ended (NO), it repeats A41 (approach interaction control process) and A43 (accumulation of interaction history). If the server device 10 determines that the approach state has ended (YES), it returns to A22 and performs normal interaction control process.

[0062] The processes of activities A21 to A23, A31 to A33, and A41 to A44 are repeatedly executed until the dialogue end button B21 is operated on the interactive AI screen C2. When the user terminal 20 accepts the operation of the dialogue end button B21 (activity A51), it transmits end instruction data instructing the end of the dialogue to the server device 10. When the server device 10 receives the end instruction data, it ends the dialogue control process (activity A52).

[0063] 1 all function as UIs for the interactive AI module 3. The user terminals 20 include a first user terminal used by a first user (e.g., user terminal 20-1 used by Tom) and a second user terminal used by a second user (e.g., user terminal 20-2 used by Emma). The server device 10 also functions as an example of an acquisition unit that acquires information indicating whether or not the terminals are approaching each other (hereinafter referred to as "approach notification information").

[0064] The server device 10 (an example of an acquisition unit) acquires approach notification information about a second user terminal from a first user terminal. In the examples of FIGS. 4 and 10, the server device 10 receives sound data transmitted from the user terminal 20-1 at A33. This sound data is data indicating ambient sounds around the user terminal 20-1, and whether or not the ambient sounds include a specific sound indicates whether or not the user terminal 20-2 is approaching the user terminal 20-1. In this way, by receiving the sound data, the server device 10 acquires approach notification information indicating whether or not the second user terminal (user terminal 20-2 in the example of FIG. 10) is approaching from the first user terminal (user terminal 20-1 in the example of FIG. 10).

[0065] The server device 10 also functions as an example of a behavior control unit that controls the behavior of the UI of the interactive AI. The server device 10 controls the behavior of the UI of the interactive AI in each of a plurality of user terminals 20, including a first user terminal and a second user terminal. When information indicating the approach of the second user terminal is acquired from the first user terminal as approach notification information, the server device 10 changes the behavior of the UI of the first user terminal.

[0066] In the example of Fig. 7 showing a normal state, the server device 10 controls the behavior of the UI of the interactive AI in the first user terminal so that it makes statements based on the dialogue history of Tom, the user of the first user terminal, but in the example of Fig. 11 showing an approaching state, the server device 10 changes the behavior so that it makes statements based on the dialogue history of Emma, ​​the user of the second user terminal. According to this aspect, the change in behavior can make the user aware that a different interactive AI is nearby, and therefore the presence of the interactive AI can be enhanced compared to when the behavior does not change even when the terminals are close to each other.

[0067] Furthermore, the user terminal 20 (including the second user terminal) has a function to output a specific sound (the sound generation function shown in FIG. 3). A specific sound is a sound for notifying other user terminals 20 of the approach of the user terminal, and the specific sounds S1 and S2 described in FIG. 9 are both examples of the specific sound. Then, the server device 10 (an example of a detection unit) changes the behavior of the UI of the first user terminal when approach notification information is information indicating sounds around the first user terminal and indicates a sound including the specific sound.

[0068] Alternatively, the user terminal 20 may output radio waves such as Bluetooth (registered trademark) or WiFi instead of the specific sound, and the server device 10 may detect the proximity of the terminals when the user terminal 20 detects radio waves output by another user terminal 20. However, in this case, depending on the surrounding environment, the communication conditions may be poor (e.g., radio waves that interfere with communication may be present), making it difficult to detect the proximity. In the example of FIG. 4 etc., by using the specific sound as described above, the proximity can be detected without being affected by the communication conditions.

[0069] The specific sound includes multiple types of sounds. In the example of FIG. 9, the specific sound includes two types of specific sounds S1 and S2 with different frequencies. Note that the multiple types of sounds are not limited to this, and for example, the specific sound may include three or more types of specific sounds with different frequencies. Furthermore, the specific sound may be a sound that differs in one or more elements of sound, such as frequency (pitch), timbre, or volume. The server device 10 functions as an example of a sound control unit that causes the user terminal 20 (including the second user terminal) to output specific sounds while sequentially switching the types of sounds. In the example of FIG. 4, the server device 10 controlled the output of specific sounds by the user terminal 20 by issuing an instruction to start a dialogue-related process at A13.

[0070] Depending on the type of sound output, it may blend in with surrounding sounds and be difficult to detect, but by switching between different types of specific sounds and outputting them, the likelihood that the specific sound will be of a type that is less likely to blend in with surrounding sounds can be increased compared to when there is only one type of specific sound, making it easier to detect approaching objects even in the presence of surrounding sounds.

[0071] Furthermore, the server device 10 (an example of an acquisition unit) functions as an example of a history acquisition unit that acquires a dialogue history with the interactive AI, that is, a dialogue history with the AI ​​module 3 via the user terminal 20 (including the second user terminal).Then, the server device 10 (an example of a behavior control unit) changes the behavior of the UI of the interactive AI of the first user terminal according to the acquired dialogue history.

[0072] 11 and 12, the server device 10 acquires a dialogue history with the interactive AI via the second user terminal (user terminal 20-2), i.e., a dialogue history between Emma and the interactive AI Beta, and causes the interactive AI Alpha of the first user terminal (user terminal 20-1) to make statements according to the acquired dialogue history. According to this aspect, Tom, the user of the first user terminal, can get a sense of the atmosphere of the person he is approaching by being informed of the type of dialogue that Emma, ​​the user of the second user terminal who is the person he is approaching, is having with the interactive AI.

[0073] The server device 10 also functions as an example of a storage unit that stores a history of approach with other user terminals 20. As described in the description of FIG. 13, the server device 10 stores the approach history by adding an approach flag to the dialogue history. The server device 10 (an example of a behavior control unit) then changes the behavior of the UI of the interactive AI in accordance with the stored approach history. In the example of FIG. 13, the server device 10 causes Alpha of the interactive AI to make a statement conveying that the first user terminal (user terminal 20-1) has previously approached the second user terminal (user terminal 20-2) and the external information at that time.

[0074] Note that the behavior of the UI of the interactive AI according to the approach history is not limited to this. For example, the server device 10 may cause the UI to make a statement about the time period, location, or content of a comment made during a past approach. The server device 10 may also change the behavior of the UI according to the number of past approaches. For example, the server device 10 may increase the number of dialogue histories of the approaching user that can be referenced for behavior control as the number of approaches increases.

[0075] Specifically, the server device 10 allows only external information to be referenced when the number of approaches to an approaching partner is equal to or less than a first threshold, allows time information and location information to be referenced in addition when the number of approaches to an approaching partner is equal to or greater than the first threshold but less than a second threshold, and allows user attributes and comment content to be referenced in addition when the number of approaches to an approaching partner is equal to or greater than the second threshold. According to this mode, it is possible to increase the amount of information disclosed to an approaching partner who has been approached many times, thereby creating a sense of closeness to the approaching partner.

[0076] In addition, the information that the conversational AI can refer to may not only be the dialogue history, but also registered information that the user has registered in advance. The registered information may include the user's profile, a message to the person they are approaching, etc. In this manner, the user can convey specific information only to people they approach multiple times. As described above, by controlling behavior based on the approach history, it is possible to increase the variety of UI behavior compared to when the approach history is not used.

[0077] <Variation: Interaction between UIs> The behavior control of the UI when approaching is not limited to the above. For example, the server device 10 (an example of a behavior control unit) may control the behavior of the UI of the first user terminal so that the AI ​​module 3 interacting through the first user terminal and the AI ​​module 3 interacting through the second user terminal interact with each other.

[0078] Fig. 14 is a diagram showing another example of a dialogue during approach. In the example of Fig. 14, the server device 10 displays both an AI appearance image F21 of Tom's interactive AI and an AI appearance image F31 of Emma, ​​the user of the second user terminal (user terminal 20-2), on the interactive AI screen C2 of the first user terminal (user terminal 20-1). The server device 10 then causes the interactive AI shown in the AI ​​appearance image F31 to output a voice V31 indicating a statement such as, "Hello, Alpha. This is Beta. Are you shopping today?"

[0079] In response, the server device 10 causes the conversational AI shown in the AI ​​appearance image F21 to output a voice V26 indicating the statement, "Hello, Beta. I came to see a movie with Tom today." The server device 10 causes the conversational AI shown in the AI ​​appearance image F21 to make such a statement based on the content of the conversation between the conversational AI Alpha and Tom up to that point and the external information that Tom has researched about movies. The server device 10 further refers to Emma's conversation history, determines a response for the conversational AI Beta, and causes the user terminal 20-1 to output the voice.

[0080] The server device 10 makes it possible to identify which interactive AI is speaking by, for example, moving or blinking the mouth of the AI ​​appearance image of the interactive AI that is speaking. The server device 10 also makes it possible to distinguish which interactive AI is speaking by outputting different voices depending on the interactive AI.

[0081] As described above, in the example of Fig. 14, the UI of the first user terminal is controlled so that the interactive AIs Alpha and Beta are conversing with each other. This configuration makes the presence of the interactive AI of the second user terminal more noticeable than when the interactive AI of the second user terminal does not appear on the first user terminal.

[0082] The server device 10 may control the UI of the first user terminal so that the amount of dialogue between the interactive AIs increases as the number of past contacts with the approaching user terminal 20 increases. The amount of dialogue may be expressed, for example, by the duration of the conversation or the number of types of conversation history used in the conversation. According to this embodiment, the more the number of contacts increases, the more the interactive AIs appear to be getting along with each other.

[0083] <Variation: Notifying the other party's location> The user of the user terminal 20 may notify the approaching party of his / her own location. In this case, for example, when approach notification information indicating the approach of a second user terminal is acquired from a first user terminal, the server device 10 functions as an example of a request unit that requests permission to notify the second user terminal of the location via the first user terminal. For example, the server device 10 causes the first user terminal to display an image requesting permission.

[0084] Fig. 15 is a diagram showing another example of a dialogue during approach. In the example of Fig. 15, the server device 10 displays an OK button B22 and an NG button B23 on the interactive AI screen C2 of the first user terminal (user terminal 20-1). The server device 10 then causes the interactive AI to output a voice V27 indicating a statement such as, "Emma and fellow interactive AI user Beta are nearby. May I let them know where you are?"

[0085] The server device 10 determines that location notification is not permitted when the NG button B23 is operated, and determines that location notification is permitted when the OK button B22 is operated. If location notification is permitted, the server device 10 functions as an example of a first notification unit that notifies the user of the location of the first user terminal via the second user terminal. The server device 10 notifies the user of the location of the first user terminal by displaying an image indicating the location of the first user terminal on the second user terminal.

[0086] FIG. 16 is a diagram showing an example of a location notification. FIG. 16 shows an interactive AI screen C3 of a second user terminal (user terminal 20-2). The server device 10 displays an AI appearance image F31, an AI appearance image F32, and a location notification image E31. The AI ​​appearance image F31 is an image that evokes the interactive AI of the second user terminal, and the AI ​​appearance image F32 is an image that evokes the interactive AI of the first user terminal.

[0087] The position notification image E31 indicates the direction (northwest, east, west, south, or north) in which the first user terminal (user terminal 20-1) is located, and the distance to the first user terminal (10 m in the example of FIG. 16). When the server device 10 determines that notification of the position is permitted, it acquires position information from both the first user terminal and the second user terminal, calculates the direction and distance, and generates and displays the position notification image E31.

[0088] The server device 10 causes the interactive AI to output a voice V31 indicating a statement such as, "It looks like Alpha and his friends are in this direction." By viewing the location notification image E31, Emma, ​​the user of the second user terminal, can grasp the locations of the other interactive AIs and the first user terminal functioning as their UI, and identify the person who has approached (Tom in the example of FIG. 16). If Emma is interested, she can then talk to the person in the displayed direction.

[0089] The method of notifying the location is not limited to the above method. For example, the server device 10 may notify the location by displaying an image showing a map of the surrounding area and the location of the first user terminal. The server device 10 may also cause the second user terminal to display the direction of the first user terminal and blink the light source of the first user terminal to make the first user terminal more noticeable. The user of the first user terminal may register their own characteristics (appearance, age, gender, height, etc.) in advance, and the server device 10 may display these characteristics on the second user terminal to make the user of the first user terminal more noticeable.

[0090] Furthermore, the server device 10 may determine whether or not to notify the location of the first user terminal based on the location of the first user terminal. For example, if the address of the user of the first user terminal is registered, the server device 10 does not notify the location of the first user terminal within a range close to the address, but notifies the location of the first user terminal within a range far from the address. According to this aspect, the location is not notified when it is inconvenient for the user, and the location is notified only when it is convenient.

[0091] <Variation: Two-stage behavior> The server device 10 may control the behavior of the UI of the interactive AI by dividing the state in which the user terminals 20 are close to each other into two stages. In this case, the server device 10 (an example of an acquisition unit) repeatedly acquires approach notification information at predetermined time intervals. Then, the server device 10 (an example of a behavior control unit) changes the behavior of the UI during a period in which approach notification information indicating the approach of the second user terminal continues to be acquired from the first user terminal, and during a predetermined period after the end of that period.

[0092] Fig. 17 is a diagram showing another example of a dialogue during approach. In the example of Fig. 17(a), the server device 10 displays an approach detection icon E22 on the interactive AI screen C2 of the first user terminal (user terminal 20-1) and causes the interactive AI to output a voice V28 indicating a statement such as, "Beta, you guys also came shopping at the same store." Fig. 17(a) shows a state in which approach notification information has been acquired (hereinafter referred to as a "first approach state") by displaying the approach detection icon E22.

[0093] When the server device 10 no longer acquires approach notification information from the first approach state, the server device 10 assumes that the second user terminal has not yet gone far for a certain period of time (hereinafter referred to as the "second approach state"), and causes the UI to behave in accordance with the second approach state. In the example of Fig. 17(b), the server device 10 terminates the display of the approach detection icon E22 and causes the interactive AI to output a voice V29 indicating a statement such as "Beta and his friends have moved away a little, but it looks like they are still in the department store."

[0094] The absence of the approach detection icon E22 indicates that the ambient sounds of the first user terminal do not include a specific sound, i.e., the first approach state is not being reached. Meanwhile, the server device 10 continues to control the behavior of the UI of the interactive AI by referring to the interaction history of the user of the second user terminal (Emma in the example of FIG. 17) from the first approach state. In other words, the server device 10 executes the interaction control process during approach (A41 shown in FIG. 7) in both the first approach state and the second approach state.

[0095] When a predetermined period of time has elapsed since the second approach state was established, the server device 10 determines that the approach state has ended (A44=YES in FIG. 7) and returns to the normal interaction control process (A22 in FIG. 7). Because the range within which the specific sound can reach (areas R1 and R2 in FIG. 10) is not very wide, the approach state may end quickly if the user continues to move. In contrast, according to the example in FIG. 17, the period during which the interaction control process is performed during approach is longer, allowing the user to experience a longer sense of proximity with other interactive AIs.

[0096] The predetermined period is not limited to a fixed period, and may be, for example, a period until a second user terminal that has approached a first user terminal moves a predetermined distance away from the first user terminal. Also, the predetermined period may be a period during which the first user terminal and the second user terminal are in the same area (such as the same station premises, the same department store, or the same neighborhood).

[0097] Furthermore, the server device 10 may set a longer predetermined period as the number of approach histories of the first user terminal and the second user terminal increases. According to this aspect, the interactive AI of the user terminal 20 that has more opportunities to approach each other can be made to experience a state of proximity (the first approach state and the second approach state) for a longer period. Furthermore, the server device 10 may vary the predetermined period depending on the time of day, the current day of the week, or other such time. For example, the server device 10 sets a longer predetermined period on holidays than a predetermined period on weekdays. According to this aspect, the state of proximity (the first approach state and the second approach state) can be made to experience a longer period during a predetermined time (for example, a time when there is more free time, such as a holiday).

[0098] Furthermore, the server device 10 may vary the predetermined period depending on the location of the first user terminal. For example, the server device 10 may make the predetermined period in a predetermined location, such as a park or a department store, longer than the predetermined period in other locations. According to this aspect, the user can experience the proximity state (the first proximity state and the second proximity state) for a longer period in a predetermined location (for example, a place that the user visits when they have time, such as a park or a department store).

[0099] <Variation: Registering dialogue materials> In the dialogue control process at the time of approach, information other than the dialogue history may be used. In this case, for example, the server device 10 functions as an example of a registration accepting unit that accepts registration of dialogue materials associated with the first user terminal. For example, the server device 10 displays a screen for registering dialogue materials.

[0100] FIG. 18 is a diagram showing an example of a dialogue material registration screen. In the example of FIG. 18, the server device 10 displays dialogue material registration buttons B24, B25, and B26 on the dialogue AI screen C2 of the first user terminal (user terminal 20-1). The registration buttons B24, B25, and B26 are operation images for registering "talk about a favorite restaurant," "talk about hobbies," and "talk about a movie I recently saw," respectively, as dialogue materials. The server device 10 causes the dialogue AI shown in the AI ​​appearance image F21 to output voice V41 indicating a statement saying, "Please pick a topic to talk about when you meet your dialogue AI friends!"

[0101] When the registration button is operated, the server device 10 associates the dialogue material indicated by the operated registration button with Tom, the user of the first user terminal, and stores the dialogue material in the dialogue history database 4, thereby registering the dialogue material. Note that the dialogue material to be registered may be information that indicates only the theme, as shown in FIG. 18, or may include more detailed content (for example, the name of a "frequently visited store" or products). More detailed content can be registered by further interacting with the dialogue AI.

[0102] Then, when the server device 10 (an example of a behavior control unit) acquires information indicating the approach of a second user terminal from the first user terminal as approach notification information, the server device 10 controls the behavior of the UI of the first user terminal based on the registered dialogue material. For example, when "talking about hobbies" is registered, the server device 10 determines what to say by referring to the hobbies section of the user attributes included in the dialogue history. Furthermore, depending on the registered topic, the server device 10 determines what to say by searching for that topic from external information using the task execution function of the AI ​​module 3. According to this embodiment, it is possible to select the dialogue content to be given to the interactive AI of the approaching partner.

[0103] Note that the server device 10 may, for example, register dialogue materials in association with a location, and control the behavior of the UI using the dialogue materials associated with the location where the proximity state has occurred. Furthermore, the server device 10 may register dialogue materials in association with a time period, such as a time of day or a day of the week, and control the behavior of the UI using the dialogue materials associated with the time period when the proximity state has occurred. Furthermore, the server device 10 may register dialogue materials in association with the number of past approaches, and control the behavior of the UI using the dialogue materials associated with the number of past approaches with the second user terminal that has become close. According to these aspects, it is possible to have a dialogue whose content is suited to the situation in which the proximity of the terminals is detected.

[0104] <Variation: Behavior Recording> The behavior of the UI of the interactive AI when approaching may be reused. For example, when approach notification information indicating the approach of a second user terminal is acquired from a first user terminal, the server device 10 functions as an example of a storage control unit that stores the behavior of the UI of the first user terminal in association with the combination of both terminals (the first user terminal and the second user terminal). The UI behavior here refers to the behavior when approaching.

[0105] 12, the interactive AI of the first user terminal makes a statement based on the dialogue history of the interactive AI of the second user terminal, and the server device 10 stores the content of the statement (an example of the UI behavior of the first user terminal) in association with the combination of the first user terminal and the second user terminal. Then, when approach notification information for that combination is acquired again, the server device 10 functions as an example of a second notification unit that notifies the user via the first user terminal of the UI behavior stored in association with that combination.

[0106] FIG. 19 is a diagram showing another example of a dialogue during approach. In the example of FIG. 19, the server device 10 causes the interactive AI of the first user terminal (user terminal 20-1) to output a voice V42 indicating a statement such as, "The last time we passed each other, I told you that you were talking about a new shop in front of the station!" In the example of FIG. 19, the server device 10 notifies the user of the first user terminal of the behavior of the UI stored in the example of FIG. 12 by explaining the behavior. This aspect allows the user to remember the previous time they passed each other.

[0107] Note that the method of notifying the user of the UI behavior is not limited to this. The server device 10 may notify the user by, for example, displaying an explanation of the UI behavior or having the interactive AI perform the same behavior. The server device 10 may also store only cases in which the UI of the interactive AI performs a predetermined behavior when approaching. The predetermined behavior may be, for example, a behavior in which the interactive AIs of approaching user terminals 20 converse with each other as in the example of FIG. 14, or a behavior in which the location of the first user terminal is notified as in the example of FIG. 16. According to this embodiment, it is possible to remind the user only of the specific behavior that occurred when the user passed by the user.

[0108] Furthermore, the server device 10 may store the UI behavior only when the time of the approaching state is equal to or longer than a threshold. According to this aspect, the UI behavior when passing by another person in an instant is not notified, but the stored UI behavior is notified only when passing by another person who has been in close proximity for a certain period of time again, so that the user can be reminded of the previous time they passed by each other.

[0109] <Variation: Output method of specific sound> The method of outputting the specific sound is not limited to the above-described method. For example, a sound corresponding to an ambient sound may be used as the specific sound. In this case, the server device 10 functions as an example of an ambient sound acquisition unit that acquires the ambient sound of the user terminal 20 (including the second user terminal). The server device 10 acquires the sound indicated by the sound data transmitted from the user terminal 20 as the ambient sound of the user terminal 20.

[0110] Then, the server device 10 (an example of a sound control unit) causes the user terminal 20 (including the second user terminal) to output a sound corresponding to the acquired ambient sound as a specific sound (an example of a specific sound). For example, the server device 10 analyzes the distribution of frequencies of sounds contained in the ambient sound, and outputs a sound of a frequency that is contained in a small proportion of the ambient sound as the specific sound. In this case, the specific sound may be limited to sounds outside the audible range, or may include sounds in the audible range.

[0111] For example, when the sound contains many high-frequency sounds, the server device 10 outputs a low-frequency sound as the specific sound, and when the sound contains many low-frequency sounds, the server device 10 outputs a high-frequency sound as the specific sound. According to this aspect, compared to when the specific sound is a uniform sound, it is easier to separate the specific sound from ambient sounds, even if there are other sounds, making it easier to detect the proximity of terminals to each other.

[0112] Conversely, the server device 10 may output a sound of a frequency that is contained in a large proportion of the ambient sound as the specific sound. This method, particularly when a sound in the audible range is output as the specific sound, makes the specific sound more likely to blend in with the ambient sound than when a sound of a frequency that is contained in a small proportion of the ambient sound is output, making it difficult for people to notice that the specific sound is a specific sound when it reaches their ears.

[0113] Furthermore, a sound corresponding to the position of the user terminal 20 may be used as the specific sound. In this case, the server device 10 functions as an example of a position acquisition unit that acquires position information indicating the position of the user terminal 20. The server device 10 periodically requests the user terminal 20 for position information and repeatedly acquires the position information of the user terminal 20. Then, the server device 10 (an example of a sound control unit) causes the user terminal 20 to output, as the specific sound, a sound corresponding to the position indicated by the acquired position information.

[0114] For example, when server device 10 acquires location information of a place where there is a high possibility of many people, such as a station, a department store, or a busy shopping district, it outputs a sound that is difficult to blend in with the sounds of the crowd and has a high volume as the specific sound. Also, when server device 10 acquires location information of a relatively quiet place, such as a hospital, a library, or a residential area, it outputs a sound with a low volume (especially if it is a sound in the audible range) as the specific sound. According to this aspect, it is possible to make the specific sound less noticeable to people in the vicinity and to make it easier to detect the approach of a person, compared to when the specific sound is a uniform sound.

[0115] <Other examples> In the example of FIG. 4, the server device 10 performs a detection process to detect the approach of the terminals to each other in A33, but this detection process may also be performed by the user terminal 20. In this case, the user terminal 20 acquires ambient sounds in A32 and determines whether the acquired ambient sounds include a specific sound. If a specific sound is included, the user terminal 20 transmits detection data to the server device 10 indicating that the terminals have been approached. Upon receiving the detection data, the server device 10 acquires the detection result indicated by the detection data as approach notification information and starts an interaction control process at the time of approach in A41. According to this embodiment, the communication load between the user terminal 20 and the server device 10 can be reduced compared to when sound data is communicated.

[0116] 4 and other examples, the proximity of terminals is detected using a specific sound output by a speaker and a sound detected by a microphone, which is a sound sensor, but the method of detecting the proximity of terminals is not limited to this. For example, the server device 10 may detect the proximity of terminals when the communication unit 23, which is a communication sensor, receives radio waves (radio waves such as Bluetooth (registered trademark) or WiFi) output by the communication unit 23 of the user terminal 20. In this case, radio waves are less likely to be blocked by obstacles than sound, so it is possible to more easily detect the proximity even in places with many obstacles than when a specific sound is used.

[0117] Furthermore, the server device 10 may detect proximity based on location information output by a positioning sensor of the user terminal 20. For example, the server device 10 periodically acquires location information from each user terminal 20, and detects that terminals have approached each other when the distance between them becomes less than a threshold. As described above, the server device 10 or the user terminal 20 may detect proximity between terminals by acquiring information output by a sensor provided in the user terminal 20 as proximity notification information.

[0118] 4, the user terminal 20 starts and ends the dialogue processing and the approach detection processing simultaneously. However, this is not limiting. For example, the user terminal 20 may continue to execute the approach detection processing regardless of whether the dialogue processing is being executed. For example, the user terminal 20 may continue to execute the approach detection processing by running a program for the approach detection processing resident in the background. In this case, when the server device 10 detects the approach of the terminals based on the sound data transmitted by the approach detection processing, it instructs the user terminal 20 to start the dialogue processing. According to this embodiment, even when the user is not interacting with the dialogue AI, the approach of the user terminal 20 with another dialogue AI can trigger the user terminal 20 to start the dialogue.

[0119] Alternatively, the AI ​​module 3 may be installed in the user terminal 20, allowing the interactive AI to operate offline. In this case, the interaction history of other interactive AIs cannot be used, but it is possible to change the behavior of the UI in response to proximity to another user terminal 20. As in the above example, this makes it possible to make the user aware of the presence of other interactive AIs and increase the presence of the interactive AI. In this way, the processor realizing the above-mentioned acquisition unit, behavior control unit, etc. is not limited to the processor of the server device 10, but may be the processor of the user terminal 20 alone, or may be both the processor of the server device 10 and the processor of the user terminal 20.

[0120] <Configuration variations> The configuration (overall configuration, hardware configuration, functional configuration, etc.) shown in FIG. 1 and other figures is an example, and other configurations may be used as long as they are not inconvenient for implementation. For example, the server device 10 may be distributed across two or more devices, or may be provided in the form of SaaS (Software as a Service) or a cloud computing system. Furthermore, the information processing performed by the server device 10 may be collectively performed by the user terminal 20. In short, as long as the information processing required for the entire automated dialogue system 1 is performed, the devices that perform that information processing may have any configuration.

[0121] Furthermore, the artificial intelligence module (AI module 3) may be an internal or external component of the server device 10, or may be an internal or external component of the automated dialogue system 1. Furthermore, the functions realized by one artificial intelligence module may be distributed and realized by two or more artificial intelligence modules, or the functions realized by two or more artificial intelligence modules may be integrated and realized by one artificial intelligence module.

[0122] The output destination of information or data (hereinafter referred to as "information, etc.") may be another device, a display, a memory unit (including a built-in memory unit and an external memory unit), etc. Acquisition of information, etc. includes acquiring information, etc. transmitted from another device, as well as acquiring information, etc. generated by the device itself. The table, etc. (table, database, etc.) in which parameters are associated is not limited to the illustrated table, etc., and the number of parameters may be reduced or increased. Furthermore, information, etc. corresponding to parameters may be obtained using a mathematical formula, a conditional formula, etc., without using a table, etc.

[0123] The above-described embodiments are information processing devices such as the server device 10 and the user terminal 20, and information processing systems such as the automated dialogue system 1 including the server device 10 and the user terminal 20. However, the embodiments may also be information processing methods. The information processing methods include the same steps as those executed by the information processing systems. The above-described embodiments may also be programs. The programs cause a computer to execute the same steps as those executed by the information processing systems.

[0124] <Additional Notes> Furthermore, it may be provided in the following aspects.

[0125] (1) An information processing system having at least one processor, wherein in an acquisition step, the processor acquires information from a first user terminal functioning as a UI (User Interface) of an interactive artificial intelligence module, indicating whether or not a second user terminal functioning as the UI is approaching, and in a behavior control step, controls the behavior of the UI, and when the information indicating the approach of the second user terminal is acquired from the first user terminal, changes the behavior of the UI of the first user terminal.

[0126] According to this embodiment, the presence of the interactive AI can be enhanced.

[0127] (2) In the information processing system described in (1) above, the second user terminal has a function to output a specific sound, the information is information indicating sounds around the first user terminal, and in the behavior control step, the processor changes the behavior when the information indicating a sound including the specific sound is acquired.

[0128] According to this aspect, it is possible to detect approach without being affected by the communication state.

[0129] (3) In the information processing system described in (2) above, the specific sound includes multiple types of sound, and in the sound control step, the processor outputs the specific sound to the second user terminal while sequentially switching between types.

[0130] According to this aspect, it is possible to easily detect the approach even when there is ambient noise.

[0131] (4) In the information processing system described in (3) above, the processor acquires sounds around the second user terminal in the ambient sound acquisition step, and in the sound control step, causes the second user terminal to output a sound corresponding to the acquired ambient sound as the specific sound.

[0132] According to this aspect, it is possible to easily detect the approach even when there is ambient noise.

[0133] (5) In the information processing system described in (3) or (4) above, the processor, in the position acquisition step, acquires position information indicating the position of the second user terminal, and in the sound control step, causes the second user terminal to output a sound corresponding to the position indicated by the acquired position information as the specific sound.

[0134] According to this aspect, it is possible to make it easier to detect the approach of a specific sound while making it difficult for people in the vicinity to notice the specific sound.

[0135] (6) In the information processing system described in any one of (1) to (5) above, in the history acquisition step, the processor acquires an interaction history with the artificial intelligence module via the second user terminal, and in the behavior control step, changes the behavior of the UI of the first user terminal according to the acquired interaction history.

[0136] According to this aspect, it is possible to make the user feel the atmosphere of the person approaching.

[0137] (7) In an information processing system described in any one of (1) to (6) above, in the behavior control step, the processor controls the behavior of the UI of the first user terminal so that the artificial intelligence module that interacts via the first user terminal and the artificial intelligence module that interacts via the second user terminal interact with each other.

[0138] According to this embodiment, the presence of the interactive AI can be more strongly felt.

[0139] (8) In the information processing system described in any one of (1) to (7) above, in the request step, when the information indicating the approach of the second user terminal is obtained from the first user terminal, the processor requests permission from the user of the first user terminal to notify the second user terminal of the location of the first user terminal, and in the first notification step, if the permission is granted, notifies the user of the second user terminal of the location of the first user terminal via the second user terminal.

[0140] According to this aspect, it is possible to identify the person who has approached.

[0141] (9) In the information processing system described in any one of (1) to (8) above, the processor accumulates the history of the approach in the accumulation step, and changes the behavior of the UI in accordance with the accumulated history in the behavior control step.

[0142] According to this embodiment, it is possible to increase the variety of UI behavior.

[0143] (10) In the information processing system described in any one of (1) to (9) above, the processor repeatedly acquires the information in the acquisition step, and changes the behavior of the UI in the behavior control step during a period in which the information indicating the approach of the second user terminal continues to be acquired from the first user terminal and for a predetermined period after the end of that period.

[0144] According to this embodiment, it is possible to make the user feel closer to other interactive AIs for a longer period of time.

[0145] (11) In the information processing system described in any one of (1) to (10) above, in the registration reception step, the processor receives registration of dialogue material associated with the first user terminal, and in the behavior control step, changes the behavior of the UI of the first user terminal in accordance with the registered dialogue material.

[0146] According to this embodiment, it is possible to select the content of the dialogue to be given to the interactive AI of the approaching partner.

[0147] (12) In the information processing system described in any one of (1) to (11) above, in the storage control step, when the information indicating the approach of the second user terminal is obtained from the first user terminal, the processor stores the UI behavior of the first user terminal in association with the combination of both terminals, and in the second notification step, when the information of the combination is obtained again, notifies the user via the first user terminal of the UI behavior stored in association with the combination.

[0148] According to this embodiment, the user can be reminded of the previous times they passed each other.

[0149] (13) An information processing method, in which a processor included in an information processing system executes each step of the information processing system described in any one of (1) to (12) above.

[0150] According to this embodiment, the presence of the interactive AI can be enhanced.

[0151] (14) A program that causes a computer to execute each step of the information processing system according to any one of (1) to (12) above.

[0152] According to this embodiment, the presence of the interactive AI can be enhanced. Of course, this is not the case. Furthermore, the above-described embodiments and modifications may be combined in any desired manner.

[0153] Finally, while various embodiments of the present invention have been described, these are presented by way of example only and are not intended to limit the scope of the invention. The novel embodiments may be embodied in various other forms, and various omissions, substitutions, and modifications may be made without departing from the spirit of the invention. The embodiments and their modifications are intended to be included within the scope and spirit of the invention, as well as within the scope of the inventions and their equivalents as defined in the appended claims. [Explanation of symbols]

[0154] 1: Automated dialogue system 2: Communication line 3: AI module 4: Dialogue history database 10: Server device 11: Control section 20: User terminal 20-1: User terminal 20-2: User terminal 21: Control unit

Claims

1. An information processing system including at least one processor, the processor: In the acquisition step, information indicating whether or not a second user terminal functioning as a UI (User Interface) of an interactive artificial intelligence module is approaching is acquired from a first user terminal functioning as the UI; In the behavior control step, a behavior of the UI is controlled, and when the information indicating the approach of the second user terminal is acquired from the first user terminal, the behavior of the UI of the first user terminal is changed. Information processing system.

2. 2. The information processing system according to claim 1, the second user terminal has a function of outputting a specific sound; the information is information indicating a sound around the first user terminal, the processor: In the behavior control step, the behavior is changed when the information indicating a sound including the specific sound is acquired. Information processing system.

3. 3. The information processing system according to claim 2, The specific sound includes a plurality of types of sound, the processor: In the sound control step, the specific sound is output from the second user terminal while sequentially switching the type of the specific sound. Information processing system.

4. 4. The information processing system according to claim 3, the processor: In the ambient sound acquisition step, ambient sound of the second user terminal is acquired; In the sound control step, a sound corresponding to the acquired surrounding sound is output from the second user terminal as the specific sound. Information processing system.

5. 4. The information processing system according to claim 3, the processor: In the position acquisition step, position information indicating a position of the second user terminal is acquired; In the sound control step, a sound corresponding to a position indicated by the acquired position information is output from the second user terminal as the specific sound. Information processing system.

6. 2. The information processing system according to claim 1, the processor: In the history acquisition step, a dialogue history with the artificial intelligence module is acquired via the second user terminal; In the behavior control step, a behavior of the UI of the first user terminal is changed in accordance with the acquired dialogue history. Information processing system.

7. 2. The information processing system according to claim 1, the processor: In the behavior control step, the behavior of the UI of the first user terminal is controlled so that the artificial intelligence module that interacts via the first user terminal and the artificial intelligence module that interacts via the second user terminal interact with each other. Information processing system.

8. 2. The information processing system according to claim 1, the processor: In the request step, when the information indicating the approach of the second user terminal is acquired from the first user terminal, a user of the first user terminal is requested to give permission for notification of the location of the first user terminal to the second user terminal; In the first notification step, if the permission is granted, the location of the first user terminal is notified to a user of the second user terminal via the second user terminal. Information processing system.

9. 2. The information processing system according to claim 1, the processor: In the accumulation step, the history of the approach is accumulated; In the behavior control step, a behavior of the UI is changed in accordance with the accumulated history. Information processing system.

10. 2. The information processing system according to claim 1, the processor: In the acquiring step, the information is repeatedly acquired; In the behavior control step, behavior of the UI is changed during a period in which the information indicating the approach of the second user terminal continues to be acquired from the first user terminal and during a predetermined period after the end of the period. Information processing system.

11. 2. The information processing system according to claim 1, the processor: In the registration receiving step, a registration of a dialogue material associated with the first user terminal is received, In the behavior control step, a behavior of the UI of the first user terminal is changed in accordance with the registered dialogue material. Information processing system.

12. 2. The information processing system according to claim 1, the processor: In the storage control step, when the information indicating the approach of the second user terminal is acquired from the first user terminal, the behavior of the UI of the first user terminal is stored in association with a combination of both terminals; In the second notification step, when the information on the combination is acquired again, the behavior of the UI stored in association with the combination is notified to the user via the first user terminal. Information processing system.

13. An information processing method, comprising: The processor of the information processing system Executing each step of the information processing system according to any one of claims 1 to 12. Information processing methods.

14. A program, A computer is caused to execute each step of the information processing system according to any one of claims 1 to 12. program.

Images