Method for using artificial intelligence (AI) to promote communication, program, server, and computer
The AI management system addresses the challenge of personalizing AI for interpersonal communication by applying personal models to language and speech AIs, enabling effective conversations that reflect individual traits and allowing administrators to manage interactions, thus enhancing communication efficiency and reducing discomfort.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-08-26
- Publication Date
- 2026-03-05
AI Technical Summary
Existing AI technologies have not effectively facilitated interpersonal communication by mimicking individual personalities and characteristics, limiting their use in enhancing human interaction and conversation.
A system utilizing AI management functions that apply personal models and information to language and speech recognition/synthesis AIs to reproduce an individual's personality and characteristics, enabling natural conversations and allowing administrators to control and manage these interactions.
Enables effective interpersonal communication by allowing AI to mimic individual personalities, facilitating conversations that reflect the person's traits and preferences, and providing administrators with control over the conversation flow, reducing discomfort and enhancing interaction efficiency.
Smart Images

Figure JP2025029989_05032026_PF_FP_ABST
Abstract
Description
A method, program, server, or computer that uses AI (artificial intelligence) to promote communication
[0001] Research is being conducted in various fields on technologies to personalize AI (artificial intelligence) by incorporating an individual's personality, characteristics, preferences, etc., and various methods are being developed. How to utilize such personalized AI is also being considered.
[0002] Research is being conducted into personalization, which involves incorporating an individual's personality, characteristics, and tastes into AI, turning it into an alternate self. Numerous studies have attempted to create the perfect individual by having AI learn an individual's personality and characteristics as a model. Even without aiming for such perfection, there are simpler ways to personalize AI. We live in an age where even individuals can easily use AI, and there are web pages where you can casually chat with AI. By providing the AI with information about your personality and characteristics and requesting responses based on those information, it is possible to have the AI respond in a manner that meets your requests to a certain extent. This can also be considered a form of personalization. Research is also underway to use these personalized AIs to help people communicate.
[0003] US Pat. US10853717B2
[0004] As in Patent Document 1, AI has evolved to learn various information about individuals and better express their personalities and characteristics. Attempts are also being made to utilize AI that mimics such individuals' personalities and characteristics to aid in interpersonal communication. However, there is a problem in that AI has not yet been used effectively to facilitate communication and interpersonal interaction.
[0005] A "personalized AI" can speak on behalf of an individual by using machine learning to learn an individual's personality and characteristics and creating a model, by providing the AI with information about the individual's personality and characteristics and having it reproduce that information, or by combining these two methods to reproduce the individual's personality and characteristics. The flow of the conversation is created by the AI's speech. The individual can watch and listen to the flow of the conversation, and by passing the baton to the AI midway through the conversation, or by joining the conversation as a new guest, it is easier to structure the conversation than if they were building it from scratch. It is also possible for the individual to converse with other "personalized AIs." Since the other party also has their own personal personality registered in the AI, or is an AI that has been trained to learn the individual's personality, the conversation can be conducted without hesitation, unlike a real person. Conversations can also be held in online chat spaces without actually meeting. Although you are not talking to the person in question but to a "personalized AI," conversations with such AI reflect the person's personality, characteristics, habits, and tastes, so you can connect with AIs you enjoy talking to or who share your interests by registering their IDs. In this way, you can help people communicate with each other and efficiently expand your interactions.
[0006] Image of AI management function
[0007] Personalization through AI is becoming a common technology. For example, there is already a service that uses AI to learn information about a deceased person, allowing people who have a connection with the deceased to speak to the AI even after their death, giving the feeling that they have spoken to the deceased. In this way, technology that implants an individual's personality and characteristics into AI, allowing it to behave like that person, even if not perfectly, is becoming commonplace.
[0008] The personalities and characteristics of the AI that are realized by teaching it or providing it with information may be those of the administrator who manages it, or they may be those of other people or the personalities and characteristics of fictitious characters. However, if the administrator uses the personality or characteristics of other people, it is preferable to obtain appropriate permission from the person who owns the personality or characteristics or the rights holder.
[0009] In the present invention, AI (artificial intelligence) refers to a computer system or algorithm that mimics, augments, or complements part or all of human intellectual capabilities. This includes, but is not limited to, machine learning, deep learning, reinforcement learning, neural networks, expert systems, natural language processing, computer vision, speech recognition, speech synthesis, and decision support systems. In the present invention, "personalized AI" refers to a state in which a language model AI such as LLM or speech recognition / synthesis AI is applied with an individual's model and information to reproduce the personality, characteristics, voice, etc. of the original individual, and is capable of conducting a conversation. However, in the present invention, as long as natural conversation is possible, it is not necessary to use a language model AI such as LLM or speech recognition / synthesis AI; any AI can be used.
[0010] Conversations and chats as described in this invention refer to voice or text conversations, or a mixture of both, unless otherwise specified.
[0011] Unless otherwise specified, the server described in this application can be any server. It can be a cloud server or an on-premise server. Any server that can execute the application can be used.
[0012] When using AI for conversation, a model called a large-scale language model (LLM) is suitable. LLMs learn from large amounts of text data, understand context, and generate natural and meaningful responses. However, in the present invention, it is not necessary to use a large-scale language model (LLM), and any AI can be used as long as natural conversation is possible.
[0013] Such AI can learn an individual's characteristics and personality, incorporating to some extent that individual's way of thinking and speech. The results can also be saved as a model or information. These can sometimes be saved as models, and sometimes in other forms, such as parameters, rules, and settings. Sometimes both are used. By saving these models and information and applying them to the AI as appropriate, conversations can always be tailored to the individual's characteristics and personality.
[0014] Furthermore, these AIs can imitate an individual's characteristics and personality to some extent simply by providing that individual with information about that individual's characteristics and personality. For example, there are websites such as Google Gemini and Microsoft Copilot that allow you to converse with a web-based AI. On these websites, if you give the command, "Please pretend to be a celebrity (any ordinary celebrity) in conversation," you can easily have the AI imitate that celebrity. This is done by inferring the words and speaking style from the information about the celebrity that the AI already has. The AI can also converse according to commands such as, "Please pretend to be a nervous person in conversation" or "Please pretend to be a happy-go-lucky 30-year-old man." This means that simply providing an AI with information about an individual's characteristics and personality allows it to have a conversation that is in line with that individual's characteristics and personality to some extent. In this way, by applying models and information to the AI, it is possible to reproduce the characteristics and personality of that individual.
[0015] Furthermore, if you want to have these conversations by voice, you can use speech synthesis software in combination with them for speaking. To listen to speech, you can use speech recognition software in combination with them. LLMs can imitate the characteristics of an individual's speech (vocabulary, writing style, use of phrases, etc.) at the text level, learning a specific person's speech and writing style and generating similar sentences, but they cannot recognize or synthesize speech. LLMs typically receive text input and generate text output, but speech recognition and speech synthesis must be performed by separate systems or models. Using a speech-to-text system and text-to-speech synthesis, a conversation can be conducted by voice.
[0016] In the field of speech-to-text recognition systems, there are systems that use AI to improve recognition technology. Whisper (a speech recognition AI) is one example, but it is also possible to combine these speech recognition systems that use AI. In the present invention, any AI may be used as long as it can establish a natural conversation.
[0017] Even in text-to-speech synthesis, if you want to express characteristics such as an individual's voice quality or speaking style, you can use "voice synthesis AI" or "voice cloning AI" to generate voice. Similarly to the previous example, by applying models and information, you can create a conversation that is in line with an individual's characteristics and personality. An example of this is WaveNet (a deep learning model for generating voice waveforms). Any AI can be used in the present invention as long as it can produce a natural conversation.
[0018] For example, one example is combining Whisper (voice recognition AI), ChatGPT (language model AI), and WaveNet (voice synthesis AI) to use them for voice conversation.
[0019] In this way, it is common to combine "speech synthesis AI" or "speech cloning AI" with language model AI such as LLM. In this invention, these "speech recognition AI," "speech synthesis AI," and "speech cloning AI" are referred to as speech recognition / speech synthesis AI.
[0020] When using these various AIs, you can either use cloud services to rent external AI via APIs, or you can set up your own dedicated server or computer.
[0021] Research into the technology of personalizing AI is still ongoing, and further development is anticipated. The "personalized AI" in this invention can be any AI or mechanism that reproduces an individual's personality or characteristics. The "AI management function" manages this.
[0022] The "AI management function" is software that manages personal models and information applied to language model AIs such as LLMs and speech recognition / speech synthesis AIs, and has the function of connecting to language model AIs such as LLMs and speech recognition / speech synthesis AIs that use personal models and information, enabling conversation. Multiple personal models and information can be managed, and the administrator can select the one they want to use each time.
[0023] The "AI Management Function" has the ability to manage personal models and information. The "AI Management Function" stores in advance information on which models and information to apply to the language model AI, such as LLM, and the speech recognition and speech synthesis AI.
[0024] In other words, the "AI management function" uses connection information to the AI to automatically connect via API or the like at the administrator's request, and applies it to language model AI such as LLM and speech recognition / speech synthesis AI that use the models and information managed by the "AI management function," enabling conversations that reproduce an individual's personality, characteristics, voice, etc. The "AI management function" has a function that applies it to language model AI such as LLM and speech recognition / speech synthesis AI that use individual models and information to enable conversations. The "AI management function" also stores connection information to language model AI such as LLM and speech recognition / speech synthesis AI that is necessary to enable conversations at the administrator's request.
[0025] Such a system already exists. Microsoft Azure Machine Learning + Azure Bot Service allows you to build chatbots and conversational AI by deploying a model trained in Azure Machine Learning and using it with Azure Bot Service. AWS SageMaker + Amazon Lex allows you to host a model in SageMaker and incorporate the endpoint into Lex to enable natural conversations. Lex supports both voice and text-based interfaces.
[0026] Figure 1 shows the application of the AI management function (1) to language model AI such as LLM, which uses personal models and information managed by the AI management function (1), and to speech recognition and speech synthesis AI.
[0027] The "AI management function" can operate as a server and be connected to a computer such as a mobile phone to operate and converse with it, or it can operate directly on a computer such as a mobile phone and converse with it. It can also run on the same server or computer as the language model AI such as LLM and the speech recognition / speech synthesis AI used. Whether the "AI management function" is running as a server or on a computer such as a mobile phone, it has the function to allow the administrator to perform various operations through a dedicated web page or application. In addition, when conversing with the "personalized AI" via text rather than voice, the "personalized AI" conversation can be displayed on a dedicated web page or application, and responses can also be entered as text from a dedicated web page or application.
[0028] Administrators can connect to the server from a computer such as a mobile phone through these dedicated web pages or applications and call up the ``AI management function,'' or if the ``AI management function'' is installed on the computer such as a mobile phone, they can start a conversation with the ``personalized AI'' by activating it.
[0029] The "AI management function" applies personal models and information to the AI so that the "personalized AI" can converse, allowing administrators and other humans to converse with the "personalized AI." Similarly, it can also converse with "personalized AI" managed by others. Administrators and other humans can speak to the "personalized AI" by voice or by typing in text to provide a topic (such as today's news), and the "personalized AI" can then provide a topic of conversation. This allows the "personalized AI" to help with conversations when conversations between humans come to a halt.
[0030] Because the "personalized AI" speaks in line with the personality and characteristics of the original individual, the administrator can predict the content and flow of the conversation to a certain extent, allowing them to watch and listen with peace of mind. It is also possible to have the administrator's "personalized AI" converse with another person's "personalized AI," and when the conversation becomes interesting, the administrator or other people can join in.
[0031] When an administrator or other human being converses with the "personalized AI," if the conversation is conducted by voice, the conversation can be sent and received from the speakers and microphone of the computer running the dedicated web page or application for the "AI management function." If the conversation is conducted by text, the text of the conversation can be displayed and entered on the dedicated web page or application for the "AI management function," and when the administrator or other human being enters text on the dedicated web page or application, the response from the "personalized AI" can be displayed and viewed in text.
[0032] When a "personalized AI" of an administrator's "AI management function" and a "personalized AI" of another "AI management function" have a voice conversation, they can send and receive the conversational audio from each other's speakers and microphones, and the conversation can be input and output from each speaker and microphone. When a text conversation is to take place, the "AI management function"'s dedicated web page or application can display and input the text of the conversation, so another person must mediate the text conversation between the two parties and input it as text into the computer on which the dedicated web page or application of each "AI management function" is running. Once one "personalized AI" displays the conversation, the content is entered as text into the computer on which the dedicated web page or application of the "AI management function" of the other "personalized AI" is running. This process is repeated.
[0033] The "AI management function" has the ability to connect to and converse with other "AI management functions" using communication methods such as internet communication, wireless or wired communication.
[0034] This communication can be carried out by checking the connection settings of each other's "AI management functions" and using a mechanism that directly connects the "AI management functions" to each other on a peer-to-peer basis, or it can be done by preparing a server dedicated to the "AI management functions" and exchanging IDs through that server to connect, as with messengers such as WhatsApp.
[0035] This allows both administrators to have a conversation using the "personalized AI" of the "AI management function" just like a phone call, even if they are far apart. Also, even if both administrators are close to each other, if they have a text conversation, the conversation is linked to each other's "AI management function," which is convenient and eliminates the need for a human to mediate the text conversation as mentioned above.
[0036] The "AI management function" has the ability to receive requests and commands from the administrator in the form of voice or text via a dedicated web page or application in response to conversations with the "personalized AI." The "AI management function" transmits these requests and commands to the language model AI, such as LLM, and the speech recognition and speech synthesis AI in use. This is done by adding the requests and commands to the conversation.
[0037] While listening to the conversation of the "personalized AI," the administrator can issue requests and commands through a dedicated web page or application for the "AI management function" to steer the conversation in the direction the administrator prefers. Because the administrator is not the one speaking, they can manipulate the conversation as if they were a third party listening to the conversation. When the administrator issues such requests or commands, the "AI management function" transmits the requests and commands to the language model AI, such as LLM, and the speech recognition / speech synthesis AI used in addition to the conversation.
[0038] This allows the administrator to issue requests or commands to the "AI management function" by voice or text while watching or listening to the conversation of the "personalized AI," such as "speak faster," "choose your words carefully," "speak a little more slowly," "ask a riddle," or "end the conversation now." In this way, the administrator can control the conversation to their liking without having to speak themselves.
[0039] If the conversation with the "personalized AI" is a voice conversation, the administrator can input requests and commands by text through a web page or application dedicated to the "AI management function" so as not to interrupt the voice conversation. Conversely, if the conversation with the "personalized AI" is a text conversation, the administrator can input requests and commands by voice through a web page or application dedicated to the "AI management function" so as not to interrupt the text conversation. This provides a function that prevents unnecessary words from being mixed in during the conversation. In other words, requests and commands are transmitted to language model AI such as LLM or speech recognition / speech synthesis AI used without the knowledge of the conversation partner. Web pages and applications dedicated to the "AI management function" have the ability to accept voice input from a microphone and transmit the administrator's requests and commands in addition to the current conversation to the language model AI such as LLM or the voice recognition / voice synthesis AI being used, even if the conversation between the "personalized AI" is a text conversation, and conversely, even if the conversation between the "personalized AI" is a voice conversation, they have the ability to accept text input and transmit the administrator's requests and commands in addition to the current conversation to the language model AI such as LLM or the voice recognition / voice synthesis AI being used.
[0040] If the conversation with the "personalized AI" is a voice conversation, the administrator can input requests and commands by text through a web page or application dedicated to the "AI management function" so as not to interrupt the voice conversation. Conversely, if the conversation with the "personalized AI" is a text conversation, the administrator can input requests and commands by voice through a web page or application dedicated to the "AI management function" so as not to interrupt the text conversation. This provides a function that prevents unnecessary words from slipping into the conversation.
[0041] The "AI management function" has the function to pause and resume a conversation with the "personalized AI." The "AI management function" can pause and resume a conversation because it receives requests and commands for the conversation from the administrator and transmits those commands to the language model AI, such as LLM, and the speech recognition / speech synthesis AI that are using the request. When pausing, the "AI management function" instructs the language model AI, such as LLM, and the speech recognition / speech synthesis AI used by the "personalized AI" that is having the conversation to pause and to monitor the conversation during the pause. This instruction may be given by the administrator via text or voice, or a pause button may be provided on a web page or application dedicated to the "AI management function." When the pause button is pressed, the "AI management function" instructs the language model AI, such as LLM, and the speech recognition / speech synthesis AI to pause and monitor the conversation during the pause. In the case of resumption, the "AI management function" instructs the language model AI such as LLM or the speech recognition / speech synthesis AI used by the "personalized AI" that is having the conversation to take over the conversation that it had been monitoring and start the conversation on behalf of the administrator. This instruction may be given by the administrator via text or voice, or a resume button may be provided on a web page or application dedicated to the "AI management function," and when this button is pressed, the "AI management function" may instruct the language model AI such as LLM or the speech recognition / speech synthesis AI to take over the conversation that it had been monitoring and start the conversation on behalf of the administrator.
[0042] This allows the administrator to pause the conversation of the "personalized AI" and take over the conversation that the administrator's "personalized AI" had up to that point. If the administrator wants to leave the conversation to the "personalized AI" again afterwards, they can simply resume it.
[0043] In this way, the pause and resume function of the "AI Management Function" can be performed by providing a pause and resume button in the "AI Management Function" app or a dedicated web page, or by voice command or text input command. Also, when paused, if the "AI Management Function" was conducting a text conversation from a language model AI such as LLM or a voice recognition / voice synthesis AI, it will stop displaying the conversation from the "Personalized AI" to the other party, and if it was conducting a voice conversation, it will stop the voice output from the "Personalized AI" so that the other party cannot hear the conversation from the "Personalized AI." When resuming, the display and voice output will resume.
[0044] If the administrator later gets bored of the conversation, they can unpause and resume the paused "personalized AI." This allows the "personalized AI" to continue the conversation with the administrator. Since the "personalized AI" continues to monitor the conversation even while it is paused, the baton of the conversation can be passed smoothly.
[0045] By using pauses in this way, it becomes easier for the administrator to grasp the flow of the conversation and there are fewer barriers to the administrator's conversation. Also, even if the conversation goes in a direction the administrator does not want, it is convenient because the administrator can have the "personalized AI" resume the conversation and think about how to structure the conversation, or have the "personalized AI" close the conversation.
[0046] The "Personalized AI" will see and hear the administrator's conversation during pauses or while the administrator is conversing with the "Personalized AI," and has the ability to convey the "Personalized AI's" views as advice to the administrator through the "AI Management Function." This is because the "AI Management Function" has the ability to receive requests and commands for the conversation from the administrator and convey those requests and commands, along with the current conversation, to the language model AI, such as LLM, and the speech recognition / speech synthesis AI being used. The "AI Management Function" can receive advice by saying to the language model AI, such as LLM, and the speech recognition / speech synthesis AI being used, "Please give us some advice while the administrator is conversing." This can be displayed as text on the screen of the "AI Management Function" app or a dedicated web page, or communicated by voice.
[0047] If the "personalized AI" conversation is a voice conversation, the administrator can display advice as text through a web page or application dedicated to the "AI management function" so as not to interrupt the voice conversation. Conversely, if the "personalized AI" conversation is a text conversation, the administrator can output advice as audio through a web page or application dedicated to the "AI management function" so as not to interrupt the text conversation. This provides a function that prevents unnecessary words from being mixed in during the conversation. In other words, advice can be received without the other party knowing. The "AI management function" dedicated web page or application can transmit advice from the language model AI, such as the LLM, or the speech recognition / speech synthesis AI being used through audio output from a speaker, even if the "personalized AI" conversation is a text conversation. Conversely, even if the "personalized AI" conversation is a voice conversation, it has the function of outputting advice from the language model AI, such as the LLM, or the speech recognition / speech synthesis AI being used as text and transmitting it.
[0048] The type of advice desired from the "AI Management Function" can be saved as a setting in advance and incorporated into the "AI Management Function." An advice button can be placed on a dedicated web page or application for the "AI Management Function," similar to when pausing. Pressing this button allows the "AI Management Function" to communicate that advice to a language model AI such as LLM or a speech recognition / speech synthesis AI. For example, pressing the advice button can result in a message such as, "Please tell me in text how you would respond if you were the administrator while the function is talking." This message is sent in addition to the current conversation. The administrator can also give instructions each time by voice or text. For example, if the user requests, "Please tell me in text how you would respond if you were the administrator while the function is talking," the "AI Management Function" will respond with an answer such as, "If it were me, I would say this response is fine." This can then be displayed as text on the screen of the "AI Management Function" app or dedicated web page, or communicated by voice. If you say, "Predict the other person's feelings and speak on their behalf," the system will respond with an answer such as, "It seems the other person is not comfortable talking about earthquakes." This can then be displayed as text on the screen of the "AI Management Function" app or a dedicated web page, or conveyed by voice.
[0049] The "AI Management Function" can save such conversation history on a computer such as a server or mobile phone that manages the "AI Management Function." It records not only the statements of the administrator's "personalized AI," but also those of the person with whom the conversation took place. In the case of a text conversation, the history is saved as text data. In the case of a voice conversation, the history can be saved as voice data, or the statements of the administrator's "personalized AI" can be saved as text and the voice of the person with whom the conversation took place can be recognized and recorded as text data, or both types of history can be saved.
[0050] In a conversation using these "personalized AIs," if an administrator joins the conversation or pauses the "personalized AI" and takes over the conversation themselves, the "personalized AI" will record what the administrator says and can use it as learning material for the models and information used by the "personalized AI."
[0051] The "AI Management Function" has the ability to change the language used as the basis for conversation. Since the "Personalized AI" is a language model AI such as LLM or a speech recognition / synthesis AI, conversations can be conducted in English or another language by issuing a request to change the language used as the basis for conversation from the "AI Management Function." The administrator can also learn the language by listening to the conversation or taking over the conversation midway.
[0052] In this way, an administrator can open an "AI Management Function" app or dedicated web page on a mobile phone or computer and operate it to have a conversation with the "personalized AI" they are managing. The administrator can also control the content of the conversation from the "AI Management Function." This makes it possible to start a conversation with others or liven up a stagnant conversation. Because administrators can control the conversation with few commands, they can manipulate the conversation as if they were operating a machine, which creates a new level of enjoyment. Because the administrator is not speaking themselves but is manipulating the conversation, they can see and hear the conversation from a third-party perspective, which is expected to reduce the sense of discomfort with conversation.
[0053] In addition, by using "personalized AI," conversation partners can also try conversations they wouldn't normally have, and get to know new sides of each other. For example, even if you have them debate a controversial topic, or talk about sports or politics, which some people have strong opinions about, the administrator does not actually talk, but only controls the conversation, so they can watch and listen to the conversation from a third-party perspective, allowing for a calm conversation without getting too heated.
[0054] The "AI management function" has the ability to receive "personalized AI" conversation requests from other servers, computers, or services and automatically link the "personalized AI" conversation to other servers, computers, or services.
[0055] Other servers, computers, and services include chat services described below, messengers such as WhatsApp, "personalized AI-enabled chat services," virtual reality software, computer games, and programs hosted on social media and websites.
[0056] When the "AI Management Function" receives a "Personalized AI" conversation request from another server, computer, or service and automatically links the "Personalized AI" conversation, the administrator can have a monitoring function that allows them to see and hear the conversation in the "AI Management Function." The monitoring function can be used in the "AI Management Function" app or a dedicated web page. When the "AI Management Function" is conducting multiple conversations, it is possible to switch between them and see and hear them.
[0057] The functions of the "AI Management Function" explained so far can be used as is for conversations monitored by the monitoring function of the "AI Management Function." Functions such as the administrator's ability to make requests and commands to the "Personalized AI" conversation, the ability to pause and resume the "Personalized AI" conversation, and the ability to convey the "Personalized AI's" views as advice to the administrator through the "AI Management Function" can also be used with the monitoring function.
[0058] The "AI management function" can have functions similar to messengers such as WhatsApp. In other words, you can register accounts for other "AI management functions" or humans and have conversations with them whenever you like. Conversations can be conducted by text or voice.
[0059] If it is desired to enable humans who do not have an "AI management function" to converse with the "AI management function" of other administrators, a dedicated server, app, or web page that can communicate with the "AI management function" can be prepared, and humans who do not have an "AI management function" can register their own account, handle name, or ID from there, and can register other "AI management functions" or humans to their own accounts in the address book and begin conversations.
[0060] The "AI Management Function" can leave conversations with other registered "Personalized AIs" or humans to the "Personalized AI." When a conversation request is made or when a conversation is requested, the administrator has the ability to set whether to have the conversation themselves or have the "Personalized AI" conduct the conversation. This setting can be switched at any time. If the "Personalized AI" is allowed to converse, when a conversation request is made from another "Personalized AI" or a human account, or when a conversation is requested by the administrator, the "Personalized AI" managed by the "AI Management Function" will automatically converse.
[0061] When the conversation is left to a "personalized AI" in this way, the "AI management function" has the ability to specify in advance the speaking style, content, and how the conversation will be conducted as conversation settings, such as "converse calmly," "talk about today's baseball game," or "converse softly at first and then become more aggressive in the middle of the game."
[0062] It also has a function that allows you to specify the speaking style, conversation content, and how to have a conversation for each specific handle name or ID.It also has a function that allows you to register messages for specific handle names or IDs in advance, and when a conversation request is made from that handle name or ID, the message can be played.
[0063] It also has a calendar and the ability to register schedules. For example, if a conversation request comes in from another "AI management function" or a human, the "personalized AI" will respond from 9:00 PM to 8:00 AM, and at other times the administrator will be notified. It is possible to set which will respond. Furthermore, for each handle name or ID that contacts you, you can specify the speaking style, content of the conversation, such as "speak concisely" or "speak politely," and how the conversation will be conducted. You can also play a specific message for each handle name or ID that contacts you. You can also set the conversation style and message to be changed by specifying a time or date.
[0064] Of course, the administrator can always respond to conversation requests himself.
[0065] The calendar also allows administrators to schedule other events unrelated to conversations.
[0066] The "AI management function" may have the group chat functionality found in other messengers. The administrator can participate in the group chat themselves, but can also schedule messages for the "AI management function" on the calendar. For example, if another "AI management function" or a human contacts the group chat between 9:00 PM and 8:00 AM, the function could reply with a message such as "We'll respond the next morning." Or, if a specific handle name or ID contacts the group chat on a specific day, a specific message could be sent to the group chat.
[0067] When a conversation request is made, or when a conversation request is made, the functions of the "AI Management Function" explained so far can be used as they are, regardless of whether the administrator or the "Personalized AI" responds. Functions such as the administrator's ability to make requests and commands to the "Personalized AI" conversation, the ability to pause and resume the "Personalized AI" conversation, and the ability to convey the "Personalized AI's" views as advice to the administrator through the "AI Management Function" can also be used as a messenger.
[0068] It is also possible to use existing chat services designed for general person-to-person conversations, or to have the "personalized AI" converse with the AI through existing messengers such as WhatsApp. In this case, the administrator logs into the chat service or messenger, such as WhatsApp, using an account prepared by the administrator and proceeds until the user is able to converse with the other party. For voice conversations, the other party's conversation is answered through the computer's speakers. When the user inputs the voice into the microphone of the computer running the "AI Management Function" app or dedicated web page, the "AI Management Function" transmits the voice to the language model AI, such as LLM, or speech recognition / speech synthesis AI currently in use. The voice then replies through the speaker of the computer running the "AI Management Function" app or dedicated web page, which is then input directly into the microphone of the computer connected to the chat service or messenger, such as WhatsApp. Repeating this process allows for a conversation to take place.
[0069] Alternatively, if a chat service or messenger such as WhatsApp has an API-like function that can link the content of the conversation to other software, the "AI management function" can use this to obtain the voice conversation, and then pass the voice conversation to a language model AI such as LLM or a voice recognition / voice synthesis AI used through the "AI management function" to have it respond to the voice conversation, which can then be passed to an API-like function that can link the content of the conversation on the chat service or messenger such as WhatsApp, thereby establishing the conversation.
[0070] If the computer running the AI management app or dedicated web page is the same computer that is connected to a chat service or messenger such as WhatsApp, the conversation will proceed automatically unless the microphone and speaker functions of that computer are turned off. This is because the sound coming from the speaker is also input directly into the microphone.
[0071] In the case of text chat, a program is used to copy the text written by the other party on the chat service or messenger screen such as WhatsApp and pass it to the "AI management function," or the administrator copies it themselves and passes it to the "AI management function." The text is then passed to a language model AI such as LLM or a speech recognition / speech synthesis AI used through the "AI management function," which responds in text, and the text is then entered directly from the "AI management function" into the chat service or messenger such as WhatsApp to carry out the conversation.
[0072] Alternatively, in the case of text chat, the text written by the person you are chatting with is displayed on the screen of a chat service or messenger such as WhatsApp. Using a program that recognizes the characters displayed on the screen, you input the text into the "AI Management Function." The text is then passed to a language model AI such as LLM or a speech recognition / synthesis AI used through the "AI Management Function," which then replies in text. This text can then be directly entered into the chat service or messenger such as WhatsApp from the "AI Management Function" to carry out the conversation.
[0073] Furthermore, in the case of text chat, the text written by the person you are talking to is displayed on the screen in a chat service or messenger such as WhatsApp. Using a program that produces speech from the characters displayed on the screen, the text is entered into the "AI Management Function." The speech is then passed to a language model AI such as LLM or a speech recognition / speech synthesis AI used in the "AI Management Function," which then replies in text. This can then be directly entered into a chat service or messenger such as WhatsApp from the "AI Management Function" to carry out the conversation.
[0074] Another method, in the case of text chat, if the chat service or messenger such as WhatsApp has an API-like function that allows the conversation content to be linked to other software, the "AI management function" can use this to obtain the text written by the conversation partner, and then pass the text to a language model AI such as LLM or a speech recognition / speech synthesis AI used through the "AI management function" to have the conversation respond in text, which can then be passed to an API-like function that can link the conversation content of the chat service or messenger such as WhatsApp, thereby establishing the conversation.
[0075] Even in conversations using chat services or messengers such as WhatsApp, as in the previous example, the administrator can have the "personalized AI" conduct the conversation from the beginning, pause it, and then have the administrator take over the conversation or return the conversation to the "personalized AI." The "personalized AI" conversation pause and resume function can be used. Also, as in the previous example, during a conversation with the "personalized AI," the administrator can make requests or commands to the "AI management function" via voice or text, and during the administrator's conversation, the "personalized AI" can convey its views as advice to the administrator through the "AI management function." These are done by the administrator through a web page or application dedicated to the "AI management function."
[0076] Chat services and messengers such as WhatsApp themselves have the ability to link with "AI management functions," and there is also a way to use these "AI management functions" to realize automated conversations.
[0077] In this case, the chat service or messenger such as WhatsApp has a function to save the connection settings with the "AI management function" in advance. The connection settings with the "AI management function" require, first of all, the location of the "AI management function" (for example, its address on the Internet).
[0078] In addition, when connecting to the "AI Management Function" from a chat service or messenger such as WhatsApp, information is required to prove that the connection is legitimate and authorized by the administrator, such as a login name and password for the "AI Management Function."
[0079] It is also possible for chat services and messengers such as WhatsApp to not have information within them that proves that their connection to the "AI Management Function" is legitimate and approved by the administrator, but to register information (such as IP addresses) held by chat services and messengers such as WhatsApp in the "AI Management Function" and prove that the connection is legitimate and approved by the administrator. In this case, the "AI Management Function" needs a function to manage this information.
[0080] In any case, any method can be used as long as it allows the "AI management function" itself to determine that such connections are legitimate, and can prove that the connections are legitimate.
[0081] By using this information, it will be linked with the "AI management function." The method of linking and exchanging information can be API, but other methods are also acceptable. Any method is acceptable as long as it can link properly.
[0082] When a chat service or messenger such as WhatsApp receives a conversation request, or conversely when an administrator requests a conversation, the administrator can set whether to have the conversation themselves or have a "personalized AI" conduct the conversation. This setting can be switched at any time.
[0083] If an administrator then sets up a chat service or messenger such as WhatsApp to have the "personalized AI" conduct conversations, then when someone starts a conversation within that app, or if the administrator requests a conversation themselves, the conversation will be automatically conducted by the "personalized AI."
[0084] In such cases, chat services and messengers such as WhatsApp have a function that allows users to specify in advance the speaking style, content, and how the conversation will be conducted as conversation settings, such as "Let's have a calm conversation," "Let's talk about today's baseball game," or "Start off softly and then get more aggressive in the middle."
[0085] It also has a function that allows you to specify the speaking style, conversation content, and how to have a conversation for each specific handle name or ID.It also has a function that allows you to register messages for specific handle names or IDs in advance, and when a conversation request is made from that handle name or ID, the message can be played.
[0086] When a conversation occurs under the above conditions, the server of a chat service or messenger such as WhatsApp connects to the administrator's "AI management function." The "AI management function" applies information and models to reproduce an individual's personality and characteristics to AIs such as language model AIs like LLM and speech recognition / speech synthesis AIs, making them capable of conversation. The chat service or messenger such as WhatsApp then connects the content of the conversation to the "AI management function," which then returns a response to the conversation to the chat service or messenger such as WhatsApp. This process is repeated. In this way, a conversation automatically begins on the chat service or messenger such as WhatsApp.
[0087] Chat services and messengers such as WhatsApp can have a monitoring function for conversations between "personalized AIs." Administrators can use the monitoring function of chat services and messengers such as WhatsApp to see and hear the conversations between "personalized AIs." Therefore, chat service apps and web pages, as well as WhatsApp and other messenger apps and web pages, have monitoring screens for administrators. Administrators can see a list of the "personalized AIs'" IDs, handle names, and the types of conversations they are having. They can see and hear each individual conversation in the app or web page. If multiple conversations are taking place, they can switch between them to monitor.
[0088] The "AI management function" describes a function that allows requests and commands from an administrator to be received via voice or text in response to conversations with the "personalized AI" through a dedicated web page or application, but this can also be used in the monitoring functions of chat services and messengers such as WhatsApp.
[0089] Chat services and messengers such as WhatsApp have a function that allows administrators to issue requests and commands to "personalized AI" regarding conversations they are monitoring, such as how they want the conversation to be conducted and the method of the conversation. Administrators issue requests and commands via text or voice from the monitoring function of the chat service app, web page, or messenger app or web page such as WhatsApp. These requests and commands are sent from the chat service or messenger app such as WhatsApp via the "AI management function" to the language model AI such as LLM or the speech recognition / speech synthesis AI running for the conversation. The language model AI such as LLM or the speech recognition / speech synthesis AI adjusts the conversation to respond to the requests for the specified conversation.
[0090] When an administrator issues such requests or commands through the monitoring function of chat service apps, web pages, or messenger apps or web pages such as WhatsApp, the "AI management function" transmits the requests and commands to the language model AI such as LLM or speech recognition / speech synthesis AI in use in addition to the current conversation. For example, for the currently monitored conversation, administrators can make requests by voice or text such as "speak faster," "choose your words carefully," or "make yourself more appealing." This allows administrators to control the conversation to their liking.
[0091] If the conversation being monitored is a voice conversation, the administrator can make requests or commands by entering text through the monitoring function of a chat service app, web page, or messenger app or web page such as WhatsApp, so as not to disturb the voice conversation. Conversely, if the conversation being monitored is a text conversation, the administrator can make requests or commands by voice through the monitoring function of a chat service app, web page, or messenger app or web page such as WhatsApp, so as not to disturb the text conversation. This function prevents unnecessary words from being mixed in during the conversation.
[0092] We have described that the "AI Management Function" has the ability to pause and resume conversations with the "personalized AI," but these functions of the "AI Management Function" can also be used in conjunction with the monitoring functions of chat services and messengers such as WhatsApp.
[0093] Chat services and messengers such as WhatsApp have a conversation monitoring function that allows the "personalized AI" to pause and resume a conversation. Chat services and messengers such as WhatsApp have an "AI management function" that allows the "personalized AI" to receive requests and commands for the conversation from the administrator, making it possible to pause and resume a conversation. If paused, the administrator can converse on behalf of the "personalized AI." Furthermore, even during a pause, the "personalized AI" continues to monitor the administrator's conversation, and when the administrator resumes the "personalized AI" conversation, the conversation between the "personalized AI" and the other party resumes.
[0094] In the case of a pause, the conversation monitoring function of the chat service or messenger such as WhatsApp will communicate that a pause has been made to the "AI Management Function." Upon receiving this communication, the "AI Management Function" will use its own functions to instruct the language model AI, such as LLM, and the speech recognition / speech synthesis AI used by the "Personalized AI" to pause and to monitor the conversation during the pause.
[0095] This instruction can be given by the administrator via text or voice from the chat service app or web page, or the messenger app or web page such as WhatsApp, or a pause button can be provided on the chat service app or web page, or the messenger app or web page such as WhatsApp, or a dedicated web page or application, which, when pressed, will signal the "AI management function" to pause.
[0096] When resuming conversation, the conversation monitoring function of the chat service or messenger such as WhatsApp will communicate with the "AI Management Function" to resume conversation. When the "AI Management Function" receives this communication, it will use its own functions to instruct the language model AI such as LLM or the speech recognition / speech synthesis AI used by the "personalized AI" to take over the conversation that it had been monitoring and begin the conversation on behalf of the administrator.
[0097] This instruction can be given by the administrator via text or voice from the chat service app or web page, or the messenger app or web page such as WhatsApp, or a resume button can be provided on a web page or application dedicated to the chat service app or web page, or the messenger app or web page such as WhatsApp, and pressing this button will link to the "AI management function" to resume.
[0098] The "AI Management Function" describes that the "Personalized AI" will listen to and see the administrator's conversations during the pause, and that it has the ability to convey the "Personalized AI's" views as advice to the administrator through the "AI Management Function." This can also be used in the monitoring functions of chat services and messengers such as WhatsApp. In such cases, the "AI Management Function" will be linked to receive advice from the chat service or messenger conversation monitoring function such as WhatsApp.
[0099] This instruction can be given by the administrator via text or voice from the chat service app or web page, or the messenger app or web page such as WhatsApp, or an advice button can be provided on a web page or application dedicated to the chat service app or web page, or the messenger app or web page such as WhatsApp, and pressing this button will link to the "AI management function" to receive advice.
[0100] When receiving advice, the "AI Management Function" is connected to receive advice from the conversation monitoring function of a chat service or messenger such as WhatsApp. When the "AI Management Function" receives this connection, it uses its own functions to instruct the language model AI such as LLM and the speech recognition / speech synthesis AI used by the "personalized AI" that "advice should be provided while the administrator is having a conversation."
[0101] If you choose to enter text or voice input instead of using buttons, you can also enter details about the type of advice you want, such as "Tell me how you think my conversation partner is feeling" or "Give me some example responses."
[0102] The "personalized AI" pauses the conversation and monitors the administrator's conversation while the administrator speaks instead, and the administrator's speaking style and habits during this time are recorded as a history in the "AI management function," so they can be used as learning material. It would also be good to have a function to save this history in chat services or messengers such as WhatsApp.
[0103] As such, when chat services or messengers like WhatsApp are engaged in automated conversations through the "management AI"'s automated conversation function, chat services and messengers like WhatsApp have features such as a monitoring function that allows users to switch between multiple conversations, a function for making requests and giving commands to the conversation, a function for pausing and resuming the conversation, and a function for receiving advice about the conversation. However, these features can be used through the "AI management function" rather than through the chat service or messenger like WhatsApp. This is because all conversations between the administrator's "personalized AI" through chat services or messengers like WhatsApp, including the other party's conversations, are conducted through the "AI management function." Therefore, even without using chat services or messengers like WhatsApp, the administrator's requests, commands, pausing and resuming the conversation, and receiving advice about the conversation can be realized through the "AI management function" by communicating them to the language model AI, such as LLM, or the speech recognition / speech synthesis AI used in addition to the current conversation.
[0104] If such functionality is added to the "AI Management Function," it will be necessary to add a monitoring function that allows users to switch between multiple conversations by opening the "AI Management Function" app or web page while an automated conversation is taking place, such as through the automated conversation function of a chat service or messenger such as WhatsApp. The functions for making requests and giving commands regarding the conversation, pausing and resuming the conversation, and receiving advice about the conversation are all functions that are originally included in the "AI Management Function."
[0105] It is also possible to add a function to register schedules in the calendar function of chat services or messengers such as WhatsApp. For example, if a conversation request comes in from another "AI management function" or a human between 9:00 PM and 8:00 AM, the "personalized AI" will respond, and at other times, the administrator will be notified. It is also possible to specify the speaking style, content, and conversation content for each contact's handle name or ID, such as "speak concisely" or "speak politely," and to play a specific message for each contact's handle name or ID. It is also possible to set the conversation style and message to be changed by specifying a time or date. Of course, the administrator can always respond to conversation requests themselves.
[0106] Additionally, the group chat function may have a function that allows the use of an "AI management function." The administrator can participate in the group chat, but can also schedule messages for the "AI management function" on the calendar. For example, if another "AI management function" or a human contacts the group chat between 9:00 PM and 8:00 AM, the function could reply with a message such as "We'll respond the next morning." Or, if a specific handle name or ID contacts the group chat on a specific day, a specific message could be sent to the group chat.
[0107] The "AI Management Function" can save such conversation history on a computer, such as a server or mobile phone, that manages the "AI Management Function." It records not only the statements of the administrator's "personalized AI," but also those of the person with whom the conversation took place. In the case of a text conversation, the history is saved as text data. In the case of a voice conversation, the history can be saved as voice data, or the statements of the administrator's "personalized AI" can be saved as text and the voice of the person with whom the conversation took place can be recognized and recorded as text data, or both histories can be saved. There may also be a function to save these histories in chat services or messengers such as WhatsApp.
[0108] When an administrator joins a conversation using these "personalized AIs" or pauses the "personalized AI" and takes over the conversation, the "personalized AI" records what the administrator says and can use it as learning material.
[0109] Chat services and messengers like WhatsApp are apps whose primary purpose is communication, such as conversations and messaging, but even apps that don't have this function can send and receive messages. Examples of such apps include messaging features in video games and message sending features in dating and matchmaking apps. Even if an app has a conversation or message exchange function within it, as we've described so far, it can be linked to an "AI management function" to enable conversations in the same way as chat services and messengers like WhatsApp.
[0110] These chat services and messengers like WhatsApp run on servers and computers.
[0111] In a typical chat service, someone with an account on that service looks at the IDs and profiles of others, chooses the person they want to talk to, and applies to chat. If the other person accepts, they can chat. In a bulletin board-style chat where multiple people can post text, you choose the bulletin board yourself, view it, and post after watching the flow of the conversation. In either case, the person must take the initiative to apply for the chat or post on the bulletin board.
[0112] In contrast, a "personalized AI-participating chat service" is a server with the function of automatically conversing with "personalized AIs" managed by multiple "AI management functions," as well as the function of conversing between "personalized AIs" and humans. It may be on the cloud, or on a server-client system, or on a computer on the Internet. With a "personalized AI-participating chat service," a "personalized AI" acts as a proxy for the administrator and automatically converses with the "personalized AIs" of other administrators, or with humans who are participating at the time. The administrator can set in advance the date and time of the conversation, the type of "personalized AI" or human to converse with, and the content of the conversation.
[0113] The administrator can also monitor the automated conversations of such "personalized AI" in real time. If necessary, they can issue requests or commands to the "personalized AI" conversation. They can also pause the "personalized AI" conversation and have the conversation themselves. The administrator can then review these conversations later as the "personalized AI" conversation history. By intervening in the "personalized AI" conversation, the administrator can create an environment that is easier to talk in than if the administrator had started the conversation from the beginning. This history is also saved in the "AI management function," but it may also be saved in the "personalized AI joinable chat service."
[0114] The administrator creates an account in the "personalized AI-participable chat service." The administrator also describes the administrator's ID and password for the "personalized AI-participable chat service," information notification means such as an email address, and connection settings with the "AI management function."
[0115] The "personalized AI-participation-enabled chat service" has a function for pre-saving connection settings with the "AI management function." The connection settings with the "AI management function" require, in part, the location of the "AI management function" (for example, its address on the Internet).
[0116] In addition, when connecting from the "Personalized AI Participation Chat Service" to the "AI Management Function," information is required to prove that the connection is legitimate and authorized by the administrator. For example, this would include the login name and password for the "AI Management Function."
[0117] The "personalized AI-participable chat service" may not have information that proves that the connection to the "AI management function" is legitimate and approved by the administrator, but may register information (IP address, etc.) held by the "personalized AI-participable chat service" in the "AI management function" to prove that the connection is legitimate and approved by the administrator. In that case, the "AI management function" needs a function to manage this information.
[0118] In any case, any method can be used as long as it allows the "AI management function" itself to determine that such connections are legitimate, and can prove that the connections are legitimate.
[0119] The "personalized AI-participation chat service" has the function of executing the functions necessary to have a "personalized AI" converse through the linked "AI management function."
[0120] The "personalized AI-participable chat service" or "AI management function" has a function for registering a profile and automatic conversation settings. The "personalized AI-participable chat service" matches conversations according to the profile and automatic conversation settings.
[0121] The "AI management function" applies information and models to reproduce an individual's personality and characteristics to AIs such as language model AIs such as LLM and speech recognition / speech synthesis AIs, and has the function of linking with the "personalized AI-participable chat service" to automatically start a conversation on the "personalized AI-participable chat service."
[0122] If there are several "Personalized AIs" in the "AI Management Function," you can create an account for each one. There is one account per "Personalized AI." Each one can have its own profile and auto-conversation settings.
[0123] A profile is information used to introduce oneself, including a handle name, self-introduction, hobbies, occupation, gender, age, educational background, address, and area of activity. It is desirable to set information about the person who is the source of the "personalized AI." For example, if an administrator is the person who is the source of the "personalized AI," it is desirable to set information about the administrator. For items that can be considered to have multiple hobbies, areas of activity, etc., multiple items should be set.
[0124] Automated conversation settings are settings for a personalized AI to use in a personalized AI chat service. These settings include the conversation start time, conversation end time, conversation duration, conversation format (text, voice, or either), conversational participants (limits on the number of participants, such as two, three, or four), the number of simultaneous conversations (the number of simultaneous conversations a personalized AI can have), blocking conditions (a handle name or ID can be specified to prevent conversations with that handle name or ID), and matching conditions (matching conditions can be specified from the profile, handle name, or ID of the potential conversation partner. If no conditions are specified, anyone is allowed. If specified, matching conditions include matching profile hobbies, matching geographical area, matching age range, or specifying the handle name or ID of the personalized AI you want to talk to. Conversely, you can also specify conditions for denial of matching. These conditions can be specified in the profile, such as if any of the profile hobbies match or matching geographical area does not match).
[0125] Language model AI such as LLM and speech recognition / speech synthesis AI are designed to enable multiple conversations to take place simultaneously, and the number of simultaneous conversations is increased by utilizing this mechanism.
[0126] You can also set whether to open the conversation (if the setting is open, third parties can see and hear the conversation; if it is closed, they cannot see or hear it), whether to allow conversation with "personalized AI" (whether you can have a conversation with "personalized AI"), and whether to allow conversation with humans (whether you can have a conversation with humans). In order to have a conversation on a "personalized AI-participation chat service," at least one of the two must be allowed.
[0127] In the automatic conversation settings, you can specify in advance the speaking style, conversation content, and how the conversation will be conducted as "conversation content." Examples include "converse calmly," "talk about today's baseball broadcast," and "converse softly at first and then become more aggressive in the middle of the game." When a conversation with a "personalized AI" begins, the "personalized AI-participating chat service" transmits this information to the language model AI, such as LLM, and the speech recognition / speech synthesis AI used through the "AI management function." This specification can be made for each handle name or ID.
[0128] Additionally, when you specify a handle name or ID in the automatic conversation settings and start a conversation, you can leave a message. For example, "Did any Japanese gymnasts retire recently?" or "Tell me about the rumors in Kagoshima Prefecture." The message can be viewed by the conversation partner's administrator by checking the conversation history. In this way, you can indirectly deepen connections between people. This history is also saved in the "AI management function," but it can also be saved in the "personalized AI-participation chat service."
[0129] Furthermore, a profile for a "personalized AI" can have a parameter called the AI's growth rate. This can be included in the profile. Normally, unless an AI falls into a special state such as overfitting during AI model learning, the more information it is given, the more it has learned, the higher its growth rate. The higher the growth rate, the more it can express an individual's personality and characteristics. In other words, it can be said to be closer to the individual. This growth rate can be quantified and used. When quantifying, for example, the growth rate of a "personalized AI" can be thought of in terms of days or hours. This is the actual number of days or hours that an administrator has input information and trained the "personalized AI" to grow. This can be used as the growth rate as is.
[0130] In this way, if a "personalized AI" has a parameter called AI growth level in its profile, it is also possible to specify the growth level of the conversation partner as a matching condition for automatic conversation settings. For example, when an administrator allows a "personalized AI" to participate in a "personalized AI-participating chat service," the administrator could specify a growth level of "100 hours or more" as a condition. This means that the growth level is used for conversation matching in the "personalized AI-participating chat service."
[0131] Although this explanation uses time as the growth level, any index other than time can be used as long as it can measure the growth level of the AI.
[0132] You can set the language used for conversation in your profile. "Personalized AI" is a language model AI such as LLM, or a voice recognition / speech synthesis AI, so by issuing a request to change the base language of conversation from the "AI management function," you can have conversations in not only Japanese but also English and other languages. You can also specify the language used as a matching condition for automatic conversation settings.
[0133] In addition, if the number of simultaneous conversations (the number of chats that can be held at one time) is two or more, profile and automatic conversation settings can be set for each one.
[0134] The profile and automatic conversation settings are stored in the "Personalized AI Participant Chat Service" or in the "AI Management Function." If stored in the "AI Management Function," the "AI Management Function" automatically links the information to the "Personalized AI Participant Chat Service" as needed.
[0135] Furthermore, when automatically linking from the "AI management function" to the "personalized AI-participable chat service," it is desirable to store the account information (ID, password, email address) of the administrator of the "personalized AI-participable chat service" in the "AI management function," as well as the internet address of the "personalized AI-participable chat service," and present the connection of the "AI management function" to the "personalized AI-participable chat service" as legitimate, or present other information that can prove the connection is legitimate, to enable secure linking. The "personalized AI-participable chat service" needs to be set up to accept linking of such information from the "AI management function."
[0136] In this way, when the "AI management function" automatically links the profile and automatic conversation settings to the "personalized AI-participable chat service," the "AI management function" has a function to save the profile and automatic conversation settings and a function to automatically link information to the "personalized AI-participable chat service."
[0137] If an administrator uses multiple "personalized AI-participation-enabled chat services," it is convenient to be able to reuse information by registering profiles and automatic conversation settings in the "AI management function."
[0138] By registering such information, the "personalized AI-participation chat service" can automatically have a conversation with the "personalized AI."
[0139] Alternatively, if the administrator wants to have a conversation with the "personalized AI" at a time of their choosing, they can start the conversation from the "personalized AI joinable chat service" and have the "personalized AI" start the conversation immediately. In this case, the conversation settings will also be based on the profile and automatic conversation settings, but as for the end time of the conversation, if the administrator wants to have a conversation with the "personalized AI" at a time of their choosing, they can notify the "personalized AI joinable chat service" of the time set by the administrator.
[0140] When the conversation start time in the automatic conversation settings of the "personalized AI" arrives, or when the administrator operates to start a conversation, the "personalized AI participation-enabled chat service" accesses the "AI management function" to check whether connection is possible, whether there are any network abnormalities, and whether the "personalized AI" is in a state where it can have a conversation.
[0141] The "personalized AI-participation chat service" matches multiple "personalized AIs" that can converse based on their respective profiles and automatic conversation settings, allows them to converse, and has the function of ending the conversation when the conversation time or end time of each "personalized AI" arrives.
[0142] If multiple "personalized AIs" have the same conversation start time, they will be processed in an appropriate order, such as in the order of ID numbers.
[0143] An example of matching is shown below, but there are various matching methods that can be used by chat services. Any matching method can be used as long as the participating "personalized AI" can start a conversation.
[0144] Depending on the chat service, the space where chatting takes place or where people are waiting to prepare for chatting is called a "room," and when a new person joins the conversation, it is called "entering a room." In the present invention, the terms "chat" and "joining a chat" are used, but they have the same meaning.
[0145] When the conversation start time for the "personalized AI" arrives, or when the administrator initiates a conversation, that "personalized AI" becomes the "personalized AI" to be newly matched. The "personalized AI participation-enabled chat service" compares the conversation format, number of conversations, matching condition settings, and blocking condition settings of all "personalized AIs" currently participating in the first "chat" in the queue with the profile, ID, and handle name of the "personalized AI" to be newly matched to see if the conditions are met. It then compares the conversation format, number of conversations, matching condition settings, and blocking condition settings of the "personalized AI" to be newly matched with the profiles, IDs, and handle names of all "personalized AIs" participating in the first "chat" to see if the conditions are met. If all of these conditions are met, the "personalized AI" to be newly matched is connected to the waiting "chat" and "joined the chat."
[0146] The queue is like a box that arranges chats according to priority. The chat at the top has the highest priority. When the number of people participating in the chat has reached the automatic conversation settings of all the personalized AIs, the chat will be removed from the queue.
[0147] The "chat" will then begin a conversation with the newly matched "personalized AI." The "personalized AI participation-enabled chat service" will notify the "personalized AIs" already participating in the target "chat" and the new "personalized AI" that "a new conversation partner will join the chat," connect the new "personalized AI," and "add it to the chat" to start the conversation. Here, if the number of conversation partners set in the automatic conversation settings for all "personalized AIs" participating in the "chat" is met, the "chat" will be removed from the queue. If not, the "chat" will remain in the queue.
[0148] If the conditions are not met, the same process is carried out for the next "chat" in the queue. This is repeated until there are no more "chat" in the queue. When the conditions are not met for all "chat" in the queue, the newly matched "personalized AI" becomes a new "chat" and is placed at the back of the queue.
[0149] Every time a new matching target "personalized AI" comes in, the "chats" in the queue are checked to see if they match.
[0150] If the number of simultaneous conversations for the "personalized AI" to be newly matched is two or more and the conversation start time in the automatic conversation settings is the same, a new matching process will be performed for that number of times. If the administrator starts a conversation multiple times for the same "personalized AI," a new matching process will be performed.
[0151] However, the position in the queue can be changed by the settings of the "personalized AI joinable chat service." For example, even if two people are in a "chat" that can accommodate three people, the number of people is still less than three, so it will continue to be in the queue and wait for the remaining "personalized AI" to join. However, while in the queue, the two people are still having a conversation. Since the conversation is ongoing, it is reasonable to lower the priority of that "chat," that is, to place the "chat" at the end of the queue once two people have joined.
[0152] If there is a "personalized AI" that is set to "chat" with a "personalized AI" with a specific ID or handle name, the "chat" will not take place until that specific ID or handle name appears, and will remain in a queue during that time, but it is also possible to set the priority of such a "chat" to be higher. This is because even if a "personalized AI" with a specific ID or handle name does come in, it will be taken by other "chat" with a higher priority that is in the queue.
[0153] In this way, the "personalized AI joinable chat service" can also manipulate the priority of "chats" in the queue using its own algorithm.
[0154] When a "personalized AI" is carrying out a conversation within a "chat," when either the "single conversation time" or the "conversation end time" in the automatic conversation settings of the participating "personalized AI" has elapsed, the "personalized AI participation-enabled chat service" will process to end the conversation within the "chat" of that "personalized AI."
[0155] The "personalized AI joinable chat service" notifies the "personalized AI" that the conversation is ending through the "personalized AI" management function.
[0156] The "personalized AI" management function notifies the connected language model AI, such as LLM, and the speech recognition / synthesis AI that "it's time to end the conversation." The "personalized AI" then says goodbye to the person in the "chat."
[0157] The "AI management function" of the "personalized AI" notifies the "personalized AI joinable chat service" that it is ready to leave the "chat." The "personalized AI joinable chat service" then removes the "personalized AI" from the "chat."
[0158] The "personalized AI participation chat service" removes the "personalized AI" from the "chat" when the "single conversation time" of the automatic conversation setting of the "personalized AI" has ended, but if the "conversation end time" has not yet been reached, it performs matching processing with "chat" in the queue again to start the next conversation. If there is no matching "chat" in the queue, the "personalized AI" becomes a new "chat" and enters the back of the queue.
[0159] The "personalized AI participation chat service" ends a "chat" when all "personalized AIs" participating in the "chat" leave, but even after a "personalized AI" leaves the "chat," if one or more other "personalized AIs" remain and there is remaining conversation time, the "chat" will be queued. Also, if two or more people remain in the "chat," the remaining "personalized AIs" will continue their conversation. In other words, they will be in the queue while they are talking.
[0160] When the end time of the conversation in the automatic conversation setting of the "personalized AI", the "personalized AI joinable chat service" performs the process of leaving the "chat" as described above and leaves the "chat". If it is in the queue, it will also leave and notify the "personalized AI" management function that the conversation has ended. When the end time of the conversations of all the "personalized AI" belonging to that "AI management function" has arrived, the "personalized AI joinable chat service" and the "AI management function" will disconnect from each other.
[0161] In addition, for these "personalized AIs" to have a conversation with each other, the setting for "allow conversation with "personalized AIs" in the automatic conversation settings of the participating "personalized AIs" must be set to "allow."
[0162] The "personalized AI-participation chat service" allows humans to log in and converse with the "personalized AI," and also has the ability to see and hear the "personalized AI" conversations within the "chat." In this case, humans create an account, as well as an ID, handle name, and profile. The profile is information used to introduce oneself, including handle name, self-introduction, hobbies, occupation, gender, age, educational background, address, and area of activity.
[0163] When a human logs in and wants to have a conversation with a "personalized AI," the "personalized AI participating chat service" provides the human with a list of "personalized AIs" with which the human can converse and their profiles, allowing the human to select from the list and start a conversation.
[0164] The "personalized AIs" to be listed are those that are between the start time and end time of a conversation of a "personalized AI" participating in the "personalized AI participation chat service", have an automatic conversation setting of "allow" for conversation with humans, the human's profile meets the matching conditions of the automatic conversation setting of each "personalized AI", and the human's ID or handle name is not set as a blocking condition of the automatic conversation setting of each "personalized AI", and are either "personalized AIs" that are not currently having a conversation, or are having a conversation in the "chat" but are in a waiting queue because the number of people conversing is not sufficient.
[0165] Of course, if you are having a conversation within a "chat," the automatic conversation settings of all "personalized AIs" within that "chat" must be set to "allow" to allow conversation with humans, the human's profile must meet the matching conditions of the automatic conversation settings of all "personalized AIs" within that "chat," and the human's ID or handle name must not be set as a blocking condition of the automatic conversation settings of all "personalized AIs" within that "chat."
[0166] Humans can view the profiles of these listed "personalized AIs" and select the "personalized AI" to converse with.
[0167] Among the listed "personalized AIs," if the "conversation openness setting" in the automatic conversation settings of all "personalized AIs" that are currently "chatting" and participating in the "chat" is set to open, humans can see and hear the conversation. Therefore, humans can determine what kind of conversation is currently taking place before joining the conversation.
[0168] Even if a human participates in a conversation, when the conversation time or end time set for the automatic conversation setting of the "Personalized AI" participating in the "Chat" ends, the "Personalized AI" will leave the "Chat" in the same way as when a conversation is between "Personalized AIs." Humans can leave the "Chat" on their own whenever they like.
[0169] Even if a human participates in a conversation, their ID, handle name, and conversation content will remain in the history of other "personalized AI" who participated. This history will also be saved in the "AI management function," but it may also be saved in the "personalized AI-participation chat service."
[0170] Furthermore, in the case of chats that humans can participate in, even the administrator of a personalized AI can participate in the chat. This does not mean pausing the personalized AI that you manage and participating in the chat in its place, but rather participating separately as a human. The way to participate is the same as the way a non-administrator can enter a chat.
[0171] If a human logs in and wants to see and hear the conversation of a "personalized AI," but does not want to talk, the "personalized AI-participation chat service" provides the human with a list of "chats" in which the human can see and hear the conversation and the profiles of the "personalized AI" participating in those chats, and the human has the ability to select from the list to see and hear the conversation. Even if the human does not log in and talk at all, they can see and hear the conversation during the "chats."
[0172] The "chats" to be listed must be "chats" in which two or more people are conversing within a "personalized AI-participation chat service," and the "conversation openness setting" in the automatic conversation settings of all "personalized AIs" within that "chat" must be open, and the ID or handle name of a human must not be set as a blocking condition in the automatic conversation settings of all "personalized AIs" within that "chat."
[0173] In addition, it is also possible to add to the conditions of the ``chat'' listed above an item that asks whether the human profile meets the matching conditions of the automatic conversation settings of all ``personalized AI'' within that ``chat.''
[0174] Humans can view the "personalized AI" profiles of these listed "chats" and select "chats" to see and hear the conversations.
[0175] Furthermore, with regard to chats that can be seen and heard by humans, even the administrator of the personalized AI can see and hear the chats in the same way. The way to participate is the same as the way a non-administrator can join the chat.
[0176] The "personalized AI-participable chat service" can have a monitoring function for the "chat" conversations of the "personalized AI." By using the monitoring function of the "personalized AI-participable chat service," the administrator can see and listen to the content of the conversations of the "personalized AI." For this reason, the app and web page of the "personalized AI-participable chat service" have a monitoring screen for administrators. There, the administrator can see in a list what kind of "chats" the "personalized AI" is having, what kind of IDs and handle names they are using, and what kind of conversations they are having. The app and web page can be used to see and listen to each actual conversation. If multiple "chat" conversations are taking place, the administrator can switch between the multiple "chat" conversations to monitor them.
[0177] The "AI management function" has been described as having the ability to receive requests and commands from an administrator in the form of voice or text in response to conversations with the "personalized AI" through a dedicated web page or application, but this can also be used in the monitoring function of the "personalized AI-participation chat service."
[0178] The "personalized AI-participable chat service" has a function that allows the administrator to make requests and commands regarding the "chat" conversations that the administrator is monitoring, such as how the administrator wants the "personalized AI" to converse, and how and what the conversation should be conducted. The administrator makes requests and commands by text or voice using the monitoring function of the "personalized AI-participable chat service" app or web page. The "personalized AI-participable chat service" sends the request to the language model AI such as LLM or the speech recognition / speech synthesis AI that is running for the conversation via the "AI management function." The language model AI such as LLM or the speech recognition / speech synthesis AI adjusts the conversation to respond to the request for the specified conversation.
[0179] When an administrator issues such requests or commands through the monitoring function of the app or web page of the "Personalized AI-Participant Chat Service," the "AI Management Function" transmits the requests and commands to the language model AI, such as LLM, and the speech recognition / speech synthesis AI that are used in addition to the conversation. For example, this allows administrators to make voice or text requests such as "speak faster," "choose your words more carefully," or "make yourself more appealing" regarding the "chat" conversation currently being monitored. This allows administrators to control the conversation to their liking.
[0180] If the "chat" conversation being monitored is a voice conversation, the administrator can input requests or commands by text through the monitoring function of the "personalized AI-participable chat service" app or web page so as not to disturb the voice conversation. Conversely, if the "chat" conversation being monitored is a text conversation, the administrator can input requests or commands by voice through the monitoring function of the "personalized AI-participable chat service" app or web page so as not to disturb the text conversation. This function prevents unnecessary words from being mixed in during the conversation.
[0181] The "AI management function" has been described as having the ability to pause and resume "personalized AI" conversations, but this can also be used in the monitoring function of the "personalized AI-participation chat service."
[0182] The "personalized AI-participable chat service" has a function that allows the "personalized AI" conversation to be paused and resumed from the "chat" conversation monitoring function. The "personalized AI-participable chat service" has a function that allows the "personalized AI" to receive requests and commands for the conversation from the administrator through the "AI management function," so the conversation can be paused and resumed using this function. If paused, the administrator can converse on behalf of the "personalized AI." Furthermore, even during pause, the "personalized AI" monitors the administrator's conversation, and when the administrator resumes the "personalized AI" conversation, the conversation between the "personalized AI" and the other party will resume.
[0183] In the case of a pause, the "chat" conversation monitoring function of the "personalized AI-participable chat service" communicates with the "AI management function" to pause the conversation. Upon receiving this communication, the "AI management function" uses its own functions to instruct the language model AI, such as LLM, and the speech recognition / speech synthesis AI used by the "personalized AI" to pause the conversation and to monitor the "chat" conversation during the pause.
[0184] This instruction can be given by the administrator via text or voice from the app or web page of the "personalized AI-participable chat service," or a pause button can be provided on a web page or application dedicated to the app or web page of the "personalized AI-participable chat service," and pressing this button can link to the "AI management function" to pause the chat.
[0185] In the case of resumption, the "chat" conversation monitoring function of the "personalized AI-participable chat service" communicates with the "AI management function" to inform it of the resumption. When the "AI management function" receives this communication, it uses its own functions to instruct the language model AI, such as LLM, and the speech recognition / speech synthesis AI used by the "personalized AI" to take over the "chat" conversation that it had been monitoring and to start the conversation on behalf of the administrator.
[0186] This instruction can be given by the administrator via text or voice from the app or web page of the "personalized AI-participable chat service," or a resume button can be provided on a web page or application dedicated to the app or web page of the "personalized AI-participable chat service," and pressing this button will link to the "AI management function" to resume.
[0187] The "AI Management Function" describes that the "Personalized AI" will see and hear the administrator's conversation during pauses or while the administrator is conversing with the "Personalized AI," and that it has a function that can convey the "Personalized AI's" views as advice to the administrator through the "AI Management Function." This can also be used in the monitoring function of the "Personalized AI Participatory Chat Service." In that case, the "AI Management Function" is linked to receive advice from the "Chat" conversation monitoring function of the "Personalized AI Participatory Chat Service."
[0188] This instruction can be given by the administrator via text or voice from the app or web page of the "personalized AI-participable chat service," or an advice button can be provided on a web page or application dedicated to the app or web page of the "personalized AI-participable chat service," and pressing this button can link to the "AI management function" to receive advice.
[0189] When receiving advice, the "chat" conversation monitoring function of the "personalized AI-participation-enabled chat service" communicates with the "AI management function" to request advice. Upon receiving this communication, the "AI management function" uses its own functions to instruct the language model AI, such as LLM, and the speech recognition / speech synthesis AI used by the "personalized AI" that "advice should be provided while the administrator is having a conversation."
[0190] If you choose to enter text or voice input instead of using buttons, you can also enter details about the type of advice you want, such as "Tell me how you think my conversation partner is feeling" or "Give me some example responses."
[0191] The "personalized AI" pauses the conversation and the administrator speaks in its place, while the "personalized AI" monitors the administrator's "chat" conversation, and the speaking style and habits during this time can be used as learning material.
[0192] In this way, when the "personalized AI-participable chat service" is engaged in an automated conversation through the "management AI" automatic conversation function, the "personalized AI-participable chat service" has a monitoring function that allows users to switch between multiple conversations while watching and listening, a function for making requests and commands to the "chat" conversation, a function for pausing and resuming the conversation, and a function for receiving advice about the conversation. However, these functions may be used through the "AI management function" rather than through the "personalized AI-participable chat service." This is because all conversations between the administrator and the "personalized AI" through the "personalized AI-participable chat service," including the other party's conversation, are conducted through the "AI management function." Therefore, even without the "personalized AI-participable chat service," the administrator's requests, commands, pausing and resuming the conversation, and receiving advice about the conversation can be realized from the "AI management function" by communicating the administrator's requests, commands, pausing and resuming the conversation, receiving advice about the conversation, etc. to the language model AI such as LLM or speech recognition / speech synthesis AI being used in addition to the current conversation.
[0193] If such a function is to be added to the "AI Management Function," it will be necessary to add a monitoring function that will enable users to switch between multiple conversations and listen to them when they open the "AI Management Function" app or web page while an automatic conversation is taking place using the automatic conversation function of the "Personalized AI Participation Chat Service."
[0194] The functions of making requests for conversations, issuing commands, pausing and resuming conversations, and receiving advice about conversations are originally functions of the "AI management function." However, the function of matching conversations is the "personalized AI-participation chat service."
[0195] Administrators can use the "personalized AI-participating chat service" to have the "personalized AI" automatically converse and later check the conversation history. If they find an ID or handle name that they think they might get along with, they can use the message function to pass on a message and expand their circle of contacts. Because this is done automatically, they can expand their circle of contacts even while they are working. In addition, administrators can use the monitoring function of the "personalized AI-participating chat service" to watch and listen to the "personalized AI" conversations, and can even take turns in the conversation midway, allowing them to actively participate in the conversation and gradually eliminate any sense of discomfort about conversations.
[0196] These "personalized AI-enabled chat services" run on servers and computers.
[0197] There are virtual reality software and computer games that allow users to create their own avatars and live, play, and fight in that world. By linking these with "personalized AI," users can have their characters converse automatically even when they are not logged into the virtual reality software or computer game.
[0198] Normally, characters in virtual reality software or computer games do not appear in the software unless you are logged in. However, in the world of the virtual reality software or computer game, each character is set to live in that world, so they should not disappear or reappear.
[0199] So, when you are not logged in or have finished operating your character, you can have your character wait in a specific location such as your home, lobby, or bar, and have conversations using a "personalized AI," which adds depth to the worldview of the virtual world software or computer game.When a character operated by another human talks to your character, the "personalized AI" will respond, which is expected to lead to a variety of conversations that are not standardized.
[0200] It has a function to save connection settings with the "AI management function" in advance within virtual reality software or computer games. The connection settings with the "AI management function" require, first of all, the location of the "AI management function" (for example, an address on the Internet).
[0201] In addition, when connecting to the "AI Management Function" from virtual reality software or a computer game, information is required to prove that the connection is legitimate and authorized by the administrator. For example, the login name and password for the "AI Management Function" would be such information.
[0202] It is also possible for virtual reality software or computer games not to have information within them that proves that a connection to the "AI Management Function" is legitimate and approved by the administrator, but to register information (such as IP addresses) held by the virtual reality software or computer game in the "AI Management Function" and prove that the connection is legitimate and approved by the administrator. In this case, the "AI Management Function" needs to have a function to manage this information.
[0203] In any case, any method can be used as long as it allows the "AI management function" itself to determine that such connections are legitimate, and can prove that the connections are legitimate.
[0204] This allows it to link with the "AI management function." The method of linking and exchanging information can be through an API, but other methods are also acceptable. Any method is acceptable as long as it can link properly.
[0205] When the administrator finishes controlling the character in the virtual world software or computer game, the administrator has the ability to choose whether to simply exit the game or to have the character continue to converse using a "personalized AI" until the next time the administrator logs into the virtual world software or computer game and controls the character.
[0206] If the administrator logs in to the virtual world software or computer game next time and lets the "personalized AI" converse until he or she moves the character, the character will not disappear but will continue to remain in that location within the virtual world software or computer game, and if another character begins to converse, the conversation will be automatically conducted by the "personalized AI."
[0207] When another character begins to converse with a character whose administrator is in the above-described state, the virtual world software or computer game server connects to the "AI management function" of that character's administrator. The "AI management function" applies information and models to the language model AI, such as LLM, and AI, such as speech recognition and speech synthesis AI, to reproduce the individual's personality and characteristics, making the character capable of conversation. The virtual world software or computer game server then shares the content of the other character's conversation with the "AI management function," which then sends a response back to the virtual world software or computer game server. This process is repeated. In this way, characters in the virtual world software or computer game automatically begin conversing.
[0208] Regarding the conversation at that time, the virtual space software or the computer game may have a function that allows the way of returning the conversation to be saved in the automatic behavior settings of the virtual space software or the computer game. For example, the way of conversation such as "speak calmly" or "speak in a sleepy voice" can be saved, and the character will converse in that way.
[0209] Conversations are recorded as history within the virtual world software or computer game. Administrators can view the conversation history in the virtual world software or computer game and check what conversations the character has had.
[0210] At the same time, the conversation is recorded as a history in the "AI Management Function." Administrators can check what conversations the character has had by looking at the "AI Management Function" app or a dedicated web page.
[0211] In the example above, the character remains in the location where the administrator finished controlling it, waiting for a conversation.
[0212] When an administrator finishes controlling a character in a virtual world software or computer game, the administrator's character can save automatic behavior settings that describe when, where, and how the character should act when spoken to, as well as the speech style, conversation content, and conversational content. The virtual world software or computer game can then automatically control the administrator's character's behavior. For example, in the virtual world software or computer game, the character might be sitting in a chair in the living room of the house from 9:00 to 18:00 and respond calmly. From 18:00 to 23:00, the character is drinking at a bar and speaks in a drunken tone. From 23:00 to 9:00, the character is sleeping in the bedroom of the house and only says "grrr." By registering the character's time, location, and behavior in advance, the virtual world software or computer game can control the administrator's character to act accordingly. This allows the character to appear to other players as if they are living a life closer to real life. Furthermore, these actions may be changed by specifying the day of the week in the virtual world software or computer game, or by specifying a date on a calendar in the virtual world software or computer game. For a character's action such as "drinking alcohol at a bar," simply change the character's animation, and the character itself does not need to move. For example, if the character is normally doing nothing, they will stand facing forward, but if they are drinking alcohol, they may be animated as holding a bottle of alcohol and bringing it to their mouth.
[0213] Virtual space software and computer games can have a function that allows characters to send messages when the administrator has finished controlling the character and the character is having an automatic conversation. This means that the message will only be sent when a character with a specific ID or character name speaks to your character. The administrator can input into the virtual space software or computer game what message to send to which ID or character name.
[0214] Virtual space software and computer games can be equipped with a function that allows the administrator to control their own character while having the conversation be conducted by a "personalized AI." In this case, the administrator can issue requests or commands to the "personalized AI" regarding the conversation, pause the "personalized AI" conversation, and have the administrator talk, or receive advice from the "personalized AI" while the administrator is talking, similar to the monitoring function in a "personalized AI-participation chat service."
[0215] In this case, an operation screen can be displayed within the character operation screen of the virtual space software or computer game, allowing requests and commands regarding the conversation, pausing the conversation, resuming the conversation, and requesting advice regarding the conversation.
[0216] If the administrator himself speaks in these conversations, the ``personalized AI'' records his or her remarks as history, and these can be used as learning material for the ``personalized AI.''
[0217] Virtual space software and computer games can have the ability to borrow the conversations of these "personalized AI" for NPC (non-player character) conversations. Attempts have already been made to use AI to make NPCs converse like humans, but by using "personalized AI" that each individual has developed to converse, the characters gain even more depth and become closer to a realistic worldview. For example, during a specific event, a character unique to the virtual space software or computer game can appear as an NPC, and the administrator's "personalized AI" that was borrowed can be used only during conversations. The "personalized AI" will converse in a way that suits the purpose of the event.
[0218] These virtual reality software and computer games run on servers and computers.
[0219] If the administrator is the owner of a homepage or has an account on a social networking site, they can place a program that allows visitors to the homepage or those who view the profile on the social networking site to converse with the administrator's "personalized AI." This is possible by placing such a program on the social networking site or homepage.
[0220] The program has a function to save the connection settings with the "AI management function" in advance. The connection settings with the "AI management function" require, first of all, the location of the "AI management function" (for example, its address on the Internet).
[0221] In addition, when a program connects to the "AI Management Function," information is required to prove that the connection is legitimate and authorized by the administrator. For example, the login name and password for the "AI Management Function" would be such information.
[0222] The program may not have information within it that proves that when it connects to the "AI management function," it is a legitimate connection approved by the administrator, but may register information held by the program (such as IP address) in the "AI management function" to prove that the connection is legitimate and approved by the administrator. In this case, the "AI management function" needs a function to manage this information.
[0223] In any case, any method can be used as long as it allows the "AI management function" itself to determine that such connections are legitimate, and can prove that the connections are legitimate.
[0224] This allows it to link with the "AI management function." The method of linking and exchanging information can be through an API, but other methods are also acceptable. Any method is acceptable as long as it can link properly.
[0225] When a visitor to the homepage or SNS presses the conversation button, the program connects to the administrator's "AI management function" and allows the visitor to have a conversation with the "personalized AI."
[0226] When a visitor to a homepage or SNS presses the conversation button, the "AI management function" applies information and models to reproduce the individual's personality and characteristics to the language model AI, such as LLM, and the AI, such as speech recognition and speech synthesis AI, to make the program ready for conversation. The program then links the content of the visitor's conversation to the "AI management function," which then returns a response to that to the program. This process is repeated. In this way, a conversation automatically begins on the homepage or SNS.
[0227] These homepages and SNSs run on servers and computers.
[0228] This program has the advantage that visitors can talk to the account's "personalized AI" and learn to some extent about the administrator's personality, hobbies, etc.
[0229] The present invention is not limited to the above-described embodiments, and various modifications are possible based on the spirit of the present invention, and these are not excluded from the scope of the present invention.
[0230] 1...AI management function
Claims
1. The "AI management function" operates on a server, computer, or mobile phone, and has a web page or application for operating it, from which the administrator can operate it. It manages the personal models and information applied to them and their connection settings in order to personalize the AI. Multiple personal models and information can be managed, and the administrator can select the one they want to use each time and apply it to the AI to have text or voice conversations as a "personalized AI." This allows it to converse with humans or other "personalized AIs." The "AI management function" allows the administrator to input requests and commands for the "personalized AI" by text or voice from a web page or application regarding the conversation, and can pause the conversation so that the administrator can converse on their behalf. While the administrator is conversing, the "personalized AI" analyzes the conversation, and the "personalized AI" can give advice to the administrator by text or voice from a web page or application. When the administrator wants to stop the conversation, they can leave the rest of the conversation to the "personalized AI." Furthermore, when conversing with other "AI Management Functions", "Personalized AIs" can converse with each other via the Internet, wireless or wired communication, and separately from this, the "AI Management Function" has the function of receiving a "Personalized AI" conversation request from another server, computer or service and automatically linking the "Personalized AI" conversation to other servers, computers or services, and when the "AI Management Function" receives a "Personalized AI" conversation request from another server, computer or service and automatically links the "Personalized AI" conversation, the administrator has a monitoring function to see and listen to the conversation with the "AI Management Function", and the monitoring function can be used with the "AI Management Function" app or a dedicated web page, and when the "AI Management Function" is conducting multiple conversations, the administrator can switch between the conversations and see and listen to them, and for conversations monitored by the monitoring function of the "AI Management Function", the administrator can make requests and commands to the "Personalized AI" conversation, and can pause and resume the "Personalized AI" conversation,The monitoring function can also be used to convey the views of the "personalized AI" to the administrator as advice through the "AI management function," and there is a function to save the conversation history of these "personalized AIs." When the administrator speaks, the content of the conversation can be used as learning material for the "personalized AI." This method is characterized by increasing interactions between administrators and facilitating communication through these functions.
2. The "AI management function" operates on a server, computer, or mobile phone, and has a web page or application for operating it, from which the administrator can operate it. It manages the personal models and information applied to them in order to personalize the AI, as well as their connection settings. Multiple personal models and information can be managed, and the administrator can select the one they want to use each time and apply it to the AI to have text or voice conversations as a "personalized AI." This allows it to converse with humans or other "personalized AIs." The "AI management function" allows the administrator to input requests and commands for the "personalized AI" by text or voice from a web page or application regarding the conversation, and can pause the conversation so that the administrator can converse on their behalf. While the administrator is conversing, the "personalized AI" analyzes the conversation, and the "personalized AI" can give advice to the administrator by text or voice from a web page or application. When the administrator wants to stop the conversation, they can leave the rest of the conversation to the "personalized AI." Furthermore, when conversing with other "AI Management Functions", "Personalized AIs" can converse with each other via the Internet, wireless or wired communication, and separately from this, the "AI Management Function" has the function of receiving a "Personalized AI" conversation request from another server, computer or service and automatically linking the "Personalized AI" conversation to other servers, computers or services. When the "AI Management Function" receives a "Personalized AI" conversation request from another server, computer or service and automatically links the "Personalized AI" conversation, the administrator has a monitoring function to see and listen to the conversation with the "AI Management Function", and the monitoring function can be used with the "AI Management Function" app or a dedicated web page, and when the "AI Management Function" is conducting multiple conversations, the administrator can switch between the conversations and watch and listen to them. Regarding conversations monitored by the monitoring function of the "AI Management Function", the administrator can make requests and commands to the "Personalized AI" conversation, and can pause and resume the "Personalized AI" conversation.The monitoring function can also be used to convey the views of the "personalized AI" to the administrator as advice through the "AI management function." In addition, like a general chat service or general messenger application, the "AI management function" can register each other's IDs and handle names with other "AI management functions" through internet communication, wireless or wired communication, and even people who do not have an "AI management function" can register their own IDs or handle names from a dedicated web page or application, and from there, when necessary, "AI management functions" can converse with each other, between "AI management functions" and humans, or between humans and humans. When conversing, there is a switching function that allows the administrator to set whether to converse themselves or have the "personalized AI" converse, and this setting can be switched at any time. The "AI management function" uses a calendar function to register whether an administrator will respond to a conversation request from the other party depending on the date and time, or whether the "personalized AI" will automatically converse and respond. If the "personalized AI" responds automatically, the speaking style, conversation content, and how the conversation will be conducted can be registered in advance, and these can be specified for each specific ID or handle name. In addition, when a conversation request is made from a specific ID or handle name, there is also a function to leave a message to that specific ID or handle name, and there is a function to save the conversation history of these "personalized AI." When the administrator speaks, the content of the conversation can also be used as learning material for the "personalized AI." This method is characterized by increasing interactions between administrators and facilitating communication through these functions.
3. In addition to the functions of general chat services and messengers such as WhatsApp, it has the function of having a "personalized AI" conduct conversations in cooperation with the "AI Management Function," and has the function of connecting to the "AI Management Function" and connecting the "personalized AI" conversations to chat services and messengers such as WhatsApp. Furthermore, chat services and messengers such as WhatsApp have the function of executing the necessary functions of the "AI Management Function," and using this, chat services and messengers such as WhatsApp have a switching function that allows the administrator to set whether to have the conversation themselves or to have the "personalized AI" conduct the conversation, and this setting can be switched at any time. If the setting is set to have the "personalized AI" conduct the conversation, when someone converses with the administrator's account or when they converse with them, the "personalized AI" will be used to automatically conduct the conversation, and in such cases, chat services and messengers such as WhatsApp have a function that allows the administrator to specify in advance the speaking style, conversation content, and how the conversation will be conducted as conversation settings, and these can be specified using a specific handle name or ID. and has the ability to specify a specific handle name or ID in advance, and has the ability to register messages for specific handle names or IDs in advance, and when a conversation request is made from that handle name or ID, that message can be played; chat services and messengers such as WhatsApp have monitoring functions for administrators, and the administrator can watch and listen to conversations with the "personalized AI" from the web page or application of the chat service or messenger such as WhatsApp, and if multiple "personalized AI" conversations are going on simultaneously, they can switch between watching and listening to them; the administrator can make requests and commands for the "personalized AI" conversations by text input or voice through the web page or application, the administrator can pause the conversation and talk on their behalf; while the administrator is talking, the "personalized AI" analyzes the conversation, and the "personalized AI" can give advice to the administrator by text display or voice from the web page or application; and when the administrator wants to stop the conversation, the rest of the conversation can be left to the "personalized AI" instead.In chat services and messengers such as WhatsApp, a calendar function allows you to register whether an administrator will respond to a conversation request from the other party depending on the date and time, or whether a "personalized AI" will automatically converse and respond; if the "personalized AI" responds automatically, you can register in advance the speaking style, conversation content, and how the conversation will take place; these can be specified for each specific ID or handle name; and when a conversation request is made from a specific ID or handle name, there is also a function to leave a message to that specific ID or handle name; there is a function to save the conversation history of these "personalized AI" conversations; when the administrator speaks, the content of the conversation can also be used as learning material for the "personalized AI," and these functions increase interactions between administrators and facilitate communication.
4. The "Personalized AI Participating Chat Service" is a server or computer that has the function of enabling conversations between "Personalized AIs" of multiple "AI Management Functions" or between "Personalized AIs" and humans, and has the function of connecting to the "AI Management Function" and linking the conversations of the "Personalized AIs" to the "Personalized AI Participating Chat Service." Furthermore, the "Personalized AI Participating Chat Service" has the function of executing the necessary functions of the "AI Management Function," and has the function of registering a profile and automatic conversation settings set by the administrator, where the profile represents the attributes of the "Personalized AI," and the automatic conversation settings include the start time and end time of the automatic conversation, the duration of each conversation, matching conditions for conversations with other "Personalized AIs," and blocking conditions for IDs and handle names. The profile and automatic conversation settings can also be registered in the "AI Management Function," in which case the "AI Management Function" has the function of automatically linking the profile and automatic conversation settings, and the "Personalized AI Participating Chat Service" can link multiple "Personalized AIs" that are available for conversation between the start time and end time of the automatic conversation. and a function to end the conversation when the conversation time or end time of the automatic conversation setting of each "personalized AI" arrives; when a human creates an account and profile in the "personalized AI participation possible chat service," the human can also log in and converse with the "personalized AI"; the "personalized AI" that can converse is listed, and the "personalized AI" listed is a "personalized AI" that is between the start and end time of the automatic conversation at the time when the "personalized AI participation possible chat service" is in, and is not conversing at that time, and the human profile is not excluded by the matching conditions or blocking conditions of the automatic conversation setting of that "personalized AI"; and a "personalized AI" that is between the start and end time of the automatic conversation at that time, and is chatting, but has a vacancy in the number of conversations in the chat, and the human is not excluded by the matching conditions or blocking conditions of the automatic conversation setting of all the "personalized AI" participating in the chat;Humans can select the "personalized AI" they want to talk to from the list and talk to it. In addition, the "personalized AI-participable chat service" has a monitoring function for administrators, and the administrator can view and listen to the "personalized AI" conversations from the web page or application of the "personalized AI-participable chat service." If multiple "personalized AI" conversations are going on simultaneously, they can switch between them to view and listen to them. Regarding the "personalized AI" conversations, the administrator can input requests or commands for the conversation by text or voice through the web page or application, and can pause the conversation and manage it. The administrator can converse on his / her behalf, and while the administrator is conversing, the "personalized AI" analyzes the conversation, and the "personalized AI" can give the administrator advice in text or voice from a web page or application, and when the administrator wants to stop conversing, the rest of the conversation can be left to the "personalized AI" instead, and there is a function to save the conversation history of these "personalized AI", and when the administrator speaks, the content of the conversation can also be used as learning material for the "personalized AI", and these functions increase interaction between administrators and facilitate communication.
5. A function that allows virtual space software or computer games to add a linking function with the "AI Management Function" so that characters owned by the administrator can have automatic conversations, and it has a function that saves connection settings with the "AI Management Function" within the virtual space software or computer game, and links with the "AI Management Function" to call up "personalized AI" conversations from the virtual space software or computer game, and the administrator has the ability to choose whether to simply end the virtual space software or computer game when the administrator has finished operating the character, or to have the character continue to converse using the "personalized AI" until the administrator next logs in to the virtual space software or computer game and operates it, and if the character continues to converse, the character will either remain in that location, or, when the administrator has finished operating the character in the virtual space software or computer game, saves automatic behavior settings within the virtual space software or computer game that describe what day or day of the week, what time, where, how the administrator's character will act and how the administrator's character will converse, and the administrator will automatically act in accordance with those settings. The administrator's character will remain in the virtual world software or computer game even after the administrator has finished operating that character, and if another character speaks to the administrator's character, the virtual world software or computer game will work with the "personalized AI" to automatically conduct the conversation using the "personalized AI", and a message can be saved in the virtual world software or computer game for when a character with a specific ID or character name speaks to your character, and the conversation will remain as history in the virtual world software or computer game, and the administrator can view the conversation history in the virtual world software or computer game. The conversation will also be saved as history in the "AI Management Function", and the administrator can check what kind of conversation the character had by looking at the "AI Management Function" app or a dedicated web page.In the explanation so far, the character will remain in the place where the administrator has finished operating that character and will be in a state of waiting for a conversation, but in addition to that, virtual world software and computer games allow the administrator to operate their own character whileConversations can be made into a "personalized AI" by giving the "personalized AI" requests and commands about the conversation, or pausing the "personalized AI" conversation so the administrator can talk to it, or receiving advice from the "personalized AI" while the administrator is talking. In this case, an operation screen can be displayed within the character operation screen of the virtual world software or computer game, where requests and commands about the conversation can be made, the conversation can be paused, the conversation can be resumed, and advice can be requested about the conversation. If the administrator himself talks in these conversations, the "personalized AI" records his or her remarks as history, so they can be used as learning material for the "personalized AI." The virtual space software or computer game can have a function to borrow the conversation of these "personalized AIs" for conversations with NPCs (non-player characters), and characters unique to the virtual space software or computer game can appear as NPCs, and the administrator's borrowed "personalized AI" can be used only during conversations, and the "personalized AI" will converse with content appropriate to the purpose of the event, and even when the administrator is not operating the character in the virtual space software or computer game, the character will appear to others as if it were alive, allowing communication to continue.
6. A method characterized by the fact that by installing a conversation program on the administrator's homepage or SNS account, a person who views the homepage or SNS and requests a conversation using the conversation program can converse with a "personalized AI" managed by the administrator, and when a conversation is requested by that person, the conversation program can be linked to an "AI management function," and through the "AI management function," the "personalized AI" can converse with that person, and by conversing with the "personalized AI" of that account, the person can learn to some extent about the administrator's personality, hobbies, etc.
7. A program for executing the method according to any one of claims 1 to 6.
8. A server or computer that executes the method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Communication method and system using multiple avatars simultaneously
JP2020101950A
Information processing device, information processing system, information processing method, and program
JP2022012457A
Intervention in conversation between virtual agent and user
US10171662B1
Social Media Connection for a Robot
US20190245812A1