Chat system using generative ai device

Abstract

To solve a problem in which, when a user talks to photos of deceased pets or people, they would respond just as if they were alive, and what if the user could even converse with them using words.SOLUTION: A chat system generates replies to input from users using not only what a generative AI device learns from open data such as the WWW, but also what it learns from the user's private data. This allows for general topics to be included, but also allows for specific information that others would not know to be at the core of the conversation with the user, making it possible to have conversations with deceased pets or people.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] This invention relates to a chat system using a generative AI device that generates replies to user input using the contents of a private database that learns with the user's permission. [Background technology]

[0002] In recent years, generative AI such as chatGPT (Chat Generative Pre-trained Transformer) (trademark, hereinafter the same) has appeared. At the time of filing this application, the only patent documents related to the Japan Patent Office in which the term generative AI appears are Patent No. 689532 "Accounting Processing Device, Accounting Processing System, Accounting Processing Method and Program", Patent No. 7213626 "Security Measures Consideration Tool", and JP 2019-219898 "Security Measures Consideration Tool".

[0003] Generative AI, such as chatGPT, is called an artificial intelligence chatbot. In other words, GPT is an AI that generates natural language according to the instructions of a given text, and for this reason, it has the ability to understand natural conversations between humans in input and output, as well as the ability to learn the vast amount of information on the Internet and create natural conversations. Some GPTs have the ability to generate not only text, but also voice, music, images, metaverse spaces, and more. Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, more and more people have come to regard pets such as dogs and cats as members of the family. It is not uncommon to hold a funeral for a beloved dog or cat when it dies. Some people even complain of the so-called pet loss symptoms. It is natural to talk to your pet in front of a photo of your pet.

[0005] If you could talk to a photo of your pet, wouldn't it respond just as if it were alive? And how nice would it be if you could converse with it in words? Even if your pet is still alive, it would be nice to be able to do the same thing if you were to leave it behind while traveling. [Means for solving the problem]

[0006] The inventor thought that the above-mentioned problems could be solved by applying the technology of a generative AI device, i.e., an artificial intelligence chatbot. However, if a response is generated from the contents learned from an open database such as the WWW, it will be a bland conversation with a general pet, not a conversation with a specific pet that was a member of the family. It is as empty as a sewn dog telling a common story. Therefore, the inventor thought that it is important that the generative AI device must learn specific contents, such as the memories of the days that the owner spent with the pet. It is possible to make it possible to talk to a portrait of a deceased person, not just a pet, but also to a human family member, so that the person will respond as if they were alive.

[0007] The above problem is achieved by providing a chat system using a generating AI device, which is composed of a generating AI device connected to open data such as the World Wide Web, a terminal device, and a user's private data, wherein the terminal device is equipped with a communication device, an input device, and an output device, and the generating AI device communicates data with the terminal device via the communication device, receives input content from the input device, generates a response to the input content using the contents of the private data which it learns with the user's permission, and outputs the response to the input content to the output device of the terminal device.

[0008] The terminal device is, for example, a user's smartphone, and this communication device is used to interact with the generating AI device, and is generally connected to the Internet, but is not limited to this. The input device of the terminal device can be, for example, a physical keyboard for inputting text or a virtual keyboard. The input device can also input voice using a microphone, and this can be freely designed. The output device of the terminal device can be, for example, a display that outputs text, but can be configured to output a moving image of the pet to the display and output the pet's voice to a speaker. It is also possible to configure a system in which the input device is a virtual keyboard for inputting text, and the output device is a speaker that outputs the pet's voice.

[0009] With regard to the above-mentioned pet video images, it is possible and preferable to record the user's private photos and videos as data and have the AI ​​generating device learn from them and then reconstruct them into photos and videos that match the dialogue. With regard to the pet's voice, it is possible and preferable to record the user's private recordings as data and have the AI ​​generating device sample the recorded voices to create a pet's voice tone that matches the dialogue, or to convert the text responses of the pet that the AI ​​generating device is impersonating into a voice tone and output them.

[0010] The input device of the terminal device is also used to input the contents as private data. Although it is convenient to use the same virtual keyboard on the smartphone for the content input device and the above-mentioned dialogue input device, a system configuration is also possible in which a personal computer and a smartphone are used separately, such as using a physical keyboard of a personal computer as the content input device and a virtual keyboard of a smartphone as the dialogue input device. Alternatively, for example, a system configuration is also possible in which a photo stand is applied as a terminal device and is equipped with a communication device, a dialogue input device, and an output device, and a smartphone is used as another terminal device and is equipped with a communication device, the above-mentioned content input device, and an output device. In other words, the configuration of the input device of the present invention may be freely designed.

[0011] The generating AI device can connect to the WWW and other open data sources and learns from this information. In addition, the generating AI device is also connected to the user's private data and learns various details about the pets that were part of the user's family. This allows the device to talk about general pet topics while placing specific details at the core of the conversation, such as the owner's memories of the days they spent with their pet, which would not be known to others. It is important to note that since the learning source is the user's private data, the generating AI device learns with the user's permission and uses the learned contents only for conversations with this user.

[0012] The user's private data is stored in the storage device of the terminal device that constitutes this chat system, in the storage device of the generating AI device, or on a network to which both can be connected. Wherever the user's private data is stored, the generating AI device must obtain the user's permission to access and learn from the contents of the data. When the generating AI device requests access, the user must select the "Accept" switch in response to the pop-up display of the access request, for example, as a setting on the terminal device. If the user finds this annoying, the user may set "Always Allow" as one form of permission. For example, in a configuration in which an app that serves as the generating AI device is installed on a smartphone as a terminal device, it is assumed that the smartphone user has given permission. The user's private data may have some structure, or it may not have a structure like text.

[0013] The learning content must be set to be used only for dialogue with this user. Otherwise, the boundary between the user's private data and open data will become unclear. There may be multiple users, such as when the owners are a father, mother, and child. In that case, the user's terminal device that is allowed to access the generating AI device can be configured to use a password, biometrics, a secret phrase, or a unique identification code for the terminal. It is also possible to divide the private data into several parts and set different access rights for each. In the case of a memorial item such as a natural disaster memorial monument, which will be described later, the user is the person who visited the monument. The private data can be set to transmit information such as "what happened here" and "wisdom for future generations," and the generating AI device can respond to the information about the monument as if it were the information of the monument via the smartphone of the user who stops by the monument. Here is an example.

[0014] As for who enters the user's private data, if there are multiple owners, it can be all of them, some of them, or just one person, but in any case, it can be set by the user. As for what to enter as the user's private data, examples include things that will be remembered after the death of the pet, or selecting from photos taken. Or, it may be entered as if you were keeping a diary while you were alive. In the case of a human, for example, you would enter a catalog of your possessions, various passwords, words of thanks to your surviving family, a diary, etc., to prepare for your own death.

[0015] In addition, the generating AI device can be notified of online communication platforms such as WWW and SNS where users post as the location of the private data described above. Alternatively, the user may directly input the WWW or SNS content related to the pet as private data.

[0016] Now, in the case where there is a discrepancy between what has been learned from open data and private data on a particular topic, the generative AI device can be designed to generate a response using what has been learned from the private data, enabling a dialogue with fewer discrepancies between the user and the generative AI device.

[0017] Next, the chat system using the generative AI device of the present invention can be used with memorial items. Memorial items include photo stands that hold the pet's portrait (even if the pet is alive), portraits, Buddhist altars, gravestones, clothes and toys used by the pet, etc. For humans, the range is even wider, and the deceased person's collections and creations are also memorial items. Bronze statues of great people, graves of musicians, stone monuments with poems and haiku, and local stone monuments with poems related to famous songs are also memorial items. In addition, since the smartphone used by the deceased is a legacy, it is possible for the bereaved family to incorporate it into the chat system using the generative AI device of the present invention. Effect of the Invention

[0018] The chat system of this invention is characterized by the fact that the AI ​​generating device generates replies to inputs from users using not only what it learns from open data such as the WWW, but also what it learns from the user's private data. This makes it possible to focus on specific content that others would not know while also including general topics. [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 is an explanatory diagram of a chat system according to a first embodiment. [Diagram 2] FIG. 1 is an explanatory diagram of a smartphone according to a first embodiment. [Diagram 3] FIG. 11 is an explanatory diagram of a chat system according to a second embodiment. [Figure 4] FIG. 11 is an explanatory diagram showing the flow of operations in the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS EXAMPLES

[0020] Figure 1 is a schematic representation of the chat system of Example 1. The generation AI device 200 itself is well known, for example as chatGPT, and has a user authentication unit 204 that registers users who will use it in advance and checks whether the user is a registered user each time they access the system. It also periodically circulates around the WWW and other sites to collect mainly open data, indexes it for easy search, and creates a database 202 of open data.

[0021] The smartphone 100 has private data 106 input by the user. This is recorded in the storage device 104 as shown in FIG. 2. The smartphone 100 is equipped with a communication device 110 for communicating with the generation AI device 200 via the Internet. The input / output device 112 also has a touch panel 116 as an input device provided on a display 114 as an output device. In addition, the smartphone 100 is equipped with a microphone 118 for inputting voice and a speaker 120 for outputting voice. It also has a camera 122. These are connected to a bus and are appropriately controlled by the control device 102.

[0022] The user uses a virtual keyboard displayed on the display 114 below the touch panel 116 to input specific details such as memories of days spent with a pet, which are recorded as private data 106 in the storage device 104. Meanwhile, the user can interact with the AI ​​generating device 200 using the same virtual keyboard.

[0023] When the user launches an app (not shown) and connects to the generating AI device 200, the generating AI device 200 checks the private data 106 to which it has been given access rights in advance through the settings of the data usage permission unit 108 of the smartphone 100, and if there is an update, imports it and prepares for future dialogue with the user. If there is no update, the previous private data 106 can be used. The generating AI device 200 then receives input from the user, generates a response to the input using the contents of the private data 106, and transmits it so that the response is output to the display 114 of the smartphone 100. At this time, the above-mentioned open data database 202 may be used.

[0024] If the generated AI device 200 or an app (not shown) of the smartphone 100 supports voice chat, it is possible to configure the device so that the user can input using the microphone 118 of the smartphone 100 and the generated AI device 200 outputs a reply to the speaker 120 of the smartphone 100. It is also possible to design the device so that an image captured by the camera 122 is sent to the generated AI device 200 and used in the reply. EXAMPLES

[0025] Figure 3 is a schematic diagram of a chat system of Example 2. The difference from Example 1 is that the user notifies the generated AI device 200 of the user ID and password required to use the online communication platform SNS300 via the data usage permission unit 124, and then permits its use. This design enables the generated AI device 200 to use the contents of the private data 302 on the SNS300, separately from the private data 106. EXAMPLES

[0026] FIG. 4 relates to a chat system of the third embodiment. In both the first and second embodiments, the AI ​​generating device 200 uses the private data 106 and the contents of the open data database 202 to reply. For example, if the user has a male calico cat, the private data 106 contains information such as "male calico cat". On the other hand, the open data database 202 contains information such as "most calico cats are female". Although a discrepancy occurs here, the user actually has a male calico cat, which is born occasionally, so when generating a reply, the information in the private data 106 is used instead of the open data (202). This allows a dialogue between the user and the AI ​​generating device 200 that is free from discrepancies from the beginning. Of course, it is effective to include a general topic such as "most calico cats are female, and male calico cats are rare" to broaden the depth of the dialogue.

[0027] As shown in Fig. 4, the generation AI device 200 adjusts the response. When "calico cat is female" is compared with "male calico cat" (step 400), there is a clear discrepancy (step 402), so "male calico cat" from the private data 106 is adopted (step 404) and a response is created and sent (step 404). If there were no discrepancies in step 402 in other examples, the generation AI device 200 would be less likely to hesitate in its decision. EXAMPLES

[0028] Example 4 will be described without using drawings. If a portrait of a deceased pet is stored in the private data 106 of the storage device 104 of the smartphone 100 and displayed on the display 114, the smartphone 100 becomes a photo stand. In other words, the smartphone 100 is a memorial item and also constitutes a part of the chat system by the generation AI device of the present invention. [Industrial Applicability]

[0029] Generative AI devices that generate responses to user input using not only what they learn from open data such as the WWW but also what they learn from the user's private data have novelty and inventive step, as well as great industrial applicability. In the case of humans, it would be interesting to accumulate all sorts of information about oneself, even while alive, as open data, and have a generative AI device search for people who look like oneself, for example. Generative AI devices will be eternal as long as humanity survives, so it may be possible for people in the distant future to have a generative AI device search for things like "Was there someone who looked like me in the past, and what was their name, job, or occupation?" [Explanation of symbols]

[0030] 100...smartphone 102...control device 104... storage device 106... private data 108: Data usage permission unit 110: Communication device 112... I / O device 114... Display 116...Touch panel 118...Microphone 120...Speaker 122...Camera 124... Data usage permission unit 200... Generating AI device 202...Open data database 204...User authentication unit 300...SNS 302...Private data

Claims

1. A chat system consisting of a generating AI device connected to open data such as the World Wide Web, a terminal device, and user private data, wherein the terminal device is equipped with a communication device, an input device, and an output device, and the generating AI device communicates data with the terminal device via the communication device, receives input content from the input device, and generates a response to the input content using the contents of the private data which it learns with the user's permission, and outputs the response to the input content to the output device of the terminal device.

2. A chat system using a generating AI device as described in claim 1, which notifies the generating AI device of online communication platforms such as the WWW and SNS where users post as the location of the private data.

3. A chat system using a generating AI device as described in claim 1, wherein in the event of a discrepancy between the matters learned in the open data and the private data for a particular topic, the generating AI device generates a reply using the matters in the private data.

4. A chat system using the generative AI device of claim 1 for use with memorial items.

Images