system

Abstract

We provide the system. [Solution] A system including means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, means for converting the analysis results into respectful expressions, and means for outputting the conversion results.

Description

Technical Field

[0005] , ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Communication within a workplace team consisting of diverse members is becoming increasingly difficult, and attention has been focused on measures to improve psychological safety. However, there is a problem that it is difficult to convert into an expression that respects the other party when conveying one's true feelings to the other party.

Means for Solving the Problems

[0005] The present invention provides a system that receives input information from a user, analyzes the content to be conveyed based on the input information, converts it into an expression that respects the other party based on the analysis result, and outputs the conversion result. Thereby, it becomes easy for the user to convert into an expression that respects the other party when conveying one's true feelings to the other party.

Brief Description of the Drawings

[0006] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Embodiment 1 of Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1 of Form Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2 of Embodiment 2. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2 of Form Example 2. [Figure 15] This is a sequence diagram showing the processing flow of the data processing system in Embodiment 3 of Example 3. [Figure 16]It is a sequence diagram showing the processing flow of the data processing system in Application Example 3 of Form Example 3. [Figure 17] It is a sequence diagram showing the processing flow of the data processing system in Example 1 of Form Example 1 when combined with an emotion engine. [Figure 18] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1 of Form Example 1 when combined with an emotion engine. [Figure 19] It is a sequence diagram showing the processing flow of the data processing system in Example 2 of Form Example 2 when combined with an emotion engine. [Figure 20] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 of Form Example 2 when combined with an emotion engine. [Figure 21] It is a sequence diagram showing the processing flow of the data processing system in Example 3 of Form Example 3 when combined with an emotion engine. [Figure 22] It is a sequence diagram showing the processing flow of the data processing system in Application Example 3 of Form Example 3 when combined with an emotion engine. [Figure 23] It is a sequence diagram showing the processing flow of the data processing system in other embodiments.

Embodiments for Carrying Out the Invention

[0007] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0008] First, the language used in the following description will be explained.

[0009] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)), etc.

[0010] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor. [[ID=G]]

[0011] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0012] In the following embodiments, the labeled communication I / F (Interface) is an interface that includes a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0014] [First Embodiment]

[0015] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0016] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0019] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0022] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0026] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[0027] "Example of form 1"

[0028] One embodiment of the present invention is a system used as a bot for a communication tool. This system has a means of receiving input information from the user. The user inputs their true feelings and their relationship with the other person. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[0029] "Example of form 2"

[0030] Next, the system has a means to analyze the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect shown to the recipient when conveying that message.

[0031] "Example of form 3"

[0032] Furthermore, the system has a means of converting the analysis results into respectful expressions. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[0033] "Example of form 4"

[0034] Finally, the system has a means of outputting the conversion results. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[0035] The following describes the processing flow for each example of the form.

[0036] "Example of form 1"

[0037] Step 1: The user inputs their true feelings and their relationship with the other person into the communication tool bot. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[0038] Step 2: The system analyzes the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect the user will show to the recipient when conveying that message.

[0039] Step 3: The system converts the analysis results into a respectful expression. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[0040] Step 4: The system outputs the conversion result. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[0041] (Example 1)

[0042] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0043] In modern information exchange, it is difficult for users to find appropriate communication methods that consider both their true feelings and their relationship with the other person. Especially in workplace and organizational communication, it is necessary to effectively convey one's own opinions while respecting others, but finding concrete ways to do so is not easy.

[0044] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0045] In this invention, the server includes means for receiving input information from a user, means for converting the input information into a data format and transmitting it, and means for performing analysis using a generated artificial intelligence model based on the input information. This makes it possible for users to easily obtain appropriate communication methods based on their true feelings and their relationship with the other person.

[0046] A "user" refers to an individual or organization that provides input information to the system.

[0047] "Input information" refers to data that users provide to the system, specifically including information about the user's true feelings and their relationship with the other party.

[0048] "Data format" refers to the format in which information is converted into a form that can be processed by a computer.

[0049] A "generative artificial intelligence model" refers to a machine learning model used for natural language processing, specifically a technology that performs analysis based on user input.

[0050] "Analysis" refers to information processing that uses input information to derive appropriate communication methods.

[0051] "Communication methods" refer to the specific means and expressions that indicate how a user should convey information to another person.

[0052] "Organizational management" refers to management activities aimed at the efficient operation of personnel and operations within an organization.

[0053] "Information exchange" refers to the act of transmitting information between individuals or groups.

[0054] An "automatic response program" refers to software that automatically generates responses in response to user input.

[0055] The following system configurations are possible as embodiments for carrying out this invention.

[0056] Users input their true feelings and their relationship with the other person using a device. The device is a smartphone or personal computer, providing an interface for receiving the information entered by the user. The information entered by the user is collected through text boxes.

[0057] The terminal converts the input information received from the user into a data format and sends it to the server. During this process, the data is converted to a standard data format such as JSON and transmitted securely using the HTTPS protocol.

[0058] The server uses a generative artificial intelligence model to analyze the received data. Specifically, it can utilize general machine learning models as generative AI models for natural language processing. For example, OpenAI's GPT-3® is one such model. This model generates appropriate communication methods based on the user's true feelings and relationship with them.

[0059] The generated communication method is sent from the server to the terminal. The terminal displays the received information to the user, who can then use it as a reference to communicate with the other party.

[0060] For example, if a user inputs the information "I think his proposal is wrong" and "He is my boss," the generating AI model will generate a communication method such as "When dealing with your boss, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." An example of a prompt might be, "Please suggest an appropriate communication method based on the user's true feelings and their relationship with the other person."

[0061] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0062] Step 1:

[0063] The user uses their device to input their true feelings and their relationship with the other person. Specifically, they enter information such as "I think his suggestion is wrong" and "He is my boss" into the text box on the device. The entered information is temporarily stored on the device.

[0064] Step 2:

[0065] The terminal converts the input information received from the user into a data format and sends it to the server. Specifically, it converts the input information into JSON format and sends it to the server using the HTTPS protocol. At this time, the input information is structured as a JSON object with keys for "true feelings" and "relationship".

[0066] Step 3:

[0067] The server parses the received JSON data. Specifically, it uses a generative AI model to generate appropriate communication methods based on the user's true feelings and relationship with the other party. The server inputs the prompt "Please suggest an appropriate communication method based on the user's true feelings and relationship with the other party" into the generative AI model and performs the analysis.

[0068] Step 4:

[0069] The server sends the analysis results obtained from the generated AI model to the terminal in JSON format. Specifically, it structures the generated communication method as a JSON object with the key "proposal" and sends it to the terminal using the HTTPS protocol.

[0070] Step 5:

[0071] The terminal parses the JSON data received from the server and displays a generated communication method to the user. Specifically, the terminal screen displays a message such as, "When communicating with your superior, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." The user can then use this suggestion as a reference when communicating with others.

[0072] (Application Example 1)

[0073] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server," and the smart device 14 will be referred to as a "terminal."

[0074] In face-to-face services, smooth communication with customers is crucial, but accurately understanding their true feelings and emotions and responding appropriately is a challenging task. In particular, making instantaneous decisions about appropriate responses based on a customer's facial expressions and relationship with them has been difficult with traditional methods.

[0075] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0076] In this invention, the server includes means for receiving input information from the user, means for acquiring video data and analyzing a person's facial expressions, and means for generating a response based on a prompt sentence using a generative AI model. This enables the automatic generation of appropriate responses based on the customer's facial expressions and relationship, facilitating smooth communication in face-to-face services.

[0077] "Means of receiving user input information" refers to the methods and devices by which the system acquires data and information provided by the user.

[0078] "Means for analyzing what you want to convey" refers to methods or devices that process information received from users to understand their intentions and objectives.

[0079] "Means of converting into respectful expressions" refers to methods or devices that convert analyzed content into appropriate and polite expressions for the other party.

[0080] "Means for outputting conversion results" refers to methods or devices for presenting the converted information to a user or other system.

[0081] "Means for acquiring video data and analyzing a person's facial expressions" refers to methods or devices for acquiring video using cameras or other equipment and analyzing the facial expressions of people within that video.

[0082] "Means for generating appropriate responses based on facial expression data and relationships" refers to methods or devices for determining the optimal response or action by considering the relationship between the analyzed facial expression information and the user.

[0083] "Means for generating responses based on prompt sentences using a generative AI model" refers to methods or devices that utilize artificial intelligence models to generate appropriate responses based on given prompt sentences.

[0084] The system for carrying out this invention includes a terminal for receiving input information from a user, a camera for acquiring video data, and a server for processing this data. The server receives the information provided by the user and analyzes the content the user wants to convey based on that information. The analyzed content is converted into respectful language and output as an appropriate response.

[0085] The server analyzes facial expressions from video data acquired using a camera. Specifically, it uses image processing libraries such as OpenCV to recognize facial expressions in real time. The recognized facial expression data is considered along with the relationship with the user and used as basic data to generate appropriate responses.

[0086] The system utilizes a generative AI model to generate responses based on prompts. For example, it can use the OpenAI API to input a prompt and obtain an appropriate response. A specific example of a prompt would be, "The customer's expression indicates dissatisfaction, and they are a regular customer. Please suggest an appropriate response." Based on this prompt, the AI ​​model generates the optimal response for the customer.

[0087] This system is expected to facilitate smoother communication in face-to-face services and improve customer satisfaction.

[0088] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0089] Step 1:

[0090] The terminal receives input information from the user. This input information includes the user's true feelings and their relationship with the other party. This information is sent to the server and used as basic data for analysis.

[0091] Step 2:

[0092] The server acquires video data using a camera and analyzes people's facial expressions. It uses image processing libraries such as OpenCV to recognize facial expressions in real time. The input is video data from the camera, and the output is the analyzed facial expression data.

[0093] Step 3:

[0094] The server generates prompt text based on user input and analyzed facial expression data. This prompt text includes the user's true feelings, their relationship with the other person, and facial expression data. This prepares the input for the generating AI model.

[0095] Step 4:

[0096] The server generates responses based on prompts using a generative AI model. Using the OpenAI API, prompts are input, and appropriate responses are obtained. The input is the prompt, and the output is the generated response.

[0097] Step 5:

[0098] The server sends the generated response to the terminal and presents it to the user. This allows the user to know how to proceed appropriately. The output is the response presented to the user.

[0099] (Example 2)

[0100] Next, we will describe Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0101] In modern communication, it is crucial to accurately analyze what a user wants to convey and translate it into expressions that show appropriate respect for the recipient. However, conventional technologies have a challenge in generating expressions that fully consider the user's intentions and the recipient's feelings.

[0102] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0103] In this invention, the server includes means for receiving information from a user, means for analyzing the information using natural language processing technology, and means for evaluating the user's intentions and the degree of respect shown to the other party based on the analysis results. This makes it possible to accurately grasp the user's intentions and generate expressions that show appropriate consideration for the other party.

[0104] A "user" is an entity that uses a system to input information and receive analysis results.

[0105] "Information" refers to text data that users input into the system, including the user's intentions and considerations for others.

[0106] "Natural language processing technology" refers to techniques that enable computers to understand and analyze human language, and includes tokenization, part-of-speech tagging, and dependency analysis.

[0107] "Analysis" is the process of processing information using natural language processing technology to identify the user's intentions and the degree of respect they have for the other party.

[0108] "Evaluation" is the act of judging the user's intentions and the degree of respect they show to others, based on the analysis results.

[0109] "Output" refers to the process of providing the user with the results of the analysis and evaluation.

[0110] A "system" is a device or program that includes a set of means for receiving, analyzing, evaluating, and outputting information from a user.

[0111] This invention is a system that analyzes information entered by a user and evaluates their intent and the degree of respect shown to the other party. The server receives information from the user and performs analysis using natural language processing technology. This analysis uses natural language processing libraries such as "spaCy" and "NLTK". These libraries enable text tokenization, part-of-speech tagging, and dependency analysis, and are used to accurately grasp the user's intent.

[0112] The server evaluates the user's intent and the degree of respect shown to the recipient based on the analysis results. The evaluation results are output to the user via their device. This allows the user to see how their message is interpreted and how much consideration they have shown to the recipient.

[0113] For example, if a user enters the message, "Could you please change the meeting time?", the server analyzes this message and understands that the user is requesting a change in the meeting time. Furthermore, the use of polite language indicates a high degree of respect for the other party.

[0114] An example of a prompt to input into the generating AI model is, "Analyze the polite language used by the user when requesting a change in meeting time, and evaluate the degree of respect shown to the other party." This prompt allows the system to accurately analyze the user's intent and make an appropriate evaluation.

[0115] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0116] Step 1:

[0117] The user inputs information into the system via a terminal. This information is text data containing the message the user wants to convey. The terminal then sends this input information to the server.

[0118] Step 2:

[0119] The server analyzes the received information using natural language processing techniques. Specifically, the server uses libraries such as "spaCy" and "NLTK" to tokenize the text, tag it with parts of speech, and perform dependency analysis. This analysis identifies the user's intent and grasps the semantic structure of the text. The input is the user's text data, and the output is the analyzed intent and structural information.

[0120] Step 3:

[0121] The server evaluates the user's intent and the degree of respect shown to the other party based on the analysis results. Specifically, it checks whether polite language and respectful expressions are included and determines the extent of consideration shown to the other party. The input is the analyzed intent and structural information, and the output is the result of identifying the intent and evaluating the degree of respect.

[0122] Step 4:

[0123] The server returns the evaluation results to the user. The terminal displays these results to the user. Specifically, it includes a summary of what the user wants to convey and an evaluation of the degree of respect shown to the other party. The input is the evaluation result, and the output is the evaluation information presented to the user.

[0124] (Application Example 2)

[0125] Next, we will describe Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server," and the smart device 14 will be referred to as a "terminal."

[0126] In modern electronic transaction services, there is a demand for prompt and appropriate responses to user inquiries and complaints. However, accurately understanding the user's intentions and level of respect can be difficult, sometimes leading to a decline in the quality of service. Therefore, a system is needed that analyzes the user's intentions and level of respect, and proposes appropriate response methods.

[0127] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0128] In this invention, the server includes means for receiving information from a user, means for analyzing the content to be conveyed based on the information, and means for proposing a response method based on the analysis results. This enables an accurate understanding of the user's intentions and degree of respect, and allows for a quick and appropriate response.

[0129] "Means of receiving information from users" refers to the methods by which the system acquires data and messages provided by users.

[0130] "Methods for analyzing the message to be conveyed" refers to methods of processing data based on acquired information in order to understand the user's intentions and objectives.

[0131] "Methods for converting information into respectful language" refer to methods of reconstructing information in a way that shows respect to the other party, based on the analysis results.

[0132] "Means for outputting conversion results" refers to a method for providing the reconstructed information to a user or other system.

[0133] "Means of proposing response methods" refers to methods for presenting optimal countermeasures or responses based on analysis results.

[0134] "User intent" refers to the purpose or desire that the user is trying to convey through the system.

[0135] "Degree of respect" refers to the level of respect and attitude that a user shows towards another person.

[0136] "Electronic transaction service support tools" are auxiliary systems and applications used to facilitate online commercial transactions.

[0137] The "automatic response function of the dialogue support tool" is a function that automates communication with users and enables efficient responses.

[0138] A description of the embodiment for carrying out the invention will be given.

[0139] This invention is a system that receives information from a user, analyzes the user's intentions and degree of respect towards the other party based on that information, and proposes an appropriate response method. The system consists of a server and a user terminal.

[0140] The server receives messages sent from the user's terminal. The received messages are analyzed using natural language processing techniques. This analysis utilizes the Python programming language and natural language processing libraries such as spaCy and Transformers. The analysis results in an estimation of the user's intent and level of respect.

[0141] Based on the analysis results, the server uses a generative AI model to propose an appropriate response. This proposal is sent to the user's terminal and presented to the user. The user can then use the proposed response as a reference to communicate appropriately with the other party.

[0142] For example, if a user sends a message saying, "There was a problem with my recent transaction. Please address it urgently," the server analyzes this message and understands the user's intent ("there is a problem") and the degree of respect expressed ("urgently"). Based on this, the server proposes and presents a prompt solution to the user.

[0143] An example of a prompt message is: "Analyze the user's message and estimate its intent and level of respect. Message: 'There was a problem with a recent transaction. Please address it as soon as possible.'"

[0144] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0145] Step 1:

[0146] The user uses a terminal to input a message and sends it to the server. The input message is natural language text containing the user's intentions and requests. The server receives this message.

[0147] Step 2:

[0148] The server tokenizes received messages using the natural language processing library spaCy and analyzes their grammatical structure. The input is the user's message, and the output is the tokenized words and their grammatical relationships. This process clarifies the message's structure.

[0149] Step 3:

[0150] The server uses Transformers to estimate the user's intent and level of respect from tokenized messages. The input is a tokenized message, and the output is a numerical value or label indicating the user's intent and level of respect. This process allows the meaning of the message to be understood.

[0151] Step 4:

[0152] The server uses a generative AI model to generate appropriate responses based on estimated intent and respect levels. The input is the intent and respect levels, and the output is the proposed response. This process determines the optimal response for the user.

[0153] Step 5:

[0154] The server sends the generated response method to the user's terminal. The user reviews the proposed response method on their terminal and, if necessary, uses it as a reference to reply to the other party. The input is the proposed response method, and the output is the user's confirmation and use. This process enables the user to communicate appropriately.

[0155] (Example 3)

[0156] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0157] In modern communication, it is crucial for users to translate their true feelings into respectful expressions, but doing so manually is difficult and time-consuming. Furthermore, there is a lack of technology to automatically generate appropriate expressions that take into account the user's intentions and relationship.

[0158] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0159] In this invention, the server includes means for receiving information from the user, means for using a generative AI model to analyze the information, and means for transforming the expression based on the analysis results. This makes it possible to automatically transform the user's true feelings into expressions that respect the other party.

[0160] A "user" is an entity that uses a system to input information and receives the converted results.

[0161] "Information" refers to text data that users input into the system, including the user's intentions and relationships.

[0162] A "generative AI model" is an artificial intelligence technology used to analyze input information and perform appropriate transformations.

[0163] "Analysis" is the process of using a generative AI model to understand the intent and emotions behind the input information and extract the foundational data for transformation.

[0164] "Conversion" is the process of replacing input information with respectful expressions based on the analysis results.

[0165] "Output" refers to the process of presenting the converted result to the user.

[0166] A "server" is a computer system that receives information from users, analyzes and transforms it, and outputs the results.

[0167] One embodiment of this invention includes a process in which a user inputs information using a terminal, and a server analyzes and transforms that information.

[0168] The server communicates with the terminal over the network to receive information from the user. The user enters text into the terminal's input field. For example, they might enter information such as "I think his suggestion is wrong."

[0169] The server uses a generative AI model to analyze the information it receives. This model uses natural language processing techniques to understand the intent and sentiment of the input information. Specifically, it can use generative AI models such as OpenAI's GPT-3.

[0170] After the analysis is complete, the server transforms the information based on the analysis results. The purpose of the transformation is to replace the user's true feelings with expressions that respect the other party. For example, the information "I think his proposal is wrong" is transformed into the expression "It might be necessary to consider his proposal from a different perspective."

[0171] The converted information is sent from the server to the terminal and presented to the user. This allows the user to communicate in a way that is considerate of the other person.

[0172] A concrete example of a prompt sentence is, "Please rephrase the following sentence in a respectful manner: I think his suggestion is wrong." By inputting this prompt sentence into the generation AI model, an appropriate transformation is performed. The flow of the specific processing in Example 3 will be explained using Figure 15.

[0173] Step 1:

[0174] The user inputs information using a terminal. The user enters their honest opinion in text format into the terminal's input field. For example, they might enter, "I think his proposal is wrong." This input information becomes the basis for subsequent analysis and transformation.

[0175] Step 2:

[0176] The terminal sends the entered information to the server. The terminal sends the text entered by the user to the server via an HTTP request. This transmission allows the server to receive the data for analysis and transformation.

[0177] Step 3:

[0178] The server inputs the received information into a generative AI model. The server then uses the generative AI model to analyze the information. This model utilizes natural language processing techniques to understand the intent and emotions behind the input information. Based on the analysis, it determines how the information should be transformed.

[0179] Step 4:

[0180] The server transforms the information based on the analysis results. Based on the analysis results, the server transforms the input information into respectful language. For example, the information "I think his proposal is wrong" is transformed into "It might be necessary to consider his proposal from a different perspective." This transformation ensures that the user's true feelings are expressed in a way that is considerate of the other person.

[0181] Step 5:

[0182] The server sends the converted information to the terminal. The server sends the conversion result to the terminal via an HTTP response. This transmission prepares the terminal to present the conversion result to the user.

[0183] Step 6:

[0184] The terminal displays the conversion results to the user. The terminal displays the conversion results received from the server to the user. The user can check this converted information and use it when communicating it to the other party. This enables the user to communicate in a way that is considerate of the other person.

[0185] (Application Example 3)

[0186] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0187] In modern face-to-face customer service, polite and considerate communication with customers is crucial. However, it is difficult for staff to instantly choose the appropriate expression, which hinders the improvement of customer satisfaction. Therefore, there is a need for a system that allows staff to use respectful language with customers in real time.

[0188] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0189] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful language. This enables staff to use appropriate language with customers in real time.

[0190] "Means of receiving user input information" refers to the function that allows the system to acquire information provided by the user.

[0191] "Means of analyzing what you want to convey" refers to a function that analyzes input information in order to understand the message the user intends to convey.

[0192] "A means of converting into respectful language" refers to a function that transforms the analyzed content into language that is considerate of the other person.

[0193] "Means for outputting conversion results" refers to a function for presenting the converted expression to the user.

[0194] "Means of presenting in real time on a visual display device" refers to a function for instantly displaying the converted expression visually.

[0195] A "wearable information terminal" is an information processing device that a user can wear and use.

[0196] "Communication support tools for face-to-face customer service" are tools designed to assist staff communication during face-to-face interactions with customers.

[0197] To implement this invention, smart glasses are used as wearable information terminals. The smart glasses receive voice input from the user and transmit it to a server. The server converts the voice to text using speech recognition software (e.g., Google® Speech-to-Text). The converted text is analyzed using a generative AI model (e.g., OpenAI GPT-3) and converted into respectful language. The converted language is displayed in real time on the smart glasses' display. This enables the user to use appropriate language when speaking to customers.

[0198] For example, if a user tries to say, "This product may not be right for you," the server will translate this to, "You might want to consider other options for this product," and display it on the smart glasses. An example of a prompt to input into the generating AI model is, "Please translate this into a respectful expression for the user's statement: 'This product may not be right for you.'"

[0199] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[0200] Step 1:

[0201] The user performs voice input through smart glasses, which are wearable information terminals. The voice input includes the content the user wants to convey to the customer.

[0202] Step 2:

[0203] The device uses speech recognition software (e.g., Google Speech-to-Text) to convert voice input into text data. The input is voice data, and the output is text data. This conversion processes the voice information into a format that can be analyzed.

[0204] Step 3:

[0205] The server uses a generative AI model (e.g., OpenAI GPT-3) to analyze text data and convert it into respectful language. The input is the converted text data, and the output is the text data of the respectful language. Prompts are used to convert the language to reflect the user's intent.

[0206] Step 4:

[0207] The server sends the converted text data to the terminal. The terminal displays the conversion results in real time on the smart glasses' display. This allows the user to use appropriate language when communicating with customers. The input is text data of the respected language, and the output is visually displayed information.

[0208] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0209] "Example of form 1"

[0210] One embodiment of the present invention provides a system incorporating an emotion engine. This system receives input information from the user and analyzes the message the user wants to convey based on that information. Based on the analysis results, it converts the message into a respectful expression and outputs the converted result. Furthermore, this system includes an emotion engine that recognizes the user's emotions. This emotion engine analyzes the emotion from the user's input information and converts it into a respectful expression that takes that emotion into account. Specifically, if the user inputs "I think his proposal is wrong" and the emotion at that time is "anger," the emotion engine analyzes that "anger" and converts it into a respectful expression such as "Perhaps we should reconsider his proposal."

[0211] "Example of form 2"

[0212] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts the expression of respect, such as "You might want to reconsider his suggestion," to a calmer expression such as "His suggestion might be worth reconsidering."

[0213] "Example of form 3"

[0214] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts the expression of respect, such as "You might want to reconsider his suggestion," to a calmer expression such as "His suggestion might be worth reconsidering."

[0215] The following describes the processing flow for each example of the form.

[0216] "Example of form 1"

[0217] Step 1: Receive input information from the user.

[0218] Step 2: Analyze the message you want to convey based on the information you received.

[0219] Step 3: Based on the analysis results, convert the expression into one that respects the other party.

[0220] Step 4: Output the conversion result.

[0221] Step 5: Analyze the user's emotions from their input information.

[0222] Step 6: Convert the analyzed emotions into expressions of respect that take them into account.

[0223] "Example of form 2"

[0224] Step 1: Receive input information from the user.

[0225] Step 2: Analyze the message you want to convey based on the information you received.

[0226] Step 3: Based on the analysis results, convert the expression into one that respects the other party.

[0227] Step 4: Output the conversion result.

[0228] Step 5: Track changes in the user's emotions.

[0229] Step 6: Adjust your expression of respect based on changes in your feelings.

[0230] (Example 1)

[0231] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0232] In modern information exchange, it is a challenging task for users to appropriately express their emotions while maintaining respectful communication with others. In particular, when emotions are heightened, people may use expressions that lead to misunderstandings. Improving this situation and achieving smoother communication is essential.

[0233] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0234] In this invention, the server includes a device for receiving information from a user, a device for analyzing emotions based on the information, and a device for converting the analysis results into respectful language. This makes it possible to consider the user's emotions and convert them into respectful language, thereby enabling smooth communication.

[0235] A "user" is an individual or group that uses a system to input information and communicate.

[0236] "Information" refers to data that users input into the system, including their intentions, emotions, and relationships with others.

[0237] A "device" is a set of hardware or software components designed to perform a specific function.

[0238] A "device for analyzing emotions" is a device that has the function of identifying emotions from user input information and performing analysis based on those emotions.

[0239] A "device that converts into respectful expressions" is a device that, based on analyzed emotions, converts the user's intentions into expressions that appropriately convey them to the other party.

[0240] A "generative AI model" is a model that uses artificial intelligence technology to generate appropriate output from input data.

[0241] A "prompt statement" is an instruction given to a generative AI model to obtain a specific output.

[0242] The following system is constructed as an embodiment of this invention.

[0243] Users input information into the system using a terminal. This information includes the user's intentions, feelings, and relationships with others. For example, a user might input the intention "I think his suggestion is wrong" and the relationship "He is my boss."

[0244] The terminal sends the information received from the user to the server. The server uses an emotion analysis device to identify the user's emotions from the input information. This device analyzes the input data and determines what emotions the user is experiencing.

[0245] Next, the server uses a device that translates the user's intent into appropriate language based on the analyzed emotions, respecting the other party's perspective. This device utilizes a generative AI model to generate prompt sentences, creating expressions that effectively convey the user's intent to the other party.

[0246] As a concrete example, if a user inputs "I think his suggestion is wrong" and their emotion is "anger," the generative AI model is prompted with the following message: "If a user inputs 'I think his suggestion is wrong' and their emotion is 'anger,' please convert it into a respectful expression." Based on this prompt, the generative AI model generates the expression "Perhaps we should reconsider his suggestion."

[0247] Finally, the server sends the converted expression back to the terminal, which then displays the result to the user. This allows the user to express their emotions appropriately while communicating respectfully with others.

[0248] The flow of the specific processing in Example 1 will be explained using Figure 17.

[0249] Step 1:

[0250] The user inputs information into the system via a terminal. This information includes the user's intentions, feelings, and relationships with others. Specifically, the user inputs the intention, "I think his suggestion is wrong," and the relationship, "He is my boss." The input information is then sent from the terminal to the server.

[0251] Step 2:

[0252] The server passes the received information to a device that analyzes emotions. This device analyzes the user's input and identifies the emotion. For example, if the input intention is "I think his suggestion is wrong," the emotion is determined to be "anger." This analysis result is then used in the next step.

[0253] Step 3:

[0254] The server uses a device that translates analyzed emotions into respectful language. This device utilizes a generative AI model to generate prompt sentences. Specifically, the generative AI model is given the prompt sentence, "If the user inputs 'I think his suggestion is wrong' and the emotion is 'anger,' please translate it into respectful language." Based on this prompt sentence, the generative AI model generates the expression, "Perhaps we should reconsider his suggestion."

[0255] Step 4:

[0256] The server sends the generated expression back to the terminal. The terminal displays this conversion result to the user. The user can review the displayed content and communicate it to the other party as needed. This allows the user to express their emotions appropriately while engaging in respectful communication with others.

[0257] (Application Example 1)

[0258] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server," and the smart device 14 will be referred to as a "terminal."

[0259] In face-to-face customer service, a challenge exists in that it is difficult for store employees to properly understand customers' emotions and respond smoothly. In particular, there is a need to accurately grasp the emotions contained in customers' statements and to provide appropriate responses quickly.

[0260] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0261] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful expressions for the other party. This enables the server to analyze customer statements in real time, generate appropriate responses that correspond to emotions, and allow store staff to provide quick and appropriate customer service.

[0262] "Means of receiving user input information" refers to the methods by which the system acquires information provided by the user.

[0263] "Methods for analyzing what you want to convey" refers to methods of analyzing what should be communicated based on information received from the user.

[0264] "Methods for converting into respectful expressions" refer to methods of transforming expressions into forms that show respect to the other party, based on the analyzed content.

[0265] "Means for outputting conversion results" refers to a method of presenting the converted expression to the user or another system.

[0266] "Methods for converting speech to text using speech recognition technology" refers to technologies for converting speech data into textual information.

[0267] "Methods for analyzing user emotions using emotion analysis technology" refers to technologies for analyzing user emotions from their statements and actions.

[0268] "Means for displaying the conversion results on a smart device's display device" refers to a method of displaying the converted information on the screen of a smart device.

[0269] "Tools for supporting customer service in face-to-face services" are tools designed to support customer interaction when providing services directly to customers in person.

[0270] A "device for communication support" is a device used to facilitate the exchange of information.

[0271] The system for implementing this invention mainly consists of three elements: a server, a terminal, and a user. The server receives input information from the user and converts the speech to text using speech recognition technology. Specifically, it uses a speech recognition API such as Google Cloud Speech-to-Text. The converted text is then analyzed to determine the user's emotions using sentiment analysis technology. By using a sentiment analysis engine such as IBM Watson® Tone Analyzer, it is possible to accurately grasp the user's emotions.

[0272] Based on the analyzed emotional information, the server analyzes the message to be conveyed and transforms it into respectful language. A generative AI model is used to generate appropriate expressions. This transformation result is displayed on the smart device's display. For example, using smart glasses like Google Glass®, store employees can see appropriate responses to customers in real time.

[0273] As a specific example, when a customer says, "This product is too expensive," the server converts the voice into text and uses sentiment analysis technology to detect "dissatisfaction." Then, using a generative AI model, it generates a response such as, "It seems you're dissatisfied with the price. Would you like me to introduce some more affordable alternatives?" and displays it on the smart glasses.

[0274] As an example of a prompt sentence, "Customer's statement: 'This product is too expensive.' Sentiment: Dissatisfaction. Please generate an appropriate response." can be cited. By using this prompt sentence, the generative AI model can generate an appropriate response.

[0275] The flow of the specific process in Application Example 1 will be described using Figure 18.

[0276] Step 1:

[0277] The user performs voice input through the microphone of the smart device. The terminal captures this voice data and sends it to the server. The input is voice data, and the output is the voice data sent to the server.

[0278] Step 2:

[0279] The server uses speech recognition technology to convert the received voice data into text. Specifically, it uses the Google Cloud Speech-to-Text API to convert the voice into character information. The input is voice data, and the output is text data.

[0280] Step 3: [[ID=Y9]]

[0281] The server inputs the text data into sentiment analysis technology to analyze the user's sentiment. It uses the IBM Watson Tone Analyzer to extract sentiment from the text. The input is text data, and the output is sentiment information.

[0282] Step 4:

[0283] The server uses a generative AI model to generate respectful expressions based on emotional information and text data. It uses prompts to generate appropriate responses. The input is emotional information and text data, and the output is the transformed expression.

[0284] Step 5:

[0285] The server sends the generated representation to the terminal and displays it on the smart device's display. The terminal receives this information and displays it on its screen for the user to verify. The input is the converted representation, and the output is the information displayed on the smart device's screen.

[0286] (Example 2)

[0287] Next, we will describe Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0288] In modern communication, it is crucial to appropriately express what the user wants to convey and to show respect for the other person. However, choosing the appropriate expression depending on the user's emotional state and relationship with the other person is not easy. Therefore, there is a need for technology that can accurately convey the user's intentions while translating them into respectful expressions.

[0289] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0290] In this invention, the server includes means for receiving information from a user, means for using natural language processing technology to analyze the content based on the information, and means for tracking changes in emotion based on the analysis results and adjusting the expression to respect the other party. This makes it possible to accurately convey the user's intentions while converting them into respectful expressions.

[0291] A "user" is an entity that uses a system to input information and express what it wants to convey to others.

[0292] "Information" refers to the data that users input into the system, including the content they want to convey and their emotional state.

[0293] "Natural language processing technology" is a technology that enables computers to understand and analyze human language, and is used to analyze user input.

[0294] "Emotional changes" refer to how a user's emotional state changes over time or in response to changing circumstances, and this is something the system tracks.

[0295] "Respectful expression" refers to language that is adjusted to show respect to the other party when conveying the user's intentions.

[0296] "Means of adjustment" refer to methods and technologies for transforming user input into respectful expressions based on analysis results and changes in emotions.

[0297] This invention is a system that converts user-inputted information into respectful language. The system is composed of three main components: the user, the terminal, and the server.

[0298] Users input information into the system through their device. This information includes what the user wants to convey and their emotional state. The device's role is to transmit the user's input to the server.

[0299] The server uses natural language processing techniques to analyze the information it receives. This analysis employs natural language processing models, such as generative AI models. Specifically, Google's BERT and OpenAI's GPT are examples of such models. These models are used to understand the user's input and grasp what the user wants to convey and the degree of respect they show to the other party.

[0300] Furthermore, the server uses an emotion engine to track changes in the user's emotions. The emotion engine has the role of detecting changes in emotions based on the user's input and adjusting the expression to show respect for the other party based on the analysis results.

[0301] As a specific example, when the user inputs "I think his proposal is wrong" and the emotion at that time changes from "anger" to "calm", the server uses the emotion engine to track that change. Then, the server adjusts to a calm expression such as "His proposal may be worth reconsidering."

[0302] An example of a prompt sentence is: "Analyze the user's input sentence, consider the change in emotion, and convert it into an expression that shows respect for the other party. Input sentence: 'I think his proposal is wrong' Change in emotion: from 'anger' to 'calm'".

[0303] The flow of the specific process in Example 2 will be described using FIG. 19.

[0304] Step 1:

[0305] The user inputs information into the system through the terminal. This information includes the content the user wants to convey and the emotional state. The input information is sent from the terminal to the server.

[0306] Step 2:

[0307] The server uses natural language processing technology to analyze the information received from the terminal. Specifically, it uses a generative AI model to understand the user's input content and grasp the content the user wants to convey and the degree of respect for the other party. Through this analysis, the intention of the input information becomes clear.

[0308] Step 3:

[0309] The server operates the emotion engine based on the analysis results. The emotion engine detects changes in emotion based on user input. For example, if the user's emotion changes from "anger" to "calmness," it tracks that change. In this process, data is acquired on how the input emotional state changed.

[0310] Step 4:

[0311] The server adjusts the user's message based on emotional changes. Specifically, it considers the analysis results and emotional shifts to transform the message into a respectful expression. This transformation generates a message that accurately conveys the user's intent while showing respect to the recipient.

[0312] Step 5:

[0313] The server sends the adjusted message back to the user. The user can check this message through their terminal. The output message reflects the user's intentions while also being considerate of the recipient.

[0314] (Application Example 2)

[0315] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0316] In modern information processing systems, it is crucial to appropriately analyze user emotions and translate them into respectful expressions. However, conventional systems have struggled to track changes in user emotions in real time and adjust their expressions accordingly. This creates a challenge where misunderstandings and discomfort can arise in communication between users and systems.

[0317] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0318] In this invention, the server includes means for receiving input information from the user, means for analyzing the content to be conveyed based on the input information, and means for tracking changes in the user's emotions and adjusting expressions of respect based on those changes in emotions. This makes it possible to generate appropriate and respectful expressions in real time that correspond to the user's emotions, thereby reducing misunderstandings and discomfort.

[0319] "Means of receiving user input information" refers to the function that allows the system to acquire information provided by the user.

[0320] "Means for analyzing what you want to convey" refers to a function that processes user input information to understand what that information is trying to communicate.

[0321] "Means of converting into respectful expressions" refers to a function that converts the analyzed content into respectful expressions towards the other party.

[0322] "Means for tracking changes in user emotions and adjusting expressions of respect" refers to a function that monitors changes in user emotions in real time and appropriately adjusts expressions in response to those changes.

[0323] "Means for outputting conversion results" refers to a function for providing the converted expression to the user or other systems.

[0324] This section describes the embodiments for carrying out the invention. This invention is a system that generates appropriate and respectful expressions in response to the user's emotions. The system receives input information from the user and analyzes that information to understand what the user wants to convey. Natural language processing technology is used for the analysis. Based on the analysis results, it converts the information into respectful expressions. Furthermore, it tracks changes in the user's emotions and adjusts the expressions accordingly.

[0325] This system operates on smartphones and servers. The program is written in Python and uses the Hugging Face Transformers library for natural language processing. A BERT-based sentiment analysis model is used for sentiment analysis. The server functions as an API server using Flask, receiving user input and returning analysis results.

[0326] For example, if a user enters "Payment failed," the server uses a sentiment analysis model to interpret this as "dissatisfaction." As a result, the system generates a response such as "We apologize for the inconvenience." If the user's sentiment changes to "calm," the response is adjusted to "We will do our best to support you in resolving the issue."

[0327] An example of a prompt message is as follows:

[0328] User input: "Payment failed"

[0329] Emotion analysis: "Dissatisfaction"

[0330] Response generated: "We apologize for any inconvenience this may cause."

[0331] The flow of a specific process in Application Example 2 will be explained using Figure 20.

[0332] Step 1:

[0333] The user provides input information using a terminal. This input information is text data that includes the user's emotions and intentions. This data is sent to the server.

[0334] Step 2:

[0335] The server analyzes the received input information using natural language processing techniques. Specifically, it uses the Hugging Face Transformers library to analyze the sentiment of the input text. The input is user text data, and the output is a sentiment label (e.g., "dissatisfied," "calm").

[0336] Step 3:

[0337] The server translates the analysis results into respectful language. Using a generative AI model, it generates appropriate responses corresponding to emotion labels. The input is an emotion label, and the output is a respectful response text.

[0338] Step 4:

[0339] The server tracks changes in the user's emotions and adjusts its response as needed. If an emotional change is detected, it uses the regenerative AI model to generate an adjusted response. The input is information about the emotional change, and the output is the adjusted response text.

[0340] Step 5:

[0341] The server sends the final response to the terminal and displays it to the user. The user can review the displayed response and provide further input information as needed.

[0342] (Example 3)

[0343] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0344] In modern communication, users are required to express their true feelings in a way that respects the other person. However, it is difficult for users to come up with such expressions themselves, and it is also difficult for them to adjust their expressions appropriately according to changes in their emotions. This can lead to misunderstandings and conflicts, so a system is needed to resolve this.

[0345] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0346] In this invention, the server includes means for receiving information from the user, means for analyzing the content based on the information, means for converting the analysis results into respectful expressions, means for tracking changes in the user's emotions and adjusting the respectful expressions based on those changes in emotions, and means for performing analysis and conversion using a generative AI model. As a result, when a user conveys their true feelings to another person, the server automatically converts them into respectful expressions and further uses expressions that are appropriately adjusted according to changes in emotions.

[0347] "Means of receiving information from users" refers to an interface for obtaining text data entered by users.

[0348] "Means of content analysis" refers to the process of analyzing acquired text data to understand its intent and emotions.

[0349] "Methods for converting into respectful expressions" refers to a process that, based on analysis results, converts the user's true feelings into expressions that are considerate of the other person.

[0350] "Means for outputting conversion results" refers to an interface for presenting the converted text to the user.

[0351] "Means for tracking changes in a user's emotions and adjusting expressions of respect based on those changes" refers to a process for monitoring changes in a user's emotions and appropriately adjusting expressions in response to those changes.

[0352] "Means of performing analysis and transformation using a generative AI model" refers to the process of performing analysis and transformation of text data using a pre-trained artificial intelligence model.

[0353] "Tools for organizational management" refer to systems and software used to facilitate human resource management and communication within an organization.

[0354] An "automatic response program for communication devices" is a program that automatically responds to inquiries and messages from users.

[0355] This invention is a system that analyzes text entered by a user and converts it into respectful language. The system includes a user terminal, a server, a generative AI model, and an emotion engine.

[0356] The user enters text through the terminal. This text contains the user's true feelings. For example, they might enter, "I think his suggestion is wrong." The terminal then sends this input to the server.

[0357] The server sends the received text to a generating AI model. This model uses natural language processing techniques to analyze the text and understand the user's intent and emotions. Specifically, it grasps the context of the text and determines what kind of expression is respectful to the recipient.

[0358] Based on the analysis results, the server transforms the user's true feelings into respectful expressions. This transformation uses a pre-trained generative AI model. For example, the true feeling "I think his proposal is wrong" is changed to "It might be necessary to consider his proposal from a different perspective."

[0359] Furthermore, the server uses an emotion engine to track changes in the user's emotions. If the user's emotion changes from "anger" to "calmness," the server takes this change into account and further adjusts its expression of respect. Specifically, it might change the expression "Perhaps we should reconsider his proposal" to "Perhaps his proposal is worth reconsidering."

[0360] Ultimately, the server sends the converted text to the terminal, which then displays it to the user. This allows the user to use respectful language towards the other party.

[0361] As a concrete example, the following is an example of a prompt sentence to be input to the generation AI model: "User input: 'I think his suggestion is wrong.' Emotional state: Changed from 'angry' to 'calm.' Please generate a respectful expression." With this prompt, the system generates an appropriate expression. The flow of specific processing in Example 3 will be explained using Figure 21.

[0362] Step 1:

[0363] The user enters text through the terminal. The entered text contains the user's true feelings. For example, they might enter, "I think his proposal is wrong." This input is sent from the terminal to the server.

[0364] Step 2:

[0365] The server sends the text received from the terminal to a generative AI model. The generative AI model analyzes the text using natural language processing techniques. Specifically, it understands the context of the text and grasps the user's intent and emotions. Through this analysis, it determines what kind of expression is respectful to the other person. The analysis results are returned to the server.

[0366] Step 3:

[0367] The server translates the user's true feelings into respectful expressions based on the analysis results from the generating AI model. This translation process uses a pre-trained model. For example, the true feeling "I think his proposal is wrong" is changed to "It might be necessary to consider his proposal from a different perspective." The translated text is stored on the server.

[0368] Step 4:

[0369] The server uses an emotion engine to track changes in the user's emotions. If the user's emotion changes from "anger" to "calmness," the server takes this change into account and further adjusts its expressions of respect. Specifically, it adjusts the expression "Perhaps we should reconsider his proposal" to "Perhaps his proposal is worth reconsidering." The adjusted text is updated within the server.

[0370] Step 5:

[0371] The server sends the final converted and adjusted text to the terminal. The terminal displays this text to the user. This allows the user to use respectful language towards the other party.

[0372] (Application Example 3)

[0373] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0374] In customer service interactions within electronic transactions, operators are required to communicate with customers using appropriate and respectful language. However, operators may become emotional or struggle to immediately think of appropriate expressions, potentially leading to decreased customer satisfaction. To address this problem, a system is needed that converts operator input into respectful language in real time and sends it to the customer.

[0375] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0376] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful language. This makes it possible to convert the information entered by the operator into respectful language in real time and transmit it to the customer.

[0377] "Means of receiving user input information" refers to an interface for obtaining information that users provide to the system.

[0378] "Means of analyzing what you want to convey" refers to a function that processes information entered by the user to understand the intent and meaning of that information.

[0379] "Means of converting into respectful language" refers to a function that converts the analyzed content into language that is considerate of the other person.

[0380] "Means for outputting conversion results" refers to a function for presenting the converted expression to the user or another system.

[0381] "Means for tracking emotional changes and adjusting expressions of respect" refers to a function that monitors changes in the user's emotions and appropriately adjusts expressions in response to those changes.

[0382] "Means to support customer service in electronic transactions" refers to support functions provided by the system to enable operators to provide appropriate service to customers in electronic transaction settings.

[0383] A description of the embodiment for carrying out the invention will be provided.

[0384] The system for realizing this invention mainly consists of a server and a user terminal. The server receives input information from the user, analyzes that information, and understands what the user wants to convey. Natural language processing technology is used for the analysis, specifically a generative AI model utilizing the Transformers library. Based on the analysis results, processing is performed to convert the message into an expression that respects the recipient. The converted expression is output to the user terminal in text format.

[0385] Furthermore, the server uses sentiment analysis tools such as TextBlob and NLTK to track changes in the user's emotions. It has the ability to adjust expressions of respect according to changes in emotions. This ensures that appropriate expressions are provided according to the user's feelings.

[0386] For example, if a user types "This problem is your mistake," the system will translate this to "Could you please let me know more about this problem?" An example of a prompt would be, "Please translate the user's input into a respectful expression. Input: 'This problem is your mistake'."

[0387] In this way, a system is built to support customer service in electronic transactions. Operators can communicate with customers in real time using appropriate language.

[0388] The flow of the specific processing in Application Example 3 will be explained using Figure 22.

[0389] Step 1:

[0390] The user provides input information through their device. This input information is text data containing the user's true feelings and opinions. The device sends this input information to the server.

[0391] Step 2:

[0392] The server analyzes the received input information. This analysis utilizes natural language processing techniques and a generative AI model powered by the Transformers library. By analyzing the input information, it understands the intended message and intent. This analysis result forms the basis for the next step.

[0393] Step 3:

[0394] The server converts the input into respectful language based on the analysis results. It uses a generative AI model to transform the input information into more considerate language. This transformation process uses prompts to generate appropriate output. For example, it might use the prompt: "Please convert the user's input into respectful language. Input: 'This problem is your mistake.'"

[0395] Step 4:

[0396] The server tracks changes in the user's emotions. TextBlob and NLTK are used for sentiment analysis. It analyzes the emotions in the input information and monitors how emotions change over time. It adjusts expressions of respect according to these emotional changes.

[0397] Step 5:

[0398] The server outputs the converted expression to the terminal. The terminal presents this output to the user. The user reviews the converted expression and sends it to the customer as needed. This enables the user to communicate appropriately with the customer in real time.

[0399] (Other examples)

[0400] Next, other embodiments will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0401] In modern communication, accurately understanding a user's intentions and emotions and conveying them appropriately is crucial. However, conventional systems struggle to generate expressions that fully consider user intentions and emotions, potentially leading to misunderstandings and inappropriate communication. To solve this problem, a system is needed that accurately analyzes user intentions and emotions and generates respectful expressions based on that analysis.

[0402] The identification process performed by the identification processing unit 290 of the data processing device 12 in other embodiments is realized by the following means.

[0403] In this invention, the server includes means for receiving input information from a user; means for analyzing the input information using natural language processing technology and evaluating the user's intentions and degree of respect for the other party; means for generating prompts using a generative AI model based on the evaluation results to instruct the server to convert the input information into respectful expressions; means for tracking changes in the user's emotions using emotion analysis technology and adjusting the expressions of respect based on the changes in emotions; and means for outputting the conversion results. This enables natural and effective communication that takes into account the user's intentions and emotions.

[0404] "Means of receiving user input information" refers to a function that allows the server to receive text data entered by the user through their device.

[0405] "Natural language processing technology" refers to techniques that enable computers to understand and analyze human language, and involves processing such as text tokenization and part-of-speech tagging.

[0406] "Means for evaluating the user's intent and the degree of respect for the other party" refers to a function that analyzes input information to determine what the user wants to communicate and to what extent that expression shows respect for the other party.

[0407] A "generative AI model" is a model used to generate text using artificial intelligence, and includes, for example, OpenAI's GPT-3.

[0408] "Means for generating prompts" refers to a function that creates text to provide specific instructions to the generative AI model.

[0409] "Emotion analysis technology" is a technology that analyzes emotions from user input information and tracks changes in those emotions.

[0410] "Means for adjusting expressions of respect" refers to a function that appropriately modifies expressions of respect towards others based on analyzed changes in emotions.

[0411] "Means for outputting conversion results" refers to a function that provides the user with text generated by the generative AI model.

[0412] This invention is a system that enables natural and effective communication while taking into account the user's intentions and emotions. Specific embodiments of this system are described below.

[0413] The server receives input information sent from the user's terminal. This information is text data entered by the user via keyboard or voice input. The server uses the Python NLTK library to parse the received text data. Specifically, it tokenizes the text, tags parts of speech, and evaluates the user's intent and degree of respect for the other party. This evaluation is based on keywords and phrases within the text.

[0414] Based on the analysis results, the server generates prompt statements to be input into the generated AI model (e.g., OpenAI's GPT-3). These prompt statements provide specific instructions to the AI ​​model. An example of a prompt statement would be: "The user wants to change the meeting time. Please generate a proposal that takes the other party's availability into consideration."

[0415] Furthermore, the server uses the Google Cloud Natural Language API to analyze the user's emotions. The analyzed emotion data is used to track changes in the user's emotions. For example, if the user is feeling anxious, the server adjusts the prompts to the generative AI model to select more polite expressions.

[0416] The generative AI model takes a prompt as input and generates a respectful expression. The generated text reflects the user's intentions and feelings, and may take the form of, for example, "I would like to change the meeting time; would that be convenient for you?"

[0417] The server sends the generated conversion result to the user's terminal, which displays it on the screen. The user reviews the displayed message and decides on the next action. This allows the user to communicate appropriately with the other party.

[0418] The flow of specific processing in other embodiments will be explained using Figure 23.

[0419] Step 1:

[0420] The server receives input information sent from the user's terminal. This input information is text data entered by the user via keyboard or voice input. The server temporarily stores this text data to pass it on to the next processing step.

[0421] Step 2:

[0422] The server analyzes the received text data using natural language processing techniques. Specifically, it uses the Python NLTK library to tokenize the text and tag it with parts of speech. This allows the server to evaluate the user's intent (e.g., changing the meeting time) and the degree of respect shown to the other party. The results of this analysis are then used to generate prompt messages.

[0423] Step 3:

[0424] The server generates prompt statements to input into the AI ​​model based on the analysis results. These prompt statements provide specific instructions to the AI ​​model. For example, one might say, "The user wants to change the meeting time. Please generate a proposal that takes the other party's availability into consideration." This prompt statement will be used in the next step.

[0425] Step 4:

[0426] The server uses the Google Cloud Natural Language API to analyze the user's emotions. The input is the user's text data. The analyzed emotion data is used to track changes in the user's emotions and to adjust prompt messages. For example, if the user is feeling anxious, the server will adjust the prompt message to generate more polite language.

[0427] Step 5:

[0428] The server inputs a prompt into a generative AI model, which then generates a respectful expression. The generative AI model (e.g., OpenAI's GPT-3) generates text based on the prompt and returns it to the server as output. The generated text reflects the user's intent and emotions.

[0429] Step 6:

[0430] The server sends the generated conversion result to the user's terminal. The terminal displays the received text on the screen. The user reviews the displayed message and decides on the next action. This allows the user to communicate appropriately with the other party.

[0431] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0432] Data generation model 58 is a form of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0433] Other examples of generative AI include Gemini® (registered trademark) (Internet search). <url: https: gemini.google.com ?hl="ja">) are some examples.

[0434] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0435] [Second Embodiment]

[0436] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0437] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0438] The data processing device 12 includes a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a “computer” related to the technology of this disclosure.

[0439] Computer 22 includes a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. A database 24 and a communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0440] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0441] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0442] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0443] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0444] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0445] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0446] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0447] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0448] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[0449] "Example of form 1"

[0450] One embodiment of the present invention is a system used as a bot for a communication tool. This system has a means of receiving input information from the user. The user inputs their true feelings and their relationship with the other person. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[0451] "Example of form 2"

[0452] Next, the system has a means to analyze the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect shown to the recipient when conveying that message.

[0453] "Example of form 3"

[0454] Furthermore, the system has a means of converting the analysis results into respectful expressions. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[0455] "Example of form 4"

[0456] Finally, the system has a means of outputting the conversion results. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[0457] The following describes the processing flow for each example of the form.

[0458] "Example of form 1"

[0459] Step 1: The user inputs their true feelings and their relationship with the other person into the communication tool bot. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[0460] Step 2: The system analyzes the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect the user will show to the recipient when conveying that message.

[0461] Step 3: The system converts the analysis results into a respectful expression. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[0462] Step 4: The system outputs the conversion result. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[0463] (Example 1)

[0464] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0465] In modern information exchange, it is difficult for users to find appropriate communication methods that consider both their true feelings and their relationship with the other person. Especially in workplace and organizational communication, it is necessary to effectively convey one's own opinions while respecting others, but finding concrete ways to do so is not easy.

[0466] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0467] In this invention, the server includes means for receiving input information from a user, means for converting the input information into a data format and transmitting it, and means for performing analysis using a generated artificial intelligence model based on the input information. This makes it possible for users to easily obtain appropriate communication methods based on their true feelings and their relationship with the other person.

[0468] A "user" refers to an individual or organization that provides input information to the system.

[0469] "Input information" refers to data that users provide to the system, specifically including information about the user's true feelings and their relationship with the other party.

[0470] "Data format" refers to the format in which information is converted into a form that can be processed by a computer.

[0471] A "generative artificial intelligence model" refers to a machine learning model used for natural language processing, specifically a technology that performs analysis based on user input.

[0472] "Analysis" refers to information processing that uses input information to derive appropriate communication methods.

[0473] "Communication methods" refer to the specific means and expressions that indicate how a user should convey information to another person.

[0474] "Organizational management" refers to management activities aimed at the efficient operation of personnel and operations within an organization.

[0475] "Information exchange" refers to the act of transmitting information between individuals or groups.

[0476] An "automatic response program" refers to software that automatically generates responses in response to user input.

[0477] The following system configurations are possible as embodiments for carrying out this invention.

[0478] Users input their true feelings and their relationship with the other person using a device. The device is a smartphone or personal computer, providing an interface for receiving the information entered by the user. The information entered by the user is collected through text boxes.

[0479] The terminal converts the input information received from the user into a data format and sends it to the server. During this process, the data is converted to a standard data format such as JSON and transmitted securely using the HTTPS protocol.

[0480] The server uses a generative artificial intelligence model to analyze the received data. Specifically, it can utilize a general machine learning model as a generative AI model for natural language processing. For example, OpenAI's GPT-3 is one such model. This model generates appropriate communication methods based on the user's true feelings and relationship with them.

[0481] The generated communication method is sent from the server to the terminal. The terminal displays the received information to the user, who can then use it as a reference to communicate with the other party.

[0482] For example, if a user inputs the information "I think his proposal is wrong" and "He is my boss," the generating AI model will generate a communication method such as "When dealing with your boss, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." An example of a prompt might be, "Please suggest an appropriate communication method based on the user's true feelings and their relationship with the other person."

[0483] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0484] Step 1:

[0485] The user uses their device to input their true feelings and their relationship with the other person. Specifically, they enter information such as "I think his suggestion is wrong" and "He is my boss" into the text box on the device. The entered information is temporarily stored on the device.

[0486] Step 2:

[0487] The terminal converts the input information received from the user into a data format and sends it to the server. Specifically, it converts the input information into JSON format and sends it to the server using the HTTPS protocol. At this time, the input information is structured as a JSON object with keys for "true feelings" and "relationship".

[0488] Step 3:

[0489] The server parses the received JSON data. Specifically, it uses a generative AI model to generate appropriate communication methods based on the user's true feelings and relationship with the other party. The server inputs the prompt "Please suggest an appropriate communication method based on the user's true feelings and relationship with the other party" into the generative AI model and performs the analysis.

[0490] Step 4:

[0491] The server sends the analysis results obtained from the generated AI model to the terminal in JSON format. Specifically, it structures the generated communication method as a JSON object with the key "proposal" and sends it to the terminal using the HTTPS protocol.

[0492] Step 5:

[0493] The terminal parses the JSON data received from the server and displays a generated communication method to the user. Specifically, the terminal screen displays a message such as, "When communicating with your superior, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." The user can then use this suggestion as a reference when communicating with others.

[0494] (Application Example 1)

[0495] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0496] In face-to-face services, smooth communication with customers is crucial, but accurately understanding their true feelings and emotions and responding appropriately is a challenging task. In particular, making instantaneous decisions about appropriate responses based on a customer's facial expressions and relationship with them has been difficult with traditional methods.

[0497] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0498] In this invention, the server includes means for receiving input information from the user, means for acquiring video data and analyzing a person's facial expressions, and means for generating a response based on a prompt sentence using a generative AI model. This enables the automatic generation of appropriate responses based on the customer's facial expressions and relationship, facilitating smooth communication in face-to-face services.

[0499] "Means of receiving user input information" refers to the methods and devices by which the system acquires data and information provided by the user.

[0500] "Means for analyzing what you want to convey" refers to methods or devices that process information received from users to understand their intentions and objectives.

[0501] "Means of converting into respectful expressions" refers to methods or devices that convert analyzed content into appropriate and polite expressions for the other party.

[0502] "Means for outputting conversion results" refers to methods or devices for presenting the converted information to a user or other system.

[0503] "Means for acquiring video data and analyzing a person's facial expressions" refers to methods or devices for acquiring video using cameras or other equipment and analyzing the facial expressions of people within that video.

[0504] "Means for generating appropriate responses based on facial expression data and relationships" refers to methods or devices for determining the optimal response or action by considering the relationship between the analyzed facial expression information and the user.

[0505] "Means for generating responses based on prompt sentences using a generative AI model" refers to methods or devices that utilize artificial intelligence models to generate appropriate responses based on given prompt sentences.

[0506] The system for carrying out this invention includes a terminal for receiving input information from a user, a camera for acquiring video data, and a server for processing this data. The server receives the information provided by the user and analyzes the content the user wants to convey based on that information. The analyzed content is converted into respectful language and output as an appropriate response.

[0507] The server analyzes facial expressions from video data acquired using a camera. Specifically, it uses image processing libraries such as OpenCV to recognize facial expressions in real time. The recognized facial expression data is considered along with the relationship with the user and used as basic data to generate appropriate responses.

[0508] The system utilizes a generative AI model to generate responses based on prompts. For example, it can use the OpenAI API to input a prompt and obtain an appropriate response. A specific example of a prompt would be, "The customer's expression indicates dissatisfaction, and they are a regular customer. Please suggest an appropriate response." Based on this prompt, the AI ​​model generates the optimal response for the customer.

[0509] This system is expected to facilitate smoother communication in face-to-face services and improve customer satisfaction.

[0510] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0511] Step 1:

[0512] The terminal receives input information from the user. This input information includes the user's true feelings and their relationship with the other party. This information is sent to the server and used as basic data for analysis.

[0513] Step 2:

[0514] The server acquires video data using a camera and analyzes people's facial expressions. It uses image processing libraries such as OpenCV to recognize facial expressions in real time. The input is video data from the camera, and the output is the analyzed facial expression data.

[0515] Step 3:

[0516] The server generates prompt text based on user input and analyzed facial expression data. This prompt text includes the user's true feelings, their relationship with the other person, and facial expression data. This prepares the input for the generating AI model.

[0517] Step 4:

[0518] The server generates responses based on prompts using a generative AI model. Using the OpenAI API, prompts are input, and appropriate responses are obtained. The input is the prompt, and the output is the generated response.

[0519] Step 5:

[0520] The server sends the generated response to the terminal and presents it to the user. This allows the user to know how to proceed appropriately. The output is the response presented to the user.

[0521] (Example 2)

[0522] Next, we will describe Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0523] In modern communication, it is crucial to accurately analyze what a user wants to convey and translate it into expressions that show appropriate respect for the recipient. However, conventional technologies have a challenge in generating expressions that fully consider the user's intentions and the recipient's feelings.

[0524] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0525] In this invention, the server includes means for receiving information from a user, means for analyzing the information using natural language processing technology, and means for evaluating the user's intentions and the degree of respect shown to the other party based on the analysis results. This makes it possible to accurately grasp the user's intentions and generate expressions that show appropriate consideration for the other party.

[0526] A "user" is an entity that uses a system to input information and receive analysis results.

[0527] "Information" refers to text data that users input into the system, including the user's intentions and considerations for others.

[0528] "Natural language processing technology" refers to techniques that enable computers to understand and analyze human language, and includes tokenization, part-of-speech tagging, and dependency analysis.

[0529] "Analysis" is the process of processing information using natural language processing technology to identify the user's intentions and the degree of respect they have for the other party.

[0530] "Evaluation" is the act of judging the user's intentions and the degree of respect they show to others, based on the analysis results.

[0531] "Output" refers to the process of providing the user with the results of the analysis and evaluation.

[0532] A "system" is a device or program that includes a set of means for receiving, analyzing, evaluating, and outputting information from a user.

[0533] This invention is a system that analyzes information entered by a user and evaluates their intent and the degree of respect shown to the other party. The server receives information from the user and performs analysis using natural language processing technology. This analysis uses natural language processing libraries such as "spaCy" and "NLTK". These libraries enable text tokenization, part-of-speech tagging, and dependency analysis, and are used to accurately grasp the user's intent.

[0534] The server evaluates the user's intent and the degree of respect shown to the recipient based on the analysis results. The evaluation results are output to the user via their device. This allows the user to see how their message is interpreted and how much consideration they have shown to the recipient.

[0535] For example, if a user enters the message, "Could you please change the meeting time?", the server analyzes this message and understands that the user is requesting a change in the meeting time. Furthermore, the use of polite language indicates a high degree of respect for the other party.

[0536] An example of a prompt to input into the generating AI model is, "Analyze the polite language used by the user when requesting a change in meeting time, and evaluate the degree of respect shown to the other party." This prompt allows the system to accurately analyze the user's intent and make an appropriate evaluation.

[0537] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0538] Step 1:

[0539] The user inputs information into the system via a terminal. This information is text data containing the message the user wants to convey. The terminal then sends this input information to the server.

[0540] Step 2:

[0541] The server analyzes the received information using natural language processing techniques. Specifically, the server uses libraries such as "spaCy" and "NLTK" to tokenize the text, tag it with parts of speech, and perform dependency analysis. This analysis identifies the user's intent and grasps the semantic structure of the text. The input is the user's text data, and the output is the analyzed intent and structural information.

[0542] Step 3:

[0543] The server evaluates the user's intent and the degree of respect shown to the other party based on the analysis results. Specifically, it checks whether polite language and respectful expressions are included and determines the extent of consideration shown to the other party. The input is the analyzed intent and structural information, and the output is the result of identifying the intent and evaluating the degree of respect.

[0544] Step 4:

[0545] The server returns the evaluation results to the user. The terminal displays these results to the user. Specifically, it includes a summary of what the user wants to convey and an evaluation of the degree of respect shown to the other party. The input is the evaluation result, and the output is the evaluation information presented to the user.

[0546] (Application Example 2)

[0547] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0548] In modern electronic transaction services, there is a demand for prompt and appropriate responses to user inquiries and complaints. However, accurately understanding the user's intentions and level of respect can be difficult, sometimes leading to a decline in the quality of service. Therefore, a system is needed that analyzes the user's intentions and level of respect, and proposes appropriate response methods.

[0549] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0550] In this invention, the server includes means for receiving information from a user, means for analyzing the content to be conveyed based on the information, and means for proposing a response method based on the analysis results. This enables an accurate understanding of the user's intentions and degree of respect, and allows for a quick and appropriate response.

[0551] "Means of receiving information from users" refers to the methods by which the system acquires data and messages provided by users.

[0552] "Methods for analyzing the message to be conveyed" refers to methods of processing data based on acquired information in order to understand the user's intentions and objectives.

[0553] "Methods for converting information into respectful language" refer to methods of reconstructing information in a way that shows respect to the other party, based on the analysis results.

[0554] "Means for outputting conversion results" refers to a method for providing the reconstructed information to a user or other system.

[0555] "Means of proposing response methods" refers to methods for presenting optimal countermeasures or responses based on analysis results.

[0556] "User intent" refers to the purpose or desire that the user is trying to convey through the system.

[0557] "Degree of respect" refers to the level of respect and attitude that a user shows towards another person.

[0558] "Electronic transaction service support tools" are auxiliary systems and applications used to facilitate online commercial transactions.

[0559] The "automatic response function of the dialogue support tool" is a function that automates communication with users and enables efficient responses.

[0560] A description of the embodiment for carrying out the invention will be given.

[0561] This invention is a system that receives information from a user, analyzes the user's intentions and degree of respect towards the other party based on that information, and proposes an appropriate response method. The system consists of a server and a user terminal.

[0562] The server receives messages sent from the user's terminal. The received messages are analyzed using natural language processing techniques. This analysis utilizes the Python programming language and natural language processing libraries such as spaCy and Transformers. The analysis results in an estimation of the user's intent and level of respect.

[0563] Based on the analysis results, the server uses a generative AI model to propose an appropriate response. This proposal is sent to the user's terminal and presented to the user. The user can then use the proposed response as a reference to communicate appropriately with the other party.

[0564] For example, if a user sends a message saying, "There was a problem with my recent transaction. Please address it urgently," the server analyzes this message and understands the user's intent ("there is a problem") and the degree of respect expressed ("urgently"). Based on this, the server proposes and presents a prompt solution to the user.

[0565] An example of a prompt message is: "Analyze the user's message and estimate its intent and level of respect. Message: 'There was a problem with a recent transaction. Please address it as soon as possible.'"

[0566] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0567] Step 1:

[0568] The user uses a terminal to input a message and sends it to the server. The input message is natural language text containing the user's intentions and requests. The server receives this message.

[0569] Step 2:

[0570] The server tokenizes received messages using the natural language processing library spaCy and analyzes their grammatical structure. The input is the user's message, and the output is the tokenized words and their grammatical relationships. This process clarifies the message's structure.

[0571] Step 3:

[0572] The server uses Transformers to estimate the user's intent and level of respect from tokenized messages. The input is a tokenized message, and the output is a numerical value or label indicating the user's intent and level of respect. This process allows the meaning of the message to be understood.

[0573] Step 4:

[0574] The server uses a generative AI model to generate appropriate responses based on estimated intent and respect levels. The input is the intent and respect levels, and the output is the proposed response. This process determines the optimal response for the user.

[0575] Step 5:

[0576] The server sends the generated response method to the user's terminal. The user reviews the proposed response method on their terminal and, if necessary, uses it as a reference to reply to the other party. The input is the proposed response method, and the output is the user's confirmation and use. This process enables the user to communicate appropriately.

[0577] (Example 3)

[0578] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0579] In modern communication, it is crucial for users to translate their true feelings into respectful expressions, but doing so manually is difficult and time-consuming. Furthermore, there is a lack of technology to automatically generate appropriate expressions that take into account the user's intentions and relationship.

[0580] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0581] In this invention, the server includes means for receiving information from the user, means for using a generative AI model to analyze the information, and means for transforming the expression based on the analysis results. This makes it possible to automatically transform the user's true feelings into expressions that respect the other party.

[0582] A "user" is an entity that uses a system to input information and receives the converted results.

[0583] "Information" refers to text data that users input into the system, including the user's intentions and relationships.

[0584] A "generative AI model" is an artificial intelligence technology used to analyze input information and perform appropriate transformations.

[0585] "Analysis" is the process of using a generative AI model to understand the intent and emotions behind the input information and extract the foundational data for transformation.

[0586] "Conversion" is the process of replacing input information with respectful expressions based on the analysis results.

[0587] "Output" refers to the process of presenting the converted result to the user.

[0588] A "server" is a computer system that receives information from users, analyzes and transforms it, and outputs the results.

[0589] One embodiment of this invention includes a process in which a user inputs information using a terminal, and a server analyzes and transforms that information.

[0590] The server communicates with the terminal over the network to receive information from the user. The user enters text into the terminal's input field. For example, they might enter information such as "I think his suggestion is wrong."

[0591] The server uses a generative AI model to analyze the information it receives. This model uses natural language processing techniques to understand the intent and sentiment of the input information. Specifically, it can use generative AI models such as OpenAI's GPT-3.

[0592] After the analysis is complete, the server transforms the information based on the analysis results. The purpose of the transformation is to replace the user's true feelings with expressions that respect the other party. For example, the information "I think his proposal is wrong" is transformed into the expression "It might be necessary to consider his proposal from a different perspective."

[0593] The converted information is sent from the server to the terminal and presented to the user. This allows the user to communicate in a way that is considerate of the other person.

[0594] A concrete example of a prompt sentence is, "Please rephrase the following sentence in a respectful manner: I think his suggestion is wrong." By inputting this prompt sentence into the generation AI model, an appropriate transformation is performed. The flow of the specific processing in Example 3 will be explained using Figure 15.

[0595] Step 1:

[0596] The user inputs information using a terminal. The user enters their honest opinion in text format into the terminal's input field. For example, they might enter, "I think his proposal is wrong." This input information becomes the basis for subsequent analysis and transformation.

[0597] Step 2:

[0598] The terminal sends the entered information to the server. The terminal sends the text entered by the user to the server via an HTTP request. This transmission allows the server to receive the data for analysis and transformation.

[0599] Step 3:

[0600] The server inputs the received information into a generative AI model. The server then uses the generative AI model to analyze the information. This model utilizes natural language processing techniques to understand the intent and emotions behind the input information. Based on the analysis, it determines how the information should be transformed.

[0601] Step 4:

[0602] The server transforms the information based on the analysis results. Based on the analysis results, the server transforms the input information into respectful language. For example, the information "I think his proposal is wrong" is transformed into "It might be necessary to consider his proposal from a different perspective." This transformation ensures that the user's true feelings are expressed in a way that is considerate of the other person.

[0603] Step 5:

[0604] The server sends the converted information to the terminal. The server sends the conversion result to the terminal via an HTTP response. This transmission prepares the terminal to present the conversion result to the user.

[0605] Step 6:

[0606] The terminal displays the conversion results to the user. The terminal displays the conversion results received from the server to the user. The user can check this converted information and use it when communicating it to the other party. This enables the user to communicate in a way that is considerate of the other person.

[0607] (Application Example 3)

[0608] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0609] In modern face-to-face customer service, polite and considerate communication with customers is crucial. However, it is difficult for staff to instantly choose the appropriate expression, which hinders the improvement of customer satisfaction. Therefore, there is a need for a system that allows staff to use respectful language with customers in real time.

[0610] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0611] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful language. This enables staff to use appropriate language with customers in real time.

[0612] "Means of receiving user input information" refers to the function that allows the system to acquire information provided by the user.

[0613] "Means of analyzing what you want to convey" refers to a function that analyzes input information in order to understand the message the user intends to convey.

[0614] "A means of converting into respectful language" refers to a function that transforms the analyzed content into language that is considerate of the other person.

[0615] "Means for outputting conversion results" refers to a function for presenting the converted expression to the user.

[0616] "Means of presenting in real time on a visual display device" refers to a function for instantly displaying the converted expression visually.

[0617] A "wearable information terminal" is an information processing device that a user can wear and use.

[0618] "Communication support tools for face-to-face customer service" are tools designed to assist staff communication during face-to-face interactions with customers.

[0619] To implement this invention, smart glasses are used as a wearable information terminal. The smart glasses receive voice input from the user and transmit it to a server. The server converts the voice to text using speech recognition software (e.g., Google Speech-to-Text). The converted text is analyzed using a generative AI model (e.g., OpenAI GPT-3) and converted into respectful language. The converted language is displayed in real time on the smart glasses' display. This enables the user to use appropriate language when speaking to customers.

[0620] For example, if a user tries to say, "This product may not be right for you," the server will translate this to, "You might want to consider other options for this product," and display it on the smart glasses. An example of a prompt to input into the generating AI model is, "Please translate this into a respectful expression for the user's statement: 'This product may not be right for you.'"

[0621] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[0622] Step 1:

[0623] The user performs voice input through smart glasses, which are wearable information terminals. The voice input includes the content the user wants to convey to the customer.

[0624] Step 2:

[0625] The device uses speech recognition software (e.g., Google Speech-to-Text) to convert voice input into text data. The input is voice data, and the output is text data. This conversion processes the voice information into a format that can be analyzed.

[0626] Step 3:

[0627] The server uses a generative AI model (e.g., OpenAI GPT-3) to analyze text data and convert it into respectful language. The input is the converted text data, and the output is the text data of the respectful language. Prompts are used to convert the language to reflect the user's intent.

[0628] Step 4:

[0629] The server sends the converted text data to the terminal. The terminal displays the conversion results in real time on the smart glasses' display. This allows the user to use appropriate language when communicating with customers. The input is text data of the respected language, and the output is visually displayed information.

[0630] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0631] "Example of form 1"

[0632] One embodiment of the present invention provides a system incorporating an emotion engine. This system receives input information from the user and analyzes the message the user wants to convey based on that information. Based on the analysis results, it converts the message into a respectful expression and outputs the converted result. Furthermore, this system includes an emotion engine that recognizes the user's emotions. This emotion engine analyzes the emotion from the user's input information and converts it into a respectful expression that takes that emotion into account. Specifically, if the user inputs "I think his proposal is wrong" and the emotion at that time is "anger," the emotion engine analyzes that "anger" and converts it into a respectful expression such as "Perhaps we should reconsider his proposal."

[0633] "Example of form 2"

[0634] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts the expression of respect, such as "You might want to reconsider his suggestion," to a calmer expression such as "His suggestion might be worth reconsidering."

[0635] "Example of form 3"

[0636] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts the expression of respect, such as "You might want to reconsider his suggestion," to a calmer expression such as "His suggestion might be worth reconsidering."

[0637] The following describes the processing flow for each example of the form.

[0638] "Example of form 1"

[0639] Step 1: Receive input information from the user.

[0640] Step 2: Analyze the message you want to convey based on the information you received.

[0641] Step 3: Based on the analysis results, convert the expression into one that respects the other party.

[0642] Step 4: Output the conversion result.

[0643] Step 5: Analyze the user's emotions from their input information.

[0644] Step 6: Convert the analyzed emotions into expressions of respect that take them into account.

[0645] "Example of form 2"

[0646] Step 1: Receive input information from the user.

[0647] Step 2: Analyze the message you want to convey based on the information you received.

[0648] Step 3: Based on the analysis results, convert the expression into one that respects the other party.

[0649] Step 4: Output the conversion result.

[0650] Step 5: Track changes in the user's emotions.

[0651] Step 6: Adjust your expression of respect based on changes in your feelings.

[0652] (Example 1)

[0653] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0654] In modern information exchange, it is a challenging task for users to appropriately express their emotions while maintaining respectful communication with others. In particular, when emotions are heightened, people may use expressions that lead to misunderstandings. Improving this situation and achieving smoother communication is essential.

[0655] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0656] In this invention, the server includes a device for receiving information from a user, a device for analyzing emotions based on the information, and a device for converting the analysis results into respectful language. This makes it possible to consider the user's emotions and convert them into respectful language, thereby enabling smooth communication.

[0657] A "user" is an individual or group that uses a system to input information and communicate.

[0658] "Information" refers to data that users input into the system, including their intentions, emotions, and relationships with others.

[0659] A "device" is a set of hardware or software components designed to perform a specific function.

[0660] A "device for analyzing emotions" is a device that has the function of identifying emotions from user input information and performing analysis based on those emotions.

[0661] A "device that converts into respectful expressions" is a device that, based on analyzed emotions, converts the user's intentions into expressions that appropriately convey them to the other party.

[0662] A "generative AI model" is a model that uses artificial intelligence technology to generate appropriate output from input data.

[0663] A "prompt statement" is an instruction given to a generative AI model to obtain a specific output.

[0664] The following system is constructed as an embodiment of this invention.

[0665] Users input information into the system using a terminal. This information includes the user's intentions, feelings, and relationships with others. For example, a user might input the intention "I think his suggestion is wrong" and the relationship "He is my boss."

[0666] The terminal sends the information received from the user to the server. The server uses an emotion analysis device to identify the user's emotions from the input information. This device analyzes the input data and determines what emotions the user is experiencing.

[0667] Next, the server uses a device that translates the user's intent into appropriate language based on the analyzed emotions, respecting the other party's perspective. This device utilizes a generative AI model to generate prompt sentences, creating expressions that effectively convey the user's intent to the other party.

[0668] As a concrete example, if a user inputs "I think his suggestion is wrong" and their emotion is "anger," the generative AI model is prompted with the following message: "If a user inputs 'I think his suggestion is wrong' and their emotion is 'anger,' please convert it into a respectful expression." Based on this prompt, the generative AI model generates the expression "Perhaps we should reconsider his suggestion."

[0669] Finally, the server sends the converted expression back to the terminal, which then displays the result to the user. This allows the user to express their emotions appropriately while communicating respectfully with others.

[0670] The flow of the specific processing in Example 1 will be explained using Figure 17.

[0671] Step 1:

[0672] The user inputs information into the system via a terminal. This information includes the user's intentions, feelings, and relationships with others. Specifically, the user inputs the intention, "I think his suggestion is wrong," and the relationship, "He is my boss." The input information is then sent from the terminal to the server.

[0673] Step 2:

[0674] The server passes the received information to a device that analyzes emotions. This device analyzes the user's input and identifies the emotion. For example, if the input intention is "I think his suggestion is wrong," the emotion is determined to be "anger." This analysis result is then used in the next step.

[0675] Step 3:

[0676] The server uses a device that translates analyzed emotions into respectful language. This device utilizes a generative AI model to generate prompt sentences. Specifically, the generative AI model is given the prompt sentence, "If the user inputs 'I think his suggestion is wrong' and the emotion is 'anger,' please translate it into respectful language." Based on this prompt sentence, the generative AI model generates the expression, "Perhaps we should reconsider his suggestion."

[0677] Step 4:

[0678] The server sends the generated expression back to the terminal. The terminal displays this conversion result to the user. The user can review the displayed content and communicate it to the other party as needed. This allows the user to express their emotions appropriately while engaging in respectful communication with others.

[0679] (Application Example 1)

[0680] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0681] In face-to-face customer service, a challenge exists in that it is difficult for store employees to properly understand customers' emotions and respond smoothly. In particular, there is a need to accurately grasp the emotions contained in customers' statements and to provide appropriate responses quickly.

[0682] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0683] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful expressions for the other party. This enables the server to analyze customer statements in real time, generate appropriate responses that correspond to emotions, and allow store staff to provide quick and appropriate customer service.

[0684] "Means of receiving user input information" refers to the methods by which the system acquires information provided by the user.

[0685] "Methods for analyzing what you want to convey" refers to methods of analyzing what should be communicated based on information received from the user.

[0686] "Methods for converting into respectful expressions" refer to methods of transforming expressions into forms that show respect to the other party, based on the analyzed content.

[0687] "Means for outputting conversion results" refers to a method of presenting the converted expression to the user or another system.

[0688] "Methods for converting speech to text using speech recognition technology" refers to technologies for converting speech data into textual information.

[0689] "Methods for analyzing user emotions using emotion analysis technology" refers to technologies for analyzing user emotions from their statements and actions.

[0690] "Means for displaying the conversion results on a smart device's display device" refers to a method of displaying the converted information on the screen of a smart device.

[0691] "Tools for supporting customer service in face-to-face services" are tools designed to support customer interaction when providing services directly to customers in person.

[0692] A "device for communication support" is a device used to facilitate the exchange of information.

[0693] The system for implementing this invention mainly consists of three elements: a server, a terminal, and a user. The server receives input information from the user and converts the speech to text using speech recognition technology. Specifically, it uses a speech recognition API such as Google Cloud Speech-to-Text. The converted text is then analyzed to determine the user's emotions using sentiment analysis technology. By using a sentiment analysis engine such as IBM Watson Tone Analyzer, it is possible to accurately grasp the user's emotions.

[0694] Based on the analyzed emotional information, the server analyzes what the user wants to convey and translates it into respectful language. A generative AI model is used to generate appropriate expressions. These translation results are displayed on the smart device's display. For example, using smart glasses like Google Glass, store employees can see appropriate responses to customers in real time.

[0695] For example, if a customer says, "This product is too expensive," the server converts the speech into text and uses sentiment analysis technology to detect "dissatisfaction." Then, a generative AI model is used to generate a response such as, "It seems you are dissatisfied with the price. Would you like us to suggest a more affordable alternative?" and this response is displayed on the smart glasses.

[0696] An example of a prompt is: "Customer statement: 'This product is too expensive.' Emotion: Dissatisfied. Generate an appropriate response." Using this prompt, the generative AI model can generate an appropriate response.

[0697] The flow of a specific process in Application Example 1 will be explained using Figure 18.

[0698] Step 1:

[0699] The user provides voice input through the microphone of their smart device. The device captures this voice data and sends it to the server. The input is voice data, and the output is the voice data sent to the server.

[0700] Step 2:

[0701] The server uses speech recognition technology to convert the received audio data into text. Specifically, it uses the Google Cloud Speech-to-Text API to convert speech into text information. The input is audio data, and the output is text data.

[0702] Step 3:

[0703] The server inputs text data into sentiment analysis technology to analyze the user's emotions. IBM Watson Tone Analyzer is used to extract emotions from the text. The input is text data, and the output is emotional information.

[0704] Step 4:

[0705] The server uses a generative AI model to generate respectful expressions based on emotional information and text data. It uses prompts to generate appropriate responses. The input is emotional information and text data, and the output is the transformed expression.

[0706] Step 5:

[0707] The server sends the generated representation to the terminal and displays it on the smart device's display. The terminal receives this information and displays it on its screen for the user to verify. The input is the converted representation, and the output is the information displayed on the smart device's screen.

[0708] (Example 2)

[0709] Next, we will describe Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0710] In modern communication, it is crucial to appropriately express what the user wants to convey and to show respect for the other person. However, choosing the appropriate expression depending on the user's emotional state and relationship with the other person is not easy. Therefore, there is a need for technology that can accurately convey the user's intentions while translating them into respectful expressions.

[0711] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0712] In this invention, the server includes means for receiving information from a user, means for using natural language processing technology to analyze the content based on the information, and means for tracking changes in emotion based on the analysis results and adjusting the expression to respect the other party. This makes it possible to accurately convey the user's intentions while converting them into respectful expressions.

[0713] A "user" is an entity that uses a system to input information and express what it wants to convey to others.

[0714] "Information" refers to the data that users input into the system, including the content they want to convey and their emotional state.

[0715] "Natural language processing technology" is a technology that enables computers to understand and analyze human language, and is used to analyze user input.

[0716] "Emotional changes" refer to how a user's emotional state changes over time or in response to changing circumstances, and this is something the system tracks.

[0717] "Respectful expression" refers to language that is adjusted to show respect to the other party when conveying the user's intentions.

[0718] "Means of adjustment" refer to methods and technologies for transforming user input into respectful expressions based on analysis results and changes in emotions.

[0719] This invention is a system that converts user-inputted information into respectful language. The system is composed of three main components: the user, the terminal, and the server.

[0720] Users input information into the system through their device. This information includes what the user wants to convey and their emotional state. The device's role is to transmit the user's input to the server.

[0721] The server uses natural language processing (NLP) techniques to analyze the information it receives. This analysis employs NLP models, such as generative AI models. Specifically, Google's BERT and OpenAI's GPT are examples of such models. These models are used to understand the user's input and grasp what the user wants to convey and the degree of respect they show to the other party.

[0722] Furthermore, the server uses an emotion engine to track changes in the user's emotions. The emotion engine detects changes in emotions based on the user's input and adjusts the expression to be more respectful of the other person based on the analysis results.

[0723] For example, if a user inputs "I think his suggestion is wrong," and their emotion changes from "anger" to "calmness," the server uses an emotion engine to track this change. The server then adjusts the message to a calmer expression such as "His suggestion might be worth reconsidering."

[0724] An example of a prompt message is: "Analyze the user's input, consider the change in emotion, and convert it into an expression that shows respect for the other person. Input: 'I think his suggestion is wrong.' Change in emotion: 'Anger' to 'Calmness'."

[0725] The flow of the specific processing in Example 2 will be explained using Figure 19.

[0726] Step 1:

[0727] The user inputs information into the system via a terminal. This information includes what the user wants to convey and their emotional state. The input information is then sent from the terminal to the server.

[0728] Step 2:

[0729] The server uses natural language processing technology to analyze the information received from the terminal. Specifically, it uses a generative AI model to understand the user's input and grasp what the user wants to convey and the degree of respect they show to the other party. This analysis reveals the intent behind the input information.

[0730] Step 3:

[0731] The server operates the emotion engine based on the analysis results. The emotion engine detects changes in emotion based on user input. For example, if the user's emotion changes from "anger" to "calmness," it tracks that change. In this process, data is acquired on how the input emotional state changed.

[0732] Step 4:

[0733] The server adjusts the user's message based on emotional changes. Specifically, it considers the analysis results and emotional shifts to transform the message into a respectful expression. This transformation generates a message that accurately conveys the user's intent while showing respect to the recipient.

[0734] Step 5:

[0735] The server sends the adjusted message back to the user. The user can check this message through their terminal. The output message reflects the user's intentions while also being considerate of the recipient.

[0736] (Application Example 2)

[0737] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0738] In modern information processing systems, it is crucial to appropriately analyze user emotions and translate them into respectful expressions. However, conventional systems have struggled to track changes in user emotions in real time and adjust their expressions accordingly. This creates a challenge where misunderstandings and discomfort can arise in communication between users and systems.

[0739] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0740] In this invention, the server includes means for receiving input information from the user, means for analyzing the content to be conveyed based on the input information, and means for tracking changes in the user's emotions and adjusting expressions of respect based on those changes in emotions. This makes it possible to generate appropriate and respectful expressions in real time that correspond to the user's emotions, thereby reducing misunderstandings and discomfort.

[0741] "Means of receiving user input information" refers to the function that allows the system to acquire information provided by the user.

[0742] "Means for analyzing what you want to convey" refers to a function that processes user input information to understand what that information is trying to communicate.

[0743] "Means of converting into respectful expressions" refers to a function that converts the analyzed content into respectful expressions towards the other party.

[0744] "Means for tracking changes in user emotions and adjusting expressions of respect" refers to a function that monitors changes in user emotions in real time and appropriately adjusts expressions in response to those changes.

[0745] "Means for outputting conversion results" refers to a function for providing the converted expression to the user or other systems.

[0746] This section describes the embodiments for carrying out the invention. This invention is a system that generates appropriate and respectful expressions in response to the user's emotions. The system receives input information from the user and analyzes that information to understand what the user wants to convey. Natural language processing technology is used for the analysis. Based on the analysis results, it converts the information into respectful expressions. Furthermore, it tracks changes in the user's emotions and adjusts the expressions accordingly.

[0747] This system operates on smartphones and servers. The program is written in Python and uses the Hugging Face Transformers library for natural language processing. A BERT-based sentiment analysis model is used for sentiment analysis. The server functions as an API server using Flask, receiving user input and returning analysis results.

[0748] For example, if a user enters "Payment failed," the server uses a sentiment analysis model to interpret this as "dissatisfaction." As a result, the system generates a response such as "We apologize for the inconvenience." If the user's sentiment changes to "calm," the response is adjusted to "We will do our best to support you in resolving the issue."

[0749] An example of a prompt message is as follows:

[0750] User input: "Payment failed"

[0751] Emotion analysis: "Dissatisfaction"

[0752] Response generated: "We apologize for any inconvenience this may cause."

[0753] The flow of a specific process in Application Example 2 will be explained using Figure 20.

[0754] Step 1:

[0755] The user provides input information using a terminal. This input information is text data that includes the user's emotions and intentions. This data is sent to the server.

[0756] Step 2:

[0757] The server analyzes the received input information using natural language processing techniques. Specifically, it uses the Hugging Face Transformers library to analyze the sentiment of the input text. The input is user text data, and the output is a sentiment label (e.g., "dissatisfied," "calm").

[0758] Step 3:

[0759] The server translates the analysis results into respectful language. Using a generative AI model, it generates appropriate responses corresponding to emotion labels. The input is an emotion label, and the output is a respectful response text.

[0760] Step 4:

[0761] The server tracks changes in the user's emotions and adjusts its response as needed. If an emotional change is detected, it uses the regenerative AI model to generate an adjusted response. The input is information about the emotional change, and the output is the adjusted response text.

[0762] Step 5:

[0763] The server sends the final response to the terminal and displays it to the user. The user can review the displayed response and provide further input information as needed.

[0764] (Example 3)

[0765] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0766] In modern communication, users are required to express their true feelings in a way that respects the other person. However, it is difficult for users to come up with such expressions themselves, and it is also difficult for them to adjust their expressions appropriately according to changes in their emotions. This can lead to misunderstandings and conflicts, so a system is needed to resolve this.

[0767] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0768] In this invention, the server includes means for receiving information from the user, means for analyzing the content based on the information, means for converting the analysis results into respectful expressions, means for tracking changes in the user's emotions and adjusting the respectful expressions based on those changes in emotions, and means for performing analysis and conversion using a generative AI model. As a result, when a user conveys their true feelings to another person, the server automatically converts them into respectful expressions and further uses expressions that are appropriately adjusted according to changes in emotions.

[0769] "Means of receiving information from users" refers to an interface for obtaining text data entered by users.

[0770] "Means of content analysis" refers to the process of analyzing acquired text data to understand its intent and emotions.

[0771] "Methods for converting into respectful expressions" refers to a process that, based on analysis results, converts the user's true feelings into expressions that are considerate of the other person.

[0772] "Means for outputting conversion results" refers to an interface for presenting the converted text to the user.

[0773] "Means for tracking changes in a user's emotions and adjusting expressions of respect based on those changes" refers to a process for monitoring changes in a user's emotions and appropriately adjusting expressions in response to those changes.

[0774] "Means of performing analysis and transformation using a generative AI model" refers to the process of performing analysis and transformation of text data using a pre-trained artificial intelligence model.

[0775] "Tools for organizational management" refer to systems and software used to facilitate human resource management and communication within an organization.

[0776] An "automatic response program for communication devices" is a program that automatically responds to inquiries and messages from users.

[0777] This invention is a system that analyzes text entered by a user and converts it into respectful language. The system includes a user terminal, a server, a generative AI model, and an emotion engine.

[0778] The user enters text through the terminal. This text contains the user's true feelings. For example, they might enter, "I think his suggestion is wrong." The terminal then sends this input to the server.

[0779] The server sends the received text to a generating AI model. This model uses natural language processing techniques to analyze the text and understand the user's intent and emotions. Specifically, it grasps the context of the text and determines what kind of expression is respectful to the other person.

[0780] Based on the analysis results, the server transforms the user's true feelings into respectful expressions. This transformation uses a pre-trained generative AI model. For example, the true feeling "I think his proposal is wrong" is changed to "It might be necessary to consider his proposal from a different perspective."

[0781] Furthermore, the server uses an emotion engine to track changes in the user's emotions. If the user's emotion changes from "anger" to "calmness," the server takes this change into account and further adjusts its expression of respect. Specifically, it might change the expression "Perhaps we should reconsider his proposal" to "Perhaps his proposal is worth reconsidering."

[0782] Ultimately, the server sends the converted text to the terminal, which then displays it to the user. This allows the user to use respectful language towards the other party.

[0783] As a concrete example, the following is an example of a prompt sentence to be input to the generation AI model: "User input: 'I think his suggestion is wrong.' Emotional state: Changed from 'angry' to 'calm.' Please generate a respectful expression." With this prompt, the system generates an appropriate expression. The flow of specific processing in Example 3 will be explained using Figure 21.

[0784] Step 1:

[0785] The user enters text through the terminal. The entered text contains the user's true feelings. For example, they might enter, "I think his proposal is wrong." This input is sent from the terminal to the server.

[0786] Step 2:

[0787] The server sends the text received from the terminal to a generative AI model. The generative AI model analyzes the text using natural language processing techniques. Specifically, it understands the context of the text and grasps the user's intent and emotions. Through this analysis, it determines what kind of expression is respectful to the other person. The analysis results are returned to the server.

[0788] Step 3:

[0789] The server translates the user's true feelings into respectful expressions based on the analysis results from the generating AI model. This translation process uses a pre-trained model. For example, the true feeling "I think his proposal is wrong" is changed to "It might be necessary to consider his proposal from a different perspective." The translated text is stored on the server.

[0790] Step 4:

[0791] The server uses an emotion engine to track changes in the user's emotions. If the user's emotion changes from "anger" to "calmness," the server takes this change into account and further adjusts its expressions of respect. Specifically, it adjusts the expression "Perhaps we should reconsider his proposal" to "Perhaps his proposal is worth reconsidering." The adjusted text is updated within the server.

[0792] Step 5:

[0793] The server sends the final converted and adjusted text to the terminal. The terminal displays this text to the user. This allows the user to use respectful language towards the other party.

[0794] (Application Example 3)

[0795] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0796] In customer service interactions within electronic transactions, operators are required to communicate with customers using appropriate and respectful language. However, operators may become emotional or struggle to immediately think of appropriate expressions, potentially leading to decreased customer satisfaction. To address this problem, a system is needed that converts operator input into respectful language in real time and sends it to the customer.

[0797] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0798] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful language. This makes it possible to convert the information entered by the operator into respectful language in real time and transmit it to the customer.

[0799] "Means of receiving user input information" refers to an interface for obtaining information that users provide to the system.

[0800] "Means of analyzing what you want to convey" refers to a function that processes information entered by the user to understand its intent and meaning.

[0801] "Means of converting into respectful language" refers to a function that converts the analyzed content into language that is considerate of the other person.

[0802] "Means for outputting conversion results" refers to a function for presenting the converted expression to the user or another system.

[0803] "Means for tracking emotional changes and adjusting expressions of respect" refers to a function that monitors changes in the user's emotions and appropriately adjusts expressions in response to those changes.

[0804] "Means to support customer service in electronic transactions" refers to support functions provided by the system to enable operators to provide appropriate service to customers in electronic transaction settings.

[0805] A description of the embodiment for carrying out the invention will be given.

[0806] The system for realizing this invention mainly consists of a server and a user terminal. The server receives input information from the user, analyzes that information, and understands what the user wants to convey. Natural language processing technology is used for the analysis, specifically a generative AI model utilizing the Transformers library. Based on the analysis results, processing is performed to convert the message into an expression that respects the recipient. The converted expression is output to the user terminal in text format.

[0807] Furthermore, the server uses sentiment analysis tools such as TextBlob and NLTK to track changes in the user's emotions. It has the ability to adjust expressions of respect according to changes in emotions. This ensures that appropriate expressions are provided according to the user's feelings.

[0808] For example, if a user types "This problem is your mistake," the system will translate this to "Could you please let me know more about this problem?" An example of a prompt would be, "Please translate the user's input into a respectful expression. Input: 'This problem is your mistake'."

[0809] In this way, a system is built to support customer service in electronic transactions. Operators can communicate with customers in real time using appropriate language.

[0810] The flow of the specific processing in Application Example 3 will be explained using Figure 22.

[0811] Step 1:

[0812] The user provides input information through their device. This input information is text data containing the user's true feelings and opinions. The device sends this input information to the server.

[0813] Step 2:

[0814] The server analyzes the received input information. This analysis utilizes natural language processing techniques and a generative AI model powered by the Transformers library. By analyzing the input information, it understands the intended message and intent. This analysis result forms the basis for the next step.

[0815] Step 3:

[0816] The server converts the input into respectful language based on the analysis results. It uses a generative AI model to transform the input information into more considerate language. This transformation process uses prompts to generate appropriate output. For example, it might use the prompt: "Please convert the user's input into respectful language. Input: 'This problem is your mistake.'"

[0817] Step 4:

[0818] The server tracks changes in the user's emotions. TextBlob and NLTK are used for sentiment analysis. It analyzes the emotions in the input information and monitors how emotions change over time. It adjusts expressions of respect according to these emotional changes.

[0819] Step 5:

[0820] The server outputs the converted expression to the terminal. The terminal presents this output to the user. The user reviews the converted expression and sends it to the customer as needed. This enables the user to communicate appropriately with the customer in real time.

[0821] (Other examples)

[0822] Since this is the same as the specific processing described in the other embodiments of the first embodiment above, the explanation will be omitted.

[0823] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0824] The data generation model 58 is a form of so-called generative AI (Artificial Intelligence). One example of the data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0825] Other examples of generative AI include Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are some examples.

[0826] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0827] [Third Embodiment]

[0828] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0829] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0830] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0831] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0832] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0833] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0834] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0835] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0836] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0837] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0838] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0839] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[0840] "Example of form 1"

[0841] One embodiment of the present invention is a system used as a bot for a communication tool. This system has a means of receiving input information from the user. The user inputs their true feelings and their relationship with the other person. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[0842] "Example of form 2"

[0843] Next, the system has a means to analyze the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect shown to the recipient when conveying that message.

[0844] "Example of form 3"

[0845] Furthermore, the system has a means of converting the analysis results into respectful expressions. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[0846] "Example of form 4"

[0847] Finally, the system has a means of outputting the conversion results. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[0848] The following describes the processing flow for each example of the form.

[0849] "Example of form 1"

[0850] Step 1: The user inputs their true feelings and their relationship with the other person into the communication tool bot. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[0851] Step 2: The system analyzes the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect the user will show to the recipient when conveying that message.

[0852] Step 3: The system converts the analysis results into a respectful expression. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[0853] Step 4: The system outputs the conversion result. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[0854] (Example 1)

[0855] Next, we will describe Embodiment 1 of Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0856] In modern information exchange, it is difficult for users to find appropriate communication methods that consider both their true feelings and their relationship with the other person. Especially in workplace and organizational communication, it is necessary to effectively convey one's own opinions while respecting others, but finding concrete ways to do so is not easy.

[0857] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0858] In this invention, the server includes means for receiving input information from a user, means for converting the input information into a data format and transmitting it, and means for performing analysis using a generated artificial intelligence model based on the input information. This makes it possible for users to easily obtain appropriate communication methods based on their true feelings and their relationship with the other person.

[0859] A "user" refers to an individual or organization that provides input information to the system.

[0860] "Input information" refers to data that users provide to the system, specifically including information about the user's true feelings and their relationship with the other party.

[0861] "Data format" refers to the format in which information is converted into a form that can be processed by a computer.

[0862] A "generative artificial intelligence model" refers to a machine learning model used for natural language processing, specifically a technology that performs analysis based on user input.

[0863] "Analysis" refers to information processing that uses input information to derive appropriate communication methods.

[0864] "Communication methods" refer to the specific means and expressions that indicate how a user should convey information to another person.

[0865] "Organizational management" refers to management activities aimed at the efficient operation of personnel and operations within an organization.

[0866] "Information exchange" refers to the act of transmitting information between individuals or groups.

[0867] An "automatic response program" refers to software that automatically generates responses in response to user input.

[0868] The following system configurations are possible as embodiments for carrying out this invention.

[0869] Users input their true feelings and their relationship with the other person using a device. The device is a smartphone or personal computer, providing an interface for receiving the information entered by the user. The information entered by the user is collected through text boxes.

[0870] The terminal converts the input information received from the user into a data format and sends it to the server. During this process, the data is converted to a standard data format such as JSON and transmitted securely using the HTTPS protocol.

[0871] The server uses a generative artificial intelligence model to analyze the received data. Specifically, it can utilize a general machine learning model as a generative AI model for natural language processing. For example, OpenAI's GPT-3 is one such model. This model generates appropriate communication methods based on the user's true feelings and relationship with them.

[0872] The generated communication method is sent from the server to the terminal. The terminal displays the received information to the user, who can then use it as a reference to communicate with the other party.

[0873] For example, if a user inputs the information "I think his proposal is wrong" and "He is my boss," the generating AI model will generate a communication method such as "When dealing with your boss, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." An example of a prompt might be, "Please suggest an appropriate communication method based on the user's true feelings and their relationship with the other person."

[0874] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0875] Step 1:

[0876] The user uses their device to input their true feelings and their relationship with the other person. Specifically, they enter information such as "I think his suggestion is wrong" and "He is my boss" into the text box on the device. The entered information is temporarily stored on the device.

[0877] Step 2:

[0878] The terminal converts the input information received from the user into a data format and sends it to the server. Specifically, it converts the input information into JSON format and sends it to the server using the HTTPS protocol. At this time, the input information is structured as a JSON object with keys for "true feelings" and "relationship".

[0879] Step 3:

[0880] The server parses the received JSON data. Specifically, it uses a generative AI model to generate appropriate communication methods based on the user's true feelings and relationship with the other party. The server inputs the prompt "Please suggest an appropriate communication method based on the user's true feelings and relationship with the other party" into the generative AI model and performs the analysis.

[0881] Step 4:

[0882] The server sends the analysis results obtained from the generated AI model to the terminal in JSON format. Specifically, it structures the generated communication method as a JSON object with the key "proposal" and sends it to the terminal using the HTTPS protocol.

[0883] Step 5:

[0884] The terminal parses the JSON data received from the server and displays a generated communication method to the user. Specifically, the terminal screen displays a message such as, "When communicating with your superior, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." The user can then use this suggestion as a reference when communicating with others.

[0885] (Application Example 1)

[0886] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0887] In face-to-face services, smooth communication with customers is crucial, but accurately understanding their true feelings and emotions and responding appropriately is a challenging task. In particular, making instantaneous decisions about appropriate responses based on a customer's facial expressions and relationship with them has been difficult with traditional methods.

[0888] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0889] In this invention, the server includes means for receiving input information from the user, means for acquiring video data and analyzing a person's facial expressions, and means for generating a response based on a prompt sentence using a generative AI model. This enables the automatic generation of appropriate responses based on the customer's facial expressions and relationship, facilitating smooth communication in face-to-face services.

[0890] "Means of receiving user input information" refers to the methods and devices by which the system acquires data and information provided by the user.

[0891] "Means for analyzing what you want to convey" refers to methods or devices that process information received from users to understand their intentions and objectives.

[0892] "Means of converting into respectful expressions" refers to methods or devices that convert analyzed content into appropriate and polite expressions for the other party.

[0893] "Means for outputting conversion results" refers to methods or devices for presenting the converted information to a user or other system.

[0894] "Means for acquiring video data and analyzing a person's facial expressions" refers to methods or devices for acquiring video using cameras or other equipment and analyzing the facial expressions of people within that video.

[0895] "Means for generating appropriate responses based on facial expression data and relationships" refers to methods or devices for determining the optimal response or action by considering the relationship between the analyzed facial expression information and the user.

[0896] "Means for generating responses based on prompt sentences using a generative AI model" refers to methods or devices that utilize artificial intelligence models to generate appropriate responses based on given prompt sentences.

[0897] The system for carrying out this invention includes a terminal for receiving input information from a user, a camera for acquiring video data, and a server for processing this data. The server receives the information provided by the user and analyzes the content the user wants to convey based on that information. The analyzed content is converted into respectful language and output as an appropriate response.

[0898] The server analyzes facial expressions from video data acquired using a camera. Specifically, it uses image processing libraries such as OpenCV to recognize facial expressions in real time. The recognized facial expression data is considered along with the relationship with the user and used as basic data to generate appropriate responses.

[0899] The system utilizes a generative AI model to generate responses based on prompts. For example, it can use the OpenAI API to input a prompt and obtain an appropriate response. A specific example of a prompt would be, "The customer's expression indicates dissatisfaction, and they are a regular customer. Please suggest an appropriate response." Based on this prompt, the AI ​​model generates the optimal response for the customer.

[0900] This system is expected to facilitate smoother communication in face-to-face services and improve customer satisfaction.

[0901] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0902] Step 1:

[0903] The terminal receives input information from the user. This input information includes the user's true feelings and their relationship with the other party. This information is sent to the server and used as basic data for analysis.

[0904] Step 2:

[0905] The server acquires video data using a camera and analyzes people's facial expressions. It uses image processing libraries such as OpenCV to recognize facial expressions in real time. The input is video data from the camera, and the output is the analyzed facial expression data.

[0906] Step 3:

[0907] The server generates prompt text based on user input and analyzed facial expression data. This prompt text includes the user's true feelings, their relationship with the other person, and facial expression data. This prepares the input for the generating AI model.

[0908] Step 4:

[0909] The server generates responses based on prompts using a generative AI model. Using the OpenAI API, prompts are input, and appropriate responses are obtained. The input is the prompt, and the output is the generated response.

[0910] Step 5:

[0911] The server sends the generated response to the terminal and presents it to the user. This allows the user to know how to proceed appropriately. The output is the response presented to the user.

[0912] (Example 2)

[0913] Next, we will describe Example 2 of the morphological example. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0914] In modern communication, it is crucial to accurately analyze what a user wants to convey and translate it into expressions that show appropriate respect for the recipient. However, conventional technologies have a challenge in generating expressions that fully consider the user's intentions and the recipient's feelings.

[0915] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0916] In this invention, the server includes means for receiving information from a user, means for analyzing the information using natural language processing technology, and means for evaluating the user's intentions and the degree of respect shown to the other party based on the analysis results. This makes it possible to accurately grasp the user's intentions and generate expressions that show appropriate consideration for the other party.

[0917] A "user" is an entity that uses a system to input information and receive analysis results.

[0918] "Information" refers to text data that users input into the system, including the user's intentions and considerations for others.

[0919] "Natural language processing technology" refers to techniques that enable computers to understand and analyze human language, and includes tokenization, part-of-speech tagging, and dependency analysis.

[0920] "Analysis" is the process of processing information using natural language processing technology to identify the user's intentions and the degree of respect they have for the other party.

[0921] "Evaluation" is the act of judging the user's intentions and the degree of respect they show to others, based on the analysis results.

[0922] "Output" refers to the process of providing the user with the results of the analysis and evaluation.

[0923] A "system" is a device or program that includes a set of means for receiving, analyzing, evaluating, and outputting information from a user.

[0924] This invention is a system that analyzes information entered by a user and evaluates their intent and the degree of respect shown to the other party. The server receives information from the user and performs analysis using natural language processing technology. This analysis uses natural language processing libraries such as "spaCy" and "NLTK". These libraries enable text tokenization, part-of-speech tagging, and dependency analysis, and are used to accurately grasp the user's intent.

[0925] The server evaluates the user's intent and the degree of respect shown to the recipient based on the analysis results. The evaluation results are output to the user via their device. This allows the user to see how their message is interpreted and how much consideration they have shown to the recipient.

[0926] For example, if a user enters the message, "Could you please change the meeting time?", the server analyzes this message and understands that the user is requesting a change in the meeting time. Furthermore, the use of polite language indicates a high degree of respect for the other party.

[0927] An example of a prompt to input into the generating AI model is, "Analyze the polite language used by the user when requesting a change in meeting time, and evaluate the degree of respect shown to the other party." This prompt allows the system to accurately analyze the user's intent and make an appropriate evaluation.

[0928] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0929] Step 1:

[0930] The user inputs information into the system via a terminal. This information is text data containing the message the user wants to convey. The terminal then sends this input information to the server.

[0931] Step 2:

[0932] The server analyzes the received information using natural language processing techniques. Specifically, the server uses libraries such as "spaCy" and "NLTK" to tokenize the text, tag it with parts of speech, and perform dependency analysis. This analysis identifies the user's intent and grasps the semantic structure of the text. The input is the user's text data, and the output is the analyzed intent and structural information.

[0933] Step 3:

[0934] The server evaluates the user's intent and the degree of respect shown to the other party based on the analysis results. Specifically, it checks whether polite language and respectful expressions are included and determines the extent of consideration shown to the other party. The input is the analyzed intent and structural information, and the output is the result of identifying the intent and evaluating the degree of respect.

[0935] Step 4:

[0936] The server returns the evaluation results to the user. The terminal displays these results to the user. Specifically, it includes a summary of what the user wants to convey and an evaluation of the degree of respect shown to the other party. The input is the evaluation result, and the output is the evaluation information presented to the user.

[0937] (Application Example 2)

[0938] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0939] In modern electronic transaction services, there is a demand for prompt and appropriate responses to user inquiries and complaints. However, accurately understanding the user's intentions and level of respect can be difficult, sometimes leading to a decline in the quality of service. Therefore, a system is needed that analyzes the user's intentions and level of respect, and proposes appropriate response methods.

[0940] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0941] In this invention, the server includes means for receiving information from a user, means for analyzing the content to be conveyed based on the information, and means for proposing a response method based on the analysis results. This enables an accurate understanding of the user's intentions and degree of respect, and allows for a quick and appropriate response.

[0942] "Means of receiving information from users" refers to the methods by which the system acquires data and messages provided by users.

[0943] "Methods for analyzing what you want to convey" refers to methods of processing data based on acquired information in order to understand the user's intentions and objectives.

[0944] "Methods for converting information into respectful language" refer to methods of reconstructing information in a way that shows respect to the other party, based on the analysis results.

[0945] "Means for outputting conversion results" refers to a method for providing the reconstructed information to a user or other system.

[0946] "Means of proposing response methods" refers to methods for presenting optimal countermeasures or responses based on analysis results.

[0947] "User intent" refers to the purpose or desire that the user is trying to convey through the system.

[0948] "Degree of respect" refers to the level of respect and attitude that a user shows towards another person.

[0949] "Electronic transaction service support tools" are auxiliary systems and applications used to facilitate online commercial transactions.

[0950] The "automatic response function of the dialogue support tool" is a function that automates communication with users and enables efficient responses.

[0951] A description of the embodiment for carrying out the invention will be given.

[0952] This invention is a system that receives information from a user, analyzes the user's intentions and degree of respect towards the other party based on that information, and proposes an appropriate response method. The system consists of a server and a user terminal.

[0953] The server receives messages sent from the user's terminal. The received messages are analyzed using natural language processing techniques. This analysis utilizes the Python programming language and natural language processing libraries such as spaCy and Transformers. The analysis results in an estimation of the user's intent and level of respect.

[0954] Based on the analysis results, the server uses a generative AI model to propose an appropriate response. This proposal is sent to the user's terminal and presented to the user. The user can then use the proposed response as a reference to communicate appropriately with the other party.

[0955] For example, if a user sends a message saying, "There was a problem with my recent transaction. Please address it urgently," the server analyzes this message and understands the user's intent ("there is a problem") and the degree of respect expressed ("urgently"). Based on this, the server proposes and presents a prompt solution to the user.

[0956] An example of a prompt message is: "Analyze the user's message and estimate its intent and level of respect. Message: 'There was a problem with a recent transaction. Please address it as soon as possible.'"

[0957] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0958] Step 1:

[0959] The user uses a terminal to input a message and sends it to the server. The input message is natural language text containing the user's intentions and requests. The server receives this message.

[0960] Step 2:

[0961] The server tokenizes received messages using the natural language processing library spaCy and analyzes their grammatical structure. The input is the user's message, and the output is the tokenized words and their grammatical relationships. This process clarifies the message's structure.

[0962] Step 3:

[0963] The server uses Transformers to estimate the user's intent and level of respect from tokenized messages. The input is a tokenized message, and the output is a numerical value or label indicating the user's intent and level of respect. This process allows the meaning of the message to be understood.

[0964] Step 4:

[0965] The server uses a generative AI model to generate appropriate responses based on estimated intent and respect levels. The input is the intent and respect levels, and the output is the proposed response. This process determines the optimal response for the user.

[0966] Step 5:

[0967] The server sends the generated response method to the user's terminal. The user reviews the proposed response method on their terminal and, if necessary, uses it as a reference to reply to the other party. The input is the proposed response method, and the output is the user's confirmation and use. This process enables the user to communicate appropriately.

[0968] (Example 3)

[0969] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0970] In modern communication, it is crucial for users to translate their true feelings into respectful expressions, but doing so manually is difficult and time-consuming. Furthermore, there is a lack of technology to automatically generate appropriate expressions that take into account the user's intentions and relationship.

[0971] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0972] In this invention, the server includes means for receiving information from the user, means for using a generative AI model to analyze the information, and means for transforming the expression based on the analysis results. This makes it possible to automatically transform the user's true feelings into expressions that respect the other party.

[0973] A "user" is an entity that uses a system to input information and receives the converted results.

[0974] "Information" refers to text data that users input into the system, including the user's intentions and relationships.

[0975] A "generative AI model" is an artificial intelligence technology used to analyze input information and perform appropriate transformations.

[0976] "Analysis" is the process of using a generative AI model to understand the intent and emotions behind the input information and extract the foundational data for transformation.

[0977] "Conversion" is the process of replacing input information with respectful expressions based on the analysis results.

[0978] "Output" refers to the process of presenting the converted result to the user.

[0979] A "server" is a computer system that receives information from users, analyzes and transforms it, and outputs the results.

[0980] One embodiment of this invention includes a process in which a user inputs information using a terminal, and a server analyzes and transforms that information.

[0981] The server communicates with the terminal over the network to receive information from the user. The user enters text into the terminal's input field. For example, they might enter information such as "I think his suggestion is wrong."

[0982] The server uses a generative AI model to analyze the information it receives. This model uses natural language processing techniques to understand the intent and sentiment of the input information. Specifically, it can use generative AI models such as OpenAI's GPT-3.

[0983] After the analysis is complete, the server transforms the information based on the analysis results. The purpose of the transformation is to replace the user's true feelings with expressions that respect the other party. For example, the information "I think his proposal is wrong" is transformed into the expression "It might be necessary to consider his proposal from a different perspective."

[0984] The converted information is sent from the server to the terminal and presented to the user. This allows the user to communicate in a way that is considerate of the other person.

[0985] A concrete example of a prompt sentence is, "Please rephrase the following sentence in a respectful manner: I think his suggestion is wrong." By inputting this prompt sentence into the generation AI model, an appropriate transformation is performed. The flow of the specific processing in Example 3 will be explained using Figure 15.

[0986] Step 1:

[0987] The user inputs information using a terminal. The user enters their honest opinion in text format into the terminal's input field. For example, they might enter, "I think his proposal is wrong." This input information becomes the basis for subsequent analysis and transformation.

[0988] Step 2:

[0989] The terminal sends the entered information to the server. The terminal sends the text entered by the user to the server via an HTTP request. This transmission allows the server to receive the data for analysis and transformation.

[0990] Step 3:

[0991] The server inputs the received information into a generative AI model. The server then uses the generative AI model to analyze the information. This model utilizes natural language processing techniques to understand the intent and emotions behind the input information. Based on the analysis, it determines how the information should be transformed.

[0992] Step 4:

[0993] The server transforms the information based on the analysis results. Based on the analysis results, the server transforms the input information into respectful language. For example, the information "I think his proposal is wrong" is transformed into "It might be necessary to consider his proposal from a different perspective." This transformation ensures that the user's true feelings are expressed in a way that is considerate of the other person.

[0994] Step 5:

[0995] The server sends the converted information to the terminal. The server sends the conversion result to the terminal via an HTTP response. This transmission prepares the terminal to present the conversion result to the user.

[0996] Step 6:

[0997] The terminal displays the conversion results to the user. The terminal displays the conversion results received from the server to the user. The user can check this converted information and use it when communicating it to the other party. This enables the user to communicate in a way that is considerate of the other person.

[0998] (Application Example 3)

[0999] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1000] In modern face-to-face customer service, polite and considerate communication with customers is crucial. However, it is difficult for staff to instantly choose the appropriate expression, which hinders the improvement of customer satisfaction. Therefore, there is a need for a system that allows staff to use respectful language with customers in real time.

[1001] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[1002] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful language. This enables staff to use appropriate language with customers in real time.

[1003] "Means of receiving user input information" refers to the function that allows the system to acquire information provided by the user.

[1004] "Means of analyzing what you want to convey" refers to a function that analyzes input information in order to understand the message the user intends to convey.

[1005] "A means of converting into respectful language" refers to a function that transforms the analyzed content into language that is considerate of the other person.

[1006] "Means for outputting conversion results" refers to a function for presenting the converted expression to the user.

[1007] "Means of presenting in real time on a visual display device" refers to a function for instantly displaying the converted expression visually.

[1008] A "wearable information terminal" is an information processing device that a user can wear and use.

[1009] "Communication support tools for face-to-face customer service" are tools designed to assist staff communication during face-to-face interactions with customers.

[1010] To implement this invention, smart glasses are used as a wearable information terminal. The smart glasses receive voice input from the user and transmit it to a server. The server converts the voice to text using speech recognition software (e.g., Google Speech-to-Text). The converted text is analyzed using a generative AI model (e.g., OpenAI GPT-3) and converted into respectful language. The converted language is displayed in real time on the smart glasses' display. This enables the user to use appropriate language when speaking to customers.

[1011] For example, if a user tries to say, "This product may not be right for you," the server will translate this to, "You might want to consider other options for this product," and display it on the smart glasses. An example of a prompt to input into the generating AI model is, "Please translate this into a respectful expression for the user's statement: 'This product may not be right for you.'"

[1012] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[1013] Step 1:

[1014] The user performs voice input through smart glasses, which are wearable information terminals. The voice input includes the content the user wants to convey to the customer.

[1015] Step 2:

[1016] The device uses speech recognition software (e.g., Google Speech-to-Text) to convert voice input into text data. The input is voice data, and the output is text data. This conversion processes the voice information into a format that can be analyzed.

[1017] Step 3:

[1018] The server uses a generative AI model (e.g., OpenAI GPT-3) to analyze text data and convert it into respectful language. The input is the converted text data, and the output is the text data of the respectful language. Prompts are used to convert the language to reflect the user's intent.

[1019] Step 4:

[1020] The server sends the converted text data to the terminal. The terminal displays the conversion results in real time on the smart glasses' display. This allows the user to use appropriate language when communicating with customers. The input is text data of the respected language, and the output is visually displayed information.

[1021] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1022] "Example of form 1"

[1023] One embodiment of the present invention provides a system incorporating an emotion engine. This system receives input information from the user and analyzes the message the user wants to convey based on that information. Based on the analysis results, it converts the message into a respectful expression and outputs the converted result. Furthermore, this system includes an emotion engine that recognizes the user's emotions. This emotion engine analyzes the emotion from the user's input information and converts it into a respectful expression that takes that emotion into account. Specifically, if the user inputs "I think his proposal is wrong" and the emotion at that time is "anger," the emotion engine analyzes that "anger" and converts it into a respectful expression such as "Perhaps we should reconsider his proposal."

[1024] "Example of form 2"

[1025] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts the expression of respect, such as "You might want to reconsider his suggestion," to a calmer expression such as "His suggestion might be worth reconsidering."

[1026] "Example of form 3"

[1027] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts the expression of respect, such as "You might want to reconsider his suggestion," to a calmer expression such as "His suggestion might be worth reconsidering."

[1028] The following describes the processing flow for each example of the form.

[1029] "Example of form 1"

[1030] Step 1: Receive input information from the user.

[1031] Step 2: Analyze the message you want to convey based on the information you received.

[1032] Step 3: Based on the analysis results, convert the expression into one that respects the other party.

[1033] Step 4: Output the conversion result.

[1034] Step 5: Analyze the user's emotions from their input information.

[1035] Step 6: Convert the analyzed emotions into expressions of respect that take them into account.

[1036] "Example of form 2"

[1037] Step 1: Receive input information from the user.

[1038] Step 2: Analyze the message you want to convey based on the information you received.

[1039] Step 3: Based on the analysis results, convert the expression into one that respects the other party.

[1040] Step 4: Output the conversion result.

[1041] Step 5: Track changes in the user's emotions.

[1042] Step 6: Adjust your expression of respect based on changes in your feelings.

[1043] (Example 1)

[1044] Next, we will describe Embodiment 1 of Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1045] In modern information exchange, it is a challenging task for users to appropriately express their emotions while maintaining respectful communication with others. In particular, when emotions are heightened, people may use expressions that lead to misunderstandings. Improving this situation and achieving smoother communication is essential.

[1046] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1047] In this invention, the server includes a device for receiving information from a user, a device for analyzing emotions based on the information, and a device for converting the analysis results into respectful language. This makes it possible to consider the user's emotions and convert them into respectful language, thereby enabling smooth communication.

[1048] A "user" is an individual or group that uses a system to input information and communicate.

[1049] "Information" refers to data that users input into the system, including their intentions, emotions, and relationships with others.

[1050] A "device" is a set of hardware or software components designed to perform a specific function.

[1051] A "device for analyzing emotions" is a device that has the function of identifying emotions from user input information and performing analysis based on those emotions.

[1052] A "device that converts into respectful expressions" is a device that, based on analyzed emotions, converts the user's intentions into expressions that appropriately convey them to the other party.

[1053] A "generative AI model" is a model that uses artificial intelligence technology to generate appropriate output from input data.

[1054] A "prompt statement" is an instruction given to a generative AI model to obtain a specific output.

[1055] The following system is constructed as an embodiment of this invention.

[1056] Users input information into the system using a terminal. This information includes the user's intentions, feelings, and relationships with others. For example, a user might input the intention "I think his suggestion is wrong" and the relationship "He is my boss."

[1057] The terminal sends the information received from the user to the server. The server uses an emotion analysis device to identify the user's emotions from the input information. This device analyzes the input data and determines what emotions the user is experiencing.

[1058] Next, the server uses a device that translates the user's intent into appropriate language based on the analyzed emotions, respecting the other party's perspective. This device utilizes a generative AI model to generate prompt sentences, creating expressions that effectively convey the user's intent to the other party.

[1059] As a concrete example, if a user inputs "I think his suggestion is wrong" and their emotion is "anger," the generative AI model is prompted with the following message: "If a user inputs 'I think his suggestion is wrong' and their emotion is 'anger,' please convert it into a respectful expression." Based on this prompt, the generative AI model generates the expression "Perhaps we should reconsider his suggestion."

[1060] Finally, the server sends the converted expression back to the terminal, which then displays the result to the user. This allows the user to express their emotions appropriately while communicating respectfully with others.

[1061] The flow of the specific processing in Example 1 will be explained using Figure 17.

[1062] Step 1:

[1063] The user inputs information into the system via a terminal. This information includes the user's intentions, feelings, and relationships with others. Specifically, the user inputs the intention, "I think his suggestion is wrong," and the relationship, "He is my boss." The input information is then sent from the terminal to the server.

[1064] Step 2:

[1065] The server passes the received information to a device that analyzes emotions. This device analyzes the user's input and identifies the emotion. For example, if the input intention is "I think his suggestion is wrong," the emotion is determined to be "anger." This analysis result is then used in the next step.

[1066] Step 3:

[1067] The server uses a device that translates analyzed emotions into respectful language. This device utilizes a generative AI model to generate prompt sentences. Specifically, the generative AI model is given the prompt sentence, "If the user inputs 'I think his suggestion is wrong' and the emotion is 'anger,' please translate it into respectful language." Based on this prompt sentence, the generative AI model generates the expression, "Perhaps we should reconsider his suggestion."

[1068] Step 4:

[1069] The server sends the generated expression back to the terminal. The terminal displays this conversion result to the user. The user can review the displayed content and communicate it to the other party as needed. This allows the user to express their emotions appropriately while engaging in respectful communication with others.

[1070] (Application Example 1)

[1071] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1072] In face-to-face customer service, a challenge exists in that it is difficult for store employees to properly understand customers' emotions and respond smoothly. In particular, there is a need to accurately grasp the emotions contained in customers' statements and to provide appropriate responses quickly.

[1073] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1074] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful expressions for the other party. This enables the server to analyze customer statements in real time, generate appropriate responses that correspond to emotions, and allow store staff to provide quick and appropriate customer service.

[1075] "Means of receiving user input information" refers to the methods by which the system acquires information provided by the user.

[1076] "Methods for analyzing what you want to convey" refers to methods of analyzing what should be communicated based on information received from the user.

[1077] "Methods for converting into respectful expressions" refer to methods of transforming expressions into forms that show respect to the other party, based on the analyzed content.

[1078] "Means for outputting conversion results" refers to a method of presenting the converted expression to the user or another system.

[1079] "Methods for converting speech to text using speech recognition technology" refers to technologies for converting speech data into textual information.

[1080] "Methods for analyzing user emotions using emotion analysis technology" refers to technologies for analyzing user emotions from their statements and actions.

[1081] "Means for displaying the conversion results on a smart device's display device" refers to a method of displaying the converted information on the screen of a smart device.

[1082] "Tools for supporting customer service in face-to-face services" are tools designed to support customer interaction when providing services directly to customers in person.

[1083] A "device for communication support" is a device used to facilitate the exchange of information.

[1084] The system for implementing this invention mainly consists of three elements: a server, a terminal, and a user. The server receives input information from the user and converts the speech to text using speech recognition technology. Specifically, it uses a speech recognition API such as Google Cloud Speech-to-Text. The converted text is then analyzed to determine the user's emotions using sentiment analysis technology. By using a sentiment analysis engine such as IBM Watson Tone Analyzer, it is possible to accurately grasp the user's emotions.

[1085] Based on the analyzed emotional information, the server analyzes what the user wants to convey and translates it into respectful language. A generative AI model is used to generate appropriate expressions. These translation results are displayed on the smart device's display. For example, using smart glasses like Google Glass, store employees can see appropriate responses to customers in real time.

[1086] For example, if a customer says, "This product is too expensive," the server converts the speech into text and uses sentiment analysis technology to detect "dissatisfaction." Then, a generative AI model is used to generate a response such as, "It seems you are dissatisfied with the price. Would you like us to suggest a more affordable alternative?" and this response is displayed on the smart glasses.

[1087] An example of a prompt is: "Customer statement: 'This product is too expensive.' Emotion: Dissatisfied. Generate an appropriate response." Using this prompt, the generative AI model can generate an appropriate response.

[1088] The flow of a specific process in Application Example 1 will be explained using Figure 18.

[1089] Step 1:

[1090] The user provides voice input through the microphone of their smart device. The device captures this voice data and sends it to the server. The input is voice data, and the output is the voice data sent to the server.

[1091] Step 2:

[1092] The server uses speech recognition technology to convert the received audio data into text. Specifically, it uses the Google Cloud Speech-to-Text API to convert speech into text information. The input is audio data, and the output is text data.

[1093] Step 3:

[1094] The server inputs text data into sentiment analysis technology to analyze the user's emotions. IBM Watson Tone Analyzer is used to extract emotions from the text. The input is text data, and the output is emotional information.

[1095] Step 4:

[1096] The server uses a generative AI model to generate respectful expressions based on emotional information and text data. It uses prompts to generate appropriate responses. The input is emotional information and text data, and the output is the transformed expression.

[1097] Step 5:

[1098] The server sends the generated representation to the terminal and displays it on the smart device's display. The terminal receives this information and displays it on its screen for the user to verify. The input is the converted representation, and the output is the information displayed on the smart device's screen.

[1099] (Example 2)

[1100] Next, we will describe Example 2 of the morphological example. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1101] In modern communication, it is crucial to appropriately express what the user wants to convey and to show respect for the other person. However, choosing the appropriate expression depending on the user's emotional state and relationship with the other person is not easy. Therefore, there is a need for technology that can accurately convey the user's intentions while translating them into respectful expressions.

[1102] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1103] In this invention, the server includes means for receiving information from a user, means for using natural language processing technology to analyze the content based on the information, and means for tracking changes in emotion based on the analysis results and adjusting the expression to respect the other party. This makes it possible to accurately convey the user's intentions while converting them into respectful expressions.

[1104] A "user" is an entity that uses a system to input information and express what it wants to convey to others.

[1105] "Information" refers to the data that users input into the system, including the content they want to convey and their emotional state.

[1106] "Natural language processing technology" is a technology that enables computers to understand and analyze human language, and is used to analyze user input.

[1107] "Emotional changes" refer to how a user's emotional state changes over time or in response to changing circumstances, and this is something the system tracks.

[1108] "Respectful expression" refers to language that is adjusted to show respect to the other party when conveying the user's intentions.

[1109] "Means of adjustment" refer to methods and technologies for transforming user input into respectful expressions based on analysis results and changes in emotions.

[1110] This invention is a system that converts user-inputted information into respectful language. The system is composed of three main components: the user, the terminal, and the server.

[1111] Users input information into the system through their device. This information includes what the user wants to convey and their emotional state. The device's role is to transmit the user's input to the server.

[1112] The server uses natural language processing (NLP) techniques to analyze the information it receives. This analysis employs NLP models, such as generative AI models. Specifically, Google's BERT and OpenAI's GPT are examples of such models. These models are used to understand the user's input and grasp what the user wants to convey and the degree of respect they show to the other party.

[1113] Furthermore, the server uses an emotion engine to track changes in the user's emotions. The emotion engine detects changes in emotions based on the user's input and adjusts the expression to be more respectful of the other person based on the analysis results.

[1114] For example, if a user inputs "I think his suggestion is wrong," and their emotion changes from "anger" to "calmness," the server uses an emotion engine to track this change. The server then adjusts the message to a calmer expression such as "His suggestion might be worth reconsidering."

[1115] An example of a prompt message is: "Analyze the user's input, consider the change in emotion, and convert it into an expression that shows respect for the other person. Input: 'I think his suggestion is wrong.' Change in emotion: 'Anger' to 'Calmness'."

[1116] The flow of the specific processing in Example 2 will be explained using Figure 19.

[1117] Step 1:

[1118] The user inputs information into the system via a terminal. This information includes what the user wants to convey and their emotional state. The input information is then sent from the terminal to the server.

[1119] Step 2:

[1120] The server uses natural language processing technology to analyze the information received from the terminal. Specifically, it uses a generative AI model to understand the user's input and grasp what the user wants to convey and the degree of respect they show to the other party. This analysis reveals the intent behind the input information.

[1121] Step 3:

[1122] The server operates the emotion engine based on the analysis results. The emotion engine detects changes in emotion based on user input. For example, if the user's emotion changes from "anger" to "calmness," it tracks that change. In this process, data is acquired on how the input emotional state changed.

[1123] Step 4:

[1124] The server adjusts the user's message based on emotional changes. Specifically, it considers the analysis results and emotional shifts to transform the message into a respectful expression. This transformation generates a message that accurately conveys the user's intent while showing respect to the recipient.

[1125] Step 5:

[1126] The server sends the adjusted message back to the user. The user can check this message through their terminal. The output message reflects the user's intentions while also being considerate of the recipient.

[1127] (Application Example 2)

[1128] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1129] In modern information processing systems, it is crucial to appropriately analyze user emotions and translate them into respectful expressions. However, conventional systems have struggled to track changes in user emotions in real time and adjust their expressions accordingly. This creates a challenge where misunderstandings and discomfort can arise in communication between users and systems.

[1130] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1131] In this invention, the server includes means for receiving input information from the user, means for analyzing the content to be conveyed based on the input information, and means for tracking changes in the user's emotions and adjusting expressions of respect based on those changes in emotions. This makes it possible to generate appropriate and respectful expressions in real time that correspond to the user's emotions, thereby reducing misunderstandings and discomfort.

[1132] "Means of receiving user input information" refers to the function that allows the system to acquire information provided by the user.

[1133] "Means for analyzing what you want to convey" refers to a function that processes user input information to understand what that information is trying to communicate.

[1134] "Means of converting into respectful expressions" refers to a function that converts the analyzed content into respectful expressions towards the other party.

[1135] "Means for tracking changes in user emotions and adjusting expressions of respect" refers to a function that monitors changes in user emotions in real time and appropriately adjusts expressions in response to those changes.

[1136] "Means for outputting conversion results" refers to a function for providing the converted expression to the user or other systems.

[1137] This section describes the embodiments for carrying out the invention. This invention is a system that generates appropriate and respectful expressions in response to the user's emotions. The system receives input information from the user and analyzes that information to understand what the user wants to convey. Natural language processing technology is used for the analysis. Based on the analysis results, it converts the information into respectful expressions. Furthermore, it tracks changes in the user's emotions and adjusts the expressions accordingly.

[1138] This system operates on smartphones and servers. The program is written in Python and uses the Hugging Face Transformers library for natural language processing. A BERT-based sentiment analysis model is used for sentiment analysis. The server functions as an API server using Flask, receiving user input and returning analysis results.

[1139] For example, if a user enters "Payment failed," the server uses a sentiment analysis model to interpret this as "dissatisfaction." As a result, the system generates a response such as "We apologize for the inconvenience." If the user's sentiment changes to "calm," the response is adjusted to "We will do our best to support you in resolving the issue."

[1140] An example of a prompt message is as follows:

[1141] User input: "Payment failed"

[1142] Emotion analysis: "Dissatisfaction"

[1143] Response generated: "We apologize for any inconvenience this may cause."

[1144] The flow of a specific process in Application Example 2 will be explained using Figure 20.

[1145] Step 1:

[1146] The user provides input information using a terminal. This input information is text data that includes the user's emotions and intentions. This data is sent to the server.

[1147] Step 2:

[1148] The server analyzes the received input information using natural language processing techniques. Specifically, it uses the Hugging Face Transformers library to analyze the sentiment of the input text. The input is user text data, and the output is a sentiment label (e.g., "dissatisfied," "calm").

[1149] Step 3:

[1150] The server translates the analysis results into respectful language. Using a generative AI model, it generates appropriate responses corresponding to emotion labels. The input is an emotion label, and the output is a respectful response text.

[1151] Step 4:

[1152] The server tracks changes in the user's emotions and adjusts its response as needed. If an emotional change is detected, it uses the regenerative AI model to generate an adjusted response. The input is information about the emotional change, and the output is the adjusted response text.

[1153] Step 5:

[1154] The server sends the final response to the terminal and displays it to the user. The user can review the displayed response and provide further input information as needed.

[1155] (Example 3)

[1156] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1157] In modern communication, users are required to express their true feelings in a way that respects the other person. However, it is difficult for users to come up with such expressions themselves, and it is also difficult for them to adjust their expressions appropriately according to changes in their emotions. This can lead to misunderstandings and conflicts, so a system is needed to resolve this.

[1158] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[1159] In this invention, the server includes means for receiving information from the user, means for analyzing the content based on the information, means for converting the analysis results into respectful expressions, means for tracking changes in the user's emotions and adjusting the respectful expressions based on those changes in emotions, and means for performing analysis and conversion using a generative AI model. As a result, when a user conveys their true feelings to another person, the server automatically converts them into respectful expressions and further uses expressions that are appropriately adjusted according to changes in emotions.

[1160] "Means of receiving information from users" refers to an interface for obtaining text data entered by users.

[1161] "Means of content analysis" refers to the process of analyzing acquired text data to understand its intent and emotions.

[1162] "Methods for converting into respectful expressions" refers to a process that, based on analysis results, converts the user's true feelings into expressions that are considerate of the other person.

[1163] "Means for outputting conversion results" refers to an interface for presenting the converted text to the user.

[1164] "Means for tracking changes in a user's emotions and adjusting expressions of respect based on those changes" refers to a process for monitoring changes in a user's emotions and appropriately adjusting expressions in response to those changes.

[1165] "Means of performing analysis and transformation using a generative AI model" refers to the process of performing analysis and transformation of text data using a pre-trained artificial intelligence model.

[1166] "Tools for organizational management" refer to systems and software used to facilitate human resource management and communication within an organization.

[1167] An "automatic response program for communication devices" is a program that automatically responds to inquiries and messages from users.

[1168] This invention is a system that analyzes text entered by a user and converts it into respectful language. The system includes a user terminal, a server, a generative AI model, and an emotion engine.

[1169] The user enters text through the terminal. This text contains the user's true feelings. For example, they might enter, "I think his suggestion is wrong." The terminal then sends this input to the server.

[1170] The server sends the received text to a generating AI model. This model uses natural language processing techniques to analyze the text and understand the user's intent and emotions. Specifically, it grasps the context of the text and determines what kind of expression is respectful to the other person.

[1171] Based on the analysis results, the server transforms the user's true feelings into respectful expressions. This transformation uses a pre-trained generative AI model. For example, the true feeling "I think his proposal is wrong" is changed to "It might be necessary to consider his proposal from a different perspective."

[1172] Furthermore, the server uses an emotion engine to track changes in the user's emotions. If the user's emotion changes from "anger" to "calmness," the server takes this change into account and further adjusts its expression of respect. Specifically, it might change the expression "Perhaps we should reconsider his proposal" to "Perhaps his proposal is worth reconsidering."

[1173] Ultimately, the server sends the converted text to the terminal, which then displays it to the user. This allows the user to use respectful language towards the other party.

[1174] As a concrete example, the following is an example of a prompt sentence to be input to the generation AI model: "User input: 'I think his suggestion is wrong.' Emotional state: Changed from 'angry' to 'calm.' Please generate a respectful expression." With this prompt, the system generates an appropriate expression. The flow of specific processing in Example 3 will be explained using Figure 21.

[1175] Step 1:

[1176] The user enters text through the terminal. The entered text contains the user's true feelings. For example, they might enter, "I think his proposal is wrong." This input is sent from the terminal to the server.

[1177] Step 2:

[1178] The server sends the text received from the terminal to a generative AI model. The generative AI model analyzes the text using natural language processing techniques. Specifically, it understands the context of the text and grasps the user's intent and emotions. Through this analysis, it determines what kind of expression is respectful to the other person. The analysis results are returned to the server.

[1179] Step 3:

[1180] The server translates the user's true feelings into respectful expressions based on the analysis results from the generating AI model. This translation process uses a pre-trained model. For example, the true feeling "I think his proposal is wrong" is changed to "It might be necessary to consider his proposal from a different perspective." The translated text is stored on the server.

[1181] Step 4:

[1182] The server uses an emotion engine to track changes in the user's emotions. If the user's emotion changes from "anger" to "calmness," the server takes this change into account and further adjusts its expressions of respect. Specifically, it adjusts the expression "Perhaps we should reconsider his proposal" to "Perhaps his proposal is worth reconsidering." The adjusted text is updated within the server.

[1183] Step 5:

[1184] The server sends the final converted and adjusted text to the terminal. The terminal displays this text to the user. This allows the user to use respectful language towards the other party.

[1185] (Application Example 3)

[1186] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1187] In customer service interactions within electronic transactions, operators are required to communicate with customers using appropriate and respectful language. However, operators may become emotional or struggle to immediately think of appropriate expressions, potentially leading to decreased customer satisfaction. To address this problem, a system is needed that converts operator input into respectful language in real time and sends it to the customer.

[1188] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[1189] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful language. This makes it possible to convert the information entered by the operator into respectful language in real time and transmit it to the customer.

[1190] "Means of receiving user input information" refers to an interface for obtaining information that users provide to the system.

[1191] "Means of analyzing what you want to convey" refers to a function that processes information entered by the user to understand its intent and meaning.

[1192] "Means of converting into respectful language" refers to a function that converts the analyzed content into language that is considerate of the other person.

[1193] "Means for outputting conversion results" refers to a function for presenting the converted expression to the user or another system.

[1194] "Means for tracking emotional changes and adjusting expressions of respect" refers to a function that monitors changes in the user's emotions and appropriately adjusts expressions in response to those changes.

[1195] "Means to support customer service in electronic transactions" refers to support functions provided by the system to enable operators to provide appropriate service to customers in electronic transaction settings.

[1196] A description of the embodiment for carrying out the invention will be given.

[1197] The system for realizing this invention mainly consists of a server and a user terminal. The server receives input information from the user, analyzes that information, and understands what the user wants to convey. Natural language processing technology is used for the analysis, specifically a generative AI model utilizing the Transformers library. Based on the analysis results, processing is performed to convert the message into an expression that respects the recipient. The converted expression is output to the user terminal in text format.

[1198] Furthermore, the server uses sentiment analysis tools such as TextBlob and NLTK to track changes in the user's emotions. It has the ability to adjust expressions of respect according to changes in emotions. This ensures that appropriate expressions are provided according to the user's feelings.

[1199] For example, if a user types "This problem is your mistake," the system will translate this to "Could you please let me know more about this problem?" An example of a prompt would be, "Please translate the user's input into a respectful expression. Input: 'This problem is your mistake'."

[1200] In this way, a system is built to support customer service in electronic transactions. Operators can communicate with customers in real time using appropriate language.

[1201] The flow of the specific processing in Application Example 3 will be explained using Figure 22.

[1202] Step 1:

[1203] The user provides input information through their device. This input information is text data containing the user's true feelings and opinions. The device sends this input information to the server.

[1204] Step 2:

[1205] The server analyzes the received input information. This analysis utilizes natural language processing techniques and a generative AI model powered by the Transformers library. By analyzing the input information, it understands the intended message and intent. This analysis result forms the basis for the next step.

[1206] Step 3:

[1207] The server converts the input into respectful language based on the analysis results. It uses a generative AI model to transform the input information into more considerate language. This transformation process uses prompts to generate appropriate output. For example, it might use the prompt: "Please convert the user's input into respectful language. Input: 'This problem is your mistake.'"

[1208] Step 4:

[1209] The server tracks changes in the user's emotions. TextBlob and NLTK are used for sentiment analysis. It analyzes the emotions in the input information and monitors how emotions change over time. It adjusts expressions of respect according to these emotional changes.

[1210] Step 5:

[1211] The server outputs the converted expression to the terminal. The terminal presents this output to the user. The user reviews the converted expression and sends it to the customer as needed. This enables the user to communicate appropriately with the customer in real time.

[1212] (Other examples)

[1213] Since this is the same as the specific processing described in the other embodiments of the first embodiment above, the explanation will be omitted.

[1214] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1215] The data generation model 58 is a form of so-called generative AI (Artificial Intelligence). One example of the data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1216] Other examples of generative AI include Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are some examples.

[1217] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1218] [Fourth Embodiment]

[1219] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1220] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1221] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1222] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1223] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1224] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1225] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1226] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1227] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1228] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1229] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1230] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1231] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[1232] "Example of form 1"

[1233] One embodiment of the present invention is a system used as a bot for a communication tool. This system has a means of receiving input information from the user. The user inputs their true feelings and their relationship with the other person. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[1234] "Example of form 2"

[1235] Next, the system has a means to analyze the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect shown to the recipient when conveying that message.

[1236] "Example of form 3"

[1237] Furthermore, the system has a means of converting the analysis results into respectful expressions. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[1238] "Example of form 4"

[1239] Finally, the system has a means of outputting the conversion results. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[1240] The following describes the processing flow for each example of the form.

[1241] "Example of form 1"

[1242] Step 1: The user inputs their true feelings and their relationship with the other person into the communication tool bot. For example, they might input their true feelings, such as "I think his proposal is wrong," and their relationship, such as "He is my boss."

[1243] Step 2: The system analyzes the message the user wants to convey based on the input information. This analysis is performed using natural language processing technology. From the analysis results, the system understands what the user wants to convey and the degree of respect the user will show to the recipient when conveying that message.

[1244] Step 3: The system converts the analysis results into a respectful expression. This conversion is performed using a pre-trained model. For example, the honest opinion, "I think his proposal is wrong," is converted into a respectful expression such as, "It might be necessary to consider his proposal from a different perspective."

[1245] Step 4: The system outputs the conversion result. The output is in text format and is presented to the user. This makes it easier for the user to translate their true feelings into respectful expressions when communicating with others.

[1246] (Example 1)

[1247] Next, we will describe Embodiment 1 of Example Form 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1248] In modern information exchange, it is difficult for users to find appropriate communication methods that consider both their true feelings and their relationship with the other person. Especially in workplace and organizational communication, it is necessary to effectively convey one's own opinions while respecting others, but finding concrete ways to do so is not easy.

[1249] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1250] In this invention, the server includes means for receiving input information from a user, means for converting the input information into a data format and transmitting it, and means for performing analysis using a generated artificial intelligence model based on the input information. This makes it possible for users to easily obtain appropriate communication methods based on their true feelings and their relationship with the other person.

[1251] A "user" refers to an individual or organization that provides input information to the system.

[1252] "Input information" refers to data that users provide to the system, specifically including information about the user's true feelings and their relationship with the other party.

[1253] "Data format" refers to the format in which information is converted into a form that can be processed by a computer.

[1254] A "generative artificial intelligence model" refers to a machine learning model used for natural language processing, specifically a technology that performs analysis based on user input.

[1255] "Analysis" refers to information processing that uses input information to derive appropriate communication methods.

[1256] "Communication methods" refer to the specific means and expressions that indicate how a user should convey information to another person.

[1257] "Organizational management" refers to management activities aimed at the efficient operation of personnel and operations within an organization.

[1258] "Information exchange" refers to the act of transmitting information between individuals or groups.

[1259] An "automatic response program" refers to software that automatically generates responses in response to user input.

[1260] The following system configurations are possible as embodiments for carrying out this invention.

[1261] Users input their true feelings and their relationship with the other person using a device. The device is a smartphone or personal computer, providing an interface for receiving the information entered by the user. The information entered by the user is collected through text boxes.

[1262] The terminal converts the input information received from the user into a data format and sends it to the server. During this process, the data is converted to a standard data format such as JSON and transmitted securely using the HTTPS protocol.

[1263] The server uses a generative artificial intelligence model to analyze the received data. Specifically, it can utilize a general machine learning model as a generative AI model for natural language processing. For example, OpenAI's GPT-3 is one such model. This model generates appropriate communication methods based on the user's true feelings and relationship with them.

[1264] The generated communication method is sent from the server to the terminal. The terminal displays the received information to the user, who can then use it as a reference to communicate with the other party.

[1265] For example, if a user inputs the information "I think his proposal is wrong" and "He is my boss," the generating AI model will generate a communication method such as "When dealing with your boss, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." An example of a prompt might be, "Please suggest an appropriate communication method based on the user's true feelings and their relationship with the other person."

[1266] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1267] Step 1:

[1268] The user uses their device to input their true feelings and their relationship with the other person. Specifically, they enter information such as "I think his suggestion is wrong" and "He is my boss" into the text box on the device. The entered information is temporarily stored on the device.

[1269] Step 2:

[1270] The terminal converts the input information received from the user into a data format and sends it to the server. Specifically, it converts the input information into JSON format and sends it to the server using the HTTPS protocol. At this time, the input information is structured as a JSON object with keys for "true feelings" and "relationship".

[1271] Step 3:

[1272] The server parses the received JSON data. Specifically, it uses a generative AI model to generate appropriate communication methods based on the user's true feelings and relationship with the other party. The server inputs the prompt "Please suggest an appropriate communication method based on the user's true feelings and relationship with the other party" into the generative AI model and performs the analysis.

[1273] Step 4:

[1274] The server sends the analysis results obtained from the generated AI model to the terminal in JSON format. Specifically, it structures the generated communication method as a JSON object with the key "proposal" and sends it to the terminal using the HTTPS protocol.

[1275] Step 5:

[1276] The terminal parses the JSON data received from the server and displays a generated communication method to the user. Specifically, the terminal screen displays a message such as, "When communicating with your superior, it's best to first acknowledge the good points of their proposal, and then politely convey your own opinion." The user can then use this suggestion as a reference when communicating with others.

[1277] (Application Example 1)

[1278] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1279] In face-to-face services, smooth communication with customers is crucial, but accurately understanding their true feelings and emotions and responding appropriately is a challenging task. In particular, making instantaneous decisions about appropriate responses based on a customer's facial expressions and relationship with them has been difficult with traditional methods.

[1280] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1281] In this invention, the server includes means for receiving input information from the user, means for acquiring video data and analyzing a person's facial expressions, and means for generating a response based on a prompt sentence using a generative AI model. This enables the automatic generation of appropriate responses based on the customer's facial expressions and relationship, facilitating smooth communication in face-to-face services.

[1282] "Means of receiving user input information" refers to the methods and devices by which the system acquires data and information provided by the user.

[1283] "Means for analyzing what you want to convey" refers to methods or devices that process information received from users to understand their intentions and objectives.

[1284] "Means of converting into respectful expressions" refers to methods or devices that convert analyzed content into appropriate and polite expressions for the other party.

[1285] "Means for outputting conversion results" refers to methods or devices for presenting the converted information to a user or other system.

[1286] "Means for acquiring video data and analyzing a person's facial expressions" refers to methods or devices for acquiring video using cameras or other equipment and analyzing the facial expressions of people within that video.

[1287] "Means for generating appropriate responses based on facial expression data and relationships" refers to methods or devices for determining the optimal response or action by considering the relationship between the analyzed facial expression information and the user.

[1288] "Means for generating responses based on prompt sentences using a generative AI model" refers to methods or devices that utilize artificial intelligence models to generate appropriate responses based on given prompt sentences.

[1289] The system for carrying out this invention includes a terminal for receiving input information from a user, a camera for acquiring video data, and a server for processing this data. The server receives the information provided by the user and analyzes the content the user wants to convey based on that information. The analyzed content is converted into respectful language and output as an appropriate response.

[1290] The server analyzes facial expressions from video data acquired using a camera. Specifically, it uses image processing libraries such as OpenCV to recognize facial expressions in real time. The recognized facial expression data is considered along with the relationship with the user and used as basic data to generate appropriate responses.

[1291] The system utilizes a generative AI model to generate responses based on prompts. For example, it can use the OpenAI API to input a prompt and obtain an appropriate response. A specific example of a prompt would be, "The customer's expression indicates dissatisfaction, and they are a regular customer. Please suggest an appropriate response." Based on this prompt, the AI ​​model generates the optimal response for the customer.

[1292] This system is expected to facilitate smoother communication in face-to-face services and improve customer satisfaction.

[1293] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1294] Step 1:

[1295] The terminal receives input information from the user. This input information includes the user's true feelings and their relationship with the other party. This information is sent to the server and used as basic data for analysis.

[1296] Step 2:

[1297] The server acquires video data using a camera and analyzes people's facial expressions. It uses image processing libraries such as OpenCV to recognize facial expressions in real time. The input is video data from the camera, and the output is the analyzed facial expression data.

[1298] Step 3:

[1299] The server generates prompt text based on user input and analyzed facial expression data. This prompt text includes the user's true feelings, their relationship with the other person, and facial expression data. This prepares the input for the generating AI model.

[1300] Step 4:

[1301] The server generates responses based on prompts using a generative AI model. Using the OpenAI API, prompts are input, and appropriate responses are obtained. The input is the prompt, and the output is the generated response.

[1302] Step 5:

[1303] The server sends the generated response to the terminal and presents it to the user. This allows the user to know how to proceed appropriately. The output is the response presented to the user.

[1304] (Example 2)

[1305] Next, we will describe Example 2 of the morphological example. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1306] In modern communication, it is crucial to accurately analyze what a user wants to convey and translate it into expressions that show appropriate respect for the recipient. However, conventional technologies have a challenge in generating expressions that fully consider the user's intentions and the recipient's feelings.

[1307] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1308] In this invention, the server includes means for receiving information from a user, means for analyzing the information using natural language processing technology, and means for evaluating the user's intentions and the degree of respect shown to the other party based on the analysis results. This makes it possible to accurately grasp the user's intentions and generate expressions that show appropriate consideration for the other party.

[1309] A "user" is an entity that uses a system to input information and receive analysis results.

[1310] "Information" refers to text data that users input into the system, including the user's intentions and considerations for others.

[1311] "Natural language processing technology" refers to techniques that enable computers to understand and analyze human language, and includes tokenization, part-of-speech tagging, and dependency analysis.

[1312] "Analysis" is the process of processing information using natural language processing technology to identify the user's intentions and the degree of respect they have for the other party.

[1313] "Evaluation" is the act of judging the user's intentions and the degree of respect they show to others, based on the analysis results.

[1314] "Output" refers to the process of providing the user with the results of the analysis and evaluation.

[1315] A "system" is a device or program that includes a set of means for receiving, analyzing, evaluating, and outputting information from a user.

[1316] This invention is a system that analyzes information entered by a user and evaluates their intent and the degree of respect shown to the other party. The server receives information from the user and performs analysis using natural language processing technology. This analysis uses natural language processing libraries such as "spaCy" and "NLTK". These libraries enable text tokenization, part-of-speech tagging, and dependency analysis, and are used to accurately grasp the user's intent.

[1317] The server evaluates the user's intent and the degree of respect shown to the recipient based on the analysis results. The evaluation results are output to the user via their device. This allows the user to see how their message is interpreted and how much consideration they have shown to the recipient.

[1318] For example, if a user enters the message, "Could you please change the meeting time?", the server analyzes this message and understands that the user is requesting a change in the meeting time. Furthermore, the use of polite language indicates a high degree of respect for the other party.

[1319] An example of a prompt to input into the generating AI model is, "Analyze the polite language used by the user when requesting a change in meeting time, and evaluate the degree of respect shown to the other party." This prompt allows the system to accurately analyze the user's intent and make an appropriate evaluation.

[1320] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1321] Step 1:

[1322] The user inputs information into the system via a terminal. This information is text data containing the message the user wants to convey. The terminal then sends this input information to the server.

[1323] Step 2:

[1324] The server analyzes the received information using natural language processing techniques. Specifically, the server uses libraries such as "spaCy" and "NLTK" to tokenize the text, tag it with parts of speech, and perform dependency analysis. This analysis identifies the user's intent and grasps the semantic structure of the text. The input is the user's text data, and the output is the analyzed intent and structural information.

[1325] Step 3:

[1326] The server evaluates the user's intent and the degree of respect shown to the other party based on the analysis results. Specifically, it checks whether polite language and respectful expressions are included and determines the extent of consideration shown to the other party. The input is the analyzed intent and structural information, and the output is the result of identifying the intent and evaluating the degree of respect.

[1327] Step 4:

[1328] The server returns the evaluation results to the user. The terminal displays these results to the user. Specifically, it includes a summary of what the user wants to convey and an evaluation of the degree of respect shown to the other party. The input is the evaluation result, and the output is the evaluation information presented to the user.

[1329] (Application Example 2)

[1330] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1331] In modern electronic transaction services, there is a demand for prompt and appropriate responses to user inquiries and complaints. However, accurately understanding the user's intentions and level of respect can be difficult, sometimes leading to a decline in the quality of service. Therefore, a system is needed that analyzes the user's intentions and level of respect, and proposes appropriate response methods.

[1332] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1333] In this invention, the server includes means for receiving information from a user, means for analyzing the content to be conveyed based on the information, and means for proposing a response method based on the analysis results. This enables an accurate understanding of the user's intentions and degree of respect, and allows for a quick and appropriate response.

[1334] "Means of receiving information from users" refers to the methods by which the system acquires data and messages provided by users.

[1335] "Methods for analyzing what you want to convey" refers to methods of processing data based on acquired information in order to understand the user's intentions and objectives.

[1336] "Methods for converting information into respectful language" refer to methods of reconstructing information in a way that shows respect to the other party, based on the analysis results.

[1337] "Means for outputting conversion results" refers to a method for providing the reconstructed information to a user or other system.

[1338] "Means of proposing response methods" refers to methods for presenting optimal countermeasures or responses based on analysis results.

[1339] "User intent" refers to the purpose or desire that the user is trying to convey through the system.

[1340] "Degree of respect" refers to the level of respect and attitude that a user shows towards another person.

[1341] "Electronic transaction service support tools" are auxiliary systems and applications used to facilitate online commercial transactions.

[1342] The "automatic response function of the dialogue support tool" is a function that automates communication with users and enables efficient responses.

[1343] A description of the embodiment for carrying out the invention will be given.

[1344] This invention is a system that receives information from a user, analyzes the user's intentions and degree of respect towards the other party based on that information, and proposes an appropriate response method. The system consists of a server and a user terminal.

[1345] The server receives messages sent from the user's terminal. The received messages are analyzed using natural language processing techniques. This analysis utilizes the Python programming language and natural language processing libraries such as spaCy and Transformers. The analysis results in an estimation of the user's intent and level of respect.

[1346] Based on the analysis results, the server uses a generative AI model to propose an appropriate response. This proposal is sent to the user's terminal and presented to the user. The user can then use the proposed response as a reference to communicate appropriately with the other party.

[1347] For example, if a user sends a message saying, "There was a problem with my recent transaction. Please address it urgently," the server analyzes this message and understands the user's intent ("there is a problem") and the degree of respect expressed ("urgently"). Based on this, the server proposes and presents a prompt solution to the user.

[1348] An example of a prompt message is: "Analyze the user's message and estimate its intent and level of respect. Message: 'There was a problem with a recent transaction. Please address it as soon as possible.'"

[1349] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1350] Step 1:

[1351] The user uses a terminal to input a message and sends it to the server. The input message is natural language text containing the user's intentions and requests. The server receives this message.

[1352] Step 2:

[1353] The server tokenizes received messages using the natural language processing library spaCy and analyzes their grammatical structure. The input is the user's message, and the output is the tokenized words and their grammatical relationships. This process clarifies the message's structure.

[1354] Step 3:

[1355] The server uses Transformers to estimate the user's intent and level of respect from tokenized messages. The input is a tokenized message, and the output is a numerical value or label indicating the user's intent and level of respect. This process allows the meaning of the message to be understood.

[1356] Step 4:

[1357] The server uses a generative AI model to generate appropriate responses based on estimated intent and respect levels. The input is the intent and respect levels, and the output is the proposed response. This process determines the optimal response for the user.

[1358] Step 5:

[1359] The server sends the generated response method to the user's terminal. The user reviews the proposed response method on their terminal and, if necessary, uses it as a reference to reply to the other party. The input is the proposed response method, and the output is the user's confirmation and use. This process enables the user to communicate appropriately.

[1360] (Example 3)

[1361] Next, we will describe Embodiment 3 of Example 3. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1362] In modern communication, it is crucial for users to translate their true feelings into respectful expressions, but doing so manually is difficult and time-consuming. Furthermore, there is a lack of technology to automatically generate appropriate expressions that take into account the user's intentions and relationship.

[1363] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[1364] In this invention, the server includes means for receiving information from the user, means for using a generative AI model to analyze the information, and means for transforming the expression based on the analysis results. This makes it possible to automatically transform the user's true feelings into expressions that respect the other party.

[1365] A "user" is an entity that uses a system to input information and receives the converted results.

[1366] "Information" refers to text data that users input into the system, including the user's intentions and relationships.

[1367] A "generative AI model" is an artificial intelligence technology used to analyze input information and perform appropriate transformations.

[1368] "Analysis" is the process of using a generative AI model to understand the intent and emotions behind the input information and extract the foundational data for transformation.

[1369] "Conversion" is the process of replacing input information with respectful expressions based on the analysis results.

[1370] "Output" refers to the process of presenting the converted result to the user.

[1371] A "server" is a computer system that receives information from users, analyzes and transforms it, and outputs the results.

[1372] One embodiment of this invention includes a process in which a user inputs information using a terminal, and a server analyzes and transforms that information.

[1373] The server communicates with the terminal over the network to receive information from the user. The user enters text into the terminal's input field. For example, they might enter information such as "I think his suggestion is wrong."

[1374] The server uses a generative AI model to analyze the information it receives. This model uses natural language processing techniques to understand the intent and sentiment of the input information. Specifically, it can use generative AI models such as OpenAI's GPT-3.

[1375] After the analysis is complete, the server transforms the information based on the analysis results. The purpose of the transformation is to replace the user's true feelings with expressions that respect the other party. For example, the information "I think his proposal is wrong" is transformed into the expression "It might be necessary to consider his proposal from a different perspective."

[1376] The converted information is sent from the server to the terminal and presented to the user. This allows the user to communicate in a way that is considerate of the other person.

[1377] A concrete example of a prompt sentence is, "Please rephrase the following sentence in a respectful manner: I think his suggestion is wrong." By inputting this prompt sentence into the generation AI model, an appropriate transformation is performed. The flow of the specific processing in Example 3 will be explained using Figure 15.

[1378] Step 1:

[1379] The user inputs information using a terminal. The user enters their honest opinion in text format into the terminal's input field. For example, they might enter, "I think his proposal is wrong." This input information becomes the basis for subsequent analysis and transformation.

[1380] Step 2:

[1381] The terminal sends the entered information to the server. The terminal sends the text entered by the user to the server via an HTTP request. This transmission allows the server to receive the data for analysis and transformation.

[1382] Step 3:

[1383] The server inputs the received information into a generative AI model. The server then uses the generative AI model to analyze the information. This model utilizes natural language processing techniques to understand the intent and emotions behind the input information. Based on the analysis, it determines how the information should be transformed.

[1384] Step 4:

[1385] The server transforms the information based on the analysis results. Based on the analysis results, the server transforms the input information into respectful language. For example, the information "I think his proposal is wrong" is transformed into "It might be necessary to consider his proposal from a different perspective." This transformation ensures that the user's true feelings are expressed in a way that is considerate of the other person.

[1386] Step 5:

[1387] The server sends the converted information to the terminal. The server sends the conversion result to the terminal via an HTTP response. This transmission prepares the terminal to present the conversion result to the user.

[1388] Step 6:

[1389] The terminal displays the conversion results to the user. The terminal displays the conversion results received from the server to the user. The user can check this converted information and use it when communicating it to the other party. This enables the user to communicate in a way that is considerate of the other person.

[1390] (Application Example 3)

[1391] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1392] In modern face-to-face customer service, polite and considerate communication with customers is crucial. However, it is difficult for staff to instantly choose the appropriate expression, which hinders the improvement of customer satisfaction. Therefore, there is a need for a system that allows staff to use respectful language with customers in real time.

[1393] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[1394] In this invention, the server includes means for receiving input information from a user, means for analyzing the content to be conveyed based on the input information, and means for converting the analysis results into respectful language. This enables staff to use appropriate language with customers in real time.

[1395] "Means of receiving user input information" refers to the function that allows the system to acquire information provided by the user.

[1396] "Means of analyzing what you want to convey" refers to a function that analyzes input information in order to understand the message the user intends to convey.

[1397] "A means of converting into respectful language" refers to a function that transforms the analyzed content into language that is considerate of the other person.

[1398] "Means for outputting conversion results" refers to a function for presenting the converted expression to the user.

[1399] "Means of presenting in real time on a visual display device" refers to a function for instantly displaying the converted expression visually.

[1400] A "wearable information terminal" is an information processing device that a user can wear and use.

[1401] "Communication support tools for face-to-face customer service" are tools designed to assist staff communication during face-to-face interactions with customers.

[1402] To implement this invention, smart glasses are used as a wearable information terminal. The smart glasses receive voice input from the user and transmit it to a server. The server converts the voice to text using speech recognition software (e.g., Google Speech-to-Text). The converted text is analyzed using a generative AI model (e.g., OpenAI GPT-3) and converted into respectful language. The converted language is displayed in real time on the smart glasses' display. This enables the user to use appropriate language when speaking to customers.

[1403] For example, if a user tries to say, "This product may not be right for you," the server will translate this to, "You might want to consider other options for this product," and display it on the smart glasses. An example of a prompt to input into the generating AI model is, "Please translate this into a respectful expression for the user's statement: 'This product may not be right for you.'"

[1404] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[1405] Step 1:

[1406] The user performs voice input through smart glasses, which are wearable information terminals. The voice input includes the content the user wants to convey to the customer.

[1407] Step 2:

[1408] The device uses speech recognition software (e.g., Google Speech-to-Text) to convert voice input into text data. The input is voice data, and the output is text data. This conversion processes the voice information into a format that can be analyzed.

[1409] Step 3:

[1410] The server uses a generative AI model (e.g., OpenAI GPT-3) to analyze text data and convert it into respectful language. The input is the converted text data, and the output is the text data of the respectful language. Prompts are used to convert the language to reflect the user's intent.

[1411] Step 4:

[1412] The server sends the converted text data to the terminal. The terminal displays the conversion results in real time on the smart glasses' display. This allows the user to use appropriate language when communicating with customers. The input is text data of the respected language, and the output is visually displayed information.

[1413] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1414] "Example of form 1"

[1415] One embodiment of the present invention provides a system incorporating an emotion engine. This system receives input information from the user and analyzes the message the user wants to convey based on that information. Based on the analysis results, it converts the message into a respectful expression and outputs the converted result. Furthermore, this system includes an emotion engine that recognizes the user's emotions. This emotion engine analyzes the emotion from the user's input information and converts it into a respectful expression that takes that emotion into account. Specifically, if the user inputs "I think his proposal is wrong" and the emotion at that time is "anger," the emotion engine analyzes that "anger" and converts it into a respectful expression such as "Perhaps we should reconsider his proposal."

[1416] "Example of form 2"

[1417] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts the expression of respect, such as "You might want to reconsider his suggestion," to a calmer expression such as "His suggestion might be worth reconsidering."

[1418] "Example of form 3"

[1419] Another embodiment of the present invention provides a system in which an emotion engine tracks changes in the user's emotions and adjusts expressions of respect based on those changes. Specifically, if the user inputs "I think his suggestion is wrong" and their emotion changes from "anger" to "calmness," the emotion engine tracks this change and adjusts ...

Claims

[Claim 1] Equipped with a processor, The aforementioned processor, The system receives input information entered by the user as text data through a terminal, which includes the user's intentions and consideration for the recipient. The input information is analyzed using natural language processing technology to evaluate the user's intent and the degree of respect shown to the other party. Based on the evaluation results that assess the user's intentions and the degree of respect for the other party, a prompt is generated to instruct the user to change the expression to one that shows respect for the other party. The generated prompt is input into the generation AI model and converted into an expression that respects the other party. The converted result, which has been transformed into an expression that respects the other party, is transmitted to the terminal. To analyze the user's emotions, emotion analysis technology is used to track changes in emotions, and generative AI is used to adjust expressions of respect based on those changes in emotions. The adjusted text data is sent to the terminal. system.

Images