system

Abstract

We provide the system. [Solution] Means for generating a message, A means of automatically adding recipient accounts, including public institutions, to the aforementioned message, When sending the aforementioned message, means for saving the content of the message to cloud storage in an unmodifiable form, Means for recording the transmission and reception history of the aforementioned messages with a timestamp added, A means of verifying the recipient's identity, A system that includes means for transmitting and recording the recognition status after identity verification to a server.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the transmission and reception of electronic messages, problems such as "sent but not received by the recipient", "contents being tampered with", and "uncertain whether the recipient has confirmed" may occur. These problems reduce reliability in business and legal contexts and may cause disputes. Therefore, there is a need for means to ensure that electronic messages are reliably sent, received, their contents are not tampered with, and to prove that the recipient has confirmed.

Means for Solving the Problems

[0005] This invention provides a means for generating messages, automatically adding recipient accounts including public institutions, and saving the content of messages to cloud storage in an unmodifiable form at the time of sending. It also solves the aforementioned problems by providing means for recording message sending and receiving history with timestamps, verifying the identity of recipients, and transmitting and recording subsequent recognition status to a server. Furthermore, it prevents tampering by generating a hash value for the message content stored in cloud storage and recording the corresponding hash value, and provides access means for providing evidence information to the user so that the user can check the evidence when needed.

[0006] A "message" is a collection of information sent and received electronically, and may include text, images, audio, video, and other media.

[0007] "Public institutions" refer to government, judicial, administrative agencies, or organizations with similar authority, and are institutions that are required to be reliable and accurate.

[0008] "Cloud storage" refers to a service that allows data to be stored and managed on remote servers via the internet, enabling users to store data without owning physical storage facilities.

[0009] A "hash value" is a fixed-length string generated from original data using a specific algorithm, and it has the characteristic of generating a unique value depending on the content of the original data.

[0010] A "timestamp" is information that indicates the date and time when a particular event or piece of data occurred, and is used to prove exactly when that data or event took place.

[0011] "Identity verification" refers to a series of procedures performed to confirm that a specific individual is indeed the person they claim to be, and generally involves using passwords or two-factor authentication.

[0012] "Awareness" refers to the fact that a recipient received a specific message and that they acknowledged it, and includes the circumstances under which this information is recorded.

[0013] "Evidence" refers to information used to prove facts related to the sending and receiving of electronic messages, and includes the content of the message, the date and time of sending and receiving, and the status of confirmation by the recipient. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the language used in the following description will be explained.

[0017] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] To implement this invention, the user first composes a message using a dedicated application on their device. This application provides an interface for entering the recipient, subject, body, and, if necessary, attachments. Before sending, the user can choose the option to automatically add recipient accounts, including those of government agencies.

[0036] When a message is sent from the terminal to the server, its contents are stored in cloud storage in an immutable form. The server generates a hash value for the message during storage and records this hash value. This record includes sender information, sending date and time, recipient information, and sending confirmation information.

[0037] When the recipient receives the message, the device initiates a verification process. This verification uses two-factor authentication or other authentication methods. After authentication is complete, the recipient's acknowledgment status is sent to and recorded on the server. This proves that the recipient has viewed the message.

[0038] This system can provide users with evidence as needed. For example, if a company sends a contract to a business partner, the user can later verify the transmission record and whether the message was opened. This system helps avoid problems related to sending and receiving messages and ensures reliability in business and legal activities.

[0039] The following describes the processing flow.

[0040] Step 1:

[0041] The user opens a messaging application on their device. They enter the recipient, subject, and body of the message, and use the option to add attachments if necessary.

[0042] Step 2:

[0043] The device presents the user with an option to automatically add government account information to the CC field on the message sending screen. The user then completes the preparation for sending.

[0044] Step 3:

[0045] When the user presses the send button, the message is sent from the device to the server. At this time, the message content is saved to cloud storage.

[0046] Step 4:

[0047] The server receives the sent message, stores the message content in an unmodifiable form, and generates and records a hash value. It also stores the date and time of transmission, sender information, and recipient information along with a timestamp.

[0048] Step 5:

[0049] When the recipient's device receives the message, it initiates an identity verification process. The device provides authentication methods, including two-factor authentication, and prompts the recipient to authenticate.

[0050] Step 6:

[0051] Once the recipient is successfully authenticated, the device sends a message to the server indicating that the recipient has read the message. This information is also recorded on the server.

[0052] Step 7:

[0053] Users can request access to evidence stored on the server as needed. The server processes this request and provides the relevant evidence to the user.

[0054] Step 8:

[0055] Users can use the provided evidence to check transmission records and receipt confirmation status, which helps avoid disputes and present evidence.

[0056] (Example 1)

[0057] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0058] In modern society, ensuring the reliability and security of information transmission and reception is crucial. However, existing systems suffer from problems such as information tampering and incomplete confirmation of receipt. In particular, for the transmission and reception of important information, there is a need for means to guarantee its authenticity and to prove that the recipient has reliably confirmed the information.

[0059] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0060] In this invention, the server includes means for remotely storing information in an immutable form, means for recording transmission and reception history along with timestamps, and means for recording the recipient's awareness status. This ensures the authenticity of the information and allows proof that the recipient has confirmed it.

[0061] "Information" refers to messages and their content that are generated, transmitted, and received within a system.

[0062] A "recipient identifier" is identification information necessary to receive information, and includes information that identifies public institutions or individuals.

[0063] "Remote storage" refers to saving information in an immutable form to cloud storage or other online storage.

[0064] A "time stamp" refers to a record of the date and time added when information is transmitted or received, and is used for managing the history of that information.

[0065] "Verification" refers to the means by which a recipient verifies information after receiving it.

[0066] "Recognition status" refers to the recording of the state in which the recipient has confirmed the information, and is used as proof of receipt.

[0067] This invention provides a mechanism for ensuring the authenticity and reliability of information transmission and reception. Users utilize a system that includes a dedicated application to create information on their terminal. This information includes messages and their content, and can automatically include recipient identifiers, including those of public institutions.

[0068] The created information is sent from the terminal to the server. At this time, the information is stored in an immutable form using remote storage methods such as cloud storage. During this process, the server marks the information with a timestamp and records the transmission and reception history in detail.

[0069] The server verifies the recipient's identity through the terminal to confirm that the recipient has received the information. This verification can be done using methods such as two-factor authentication or biometric authentication. The received verification information is returned to the server and recorded as the recipient's acknowledgment status. This process allows users to later check the information transmission and reception history and the recipient's verification status, thereby increasing the reliability of the information and preventing problems.

[0070] A concrete example of this invention is when a company sends an important contract to a business partner and confirms that it has been opened and accepted. This system allows the company to prove that the contract was sent correctly and that the recipient has confirmed it.

[0071] Example of a prompt:

[0072] "A company has sent an important contract to a business partner and wants to confirm that it has been opened. Please generate a prompt message simulating this situation."

[0073] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0074] Step 1:

[0075] The user opens a dedicated application to create the information. The user enters the recipient, subject, body, and attachments into the input interface. At this time, the user can choose the option to automatically add recipient identifiers, including those of public institutions. The entered information is temporarily stored within the application.

[0076] Step 2:

[0077] The terminal sends information entered by the user to the server. Upon transmission, the terminal generates a request to send the information to cloud storage. This request contains the information's content and is stored in the cloud in an immutable form. The server receives this information, generates an identification code for it, and records it along with a timestamp. The output is a confirmation message acknowledging the completion of the save.

[0078] Step 3:

[0079] After the server sends a message to the recipient, it initiates a verification process on the recipient's device. The input is the recipient's device information, and the output is a signal to initiate the verification process. The device initiates two-factor authentication or biometric authentication, and if successful, sends the result to the server.

[0080] Step 4:

[0081] The server records the recipient's acknowledgment status. The input is information indicating successful recipient authentication, and the output is a record that the recipient has acknowledged the information. The record includes the date and time of acknowledgment and the authentication method used. This allows the user to later retrieve this acknowledgment information as evidence.

[0082] (Application Example 1)

[0083] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0084] In today's information society, security and reliability are paramount in the transmission and reception of important documents. However, conventional communication methods often lack sufficient evidence to prevent tampering with document content or to confirm receipt. In particular, ensuring the reliable delivery and record-keeping of legal documents and important documents in commercial transactions remains a challenge.

[0085] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0086] In this invention, the server includes means for generating a document, means for automatically adding recipient identification information, including that of a public institution, to the document, and means for storing the contents of the document in an immutable form on an information processing device. This makes it possible to securely store and transmit important documents without tampering with them, and to record receipt confirmations in a reliable form as evidence.

[0087] A "document" is an electronic or physical record written for the purpose of transmitting information.

[0088] A "public institution" is an organization that functions based on the public interest, such as the government and its related organizations.

[0089] "Recipient identification information" refers to information used to identify the recipient of a message or document.

[0090] An "information processing device" is a computer system that stores, processes, and transmits data.

[0091] "Time information" refers to time-related data used to identify when a document or event occurred.

[0092] "Identity verification" is a procedure to verify the legitimacy of an individual or organization.

[0093] "Confirmation status" refers to a record of the fact that a message or document was received and properly confirmed.

[0094] An "encoded value" is an encrypted string of characters generated to uniquely identify the content of data.

[0095] "Evidence" refers to records or data used to prove a certain fact or event.

[0096] "User" refers to an individual or organization that uses the functions of the system or service.

[0097] To realize this invention, the following system configuration is necessary. The main components are a user terminal, a server, and an information processing device. The user uses the terminal to generate documents using a dedicated application, and can automatically add recipient identification information at that time. This application is equipped with a document creation interface, and the user inputs the necessary information.

[0098] Documents sent from user terminals are stored in an immutable form on the information processing device, and an encoded value is generated at that time. OpenSSL, an open-source encryption library, is used for this encoding. Time information is added to the records of document transmission and reception, thereby guaranteeing the document's timestamp.

[0099] The server runs software to verify the recipient's identity, employing methods such as two-factor authentication. Authentication apps like Google® Authenticator are used in this authentication process. After authentication, the verification status is sent to a data processing unit and recorded as evidence.

[0100] This system enables users to send and store important legal or commercial documents in a secure and reliable manner. For example, a company can send an important contract to a business partner and use the record as evidence in the future. The technical features of this invention ensure that messages are protected from tampering and that receipt is reliably confirmed.

[0101] A concrete example of a prompt might be: "Design a secure messaging service to send important contracts and confirm whether they have been opened. Provide detailed instructions on sending history and authentication procedures."

[0102] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0103] Step 1:

[0104] The user terminal launches a dedicated application and inputs the necessary information through the document creation interface. This input includes the document content, recipient identification information, and information about the public institution. Based on this information, the user terminal constructs the document data. The output is a document ready for transmission.

[0105] Step 2:

[0106] The user terminal sends document data to the information processing device. During transmission, the user terminal encrypts the data using SSL / TLS. The input consists of the generated document data and the recipient's identification information. The output is the encrypted data securely delivered to the information processing device.

[0107] Step 3:

[0108] The information processing device stores the received document data in an immutable form. OpenSSL is used to generate an encoded value. This encoded value guarantees the consistency and integrity of the data. The input is encrypted document data, and the output is its encoded value and a document storage confirmation.

[0109] Step 4:

[0110] The server records the transmission and storage status of documents, adding timestamps. These timestamps are crucial for recording the precise time of each data operation. Input is storage confirmation information from the information processing device, and output includes timestamped storage records.

[0111] Step 5:

[0112] When the recipient receives the document data, the server initiates an authentication process to verify the recipient's identity. This involves performing two-factor authentication to confirm the recipient's legitimacy. The input is the recipient's identification information, and the output is the authenticated recipient information.

[0113] Step 6:

[0114] The server records the confirmation status as evidence in the data processing unit. This allows for later verification that the document was received and confirmed. The input is authenticated recipient information and the confirmation result, and the output is a record of the confirmation status.

[0115] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0116] To implement this invention, the user first launches a dedicated application on their terminal and creates a message. When the user enters the message, the terminal has an emotion engine built in that analyzes the user's input behavior in real time. This emotion engine identifies the user's emotional state by taking into account keystroke analysis, input speed, device usage, etc.

[0117] Once a user's emotional state is analyzed, the emotion engine provides feedback that is reflected in the message content. For example, if a user is feeling stressed, the system can suggest ways to soften the tone of the message. This is highly effective when sending important messages in business communications.

[0118] After the message is created and sentiment feedback is applied, the device initiates the normal message sending procedure. The public institution's account is automatically added to the CC field, and the message is sent. Upon arrival at the server, the message is stored in cloud storage in an unalterable format. At this time, a hash value is generated for the message and recorded along with the relevant evidence.

[0119] When a recipient receives a message, the device uses an emotion engine to analyze the recipient's emotional state. This analysis records the recipient's response and sends it to the server. This helps the sender understand how the recipient reacted to the message.

[0120] For example, when a manager at a company needs to notify their team of a change in the schedule for an important meeting, this system, which incorporates an emotion engine, can create an effective message with the appropriate tone. Furthermore, it can understand how recipients will perceive the information and follow up as needed.

[0121] The following describes the processing flow.

[0122] Step 1:

[0123] The user launches a dedicated application on their device and opens the new message creation screen. Here, they begin entering the recipient, subject, and message body.

[0124] Step 2:

[0125] The emotion engine built into the device analyzes the user's keystrokes, typing speed, and patterns in real time to estimate the user's emotional state.

[0126] Step 3:

[0127] The emotion engine provides users with feedback on adjusting message content and changing tone based on the analysis results. For example, if anger is detected, it suggests phrasing to soften the tone.

[0128] Step 4:

[0129] Once the user has finished composing the message, the device automatically adds the recipient account of the public institution as a CC and sends the message to the server.

[0130] Step 5:

[0131] The server stores received messages in cloud storage in an unalterable format. Simultaneously, it generates a hash value for the message and records the date and time of transmission and other relevant evidence.

[0132] Step 6:

[0133] Upon receiving the message, the recipient's device analyzes their emotional state using an emotion engine. The results of this analysis are then sent to the server as the recipient's emotional response.

[0134] Step 7:

[0135] The recipient acknowledges the message, and their response is recorded. The server collects this information and uses it as a basis to provide response data to the sender.

[0136] Step 8:

[0137] Users can refer to the evidence provided by the server and the recipient's emotional response results as needed to conduct effective follow-up.

[0138] (Example 2)

[0139] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0140] In business and personal communication, the content and tone of a message may not be properly conveyed to the recipient. This is especially true when a user's emotional state influences the message, potentially leading to misunderstandings and inappropriate responses. Furthermore, a lack of evidence regarding message transmission and reception, and insufficient means to analyze recipient responses, hinders smooth communication between senders and receivers.

[0141] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0142] In this invention, the server includes means for analyzing the user's emotional state and providing feedback that adjusts the tone of the message based on that emotion; means for storing the content of the message in an immutable form in an information storage area when sending the message; and means for analyzing the recipient's emotional state and recording the analysis results. This makes it possible for messages sent by the user to be conveyed appropriately and effectively to the recipient, and for the user to understand the recipient's reaction.

[0143] A "user" is an individual or group that uses the system to create and send messages.

[0144] "Emotional state" refers to information about the psychological or emotional responses that a user or recipient exhibits when typing or receiving a message.

[0145] "Feedback" refers to suggestions or advice that a system provides to a user to adjust the content or tone of the message.

[0146] "Tone" refers to the way a message is expressed and the tone of voice, and it is a factor that influences how the message is received by the recipient.

[0147] An "information storage area" is a storage or database used to record the content of a transmitted message and related data in an immutable form.

[0148] "Identification information" refers to hash values ​​or other identifiable information used to uniquely identify a particular message or data.

[0149] "Analysis results" refer to data on the emotional state of the user or recipient obtained by the emotion engine, and evaluations made based on that data.

[0150] "Evidence" refers to recorded data related to sent and received messages, including transmission history and recipient responses.

[0151] To implement this invention, the user is first required to use a dedicated application installed on the terminal. The user creates messages on this application, and the key element here is the emotion engine built into the terminal. This emotion engine analyzes data such as keystroke analysis, input speed, and device usage in real time to identify the user's emotional state. As a result, the user can understand the impact of their emotional state on messages and receive emotion-based tone adjustment suggestions as feedback.

[0152] Once the user finishes editing the message and confirms sending, the device automatically adds the public institution's account to the sender list. This feature is important to ensure the accuracy and compliance of the message. After the message is sent, the server stores the content in an immutable form in the information storage area. At this time, a hash value is generated as the message's identifier and recorded along with supporting information.

[0153] Furthermore, upon receiving a message, the recipient's device again utilizes the emotion engine to analyze the recipient's emotional state. This allows the sender to understand the recipient's reaction and use that information to improve subsequent communication. For example, when a company manager shares the progress of an important project with employees, they can craft a message with the appropriate tone, analyze the recipient's reaction, and follow up accordingly.

[0154] An example of a prompt message might be: "The manager is creating a notification message to inform the team about a meeting schedule change. Please suggest wording and expressions to ease tension within the message." In this way, the present invention enables effective communication through sentiment analysis.

[0155] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0156] Step 1:

[0157] The user launches a dedicated application on their device and begins composing a message. As the user types, the device collects keystroke data and input speed in real time. The entered data is then passed directly to the emotion engine, where it is analyzed to identify the user's emotional state. The emotional state obtained through this analysis becomes the basis for generating feedback.

[0158] Step 2:

[0159] The device's built-in emotion engine analyzes collected data to determine the user's emotional state. For example, rapid keystrokes and short intervals may indicate stress. Based on this analysis, the emotion engine generates specific feedback to soften the tone of the message. This feedback is displayed on the user interface, allowing the user to incorporate it into their message creation.

[0160] Step 3:

[0161] Once the user has finished composing the message and confirmed sending it, the device automatically adds the official agency's account to the CC field and prepares to send the message. At this point, the message content is compiled into data for transmission and sent to the server. During transmission, a hash value is generated for message identification, and this information is also sent along with the message.

[0162] Step 4:

[0163] The server confirms the received message and stores its contents in an immutable form in the information storage area. During this process, the message's hash value is verified, and identification information is recorded. A timestamp is added upon storage, and this is retained as a transmission history. This record guarantees the authenticity and immutability of the message.

[0164] Step 5:

[0165] When a message reaches the recipient, the recipient's device activates an emotion engine to monitor the recipient's response. Open time and touch patterns are collected as data and used to analyze the recipient's emotional state. The analysis results are sent to a server and recorded in a format that the sender can later review. The analyzed emotion data helps the sender understand how their message was received.

[0166] (Application Example 2)

[0167] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0168] In modern communication, misunderstandings and problems can arise due to misinterpretations of the sender's emotions. Furthermore, because it is difficult to grasp the recipient's emotional response, improving the quality of communication is essential. Therefore, a means is needed to ensure the evidential nature of messages while maintaining an appropriate tone.

[0169] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0170] In this invention, the server includes means for generating a message, means for performing sentiment analysis and providing feedback to adjust the tone of the message, and means for storing the message in an immutable form in data storage. This makes it possible to send messages that appropriately reflect the sender's emotions and to understand the recipient's emotional response.

[0171] "Means of generating messages" refers to functions for creating text data for the purpose of transmitting information.

[0172] The "means for automatically adding recipient accounts" refer to a function that automatically includes recipient information that should be registered as the destination when sending a message.

[0173] "A means of performing emotion analysis and providing feedback to adjust the tone" refers to a function that analyzes the emotional state from the input text data and suggests appropriate improvements to the expression of the output information.

[0174] "Means of saving data to data storage" refers to a function for storing generated data in an immutable form for the purpose of persistently preserving information.

[0175] "Means for recording transmission and reception history and adding time information" refers to a function for maintaining the trajectory of message transmission and reception along with chronological information.

[0176] "Means for authenticating the recipient" refers to a function for verifying the identity of the message recipient.

[0177] "Means for analyzing the emotional state of the recipient and transmitting and recording subsequent cognitive information to an information terminal" refers to a function for analyzing the recipient's response and storing or communicating that information.

[0178] The system for carrying out the present invention includes a server and terminals, performs sentiment analysis, and supports appropriate communication.

[0179] The server works in conjunction with data storage to manage message generation and transmission. Message generation utilizes an artificial intelligence model for sentiment analysis. This AI model leverages technologies such as the Sentiment Analysis API to analyze user-entered text data in real time. Based on the analysis results, it provides users with feedback for tone adjustment and improvement. An application incorporating these functions is installed on the device. Through this application, users can input messages and send them with the tone modified as needed.

[0180] When a message is sent, the server saves its contents to data storage in an immutable state. The send / receive history is also timestamped and recorded along with the recipient's sentiment analysis results. The recipient is also provided with sentiment analysis capabilities, which analyze their emotional state at the time of receiving the message.

[0181] As a concrete example, consider a scenario where a salesperson in a physical store uses a tablet to send information about a new product to a customer. The salesperson uses a tablet application to input the message and adjusts the tone of the message based on emotional feedback. For example, after generating the sentence, "Would you like to try out the features of this product?", the AI ​​model provides feedback such as "Make it more approachable," and the tone is changed to "Please try this amazing new product!".

[0182] Example prompt: "Analyze the tone of customer notification messages for new products and suggest a more effective tone."

[0183] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0184] Step 1:

[0185] The user launches the application on their device and opens the message input screen. The user manually enters the message text. The device temporarily stores this input data and prepares it for sentiment analysis.

[0186] Step 2:

[0187] The device sends the user-entered message to the sentiment analysis engine. Using the transmitted text data as input, the sentiment analysis engine analyzes the emotional state of the message using an AI model. As a result of the analysis, the emotional tone of the message and suggested revisions are generated.

[0188] Step 3:

[0189] The server returns the analysis results to the terminal. The returned data includes feedback for appropriate tone changes. The user can choose to accept this feedback and revise the message content, or keep the original message. The revised text data is then output.

[0190] Step 4:

[0191] The user finalizes the message and presses the send button. The device automatically adds recipient information and necessary account details when sending the message to the server. The server receives the message and saves it in its data storage in an immutable format. The saved data also includes a timestamp and an encoded value.

[0192] Step 5:

[0193] When a recipient receives a message, their device performs sentiment analysis through the recipient's application. The analyzed emotional state is sent to a server and recorded as the recipient's response. This data allows the user to track the recipient's emotional responses.

[0194] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0195] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0196] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0197] [Second Embodiment]

[0198] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0199] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0200] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0201] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0202] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0203] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0204] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0205] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0206] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0207] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0208] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0209] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0210] To implement this invention, the user first composes a message using a dedicated application on their device. This application provides an interface for entering the recipient, subject, body, and, if necessary, attachments. Before sending, the user can choose the option to automatically add recipient accounts, including those of government agencies.

[0211] When a message is sent from the terminal to the server, its contents are stored in cloud storage in an immutable form. The server generates a hash value for the message during storage and records this hash value. This record includes sender information, sending date and time, recipient information, and sending confirmation information.

[0212] When the recipient receives the message, the device initiates a verification process. This verification uses two-factor authentication or other authentication methods. After authentication is complete, the recipient's acknowledgment status is sent to and recorded on the server. This proves that the recipient has viewed the message.

[0213] This system can provide users with evidence as needed. For example, if a company sends a contract to a business partner, the user can later verify the transmission record and whether the message was opened. This system helps avoid problems related to sending and receiving messages and ensures reliability in business and legal activities.

[0214] The following describes the processing flow.

[0215] Step 1:

[0216] The user opens a messaging application on their device. They enter the recipient, subject, and body of the message, and use the option to add attachments if necessary.

[0217] Step 2:

[0218] The device presents the user with an option to automatically add government account information to the CC field on the message sending screen. The user then completes the preparation for sending.

[0219] Step 3:

[0220] When the user presses the send button, the message is sent from the device to the server. At this time, the message content is saved to cloud storage.

[0221] Step 4:

[0222] The server receives the sent message, stores the message content in an unmodifiable form, and generates and records a hash value. It also stores the date and time of transmission, sender information, and recipient information along with a timestamp.

[0223] Step 5:

[0224] When the recipient's device receives the message, it initiates an identity verification process. The device provides authentication methods, including two-factor authentication, and prompts the recipient to authenticate.

[0225] Step 6:

[0226] Once the recipient is successfully authenticated, the device sends a message to the server indicating that the recipient has read the message. This information is also recorded on the server.

[0227] Step 7:

[0228] Users can request access to evidence stored on the server as needed. The server processes this request and provides the relevant evidence to the user.

[0229] Step 8:

[0230] Users can use the provided evidence to check transmission records and receipt confirmation status, which helps avoid disputes and present evidence.

[0231] (Example 1)

[0232] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0233] In modern society, ensuring the reliability and security of information transmission and reception is crucial. However, existing systems suffer from problems such as information tampering and incomplete confirmation of receipt. In particular, for the transmission and reception of important information, there is a need for means to guarantee its authenticity and to prove that the recipient has reliably confirmed the information.

[0234] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0235] In this invention, the server includes means for remotely storing information in an immutable form, means for recording transmission and reception history along with timestamps, and means for recording the recipient's awareness status. This ensures the authenticity of the information and allows proof that the recipient has confirmed it.

[0236] "Information" refers to messages and their content that are generated, transmitted, and received within a system.

[0237] A "recipient identifier" is identification information necessary to receive information, and includes information that identifies public institutions or individuals.

[0238] "Remote storage" refers to saving information in an immutable form to cloud storage or other online storage.

[0239] A "time stamp" refers to a record of the date and time added when information is transmitted or received, and is used for managing the history of that information.

[0240] "Verification" refers to the means by which a recipient verifies information after receiving it.

[0241] "Recognition status" refers to the recording of the state in which the recipient has confirmed the information, and is used as proof of receipt.

[0242] This invention provides a mechanism for ensuring the authenticity and reliability of information transmission and reception. Users utilize a system that includes a dedicated application to create information on their terminal. This information includes messages and their content, and can automatically include recipient identifiers, including those of public institutions.

[0243] The created information is sent from the terminal to the server. At this time, the information is stored in an immutable form using remote storage methods such as cloud storage. During this process, the server marks the information with a timestamp and records the transmission and reception history in detail.

[0244] The server verifies the recipient's identity through the terminal to confirm that the recipient has received the information. This verification can be done using methods such as two-factor authentication or biometric authentication. The received verification information is returned to the server and recorded as the recipient's acknowledgment status. This process allows users to later check the information transmission and reception history and the recipient's verification status, thereby increasing the reliability of the information and preventing problems.

[0245] A concrete example of this invention is when a company sends an important contract to a business partner and confirms that it has been opened and accepted. This system allows the company to prove that the contract was sent correctly and that the recipient has confirmed it.

[0246] Example of a prompt:

[0247] "A company has sent an important contract to a business partner and wants to confirm that it has been opened. Please generate a prompt message simulating this situation."

[0248] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0249] Step 1:

[0250] The user opens a dedicated application to create the information. The user enters the recipient, subject, body, and attachments into the input interface. At this time, the user can choose the option to automatically add recipient identifiers, including those of public institutions. The entered information is temporarily stored within the application.

[0251] Step 2:

[0252] The terminal sends information entered by the user to the server. Upon transmission, the terminal generates a request to send the information to cloud storage. This request contains the information's content and is stored in the cloud in an immutable form. The server receives this information, generates an identification code for it, and records it along with a timestamp. The output is a confirmation message acknowledging the completion of the save.

[0253] Step 3:

[0254] After the server sends a message to the recipient, it initiates a verification process on the recipient's device. The input is the recipient's device information, and the output is a signal to initiate the verification process. The device initiates two-factor authentication or biometric authentication, and if successful, sends the result to the server.

[0255] Step 4:

[0256] The server records the recipient's acknowledgment status. The input is information indicating successful recipient authentication, and the output is a record that the recipient has acknowledged the information. The record includes the date and time of acknowledgment and the authentication method used. This allows the user to later retrieve this acknowledgment information as evidence.

[0257] (Application Example 1)

[0258] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0259] In today's information society, security and reliability are paramount in the transmission and reception of important documents. However, conventional communication methods often lack sufficient evidence to prevent tampering with document content or to confirm receipt. In particular, ensuring the reliable delivery and record-keeping of legal documents and important documents in commercial transactions remains a challenge.

[0260] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0261] In this invention, the server includes means for generating a document, means for automatically adding recipient identification information, including that of a public institution, to the document, and means for storing the contents of the document in an immutable form on an information processing device. This makes it possible to securely store and transmit important documents without tampering with them, and to record receipt confirmations in a reliable form as evidence.

[0262] A "document" is an electronic or physical record written for the purpose of transmitting information.

[0263] A "public institution" is an organization that functions based on the public interest, such as the government and its related organizations.

[0264] "Recipient identification information" refers to information used to identify the recipient of a message or document.

[0265] An "information processing device" is a computer system that stores, processes, and transmits data.

[0266] "Time information" refers to time-related data used to identify when a document or event occurred.

[0267] "Identity verification" is a procedure to verify the legitimacy of an individual or organization.

[0268] "Confirmation status" refers to a record of the fact that a message or document was received and properly confirmed.

[0269] An "encoded value" is an encrypted string of characters generated to uniquely identify the content of data.

[0270] "Evidence" refers to records or data used to prove a certain fact or event.

[0271] "User" refers to an individual or organization that uses the functions of the system or service.

[0272] To realize this invention, the following system configuration is necessary. The main components are a user terminal, a server, and an information processing device. The user uses the terminal to generate documents using a dedicated application, and can automatically add recipient identification information at that time. This application is equipped with a document creation interface, and the user inputs the necessary information.

[0273] Documents sent from user terminals are stored in an immutable form on the information processing device, and an encoded value is generated at that time. OpenSSL, an open-source encryption library, is used for this encoding. Time information is added to the records of document transmission and reception, thereby guaranteeing the document's timestamp.

[0274] The server runs software to verify the recipient's identity, employing methods such as two-factor authentication. Authentication apps like Google Authenticator are used in this authentication process. After authentication, the verification status is sent to a data processing unit and recorded as evidence.

[0275] This system enables users to send and store important legal or commercial documents in a secure and reliable manner. For example, a company can send an important contract to a business partner and use the record as evidence in the future. The technical features of this invention ensure that messages are protected from tampering and that receipt is reliably confirmed.

[0276] As a specific example, a prompt sentence such as "Design a secure messaging service for sending important contract documents and checking their opening status. Show the transmission history and authentication procedures in detail" can be considered.

[0277] The flow of the specific process in Application Example 1 will be described using FIG. 12.

[0278] Step 1:

[0279] The user terminal launches a dedicated application and inputs the necessary information through a document creation interface. The inputs include the content of the document, recipient identification information, information of public institutions, etc. Based on this information, the user terminal constructs document data. As an output, document data ready for transmission is generated.

[0280] Step 2:

[0281] The user terminal transmits the document data to the information processing device. When transmitting, the user terminal encrypts the data using SSL / TLS and transmits it. The inputs are the generated document data and the recipient's identification information. As an output, the encrypted data reaches the information processing device securely.

[0282] Step 3:

[0283] The information processing device stores the received document data in a tamper - proof form. Here, OpenSSL is used to generate an encoded value. This encoded value guarantees the consistency and integrity of the data. The input is the encrypted document data, and the outputs are the encoded value and the confirmation of document storage.

[0284] Step 4:

[0285] The server records the status of document transmission and storage with timestamps added. This timestamp is important for recording the exact time of each data operation. The input is the storage confirmation information from the information processing device, and the output includes the storage record with timestamps.

[0286] Step 5:

[0287] When the recipient receives the document data, the server starts an authentication process to verify the identity of the recipient. Here, two-factor authentication is performed to confirm the legitimacy of the recipient. The input is the identification information of the recipient, and the output is the authenticated recipient information.

[0288] Step 6:

[0289] The server records the confirmation status as evidence in the data processing device. This makes it possible to verify later that the document has been received and confirmed. The input is the authenticated recipient information and the confirmation result, and the output is the creation of a record of the confirmation status.

[0290] Furthermore, an emotion engine for estimating the user's emotions may be combined. That is, the specific processing unit 290 may estimate the user's emotions using the emotion identification model 59 and perform specific processing using the user's emotions.

[0291] To implement the present invention, the user first launches a dedicated application on the terminal and creates a message. When the user inputs a message, an emotion engine is incorporated into the terminal, which analyzes the user's input actions in real time. This emotion engine takes into account factors such as keystroke analysis, input speed, and device usage status to identify the user's emotional state.

[0292] Once a user's emotional state is analyzed, the emotion engine provides feedback that is reflected in the message content. For example, if a user is feeling stressed, the system can suggest ways to soften the tone of the message. This is highly effective when sending important messages in business communications.

[0293] After the message is created and sentiment feedback is applied, the device initiates the normal message sending procedure. The public institution's account is automatically added to the CC field, and the message is sent. Upon arrival at the server, the message is stored in cloud storage in an unalterable format. At this time, a hash value is generated for the message and recorded along with the relevant evidence.

[0294] When a recipient receives a message, the device uses an emotion engine to analyze the recipient's emotional state. This analysis records the recipient's response and sends it to the server. This helps the sender understand how the recipient reacted to the message.

[0295] For example, when a manager at a company needs to notify their team of a change in the schedule for an important meeting, this system, which incorporates an emotion engine, can create an effective message with the appropriate tone. Furthermore, it can understand how recipients will perceive the information and follow up as needed.

[0296] The following describes the processing flow.

[0297] Step 1:

[0298] The user launches a dedicated application on their device and opens the new message creation screen. Here, they begin entering the recipient, subject, and message body.

[0299] Step 2:

[0300] The emotion engine installed on the terminal analyzes the user's keystrokes, typing speed, and patterns in real time to estimate the user's emotional state.

[0301] Step 3:

[0302] Based on the analysis results, the emotion engine provides the user with feedback regarding the adjustment of the message content and tone change. For example, if anger is detected, it proposes turns of phrase to soften the tone.

[0303] Step 4:

[0304] When the user completes the creation of the message, the terminal automatically adds the recipient account of the public institution as a CC and sends the message to the server.

[0305] Step 5:

[0306] The server stores the received message in an immutable form in cloud storage. At the same time, it generates the hash value of the message and records the transmission date and other relevant evidentiary information.

[0307] Step 6:

[0308] When the recipient's terminal receives the message, it analyzes the recipient's emotional state with the emotion engine. The results of this analysis are sent to the server as the recipient's emotional reaction.

[0309] Step 7:

[0310] The recipient checks the message and their reaction is recorded. The server accumulates this information to serve as a basis for providing the sender with the reaction data.

[0311] Step 8:

[0312] The user can refer to the evidentiary information provided by the server and the recipient's emotional reaction results as needed to conduct effective follow-up.

[0313] (Example 2)

[0314] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0315] In business and personal communication, the content and tone of a message may not be properly conveyed to the recipient. This is especially true when a user's emotional state influences the message, potentially leading to misunderstandings and inappropriate responses. Furthermore, a lack of evidence regarding message transmission and reception, and insufficient means to analyze recipient responses, hinders smooth communication between senders and receivers.

[0316] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0317] In this invention, the server includes means for analyzing the user's emotional state and providing feedback that adjusts the tone of the message based on that emotion; means for storing the content of the message in an immutable form in an information storage area when sending the message; and means for analyzing the recipient's emotional state and recording the analysis results. This makes it possible for messages sent by the user to be conveyed appropriately and effectively to the recipient, and for the user to understand the recipient's reaction.

[0318] A "user" is an individual or group that uses the system to create and send messages.

[0319] "Emotional state" refers to information about the psychological or emotional responses that a user or recipient exhibits when typing or receiving a message.

[0320] "Feedback" refers to suggestions or advice that a system provides to a user to adjust the content or tone of the message.

[0321] "Tone" refers to the way a message is expressed and the tone of voice, and it is a factor that influences how the message is received by the recipient.

[0322] An "information storage area" is a storage or database used to record the content of a transmitted message and related data in an immutable form.

[0323] "Identification information" refers to hash values ​​or other identifiable information used to uniquely identify a particular message or data.

[0324] "Analysis results" refer to data on the emotional state of the user or recipient obtained by the emotion engine, and evaluations made based on that data.

[0325] "Evidence" refers to recorded data related to sent and received messages, including transmission history and recipient responses.

[0326] To implement this invention, the user is first required to use a dedicated application installed on the terminal. The user creates messages on this application, and the key element here is the emotion engine built into the terminal. This emotion engine analyzes data such as keystroke analysis, input speed, and device usage in real time to identify the user's emotional state. As a result, the user can understand the impact of their emotional state on messages and receive emotion-based tone adjustment suggestions as feedback.

[0327] Once the user finishes editing the message and confirms sending, the device automatically adds the public institution's account to the sender list. This feature is important to ensure the accuracy and compliance of the message. After the message is sent, the server stores the content in an immutable form in the information storage area. At this time, a hash value is generated as the message's identifier and recorded along with supporting information.

[0328] Furthermore, upon receiving a message, the recipient's device again utilizes the emotion engine to analyze the recipient's emotional state. This allows the sender to understand the recipient's reaction and use that information to improve subsequent communication. For example, when a company manager shares the progress of an important project with employees, they can craft a message with the appropriate tone, analyze the recipient's reaction, and follow up accordingly.

[0329] An example of a prompt message might be: "The manager is creating a notification message to inform the team about a meeting schedule change. Please suggest wording and expressions to ease tension within the message." In this way, the present invention enables effective communication through sentiment analysis.

[0330] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0331] Step 1:

[0332] The user launches a dedicated application on their device and begins composing a message. As the user types, the device collects keystroke data and input speed in real time. The entered data is then passed directly to the emotion engine, where it is analyzed to identify the user's emotional state. The emotional state obtained through this analysis becomes the basis for generating feedback.

[0333] Step 2:

[0334] The device's built-in emotion engine analyzes collected data to determine the user's emotional state. For example, rapid keystrokes and short intervals may indicate stress. Based on this analysis, the emotion engine generates specific feedback to soften the tone of the message. This feedback is displayed on the user interface, allowing the user to incorporate it into their message creation.

[0335] Step 3:

[0336] Once the user has finished composing the message and confirmed sending it, the device automatically adds the official agency's account to the CC field and prepares to send the message. At this point, the message content is compiled into data for transmission and sent to the server. During transmission, a hash value is generated for message identification, and this information is also sent along with the message.

[0337] Step 4:

[0338] The server confirms the received message and stores its contents in an immutable form in the information storage area. During this process, the message's hash value is verified, and identification information is recorded. A timestamp is added upon storage, and this is retained as a transmission history. This record guarantees the authenticity and immutability of the message.

[0339] Step 5:

[0340] When a message reaches the recipient, the recipient's device activates an emotion engine to monitor the recipient's response. Open time and touch patterns are collected as data and used to analyze the recipient's emotional state. The analysis results are sent to a server and recorded in a format that the sender can later review. The analyzed emotion data helps the sender understand how their message was received.

[0341] (Application Example 2)

[0342] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0343] In modern communication, misunderstandings and problems can arise due to misinterpretations of the sender's emotions. Furthermore, because it is difficult to grasp the recipient's emotional response, improving the quality of communication is essential. Therefore, a means is needed to ensure the evidential nature of messages while maintaining an appropriate tone.

[0344] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0345] In this invention, the server includes means for generating a message, means for performing sentiment analysis and providing feedback to adjust the tone of the message, and means for storing the message in an immutable form in data storage. This makes it possible to send messages that appropriately reflect the sender's emotions and to understand the recipient's emotional response.

[0346] "Means of generating messages" refers to functions for creating text data for the purpose of transmitting information.

[0347] The "means for automatically adding recipient accounts" refer to a function that automatically includes recipient information that should be registered as the destination when sending a message.

[0348] "A means of performing emotion analysis and providing feedback to adjust the tone" refers to a function that analyzes the emotional state from the input text data and suggests appropriate improvements to the expression of the output information.

[0349] "Means of saving data to data storage" refers to a function for storing generated data in an immutable form for the purpose of persistently preserving information.

[0350] "Means for recording transmission and reception history and adding time information" refers to a function for maintaining the trajectory of message transmission and reception along with chronological information.

[0351] "Means for authenticating the recipient" refers to a function for verifying the identity of the message recipient.

[0352] "Means for analyzing the emotional state of the recipient and transmitting and recording subsequent cognitive information to an information terminal" refers to a function for analyzing the recipient's response and storing or communicating that information.

[0353] The system for carrying out the present invention includes a server and terminals, performs sentiment analysis, and supports appropriate communication.

[0354] The server works in conjunction with data storage to manage message generation and transmission. Message generation utilizes an artificial intelligence model for sentiment analysis. This AI model leverages technologies such as the Sentiment Analysis API to analyze user-entered text data in real time. Based on the analysis results, it provides users with feedback for tone adjustment and improvement. An application incorporating these functions is installed on the device. Through this application, users can input messages and send them with the tone modified as needed.

[0355] When a message is sent, the server saves its contents to data storage in an immutable state. The send / receive history is also timestamped and recorded along with the recipient's sentiment analysis results. The recipient is also provided with sentiment analysis capabilities, which analyze their emotional state at the time of receiving the message.

[0356] As a concrete example, consider a scenario where a salesperson in a physical store uses a tablet to send information about a new product to a customer. The salesperson uses a tablet application to input the message and adjusts the tone of the message based on emotional feedback. For example, after generating the sentence, "Would you like to try out the features of this product?", the AI ​​model provides feedback such as "Make it more approachable," and the tone is changed to "Please try this amazing new product!".

[0357] Example prompt: "Analyze the tone of customer notification messages for new products and suggest a more effective tone."

[0358] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0359] Step 1:

[0360] The user launches the application on their device and opens the message input screen. The user manually enters the message text. The device temporarily stores this input data and prepares it for sentiment analysis.

[0361] Step 2:

[0362] The device sends the user-entered message to the sentiment analysis engine. Using the transmitted text data as input, the sentiment analysis engine analyzes the emotional state of the message using an AI model. As a result of the analysis, the emotional tone of the message and suggested revisions are generated.

[0363] Step 3:

[0364] The server returns the analysis results to the terminal. The returned data includes feedback for appropriate tone changes. The user can choose to accept this feedback and revise the message content, or keep the original message. The revised text data is then output.

[0365] Step 4:

[0366] The user finalizes the message and presses the send button. The device automatically adds recipient information and necessary account details when sending the message to the server. The server receives the message and saves it in its data storage in an immutable format. The saved data also includes a timestamp and an encoded value.

[0367] Step 5:

[0368] When a recipient receives a message, their device performs sentiment analysis through the recipient's application. The analyzed emotional state is sent to a server and recorded as the recipient's response. This data allows the user to track the recipient's emotional responses.

[0369] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0370] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0371] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0372] [Third Embodiment]

[0373] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0374] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0375] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0376] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0377] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0378] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0379] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0380] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0381] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0382] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0383] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0384] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0385] To implement this invention, the user first composes a message using a dedicated application on their device. This application provides an interface for entering the recipient, subject, body, and, if necessary, attachments. Before sending, the user can choose the option to automatically add recipient accounts, including those of government agencies.

[0386] When a message is sent from the terminal to the server, its contents are stored in cloud storage in an immutable form. The server generates a hash value for the message during storage and records this hash value. This record includes sender information, sending date and time, recipient information, and sending confirmation information.

[0387] When the recipient receives the message, the device initiates a verification process. This verification uses two-factor authentication or other authentication methods. After authentication is complete, the recipient's acknowledgment status is sent to and recorded on the server. This proves that the recipient has viewed the message.

[0388] This system can provide users with evidence as needed. For example, if a company sends a contract to a business partner, the user can later verify the transmission record and whether the message was opened. This system helps avoid problems related to sending and receiving messages and ensures reliability in business and legal activities.

[0389] The following describes the processing flow.

[0390] Step 1:

[0391] The user opens a messaging application on their device. They enter the recipient, subject, and body of the message, and use the option to add attachments if necessary.

[0392] Step 2:

[0393] The device presents the user with an option to automatically add government account information to the CC field on the message sending screen. The user then completes the preparation for sending.

[0394] Step 3:

[0395] When the user presses the send button, the message is sent from the device to the server. At this time, the message content is saved to cloud storage.

[0396] Step 4:

[0397] The server receives the sent message, stores the message content in an unmodifiable form, and generates and records a hash value. It also stores the date and time of transmission, sender information, and recipient information along with a timestamp.

[0398] Step 5:

[0399] When the recipient's device receives the message, it initiates an identity verification process. The device provides authentication methods, including two-factor authentication, and prompts the recipient to authenticate.

[0400] Step 6:

[0401] Once the recipient is successfully authenticated, the device sends a message to the server indicating that the recipient has read the message. This information is also recorded on the server.

[0402] Step 7:

[0403] Users can request access to evidence stored on the server as needed. The server processes this request and provides the relevant evidence to the user.

[0404] Step 8:

[0405] Users can use the provided evidence to check transmission records and receipt confirmation status, which helps avoid disputes and present evidence.

[0406] (Example 1)

[0407] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0408] In modern society, ensuring the reliability and security of information transmission and reception is crucial. However, existing systems suffer from problems such as information tampering and incomplete confirmation of receipt. In particular, for the transmission and reception of important information, there is a need for means to guarantee its authenticity and to prove that the recipient has reliably confirmed the information.

[0409] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0410] In this invention, the server includes means for remotely storing information in an immutable form, means for recording transmission and reception history along with timestamps, and means for recording the recipient's awareness status. This ensures the authenticity of the information and allows proof that the recipient has confirmed it.

[0411] "Information" refers to messages and their content that are generated, transmitted, and received within a system.

[0412] A "recipient identifier" is identification information necessary to receive information, and includes information that identifies public institutions or individuals.

[0413] "Remote storage" refers to saving information in an immutable form to cloud storage or other online storage.

[0414] A "time stamp" refers to a record of the date and time added when information is transmitted or received, and is used for managing the history of that information.

[0415] "Verification" refers to the means by which a recipient verifies information after receiving it.

[0416] "Recognition status" refers to the recording of the state in which the recipient has confirmed the information, and is used as proof of receipt.

[0417] This invention provides a mechanism for ensuring the authenticity and reliability of information transmission and reception. Users utilize a system that includes a dedicated application to create information on their terminal. This information includes messages and their content, and can automatically include recipient identifiers, including those of public institutions.

[0418] The created information is sent from the terminal to the server. At this time, the information is stored in an immutable form using remote storage methods such as cloud storage. During this process, the server marks the information with a timestamp and records the transmission and reception history in detail.

[0419] The server verifies the recipient's identity through the terminal to confirm that the recipient has received the information. This verification can be done using methods such as two-factor authentication or biometric authentication. The received verification information is returned to the server and recorded as the recipient's acknowledgment status. This process allows users to later check the information transmission and reception history and the recipient's verification status, thereby increasing the reliability of the information and preventing problems.

[0420] A concrete example of this invention is when a company sends an important contract to a business partner and confirms that it has been opened and accepted. This system allows the company to prove that the contract was sent correctly and that the recipient has confirmed it.

[0421] Example of a prompt:

[0422] "A company has sent an important contract to a business partner and wants to confirm that it has been opened. Please generate a prompt message simulating this situation."

[0423] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0424] Step 1:

[0425] The user opens a dedicated application to create the information. The user enters the recipient, subject, body, and attachments into the input interface. At this time, the user can choose the option to automatically add recipient identifiers, including those of public institutions. The entered information is temporarily stored within the application.

[0426] Step 2:

[0427] The terminal sends information entered by the user to the server. Upon transmission, the terminal generates a request to send the information to cloud storage. This request contains the information's content and is stored in the cloud in an immutable form. The server receives this information, generates an identification code for it, and records it along with a timestamp. The output is a confirmation message acknowledging the completion of the save.

[0428] Step 3:

[0429] After the server sends a message to the recipient, it initiates a verification process on the recipient's device. The input is the recipient's device information, and the output is a signal to initiate the verification process. The device initiates two-factor authentication or biometric authentication, and if successful, sends the result to the server.

[0430] Step 4:

[0431] The server records the recipient's acknowledgment status. The input is information indicating successful recipient authentication, and the output is a record that the recipient has acknowledged the information. The record includes the date and time of acknowledgment and the authentication method used. This allows the user to later retrieve this acknowledgment information as evidence.

[0432] (Application Example 1)

[0433] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0434] In today's information society, security and reliability are paramount in the transmission and reception of important documents. However, conventional communication methods often lack sufficient evidence to prevent tampering with document content or to confirm receipt. In particular, ensuring the reliable delivery and record-keeping of legal documents and important documents in commercial transactions remains a challenge.

[0435] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0436] In this invention, the server includes means for generating a document, means for automatically adding recipient identification information, including that of a public institution, to the document, and means for storing the contents of the document in an immutable form on an information processing device. This makes it possible to securely store and transmit important documents without tampering with them, and to record receipt confirmations in a reliable form as evidence.

[0437] A "document" is an electronic or physical record written for the purpose of transmitting information.

[0438] A "public institution" is an organization that functions based on the public interest, such as the government and its related organizations.

[0439] "Recipient identification information" refers to information used to identify the recipient of a message or document.

[0440] An "information processing device" is a computer system that stores, processes, and transmits data.

[0441] "Time information" refers to time-related data used to identify when a document or event occurred.

[0442] "Identity verification" is a procedure to verify the legitimacy of an individual or organization.

[0443] "Confirmation status" refers to a record of the fact that a message or document was received and properly confirmed.

[0444] An "encoded value" is an encrypted string of characters generated to uniquely identify the content of data.

[0445] "Evidence" refers to records or data used to prove a certain fact or event.

[0446] "User" refers to an individual or organization that uses the functions of the system or service.

[0447] To realize this invention, the following system configuration is necessary. The main components are a user terminal, a server, and an information processing device. The user uses the terminal to generate documents using a dedicated application, and can automatically add recipient identification information at that time. This application is equipped with a document creation interface, and the user inputs the necessary information.

[0448] Documents sent from user terminals are stored in an immutable form on the information processing device, and an encoded value is generated at that time. OpenSSL, an open-source encryption library, is used for this encoding. Time information is added to the records of document transmission and reception, thereby guaranteeing the document's timestamp.

[0449] The server runs software to verify the recipient's identity, employing methods such as two-factor authentication. Authentication apps like Google Authenticator are used in this authentication process. After authentication, the verification status is sent to a data processing unit and recorded as evidence.

[0450] This system enables users to send and store important legal or commercial documents in a secure and reliable manner. For example, a company can send an important contract to a business partner and use the record as evidence in the future. The technical features of this invention ensure that messages are protected from tampering and that receipt is reliably confirmed.

[0451] A concrete example of a prompt might be: "Design a secure messaging service to send important contracts and confirm whether they have been opened. Provide detailed instructions on sending history and authentication procedures."

[0452] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0453] Step 1:

[0454] The user terminal launches a dedicated application and inputs the necessary information through the document creation interface. This input includes the document content, recipient identification information, and information about the public institution. Based on this information, the user terminal constructs the document data. The output is a document ready for transmission.

[0455] Step 2:

[0456] The user terminal sends document data to the information processing device. During transmission, the user terminal encrypts the data using SSL / TLS. The input consists of the generated document data and the recipient's identification information. The output is the encrypted data securely delivered to the information processing device.

[0457] Step 3:

[0458] The information processing device stores the received document data in an immutable form. OpenSSL is used to generate an encoded value. This encoded value guarantees the consistency and integrity of the data. The input is encrypted document data, and the output is its encoded value and a document storage confirmation.

[0459] Step 4:

[0460] The server records the transmission and storage status of documents, adding timestamps. These timestamps are crucial for recording the precise time of each data operation. Input is storage confirmation information from the information processing device, and output includes timestamped storage records.

[0461] Step 5:

[0462] When the recipient receives the document data, the server initiates an authentication process to verify the recipient's identity. This involves performing two-factor authentication to confirm the recipient's legitimacy. The input is the recipient's identification information, and the output is the authenticated recipient information.

[0463] Step 6:

[0464] The server records the confirmation status as evidence in the data processing unit. This allows for later verification that the document was received and confirmed. The input is authenticated recipient information and the confirmation result, and the output is a record of the confirmation status.

[0465] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0466] To implement this invention, the user first launches a dedicated application on their terminal and creates a message. When the user enters the message, the terminal has an emotion engine built in that analyzes the user's input behavior in real time. This emotion engine identifies the user's emotional state by taking into account keystroke analysis, input speed, device usage, etc.

[0467] Once a user's emotional state is analyzed, the emotion engine provides feedback that is reflected in the message content. For example, if a user is feeling stressed, the system can suggest ways to soften the tone of the message. This is highly effective when sending important messages in business communications.

[0468] After the message is created and sentiment feedback is applied, the device initiates the normal message sending procedure. The public institution's account is automatically added to the CC field, and the message is sent. Upon arrival at the server, the message is stored in cloud storage in an unalterable format. At this time, a hash value is generated for the message and recorded along with the relevant evidence.

[0469] When a recipient receives a message, the device uses an emotion engine to analyze the recipient's emotional state. This analysis records the recipient's response and sends it to the server. This helps the sender understand how the recipient reacted to the message.

[0470] For example, when a manager at a company needs to notify their team of a change in the schedule for an important meeting, this system, which incorporates an emotion engine, can create an effective message with the appropriate tone. Furthermore, it can understand how recipients will perceive the information and follow up as needed.

[0471] The following describes the processing flow.

[0472] Step 1:

[0473] The user launches a dedicated application on their device and opens the new message creation screen. Here, they begin entering the recipient, subject, and message body.

[0474] Step 2:

[0475] The emotion engine built into the device analyzes the user's keystrokes, typing speed, and patterns in real time to estimate the user's emotional state.

[0476] Step 3:

[0477] The emotion engine provides users with feedback on adjusting message content and changing tone based on the analysis results. For example, if anger is detected, it suggests phrasing to soften the tone.

[0478] Step 4:

[0479] Once the user has finished composing the message, the device automatically adds the recipient account of the public institution as a CC and sends the message to the server.

[0480] Step 5:

[0481] The server stores received messages in cloud storage in an unalterable format. Simultaneously, it generates a hash value for the message and records the date and time of transmission and other relevant evidence.

[0482] Step 6:

[0483] Upon receiving the message, the recipient's device analyzes their emotional state using an emotion engine. The results of this analysis are then sent to the server as the recipient's emotional response.

[0484] Step 7:

[0485] The recipient acknowledges the message, and their response is recorded. The server collects this information and uses it as a basis to provide response data to the sender.

[0486] Step 8:

[0487] Users can refer to the evidence provided by the server and the recipient's emotional response results as needed to conduct effective follow-up.

[0488] (Example 2)

[0489] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0490] In business and personal communication, the content and tone of a message may not be properly conveyed to the recipient. This is especially true when a user's emotional state influences the message, potentially leading to misunderstandings and inappropriate responses. Furthermore, a lack of evidence regarding message transmission and reception, and insufficient means to analyze recipient responses, hinders smooth communication between senders and receivers.

[0491] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0492] In this invention, the server includes means for analyzing the user's emotional state and providing feedback that adjusts the tone of the message based on that emotion; means for storing the content of the message in an immutable form in an information storage area when sending the message; and means for analyzing the recipient's emotional state and recording the analysis results. This makes it possible for messages sent by the user to be conveyed appropriately and effectively to the recipient, and for the user to understand the recipient's reaction.

[0493] A "user" is an individual or group that uses the system to create and send messages.

[0494] "Emotional state" refers to information about the psychological or emotional responses that a user or recipient exhibits when typing or receiving a message.

[0495] "Feedback" refers to suggestions or advice that a system provides to a user to adjust the content or tone of the message.

[0496] "Tone" refers to the way a message is expressed and the tone of voice, and it is a factor that influences how the message is received by the recipient.

[0497] An "information storage area" is a storage or database used to record the content of a transmitted message and related data in an immutable form.

[0498] "Identification information" refers to hash values ​​or other identifiable information used to uniquely identify a particular message or data.

[0499] "Analysis results" refer to data on the emotional state of the user or recipient obtained by the emotion engine, and evaluations made based on that data.

[0500] "Evidence" refers to recorded data related to sent and received messages, including transmission history and recipient responses.

[0501] To implement this invention, the user is first required to use a dedicated application installed on the terminal. The user creates messages on this application, and the key element here is the emotion engine built into the terminal. This emotion engine analyzes data such as keystroke analysis, input speed, and device usage in real time to identify the user's emotional state. As a result, the user can understand the impact of their emotional state on messages and receive emotion-based tone adjustment suggestions as feedback.

[0502] Once the user finishes editing the message and confirms sending, the device automatically adds the public institution's account to the sender list. This feature is important to ensure the accuracy and compliance of the message. After the message is sent, the server stores the content in an immutable form in the information storage area. At this time, a hash value is generated as the message's identifier and recorded along with supporting information.

[0503] Furthermore, upon receiving a message, the recipient's device again utilizes the emotion engine to analyze the recipient's emotional state. This allows the sender to understand the recipient's reaction and use that information to improve subsequent communication. For example, when a company manager shares the progress of an important project with employees, they can craft a message with the appropriate tone, analyze the recipient's reaction, and follow up accordingly.

[0504] An example of a prompt message might be: "The manager is creating a notification message to inform the team about a meeting schedule change. Please suggest wording and expressions to ease tension within the message." In this way, the present invention enables effective communication through sentiment analysis.

[0505] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0506] Step 1:

[0507] The user launches a dedicated application on their device and begins composing a message. As the user types, the device collects keystroke data and input speed in real time. The entered data is then passed directly to the emotion engine, where it is analyzed to identify the user's emotional state. The emotional state obtained through this analysis becomes the basis for generating feedback.

[0508] Step 2:

[0509] The device's built-in emotion engine analyzes collected data to determine the user's emotional state. For example, rapid keystrokes and short intervals may indicate stress. Based on this analysis, the emotion engine generates specific feedback to soften the tone of the message. This feedback is displayed on the user interface, allowing the user to incorporate it into their message creation.

[0510] Step 3:

[0511] Once the user has finished composing the message and confirmed sending it, the device automatically adds the official agency's account to the CC field and prepares to send the message. At this point, the message content is compiled into data for transmission and sent to the server. During transmission, a hash value is generated for message identification, and this information is also sent along with the message.

[0512] Step 4:

[0513] The server confirms the received message and stores its contents in an immutable form in the information storage area. During this process, the message's hash value is verified, and identification information is recorded. A timestamp is added upon storage, and this is retained as a transmission history. This record guarantees the authenticity and immutability of the message.

[0514] Step 5:

[0515] When a message reaches the recipient, the recipient's device activates an emotion engine to monitor the recipient's response. Open time and touch patterns are collected as data and used to analyze the recipient's emotional state. The analysis results are sent to a server and recorded in a format that the sender can later review. The analyzed emotion data helps the sender understand how their message was received.

[0516] (Application Example 2)

[0517] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0518] In modern communication, misunderstandings and problems can arise due to misinterpretations of the sender's emotions. Furthermore, because it is difficult to grasp the recipient's emotional response, improving the quality of communication is essential. Therefore, a means is needed to ensure the evidential nature of messages while maintaining an appropriate tone.

[0519] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0520] In this invention, the server includes means for generating a message, means for performing sentiment analysis and providing feedback to adjust the tone of the message, and means for storing the message in an immutable form in data storage. This makes it possible to send messages that appropriately reflect the sender's emotions and to understand the recipient's emotional response.

[0521] "Means of generating messages" refers to functions for creating text data for the purpose of transmitting information.

[0522] The "means for automatically adding recipient accounts" refer to a function that automatically includes recipient information that should be registered as the destination when sending a message.

[0523] "A means of performing emotion analysis and providing feedback to adjust the tone" refers to a function that analyzes the emotional state from the input text data and suggests appropriate improvements to the expression of the output information.

[0524] "Means of saving data to data storage" refers to a function for storing generated data in an immutable form for the purpose of persistently preserving information.

[0525] "Means for recording transmission and reception history and adding time information" refers to a function for maintaining the trajectory of message transmission and reception along with chronological information.

[0526] "Means for authenticating the recipient" refers to a function for verifying the identity of the message recipient.

[0527] "Means for analyzing the emotional state of the recipient and transmitting and recording subsequent cognitive information to an information terminal" refers to a function for analyzing the recipient's response and storing or communicating that information.

[0528] The system for carrying out the present invention includes a server and terminals, performs sentiment analysis, and supports appropriate communication.

[0529] The server works in conjunction with data storage to manage message generation and transmission. Message generation utilizes an artificial intelligence model for sentiment analysis. This AI model leverages technologies such as the Sentiment Analysis API to analyze user-entered text data in real time. Based on the analysis results, it provides users with feedback for tone adjustment and improvement. An application incorporating these functions is installed on the device. Through this application, users can input messages and send them with the tone modified as needed.

[0530] When a message is sent, the server saves its contents to data storage in an immutable state. The send / receive history is also timestamped and recorded along with the recipient's sentiment analysis results. The recipient is also provided with sentiment analysis capabilities, which analyze their emotional state at the time of receiving the message.

[0531] As a concrete example, consider a scenario where a salesperson in a physical store uses a tablet to send information about a new product to a customer. The salesperson uses a tablet application to input the message and adjusts the tone of the message based on emotional feedback. For example, after generating the sentence, "Would you like to try out the features of this product?", the AI ​​model provides feedback such as "Make it more approachable," and the tone is changed to "Please try this amazing new product!".

[0532] Example prompt: "Analyze the tone of customer notification messages for new products and suggest a more effective tone."

[0533] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0534] Step 1:

[0535] The user launches the application on their device and opens the message input screen. The user manually enters the message text. The device temporarily stores this input data and prepares it for sentiment analysis.

[0536] Step 2:

[0537] The device sends the user-entered message to the sentiment analysis engine. Using the transmitted text data as input, the sentiment analysis engine analyzes the emotional state of the message using an AI model. As a result of the analysis, the emotional tone of the message and suggested revisions are generated.

[0538] Step 3:

[0539] The server returns the analysis results to the terminal. The returned data includes feedback for appropriate tone changes. The user can choose to accept this feedback and revise the message content, or keep the original message. The revised text data is then output.

[0540] Step 4:

[0541] The user finalizes the message and presses the send button. The device automatically adds recipient information and necessary account details when sending the message to the server. The server receives the message and saves it in its data storage in an immutable format. The saved data also includes a timestamp and an encoded value.

[0542] Step 5:

[0543] When a recipient receives a message, their device performs sentiment analysis through the recipient's application. The analyzed emotional state is sent to a server and recorded as the recipient's response. This data allows the user to track the recipient's emotional responses.

[0544] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0545] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0546] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0547] [Fourth Embodiment]

[0548] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0549] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0550] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0551] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0552] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0553] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0554] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0555] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0556] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0557] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0558] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0559] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0560] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0561] To implement this invention, the user first composes a message using a dedicated application on their device. This application provides an interface for entering the recipient, subject, body, and, if necessary, attachments. Before sending, the user can choose the option to automatically add recipient accounts, including those of government agencies.

[0562] When a message is sent from the terminal to the server, its contents are stored in cloud storage in an immutable form. The server generates a hash value for the message during storage and records this hash value. This record includes sender information, sending date and time, recipient information, and sending confirmation information.

[0563] When the recipient receives the message, the device initiates a verification process. This verification uses two-factor authentication or other authentication methods. After authentication is complete, the recipient's acknowledgment status is sent to and recorded on the server. This proves that the recipient has viewed the message.

[0564] This system can provide users with evidence as needed. For example, if a company sends a contract to a business partner, the user can later verify the transmission record and whether the message was opened. This system helps avoid problems related to sending and receiving messages and ensures reliability in business and legal activities.

[0565] The following describes the processing flow.

[0566] Step 1:

[0567] The user opens a messaging application on their device. They enter the recipient, subject, and body of the message, and use the option to add attachments if necessary.

[0568] Step 2:

[0569] The device presents the user with an option to automatically add government account information to the CC field on the message sending screen. The user then completes the preparation for sending.

[0570] Step 3:

[0571] When the user presses the send button, the message is sent from the device to the server. At this time, the message content is saved to cloud storage.

[0572] Step 4:

[0573] The server receives the sent message, stores the message content in an unmodifiable form, and generates and records a hash value. It also stores the date and time of transmission, sender information, and recipient information along with a timestamp.

[0574] Step 5:

[0575] When the recipient's device receives the message, it initiates an identity verification process. The device provides authentication methods, including two-factor authentication, and prompts the recipient to authenticate.

[0576] Step 6:

[0577] Once the recipient is successfully authenticated, the device sends a message to the server indicating that the recipient has read the message. This information is also recorded on the server.

[0578] Step 7:

[0579] Users can request access to evidence stored on the server as needed. The server processes this request and provides the relevant evidence to the user.

[0580] Step 8:

[0581] Users can use the provided evidence to check transmission records and receipt confirmation status, which helps avoid disputes and present evidence.

[0582] (Example 1)

[0583] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0584] In modern society, ensuring the reliability and security of information transmission and reception is crucial. However, existing systems suffer from problems such as information tampering and incomplete confirmation of receipt. In particular, for the transmission and reception of important information, there is a need for means to guarantee its authenticity and to prove that the recipient has reliably confirmed the information.

[0585] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0586] In this invention, the server includes means for remotely storing information in an immutable form, means for recording transmission and reception history along with timestamps, and means for recording the recipient's awareness status. This ensures the authenticity of the information and allows proof that the recipient has confirmed it.

[0587] "Information" refers to messages and their content that are generated, transmitted, and received within a system.

[0588] A "recipient identifier" is identification information necessary to receive information, and includes information that identifies public institutions or individuals.

[0589] "Remote storage" refers to saving information in an immutable form to cloud storage or other online storage.

[0590] A "time stamp" refers to a record of the date and time added when information is transmitted or received, and is used for managing the history of that information.

[0591] "Verification" refers to the means by which a recipient verifies information after receiving it.

[0592] "Recognition status" refers to the recording of the state in which the recipient has confirmed the information, and is used as proof of receipt.

[0593] This invention provides a mechanism for ensuring the authenticity and reliability of information transmission and reception. Users utilize a system that includes a dedicated application to create information on their terminal. This information includes messages and their content, and can automatically include recipient identifiers, including those of public institutions.

[0594] The created information is sent from the terminal to the server. At this time, the information is stored in an immutable form using remote storage methods such as cloud storage. During this process, the server marks the information with a timestamp and records the transmission and reception history in detail.

[0595] The server verifies the recipient's identity through the terminal to confirm that the recipient has received the information. This verification can be done using methods such as two-factor authentication or biometric authentication. The received verification information is returned to the server and recorded as the recipient's acknowledgment status. This process allows users to later check the information transmission and reception history and the recipient's verification status, thereby increasing the reliability of the information and preventing problems.

[0596] A concrete example of this invention is when a company sends an important contract to a business partner and confirms that it has been opened and accepted. This system allows the company to prove that the contract was sent correctly and that the recipient has confirmed it.

[0597] Example of a prompt:

[0598] "A company has sent an important contract to a business partner and wants to confirm that it has been opened. Please generate a prompt message simulating this situation."

[0599] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0600] Step 1:

[0601] The user opens a dedicated application to create the information. The user enters the recipient, subject, body, and attachments into the input interface. At this time, the user can choose the option to automatically add recipient identifiers, including those of public institutions. The entered information is temporarily stored within the application.

[0602] Step 2:

[0603] The terminal sends information entered by the user to the server. Upon transmission, the terminal generates a request to send the information to cloud storage. This request contains the information's content and is stored in the cloud in an immutable form. The server receives this information, generates an identification code for it, and records it along with a timestamp. The output is a confirmation message acknowledging the completion of the save.

[0604] Step 3:

[0605] After the server sends a message to the recipient, it initiates a verification process on the recipient's device. The input is the recipient's device information, and the output is a signal to initiate the verification process. The device initiates two-factor authentication or biometric authentication, and if successful, sends the result to the server.

[0606] Step 4:

[0607] The server records the recipient's acknowledgment status. The input is information indicating successful recipient authentication, and the output is a record that the recipient has acknowledged the information. The record includes the date and time of acknowledgment and the authentication method used. This allows the user to later retrieve this acknowledgment information as evidence.

[0608] (Application Example 1)

[0609] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0610] In today's information society, security and reliability are paramount in the transmission and reception of important documents. However, conventional communication methods often lack sufficient evidence to prevent tampering with document content or to confirm receipt. In particular, ensuring the reliable delivery and record-keeping of legal documents and important documents in commercial transactions remains a challenge.

[0611] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0612] In this invention, the server includes means for generating a document, means for automatically adding recipient identification information, including that of a public institution, to the document, and means for storing the contents of the document in an immutable form on an information processing device. This makes it possible to securely store and transmit important documents without tampering with them, and to record receipt confirmations in a reliable form as evidence.

[0613] A "document" is an electronic or physical record written for the purpose of transmitting information.

[0614] A "public institution" is an organization that functions based on the public interest, such as the government and its related organizations.

[0615] "Recipient identification information" refers to information used to identify the recipient of a message or document.

[0616] An "information processing device" is a computer system that stores, processes, and transmits data.

[0617] "Time information" refers to time-related data used to identify when a document or event occurred.

[0618] "Identity verification" is a procedure to verify the legitimacy of an individual or organization.

[0619] "Confirmation status" refers to a record of the fact that a message or document was received and properly confirmed.

[0620] An "encoded value" is an encrypted string of characters generated to uniquely identify the content of data.

[0621] "Evidence" refers to records or data used to prove a certain fact or event.

[0622] "User" refers to an individual or organization that uses the functions of the system or service.

[0623] To realize this invention, the following system configuration is necessary. The main components are a user terminal, a server, and an information processing device. The user uses the terminal to generate documents using a dedicated application, and can automatically add recipient identification information at that time. This application is equipped with a document creation interface, and the user inputs the necessary information.

[0624] Documents sent from user terminals are stored in an immutable form on the information processing device, and an encoded value is generated at that time. OpenSSL, an open-source encryption library, is used for this encoding. Time information is added to the records of document transmission and reception, thereby guaranteeing the document's timestamp.

[0625] The server runs software to verify the recipient's identity, employing methods such as two-factor authentication. Authentication apps like Google Authenticator are used in this authentication process. After authentication, the verification status is sent to a data processing unit and recorded as evidence.

[0626] This system enables users to send and store important legal or commercial documents in a secure and reliable manner. For example, a company can send an important contract to a business partner and use the record as evidence in the future. The technical features of this invention ensure that messages are protected from tampering and that receipt is reliably confirmed.

[0627] A concrete example of a prompt might be: "Design a secure messaging service to send important contracts and confirm whether they have been opened. Provide detailed instructions on sending history and authentication procedures."

[0628] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0629] Step 1:

[0630] The user terminal launches a dedicated application and inputs the necessary information through the document creation interface. This input includes the document content, recipient identification information, and information about the public institution. Based on this information, the user terminal constructs the document data. The output is a document ready for transmission.

[0631] Step 2:

[0632] The user terminal sends document data to the information processing device. During transmission, the user terminal encrypts the data using SSL / TLS. The input consists of the generated document data and the recipient's identification information. The output is the encrypted data securely delivered to the information processing device.

[0633] Step 3:

[0634] The information processing device stores the received document data in an immutable form. OpenSSL is used to generate an encoded value. This encoded value guarantees the consistency and integrity of the data. The input is encrypted document data, and the output is its encoded value and a document storage confirmation.

[0635] Step 4:

[0636] The server records the transmission and storage status of documents, adding timestamps. These timestamps are crucial for recording the precise time of each data operation. Input is storage confirmation information from the information processing device, and output includes timestamped storage records.

[0637] Step 5:

[0638] When the recipient receives the document data, the server initiates an authentication process to verify the recipient's identity. This involves performing two-factor authentication to confirm the recipient's legitimacy. The input is the recipient's identification information, and the output is the authenticated recipient information.

[0639] Step 6:

[0640] The server records the confirmation status as evidence in the data processing unit. This allows for later verification that the document was received and confirmed. The input is authenticated recipient information and the confirmation result, and the output is a record of the confirmation status.

[0641] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0642] To implement this invention, the user first launches a dedicated application on their terminal and creates a message. When the user enters the message, the terminal has an emotion engine built in that analyzes the user's input behavior in real time. This emotion engine identifies the user's emotional state by taking into account keystroke analysis, input speed, device usage, etc.

[0643] Once a user's emotional state is analyzed, the emotion engine provides feedback that is reflected in the message content. For example, if a user is feeling stressed, the system can suggest ways to soften the tone of the message. This is highly effective when sending important messages in business communications.

[0644] After the message is created and sentiment feedback is applied, the device initiates the normal message sending procedure. The public institution's account is automatically added to the CC field, and the message is sent. Upon arrival at the server, the message is stored in cloud storage in an unalterable format. At this time, a hash value is generated for the message and recorded along with the relevant evidence.

[0645] When a recipient receives a message, the device uses an emotion engine to analyze the recipient's emotional state. This analysis records the recipient's response and sends it to the server. This helps the sender understand how the recipient reacted to the message.

[0646] For example, when a manager at a company needs to notify their team of a change in the schedule for an important meeting, this system, which incorporates an emotion engine, can create an effective message with the appropriate tone. Furthermore, it can understand how recipients will perceive the information and follow up as needed.

[0647] The following describes the processing flow.

[0648] Step 1:

[0649] The user launches a dedicated application on their device and opens the new message creation screen. Here, they begin entering the recipient, subject, and message body.

[0650] Step 2:

[0651] The emotion engine built into the device analyzes the user's keystrokes, typing speed, and patterns in real time to estimate the user's emotional state.

[0652] Step 3:

[0653] The emotion engine provides users with feedback on adjusting message content and changing tone based on the analysis results. For example, if anger is detected, it suggests phrasing to soften the tone.

[0654] Step 4:

[0655] Once the user has finished composing the message, the device automatically adds the recipient account of the public institution as a CC and sends the message to the server.

[0656] Step 5:

[0657] The server stores received messages in cloud storage in an unalterable format. Simultaneously, it generates a hash value for the message and records the date and time of transmission and other relevant evidence.

[0658] Step 6:

[0659] Upon receiving the message, the recipient's device analyzes their emotional state using an emotion engine. The results of this analysis are then sent to the server as the recipient's emotional response.

[0660] Step 7:

[0661] The recipient acknowledges the message, and their response is recorded. The server collects this information and uses it as a basis to provide response data to the sender.

[0662] Step 8:

[0663] Users can refer to the evidence provided by the server and the recipient's emotional response results as needed to conduct effective follow-up.

[0664] (Example 2)

[0665] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0666] In business and personal communication, the content and tone of a message may not be properly conveyed to the recipient. This is especially true when a user's emotional state influences the message, potentially leading to misunderstandings and inappropriate responses. Furthermore, a lack of evidence regarding message transmission and reception, and insufficient means to analyze recipient responses, hinders smooth communication between senders and receivers.

[0667] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0668] In this invention, the server includes means for analyzing the user's emotional state and providing feedback that adjusts the tone of the message based on that emotion; means for storing the content of the message in an immutable form in an information storage area when sending the message; and means for analyzing the recipient's emotional state and recording the analysis results. This makes it possible for messages sent by the user to be conveyed appropriately and effectively to the recipient, and for the user to understand the recipient's reaction.

[0669] A "user" is an individual or group that uses the system to create and send messages.

[0670] "Emotional state" refers to information about the psychological or emotional responses that a user or recipient exhibits when typing or receiving a message.

[0671] "Feedback" refers to suggestions or advice that a system provides to a user to adjust the content or tone of the message.

[0672] "Tone" refers to the way a message is expressed and the tone of voice, and it is a factor that influences how the message is received by the recipient.

[0673] An "information storage area" is a storage or database used to record the content of a transmitted message and related data in an immutable form.

[0674] "Identification information" refers to hash values ​​or other identifiable information used to uniquely identify a particular message or data.

[0675] "Analysis results" refer to data on the emotional state of the user or recipient obtained by the emotion engine, and evaluations made based on that data.

[0676] "Evidence" refers to recorded data related to sent and received messages, including transmission history and recipient responses.

[0677] To implement this invention, the user is first required to use a dedicated application installed on the terminal. The user creates messages on this application, and the key element here is the emotion engine built into the terminal. This emotion engine analyzes data such as keystroke analysis, input speed, and device usage in real time to identify the user's emotional state. As a result, the user can understand the impact of their emotional state on messages and receive emotion-based tone adjustment suggestions as feedback.

[0678] Once the user finishes editing the message and confirms sending, the device automatically adds the public institution's account to the sender list. This feature is important to ensure the accuracy and compliance of the message. After the message is sent, the server stores the content in an immutable form in the information storage area. At this time, a hash value is generated as the message's identifier and recorded along with supporting information.

[0679] Furthermore, upon receiving a message, the recipient's device again utilizes the emotion engine to analyze the recipient's emotional state. This allows the sender to understand the recipient's reaction and use that information to improve subsequent communication. For example, when a company manager shares the progress of an important project with employees, they can craft a message with the appropriate tone, analyze the recipient's reaction, and follow up accordingly.

[0680] An example of a prompt message might be: "The manager is creating a notification message to inform the team about a meeting schedule change. Please suggest wording and expressions to ease tension within the message." In this way, the present invention enables effective communication through sentiment analysis.

[0681] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0682] Step 1:

[0683] The user launches a dedicated application on their device and begins composing a message. As the user types, the device collects keystroke data and input speed in real time. The entered data is then passed directly to the emotion engine, where it is analyzed to identify the user's emotional state. The emotional state obtained through this analysis becomes the basis for generating feedback.

[0684] Step 2:

[0685] The device's built-in emotion engine analyzes collected data to determine the user's emotional state. For example, rapid keystrokes and short intervals may indicate stress. Based on this analysis, the emotion engine generates specific feedback to soften the tone of the message. This feedback is displayed on the user interface, allowing the user to incorporate it into their message creation.

[0686] Step 3:

[0687] Once the user has finished composing the message and confirmed sending it, the device automatically adds the official agency's account to the CC field and prepares to send the message. At this point, the message content is compiled into data for transmission and sent to the server. During transmission, a hash value is generated for message identification, and this information is also sent along with the message.

[0688] Step 4:

[0689] The server confirms the received message and stores its contents in an immutable form in the information storage area. During this process, the message's hash value is verified, and identification information is recorded. A timestamp is added upon storage, and this is retained as a transmission history. This record guarantees the authenticity and immutability of the message.

[0690] Step 5:

[0691] When a message reaches the recipient, the recipient's device activates an emotion engine to monitor the recipient's response. Open time and touch patterns are collected as data and used to analyze the recipient's emotional state. The analysis results are sent to a server and recorded in a format that the sender can later review. The analyzed emotion data helps the sender understand how their message was received.

[0692] (Application Example 2)

[0693] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0694] In modern communication, misunderstandings and problems can arise due to misinterpretations of the sender's emotions. Furthermore, because it is difficult to grasp the recipient's emotional response, improving the quality of communication is essential. Therefore, a means is needed to ensure the evidential nature of messages while maintaining an appropriate tone.

[0695] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0696] In this invention, the server includes means for generating a message, means for performing sentiment analysis and providing feedback to adjust the tone of the message, and means for storing the message in an immutable form in data storage. This makes it possible to send messages that appropriately reflect the sender's emotions and to understand the recipient's emotional response.

[0697] "Means of generating messages" refers to functions for creating text data for the purpose of transmitting information.

[0698] The "means for automatically adding recipient accounts" refer to a function that automatically includes recipient information that should be registered as the destination when sending a message.

[0699] "A means of performing emotion analysis and providing feedback to adjust the tone" refers to a function that analyzes the emotional state from the input text data and suggests appropriate improvements to the expression of the output information.

[0700] "Means of saving data to data storage" refers to a function for storing generated data in an immutable form for the purpose of persistently preserving information.

[0701] "Means for recording transmission and reception history and adding time information" refers to a function for maintaining the trajectory of message transmission and reception along with chronological information.

[0702] "Means for authenticating the recipient" refers to a function for verifying the identity of the message recipient.

[0703] "Means for analyzing the emotional state of the recipient and transmitting and recording subsequent cognitive information to an information terminal" refers to a function for analyzing the recipient's response and storing or communicating that information.

[0704] The system for carrying out the present invention includes a server and terminals, performs sentiment analysis, and supports appropriate communication.

[0705] The server works in conjunction with data storage to manage message generation and transmission. Message generation utilizes an artificial intelligence model for sentiment analysis. This AI model leverages technologies such as the Sentiment Analysis API to analyze user-entered text data in real time. Based on the analysis results, it provides users with feedback for tone adjustment and improvement. An application incorporating these functions is installed on the device. Through this application, users can input messages and send them with the tone modified as needed.

[0706] When a message is sent, the server saves its contents to data storage in an immutable state. The send / receive history is also timestamped and recorded along with the recipient's sentiment analysis results. The recipient is also provided with sentiment analysis capabilities, which analyze their emotional state at the time of receiving the message.

[0707] As a concrete example, consider a scenario where a salesperson in a physical store uses a tablet to send information about a new product to a customer. The salesperson uses a tablet application to input the message and adjusts the tone of the message based on emotional feedback. For example, after generating the sentence, "Would you like to try out the features of this product?", the AI ​​model provides feedback such as "Make it more approachable," and the tone is changed to "Please try this amazing new product!".

[0708] Example prompt: "Analyze the tone of customer notification messages for new products and suggest a more effective tone."

[0709] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0710] Step 1:

[0711] The user launches the application on their device and opens the message input screen. The user manually enters the message text. The device temporarily stores this input data and prepares it for sentiment analysis.

[0712] Step 2:

[0713] The device sends the user-entered message to the sentiment analysis engine. Using the transmitted text data as input, the sentiment analysis engine analyzes the emotional state of the message using an AI model. As a result of the analysis, the emotional tone of the message and suggested revisions are generated.

[0714] Step 3:

[0715] The server returns the analysis results to the terminal. The returned data includes feedback for appropriate tone changes. The user can choose to accept this feedback and revise the message content, or keep the original message. The revised text data is then output.

[0716] Step 4:

[0717] The user finalizes the message and presses the send button. The device automatically adds recipient information and necessary account details when sending the message to the server. The server receives the message and saves it in its data storage in an immutable format. The saved data also includes a timestamp and an encoded value.

[0718] Step 5:

[0719] When a recipient receives a message, their device performs sentiment analysis through the recipient's application. The analyzed emotional state is sent to a server and recorded as the recipient's response. This data allows the user to track the recipient's emotional responses.

[0720] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0721] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0722] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0723] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0724] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0725] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0726] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0727] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0728] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0729] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0730] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0731] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0732] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0733] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0734] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0735] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0736] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0737] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0738] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0739] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0740] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0741] The following is further disclosed regarding the embodiments described above.

[0742] (Claim 1)

[0743] Means for generating a message,

[0744] A means of automatically adding recipient accounts, including public institutions, to the aforementioned message,

[0745] When sending the aforementioned message, means for saving the content of the message to cloud storage in an unmodifiable form,

[0746] Means for recording the transmission and reception history of the aforementioned messages with a timestamp added,

[0747] A means of verifying the recipient's identity,

[0748] A system that includes means for transmitting and recording the recognition status after identity verification to a server.

[0749] (Claim 2)

[0750] The system according to claim 1, which generates a hash value for the message content stored in the cloud storage and records the hash value.

[0751] (Claim 3)

[0752] The system according to claim 1, further comprising means for providing a user with evidence information of transmitted and received messages.

[0753] "Example 1"

[0754] (Claim 1)

[0755] Means for generating information,

[0756] A means for automatically adding recipient identifiers, including public institutions, to the aforementioned information,

[0757] When transmitting the aforementioned information, means for remotely storing the contents of the information in a form that cannot be modified,

[0758] A means for recording the transmission and reception history of the aforementioned information along with a time stamp,

[0759] Means for verifying the recipient,

[0760] A system including means for transmitting and recording the confirmed cognitive status to an information processing device.

[0761] (Claim 2)

[0762] The system according to claim 1, which generates an identification code for the remotely stored information content and records the identification code.

[0763] (Claim 3)

[0764] The system according to claim 1, comprising means for providing users with evidence of transmitted and received information.

[0765] "Application Example 1"

[0766] (Claim 1)

[0767] A device for generating documents,

[0768] A device that automatically adds recipient identification information, including public institutions, to the aforementioned document,

[0769] A device for transmitting the aforementioned document, which stores the contents of the document in an unmodifiable form on an information processing device,

[0770] A device for storing the transmission and reception records of the aforementioned documents with time information added,

[0771] A device for verifying the recipient's identity,

[0772] A device that transmits and stores the verification status after identity verification to a data processing device,

[0773] A system including a device for providing the aforementioned confirmation status as evidence.

[0774] (Claim 2)

[0775] The system according to claim 1, which generates an encoded value for the document content stored in the information processing device and stores the encoded value.

[0776] (Claim 3)

[0777] The system according to claim 1, comprising a device for a user to access evidentiary information of the said document.

[0778] "Example 2 of combining an emotion engine"

[0779] (Claim 1)

[0780] A means of providing feedback that analyzes the user's emotional state and adjusts the tone of messages based on those emotions,

[0781] Means for generating a message,

[0782] A means of automatically adding recipient accounts, including public institutions, to the aforementioned message,

[0783] When sending the aforementioned message, means for saving the contents of the message to an information storage area in a form that cannot be modified,

[0784] A means for recording the transmission and reception history of the aforementioned messages with time information added,

[0785] A means of analyzing the emotional state of the recipient and recording the analysis results,

[0786] Means for providing access to analysis results,

[0787] A system that includes this.

[0788] (Claim 2)

[0789] The system according to claim 1, which generates identification information for message content stored in the information storage area and records the corresponding identification information.

[0790] (Claim 3)

[0791] The system according to claim 1, further comprising means for providing users with evidence information of transmitted and received messages.

[0792] "Application example 2 when combining with an emotional engine"

[0793] (Claim 1)

[0794] Means for generating a message,

[0795] A means for automatically adding the target account to the aforementioned message,

[0796] Means for performing sentiment analysis when generating the message and providing feedback to adjust the tone of the message,

[0797] When sending the aforementioned message, means for saving the contents of the message to data storage in an unmodifiable form,

[0798] Means for recording the transmission and reception history and adding time information,

[0799] Means for performing recipient authentication,

[0800] A system that includes means for analyzing the emotional state of a recipient and transmitting and recording subsequent cognitive information to an information terminal.

[0801] (Claim 2)

[0802] The system according to claim 1, which generates an encoded value for the message content stored in the data storage and records the encoded value.

[0803] (Claim 3)

[0804] The system according to claim 1, further comprising means for providing users with evidence information of transmitted and received messages. [Explanation of symbols]

[0805] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Means for generating a message, A means of automatically adding recipient accounts, including public institutions, to the aforementioned message, When sending the aforementioned message, means for saving the content of the message to cloud storage in an unmodifiable form, Means for recording the transmission and reception history of the aforementioned messages with a timestamp added, A means of verifying the recipient's identity, A system that includes means for transmitting and recording the recognition status after identity verification to a server.

2. The system according to claim 1, which generates a hash value for the message content stored in the cloud storage and records the corresponding hash value.

3. The system according to claim 1, further comprising access means for providing a user with evidence information of transmitted and received messages.

Images