system

Abstract

We provide the system. [Solution] An information processing device includes means for collecting necessary data from a predetermined information source, Based on the collected data, a means of verifying consistency by cross-referencing it with existing information sets, A means of presenting the user with the missing information of the confirmed data and receiving additional information, A means for automatically converting the received additional information into a different format, The means for updating the converted information in cooperation with an external device, A means of notifying an external device, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When performing a common procedure among multiple information systems, it is necessary to follow different formats and rules according to each system, which complicates the procedure and reduces efficiency. In particular, this is prominent when the same processing is required among many systems, such as the procedure for changing corporate information. Resolving this complexity and improving business efficiency is an important issue.

Means for Solving the Problems

[0005] The information processing device will be equipped with means to collect necessary data from designated information sources such as the internet and official databases. It will also have means to verify consistency by cross-referencing the collected data with existing databases, presenting missing information to the user and allowing for the collection of additional information. Furthermore, it will be equipped with means to automatically convert this information into specified different formats, and finally, it will appropriately link with external information systems via APIs to update information, thereby streamlining procedures between different systems.

[0006] An "information processing device" is a device used for data collection, data integrity verification, data presentation and transformation, and integration with external systems.

[0007] An "information source" is something that is accessed to obtain necessary data, such as the internet or official databases.

[0008] "Data collection means" refers to the part that has the function of acquiring necessary data from a predetermined information source.

[0009] "Consistency verification means" refers to the part that has the function of comparing collected data with existing databases and detecting discrepancies or inconsistencies.

[0010] The "means for presenting additional information" refer to the part that provides a function to inform the user of any missing or necessary additional information.

[0011] A "format conversion means" is a component that has the function of automatically converting received information into a different format according to a specific request.

[0012] "API integration means" refers to the part that provides an interface for communicating with external information systems and exchanging or updating information. [Brief explanation of the drawing]

[0013] [Figure 1]This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0014] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention is an information processing system for reducing the complexity of common procedures required across different systems. In implementing the invention, the system is constructed based on the following configuration and procedure.

[0035] The server's primary role is to collect up-to-date company information, particularly company names and addresses, from the internet and official databases. This data can be obtained accurately and quickly using APIs. The server then compares the collected data with existing data to verify consistency. Based on the verification results, if any missing or inconsistent information is detected, it presents this information to the user via the terminal. The user then inputs any necessary additional information or corrections through the terminal's interface.

[0036] The server then analyzes the information received from the user and automatically converts it into the format required by each system. Even if different services require different formats, the template engine can efficiently handle this.

[0037] The converted information is sent by the server to other systems via API, and ultimately the information is updated in each respective system. This integration allows users to manage information simply and reliably without being burdened by procedures specific to each system.

[0038] For example, when a user changes the company's headquarters address, the server first retrieves the new address information from the database and compares it with the existing information. If a discrepancy is found, the terminal notifies the user and prompts them to enter the correct information. Once the user enters the new address, the server formats the address information for each system and automatically updates it via API. This automated process significantly improves the efficiency of information management.

[0039] The following describes the processing flow.

[0040] Step 1:

[0041] The server accesses designated sources to collect up-to-date data on company information. This includes using API calls and web scraping techniques.

[0042] Step 2:

[0043] The server compares the collected data with its internal database to verify consistency. Here, it evaluates whether the newly collected information matches the current data and records any discrepancies.

[0044] Step 3:

[0045] The terminal notifies the user of any missing or inconsistent information and displays the necessary corrections or additions on the interface. The user reviews this information and enters or corrects the required details.

[0046] Step 4:

[0047] The server retrieves the modified or added information from the user and converts it into the specific format required by each system. This conversion is performed automatically using a template engine.

[0048] Step 5:

[0049] The server sequentially sends the converted data via APIs to external systems to update the information. During this process, it considers various conditions, including API authentication and error handling, and performs the necessary communications.

[0050] (Example 1)

[0051] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0052] In information processing systems, a challenge is to automatically ensure the consistency and coherence of data collected from different sources and to efficiently update necessary information. In particular, there is a need to reduce the burden of manual information management and address differences in information formats across various systems, while ensuring accurate and rapid information processing.

[0053] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0054] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for verifying consistency based on the collected data, and means for presenting missing information to the user and receiving additional information based on the verification results. This enables more efficient information management and accurate data updates across different information systems.

[0055] An "information processing system" is a set of technological foundations for efficiently and accurately managing information through data collection, analysis, transformation, and external collaboration.

[0056] "Information source" refers to the place or platform from which data is obtained, such as databases or resources on the internet.

[0057] "Consistency" refers to a state where collected data matches existing data and is free from contradictions or omissions.

[0058] A "terminal" is a device that has an interface for users to present or input information.

[0059] A "template engine" is a software component designed to streamline conversion and output processes for different data formats and styles.

[0060] An "API" is a standardized programming interface that enables data communication and collaboration between different software applications.

[0061] This information processing system aims to streamline information exchange and management between different information systems. The server utilizes internet-based information sources and existing databases, collecting necessary data using APIs. This data collection places particular emphasis on information such as company information and addresses, enabling the acquisition of accurate information in real time. The server verifies the integrity of the collected data and compares it with existing databases. If there are integrity issues, the server notifies the user via a terminal. Missing information or information requiring correction is entered by the user via the terminal. The user's input process is designed to be easily performed through the terminal's interface.

[0062] Data entered by users into their terminals is analyzed by the server using a template engine and automatically converted into the format required by each system. This allows for flexible handling of different formats. The converted information is then sent by the server to external information systems via APIs, ensuring that the information is updated quickly.

[0063] To give a specific example, when a user changes the company's headquarters address, the server retrieves the new address information from the database and detects any discrepancies with the existing information. If a discrepancy is found, the user is notified via their terminal. The user enters the correct information into the terminal, which is then automatically formatted by the server for each information system, and the information is updated.

[0064] An example of a prompt message would be something like, "Please tell me the procedure for changing the company's headquarters address." This allows users to enjoy the convenience of integrated information management across systems.

[0065] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0066] Step 1:

[0067] The server collects company information from designated sources. It uses external official databases and internet requests as input, retrieving necessary data in real time via APIs. The data, including company names and addresses, forms the foundation for ensuring up-to-date information. The output is a list of the collected company information. Specifically, the server generates data queries and extracts data from the sources.

[0068] Step 2:

[0069] The server compares the collected data with existing databases to verify consistency. As input, the server uses newly collected company information and existing databases. The server performs comparisons with data within the system and executes comparison algorithms to detect inconsistencies and missing data. The output includes a consistency report and a list of inconsistencies. In specific operations, it performs database queries and comparison operations.

[0070] Step 3:

[0071] The server notifies the user via the terminal of any missing or inconsistent information based on the integrity check results. The input is the integrity check result report. The user who receives the notification will see a list of items that need correction on their terminal. The output is a user alert and a list of items to be corrected. Specifically, the server generates a notification message and displays it on the terminal's user interface.

[0072] Step 4:

[0073] The user supplements missing information and corrects inaccurate information via the terminal. The input is a list of correction items notified by the server. The user enters the necessary information on the interface and sends it to the server. The output is the corrected, supplemented data. In specific operation, the terminal provides the user interface and forwards the user's input to the server.

[0074] Step 5:

[0075] The server parses user-completed or modified information and automatically converts it to different data formats. The input is the updated data received from the user. The server uses a template engine to convert the data for each information system that requires a different format. The output is the formatted dataset. Specifically, the format conversion logic operates.

[0076] Step 6:

[0077] The server sends the converted information to an external information system via an API to update the information. The input is data with a converted format. The server sends the data to the external system, and the information in each system is updated to the latest version. The output is a confirmation message indicating that the update is complete. In specific operation, the server generates and sends an API request.

[0078] (Application Example 1)

[0079] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0080] The goal is to reduce the complexity of data linkage and format conversion between different information processing systems, thereby enabling efficient information management in logistics centers and other locations. Furthermore, it aims to improve the accuracy of information updates by quickly detecting inconsistencies and notifying users.

[0081] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0082] In this invention, the server includes means for collecting information, means for verifying the integrity of the information, means for notifying users and receiving additional information, and means for automatically converting information and coordinating with external devices. This streamlines data linkage between different systems in a logistics center and enables the rapid provision of appropriate information to users.

[0083] An "information processing device" is a device designed to collect, synchronize, transform, and update data.

[0084] An "information source" is a medium or institution that serves as the starting point for supplying the necessary data.

[0085] An "information set" refers to a collection of existing data and serves as a standard for verifying consistency.

[0086] "User" refers to a person who operates the system and provides additional information.

[0087] "Format" refers to the way in which data is represented according to specific standards.

[0088] "External devices" refer to separate systems or devices that the server interacts with.

[0089] "Notification" is the act of informing a user of specific information or a particular situation.

[0090] A "template" refers to a standardized format used for data conversion.

[0091] An "application program interface" is a means of exchanging functions between different software programs.

[0092] To implement this invention, a server is used as an information processing device. The server is responsible for processing data collection, integrity verification, information conversion, coordination with external devices, and notification.

[0093] Specifically, the server first retrieves the necessary data from designated information sources via an API. This data includes delivery destination information for logistics centers. Next, the server compares the collected data with existing information sets to verify consistency. The Python language is used for this consistency verification, allowing for efficient data comparison and updating. The requests library is used to retrieve the data, and the jinja2 library is used to format the data.

[0094] If an inconsistency is detected, the server will notify the user via the terminal. The user can receive the notification on their smartphone or tablet and enter any necessary additional information. Based on this input, the server automatically converts the information into different formats and provides it to external devices in the format required by each system. This information update is performed via an application program interface, ensuring seamless data exchange between systems.

[0095] As a concrete example, let's consider a scenario where a customer's delivery address changes at a logistics center. Using this application, the process proceeds as follows: "When the customer's new delivery address information is retrieved via API, the server compares it with the old data and sends a notification to the user stating, 'Your address has been updated.' After that, the data is automatically updated to match the format of each system."

[0096] An example of a prompt would be: "Consider an application that automates updating customer delivery addresses at a logistics center. When new delivery address information is retrieved via API, we want the system to update automatically."

[0097] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0098] Step 1:

[0099] The server retrieves delivery destination information for logistics centers from a designated source via an API. The input is the API endpoint of the source, and the output is a dataset of the latest delivery destination information. This data is retrieved using the requests library and stored in JSON format.

[0100] Step 2:

[0101] The server checks for consistency by comparing the acquired delivery address information with an existing data set. The input is the newly acquired delivery address information and the existing dataset. The output is a flag indicating whether there are inconsistencies and a list of inconsistent items. The server uses Python to sequentially compare each data item in the list and detect the differences.

[0102] Step 3:

[0103] If an inconsistency is detected, the server will notify the user via the terminal. The input is a list of the inconsistent items, and the output is a notification message to the user. The notification is sent as a push notification to smartphones and tablets.

[0104] Step 4:

[0105] The user uses a terminal to input the correct information corresponding to the inconsistent items. The input is the new shipping address information provided by the user, and the output is the corrected shipping information. The user uses the terminal interface to input the information and send it to the server.

[0106] Step 5:

[0107] The server automatically converts the correction information received from the user into the specified format. The input is the corrected delivery information, and the output is data suitable for the format required by each system. The conversion is performed using the Jinja2 library, which extracts and formats the data based on a template.

[0108] Step 6:

[0109] The server provides the converted information to an external device via an application program interface for updating. The input is formatted delivery information data, and the output is a success flag for the data update in the associated system. The server configures a POST request for the API and sends the information to the external device.

[0110] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0111] This invention aims to further enhance the user experience by incorporating an emotion engine into an information processing system. The system is configured and operated as follows:

[0112] The server collects data directly from the internet and official databases and verifies its integrity. The information obtained in this process is then presented appropriately to the user, and this is where the emotion engine plays its role.

[0113] The emotion engine analyzes user input and responses through the device to recognize their emotional state. For example, if the system determines that a user is feeling frustrated while entering complex information, based on their input speed and frequency of errors, it can adjust the interface accordingly. This is achieved by making the guidance displayed on the device clearer or, if necessary, simplifying it.

[0114] When a user adds specific information to the system, the server converts that information into the appropriate format according to the requirements of each system. During this process, based on feedback from the emotion engine, the system flexibly changes the displayed menu to reduce user stress. For example, if the emotion engine detects that the user is in a hurry, it can prioritize displaying only the most important information and request additional information only after all procedures are completed.

[0115] Ultimately, the server sends the transformed information to other systems via APIs for updates. By considering user comfort based on the output of the emotion engine, the overall efficiency of information processing and the user experience can be improved. In this way, the system goes beyond being a mere information processing device and provides a user-friendly operating environment.

[0116] The following describes the processing flow.

[0117] Step 1:

[0118] The server retrieves necessary company information from the internet and official databases. This ensures that the latest data, such as company name and address changes, is obtained.

[0119] Step 2:

[0120] The server compares the retrieved data with existing databases to verify consistency. If any discrepancies are found, the details are recorded.

[0121] Step 3:

[0122] The terminal visually displays any missing or inconsistent information to the user and requests corrections or additions of necessary information. The user responds using the terminal and enters the appropriate data.

[0123] Step 4:

[0124] The device uses an emotion engine to observe the user's input speed and behavior during input, and analyzes the user's emotional state. If user stress or confusion is detected, the device adjusts the interface to provide more user-friendly guidance.

[0125] Step 5:

[0126] The server converts the modified or additional information obtained from the user into the required format. In doing so, it utilizes the system's template engine to adapt it to the specific format required by each system.

[0127] Step 6:

[0128] The server sends the converted data to an external system using an API to ensure the information is updated correctly. Here, feedback from the sentiment engine is taken into consideration, and the user interface and processes are further optimized as needed.

[0129] (Example 2)

[0130] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0131] Conventional information processing systems suffer from several challenges, including a lack of user experience and inefficient data management. In particular, they often provide static interfaces that fail to consider the user's emotional state, leading to user stress. Furthermore, they lack flexibility in data format conversion and integration with external systems.

[0132] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0133] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing it with existing databases to verify consistency, means for performing sentiment analysis on user input and responses, and means for dynamically adjusting the user interface. This enables the provision of a comfortable interface that responds to the user's emotional state and efficient data management.

[0134] An "information processing device" is a computer system that collects, analyzes, stores, converts, and communicates data.

[0135] A "source of information" refers to an external system from which data can be obtained, such as the internet or official databases.

[0136] "Data integrity verification" is the process of verifying whether the collected data is accurate and consistent.

[0137] "Sentiment analysis" is a process that determines a user's emotional state based on factors such as their input speed and the frequency of their errors.

[0138] A "user interface" refers to the screens and controls that a user uses to interact with an information processing device.

[0139] "Format conversion" is the process of changing data into a different structure or format.

[0140] "Integration with external systems" refers to the process of exchanging and updating information with other systems.

[0141] This invention is a system for analyzing a user's emotional state and improving the user experience of an information processing system. The server uses APIs to efficiently collect necessary data from the internet and official databases. This data is temporarily stored in a database, and its accuracy and reliability are ensured by integrity checks performed using scripts such as Python.

[0142] The device captures user input in real time and sends it to the emotion engine. This emotion engine analyzes the user's input speed and error rate to determine the user's emotional state. For example, if input is slow and errors occur frequently, it is determined that the user is stressed. Machine learning algorithms are used for this analysis, and dynamic interface adjustments are made to improve the user experience.

[0143] Specifically, if the emotion engine detects that the user is in a hurry, the interface on the device automatically adjusts to display only the most important options and avoid cumbersome operations. This allows the user to access the necessary information without stress and enables efficient operation.

[0144] The server also converts additional information provided by users into different data formats, enabling data exchange with external systems. This allows information to be integrated into other systems using standard formats such as JSON and XML. A RESTful API is used for sending data to external systems, ensuring fast and secure information updates.

[0145] As a concrete example, consider a user purchasing a product on an online shopping platform. If the emotion engine detects that the user is in a hurry, the terminal will simplify the purchase process, presenting only the essential steps to reduce the user's burden. Another example of a prompt to input into the generative AI model is, "How should the interface be adjusted if the user's input speed is slow?"

[0146] Thus, the system of the present invention not only improves the efficiency of data processing but also enables the provision of a user-friendly and comfortable operating environment.

[0147] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0148] Step 1:

[0149] The server collects data from the internet and official sources via APIs. In this process, it specifies the URL or endpoint of the target data and issues an HTTP request. The input is the API endpoint, and the output is raw data received in JSON format. For example, it can retrieve the latest weather data from a weather information API.

[0150] Step 2:

[0151] The server verifies the integrity of the collected data. Using a Python script, it detects missing or outlier data and corrects or filters them as needed. The input is the JSON data obtained in step 1, and the output is clean, integrity-verified data. For example, it can impute missing values ​​in the acquired weather data.

[0152] Step 3:

[0153] The device acquires user input in real time. When a user enters data into a form, it measures key events and input time to collect input data for sentiment analysis. The input is the user's typing data, and the output is input information compiled in an analysis format. For example, it collects data from input forms for names and email addresses.

[0154] Step 4:

[0155] The device uses an emotion engine to analyze the user's emotional state. A machine learning algorithm processes the input data and estimates what emotions the user is experiencing. The input is the data used for analysis in step 3, and the output is a determination indicating the user's emotional state. For example, if the input speed is slow and there are many errors, it may be determined that the user is feeling frustrated.

[0156] Step 5:

[0157] The server adaptively changes the user interface based on the sentiment analysis results. For users in a hurry, the purchase process is simplified, and only the most important options are displayed. The input is the sentiment analysis results, and the output is the adjusted interface screen layout. For example, it might prioritize displaying only payment information.

[0158] Step 6:

[0159] The server converts the format of any additional information provided by the user as needed and sends it to the external system. It converts the data format from CSV to JSON and sends it using the HTTP protocol. The input is the additional information entered by the user, and the output is data formatted for the external system. For example, order information can be transferred to another warehouse management system.

[0160] Step 7:

[0161] The terminal generates a prompt for the AI ​​model. This prompt is displayed on the console and used as input for the model to return a response that takes the user's current state into account. The input consists of the user's sentiment analysis results and operation log, while the output is the generated prompt. For example, it might generate a prompt such as, "What action would you like to perform next?"

[0162] (Application Example 2)

[0163] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0164] Modern information processing systems tend to present information unilaterally, without considering the user's emotions or feelings. As a result, the user experience deteriorates, and users often experience stress. In particular, the complexity and difficulty of operating these systems become an even greater burden for the elderly and those unfamiliar with technology. Furthermore, even with home appliances, it is difficult to provide appropriate services that meet the user's needs, resulting in a lack of improvement in the quality of daily life. Solving these problems is essential.

[0165] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0166] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing the collected data with an existing database to verify consistency, means for presenting missing information to the user and receiving additional information, means for automatically converting the received additional information into a different format, means for updating the converted information in cooperation with an external processing device, means for analyzing the user's input and reactions through a terminal to recognize their emotional state, means for adjusting the interface based on the recognition of their emotional state, and means for controlling home appliances that analyze the user's behavior using voice input and sensors to provide appropriate support. This enables information processing that takes the user's emotions into consideration and smart operation of home appliances, improving the user experience and quality of life.

[0167] An "information processing device" is a device that has the function of collecting, analyzing, and transforming data, and exchanging information with external systems.

[0168] An "information source" is the source of the underlying data necessary to provide the required information.

[0169] A "database" is a collection of structured data used to organize information and ensure its consistency.

[0170] A "user" is a person who operates an information processing system and receives its services.

[0171] "Additional information" refers to information provided by users to supplement missing data.

[0172] "Format" refers to the arrangement and format of data used when converting information into a different format.

[0173] An "external processing device" is another device that has the function of linking with the system and updating information.

[0174] A "terminal" is a device used by a user to interact with an information processing device.

[0175] "Emotional state" refers to the psychological state that can be inferred from the user's input and responses.

[0176] An "interface" is an operating screen or method for exchanging data between a user and an information processing device.

[0177] "Voice input" is a method of inputting data into a device using the user's voice.

[0178] A "sensor" is a device used to detect the environment or the state of a user.

[0179] "Household appliances" are electrical devices used within the home to support daily life.

[0180] In this embodiment of the invention, an information processing device uses various sensors and voice input devices to control household appliances. The server collects necessary data from the internet and other sources and verifies the collected data through integrity checks in a database. This allows the server to efficiently receive additional information from users based on reliable information, automatically convert that information into different formats, and update the information with external processing devices as needed.

[0181] The device uses an emotion engine to analyze emotional data obtained through user input and reactions. The emotion engine analyzes input characteristics such as input speed and error frequency to recognize the user's psychological state. Based on this analysis, the interface is adjusted according to the user's emotions, for example, by simplifying explanations or providing interactions that reduce stress.

[0182] The home appliances are equipped with voice input devices and multiple environmental sensors that detect the user's voice and surrounding environment. This sensory data is analyzed by an AI system on a server, which then instructs the home appliances to take actions that meet the user's needs, making life more convenient.

[0183] For example, when a user says, "I want to relax today," the device collects this voice and analyzes it with its emotion engine. As a result, the home appliance changes the room lighting to a warmer tone and plays calming music. This series of operations is aimed at creating a comfortable home environment and helping the user relax.

[0184] An example of a prompt in a generative AI model is, "Please suggest activities to help me unwind after a long day." This prompt is used to support appropriate appliance operation based on the user's relaxation needs.

[0185] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0186] Step 1:

[0187] The server collects necessary data from the internet and other sources. This collected data is stored in the server's database and used as initial data.

[0188] Step 2:

[0189] The server compares the collected data with existing databases to verify consistency. The accuracy of the data is checked here, and if there are discrepancies, a warning is generated. This warning data becomes input for the next process.

[0190] Step 3:

[0191] The terminal receives additional information entered by the user. The data entered by the user is sent to the server through the terminal's input interface. This input data becomes the basis for further data transformation.

[0192] Step 4:

[0193] The server automatically converts the received additional information into a different format. This conversion is performed based on a predetermined template and is formatted to be suitable for communication with external processing devices. This output format becomes the data for communication with external processing devices.

[0194] Step 5:

[0195] The server communicates with an external processing unit to update the converted information. The external processing unit receives new data via an API and updates the system-wide data to keep it up-to-date. This updated data becomes the basis for the next process.

[0196] Step 6:

[0197] The device analyzes the user's input and responses, and recognizes their emotional state using an emotion engine. The user's input speed, error frequency, and other factors are analyzed and output as their emotional state. This emotional data then becomes input data for interface adjustments.

[0198] Step 7:

[0199] The device adjusts the interface based on its recognition of the user's emotional state. To reduce user stress, the interface simplifies the displayed content and highlights key points. This adjusted interface provides an improved user experience.

[0200] Step 8:

[0201] Home appliances analyze user behavior using voice input and sensors, and transmit the sensing data to a server. This sensing data forms the basis for operating home appliances based on user needs.

[0202] Step 9:

[0203] The server uses the prompts given to the generating AI model to generate support tailored to the user. For example, it might instruct home appliances to perform relaxation-related actions. This generated support is then implemented in the user's daily life.

[0204] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0205] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0206] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0207] [Second Embodiment]

[0208] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0209] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0210] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0211] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0212] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0213] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0214] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0215] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0216] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0217] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0218] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0219] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0220] This invention is an information processing system for reducing the complexity of common procedures required across different systems. In implementing the invention, the system is constructed based on the following configuration and procedure.

[0221] The server's primary role is to collect up-to-date company information, particularly company names and addresses, from the internet and official databases. This data can be obtained accurately and quickly using APIs. The server then compares the collected data with existing data to verify consistency. Based on the verification results, if any missing or inconsistent information is detected, it presents this information to the user via the terminal. The user then inputs any necessary additional information or corrections through the terminal's interface.

[0222] The server then analyzes the information received from the user and automatically converts it into the format required by each system. Even if different services require different formats, the template engine can efficiently handle this.

[0223] The converted information is sent by the server to other systems via API, and ultimately the information is updated in each respective system. This integration allows users to manage information simply and reliably without being burdened by procedures specific to each system.

[0224] For example, when a user changes the company's headquarters address, the server first retrieves the new address information from the database and compares it with the existing information. If a discrepancy is found, the terminal notifies the user and prompts them to enter the correct information. Once the user enters the new address, the server formats the address information for each system and automatically updates it via API. This automated process significantly improves the efficiency of information management.

[0225] The following describes the processing flow.

[0226] Step 1:

[0227] The server accesses designated sources to collect up-to-date data on company information. This includes using API calls and web scraping techniques.

[0228] Step 2:

[0229] The server compares the collected data with its internal database to verify consistency. Here, it evaluates whether the newly collected information matches the current data and records any discrepancies.

[0230] Step 3:

[0231] The terminal notifies the user of any missing or inconsistent information and displays the necessary corrections or additions on the interface. The user reviews this information and enters or corrects the required details.

[0232] Step 4:

[0233] The server retrieves the modified or added information from the user and converts it into the specific format required by each system. This conversion is performed automatically using a template engine.

[0234] Step 5:

[0235] The server sequentially sends the converted data via APIs to external systems to update the information. During this process, it considers various conditions, including API authentication and error handling, and performs the necessary communications.

[0236] (Example 1)

[0237] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0238] In information processing systems, a challenge is to automatically ensure the consistency and coherence of data collected from different sources and to efficiently update necessary information. In particular, there is a need to reduce the burden of manual information management and address differences in information formats across various systems, while ensuring accurate and rapid information processing.

[0239] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0240] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for verifying consistency based on the collected data, and means for presenting missing information to the user and receiving additional information based on the verification results. This enables more efficient information management and accurate data updates across different information systems.

[0241] An "information processing system" is a set of technological foundations for efficiently and accurately managing information through data collection, analysis, transformation, and external collaboration.

[0242] "Information source" refers to the place or platform from which data is obtained, such as databases or resources on the internet.

[0243] "Consistency" refers to a state where collected data matches existing data and is free from contradictions or omissions.

[0244] A "terminal" is a device that has an interface for users to present or input information.

[0245] A "template engine" is a software component designed to streamline conversion and output processes for different data formats and styles.

[0246] An "API" is a standardized programming interface that enables data communication and collaboration between different software applications.

[0247] This information processing system aims to streamline information exchange and management between different information systems. The server utilizes internet-based information sources and existing databases, collecting necessary data using APIs. This data collection places particular emphasis on information such as company information and addresses, enabling the acquisition of accurate information in real time. The server verifies the integrity of the collected data and compares it with existing databases. If there are integrity issues, the server notifies the user via a terminal. Missing information or information requiring correction is entered by the user via the terminal. The user's input process is designed to be easily performed through the terminal's interface.

[0248] Data entered by users into their terminals is analyzed by the server using a template engine and automatically converted into the format required by each system. This allows for flexible handling of different formats. The converted information is then sent by the server to external information systems via APIs, ensuring that the information is updated quickly.

[0249] To give a specific example, when a user changes the company's headquarters address, the server retrieves the new address information from the database and detects any discrepancies with the existing information. If a discrepancy is found, the user is notified via their terminal. The user enters the correct information into the terminal, which is then automatically formatted by the server for each information system, and the information is updated.

[0250] An example of a prompt message would be something like, "Please tell me the procedure for changing the company's headquarters address." This allows users to enjoy the convenience of integrated information management across systems.

[0251] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0252] Step 1:

[0253] The server collects company information from designated sources. It uses external official databases and internet requests as input, retrieving necessary data in real time via APIs. The data, including company names and addresses, forms the foundation for ensuring up-to-date information. The output is a list of the collected company information. Specifically, the server generates data queries and extracts data from the sources.

[0254] Step 2:

[0255] The server compares the collected data with existing databases to verify consistency. As input, the server uses newly collected company information and existing databases. The server performs comparisons with data within the system and executes comparison algorithms to detect inconsistencies and missing data. The output includes a consistency report and a list of inconsistencies. In specific operations, it performs database queries and comparison operations.

[0256] Step 3:

[0257] The server notifies the user via the terminal of any missing or inconsistent information based on the integrity check results. The input is the integrity check result report. The user who receives the notification will see a list of items that need correction on their terminal. The output is a user alert and a list of items to be corrected. Specifically, the server generates a notification message and displays it on the terminal's user interface.

[0258] Step 4:

[0259] The user supplements missing information and corrects inaccurate information via the terminal. The input is a list of correction items notified by the server. The user enters the necessary information on the interface and sends it to the server. The output is the corrected, supplemented data. In specific operation, the terminal provides the user interface and forwards the user's input to the server.

[0260] Step 5:

[0261] The server parses user-completed or modified information and automatically converts it to different data formats. The input is the updated data received from the user. The server uses a template engine to convert the data for each information system that requires a different format. The output is the formatted dataset. Specifically, the format conversion logic operates.

[0262] Step 6:

[0263] The server sends the converted information to an external information system via an API to update the information. The input is data with a converted format. The server sends the data to the external system, and the information in each system is updated to the latest version. The output is a confirmation message indicating that the update is complete. In specific operation, the server generates and sends an API request.

[0264] (Application Example 1)

[0265] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0266] The goal is to reduce the complexity of data linkage and format conversion between different information processing systems, thereby enabling efficient information management in logistics centers and other locations. Furthermore, it aims to improve the accuracy of information updates by quickly detecting inconsistencies and notifying users.

[0267] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0268] In this invention, the server includes means for collecting information, means for verifying the integrity of the information, means for notifying users and receiving additional information, and means for automatically converting information and coordinating with external devices. This streamlines data linkage between different systems in a logistics center and enables the rapid provision of appropriate information to users.

[0269] An "information processing device" is a device designed to collect, synchronize, transform, and update data.

[0270] An "information source" is a medium or institution that serves as the starting point for supplying the necessary data.

[0271] An "information set" refers to a collection of existing data and serves as a standard for verifying consistency.

[0272] "User" refers to a person who operates the system and provides additional information.

[0273] "Format" refers to the way in which data is represented according to specific standards.

[0274] "External devices" refer to separate systems or devices that the server interacts with.

[0275] "Notification" is the act of informing a user of specific information or a particular situation.

[0276] A "template" refers to a standardized format used for data conversion.

[0277] An "application program interface" is a means of exchanging functions between different software programs.

[0278] To implement this invention, a server is used as an information processing device. The server is responsible for processing data collection, integrity verification, information conversion, coordination with external devices, and notification.

[0279] Specifically, the server first obtains the necessary data from a predetermined information source via the API. This data includes information such as the delivery destination information of the logistics center. Next, the server compares the collected data with the existing information set to confirm its consistency. Python language is used for this consistency check, enabling efficient data comparison and update. The requests library is used to obtain data, and the jinja2 library is used to format the data.

[0280] If an inconsistency is detected, the server notifies the user through the terminal. The user can receive the notification from a smartphone or tablet terminal and input the necessary additional information. Based on this input, the server automatically converts the information into different formats and provides it to external devices in the format required by each system. Since this information update is performed via the application programming interface, seamless data linkage between systems is achieved.

[0281] As a specific example, assume that the delivery destination of a customer is changed at a logistics center. By using this application, when the new delivery destination information of the customer is obtained via the API, the server compares it with the old data and sends a notification to the user saying "Your address has been changed to the new information." Then, the data is automatically updated according to the formats of each system.

[0282] Examples of prompt texts include instructions such as "Please consider an application that automates the update of the delivery destination of customers at the logistics center. When new delivery destination information is obtained via the API, we want the update between systems to be performed automatically."

[0283] The flow of the specific process in Application Example 1 will be described using FIG. 12.

[0284] Step 1:

[0285] The server retrieves the delivery destination information of the logistics center from a predetermined information source via an API. The input is the API endpoint of the information source, and the output is a dataset of the latest delivery destination information. This data is retrieved using the requests library and saved in JSON format.

[0286] Step 2:

[0287] The server compares the retrieved delivery destination information with the existing information set to confirm consistency. The inputs are the newly retrieved delivery destination information and the existing dataset. The outputs are a flag indicating whether there are inconsistencies and a list of inconsistent items. The server uses Python to compare each data in the list in sequence to detect differences.

[0288] Step 3:

[0289] If inconsistencies are detected, the server notifies the user through the terminal. The input is the list containing the inconsistent items, and the output is a notification message to the user. The notification is sent as a push notification to smartphones or tablets.

[0290] Step 4:

[0291] The user inputs the accurate information corresponding to the inconsistent items using the terminal. The input is the new delivery destination information provided by the user, and the output is the corrected delivery information. The user uses the interface of the terminal to input the information and send it to the server.

[0292] Step 5:

[0293] The server automatically converts the correction information received from the user into the specified format. The input is the corrected delivery information, and the output is data suitable for the format required by each system. For the conversion, the jinja2 library is used to extract and format the data based on the template.

[0294] Step 6:

[0295] The server provides the converted information to an external device via an application program interface for updating. The input is formatted delivery information data, and the output is a success flag for the data update in the associated system. The server configures a POST request for the API and sends the information to the external device.

[0296] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0297] This invention aims to further enhance the user experience by incorporating an emotion engine into an information processing system. The system is configured and operated as follows:

[0298] The server collects data directly from the internet and official databases and verifies its integrity. The information obtained in this process is then presented appropriately to the user, and this is where the emotion engine plays its role.

[0299] The emotion engine analyzes user input and responses through the device to recognize their emotional state. For example, if the system determines that a user is feeling frustrated while entering complex information, based on their input speed and frequency of errors, it can adjust the interface accordingly. This is achieved by making the guidance displayed on the device clearer or, if necessary, simplifying it.

[0300] When a user adds specific information to the system, the server converts that information into the appropriate format according to the requirements of each system. During this process, based on feedback from the emotion engine, the system flexibly changes the displayed menu to reduce user stress. For example, if the emotion engine detects that the user is in a hurry, it can prioritize displaying only the most important information and request additional information only after all procedures are completed.

[0301] Finally, the server sends the converted information to other systems via the API to update the information. By considering the user's comfort based on the output of the emotion engine, the overall efficiency of information processing and the user experience can be improved. In this way, the system goes beyond a mere information processing device and provides an operating environment that is user-friendly.

[0302] The following describes the process flow.

[0303] Step 1:

[0304] The server obtains the necessary corporate information from the Internet or official databases. As a result, data such as the latest company name and address changes are obtained.

[0305] Step 2:

[0306] The server compares the obtained data with the existing database to check for consistency. If a discrepancy is found, the details are recorded.

[0307] Step 3:

[0308] The terminal visually presents the lack or inconsistencies in the information to the user and requests the correction or addition of the necessary information. The user responds to this using the terminal and enters the appropriate data.

[0309] Step 4:

[0310] The terminal observes the user's input speed and actions during input using the emotion engine and analyzes the user's emotional state. If the user's stress or confusion is detected, the terminal adjusts the interface to provide more user-friendly guidance.

[0311] Step 5:

[0312] The server converts the modified or additional information obtained from the user into the required format. In doing so, it utilizes the system's template engine to adapt it to the specific format required by each system.

[0313] Step 6:

[0314] The server sends the converted data to an external system using an API to ensure the information is updated correctly. Here, feedback from the sentiment engine is taken into consideration, and the user interface and processes are further optimized as needed.

[0315] (Example 2)

[0316] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0317] Conventional information processing systems suffer from several challenges, including a lack of user experience and inefficient data management. In particular, they often provide static interfaces that fail to consider the user's emotional state, leading to user stress. Furthermore, they lack flexibility in data format conversion and integration with external systems.

[0318] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0319] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing it with existing databases to verify consistency, means for performing sentiment analysis on user input and responses, and means for dynamically adjusting the user interface. This enables the provision of a comfortable interface that responds to the user's emotional state and efficient data management.

[0320] An "information processing device" is a computer system that collects, analyzes, stores, converts, and communicates data.

[0321] A "source of information" refers to an external system from which data can be obtained, such as the internet or official databases.

[0322] "Data integrity verification" is the process of verifying whether the collected data is accurate and consistent.

[0323] "Sentiment analysis" is a process that determines a user's emotional state based on factors such as their input speed and the frequency of their errors.

[0324] A "user interface" refers to the screens and controls that a user uses to interact with an information processing device.

[0325] "Format conversion" is the process of changing data into a different structure or format.

[0326] "Integration with external systems" refers to the process of exchanging and updating information with other systems.

[0327] This invention is a system for analyzing a user's emotional state and improving the user experience of an information processing system. The server uses APIs to efficiently collect necessary data from the internet and official databases. This data is temporarily stored in a database, and its accuracy and reliability are ensured by integrity checks performed using scripts such as Python.

[0328] The device captures user input in real time and sends it to the emotion engine. This emotion engine analyzes the user's input speed and error rate to determine the user's emotional state. For example, if input is slow and errors occur frequently, it is determined that the user is stressed. Machine learning algorithms are used for this analysis, and dynamic interface adjustments are made to improve the user experience.

[0329] Specifically, if the emotion engine detects that the user is in a hurry, the interface on the device automatically adjusts to display only the most important options and avoid cumbersome operations. This allows the user to access the necessary information without stress and enables efficient operation.

[0330] The server also converts additional information provided by users into different data formats, enabling data exchange with external systems. This allows information to be integrated into other systems using standard formats such as JSON and XML. A RESTful API is used for sending data to external systems, ensuring fast and secure information updates.

[0331] As a concrete example, consider a user purchasing a product on an online shopping platform. If the emotion engine detects that the user is in a hurry, the terminal will simplify the purchase process, presenting only the essential steps to reduce the user's burden. Another example of a prompt to input into the generative AI model is, "How should the interface be adjusted if the user's input speed is slow?"

[0332] Thus, the system of the present invention not only improves the efficiency of data processing but also enables the provision of a user-friendly and comfortable operating environment.

[0333] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0334] Step 1:

[0335] The server collects data from the internet and official sources via APIs. In this process, it specifies the URL or endpoint of the target data and issues an HTTP request. The input is the API endpoint, and the output is raw data received in JSON format. For example, it can retrieve the latest weather data from a weather information API.

[0336] Step 2:

[0337] The server verifies the integrity of the collected data. Using a Python script, it detects missing or outlier data and corrects or filters them as needed. The input is the JSON data obtained in step 1, and the output is clean, integrity-verified data. For example, it can impute missing values ​​in the acquired weather data.

[0338] Step 3:

[0339] The device acquires user input in real time. When a user enters data into a form, it measures key events and input time to collect input data for sentiment analysis. The input is the user's typing data, and the output is input information compiled in an analysis format. For example, it collects data from input forms for names and email addresses.

[0340] Step 4:

[0341] The device uses an emotion engine to analyze the user's emotional state. A machine learning algorithm processes the input data and estimates what emotions the user is experiencing. The input is the data used for analysis in step 3, and the output is a determination indicating the user's emotional state. For example, if the input speed is slow and there are many errors, it may be determined that the user is feeling frustrated.

[0342] Step 5:

[0343] The server adaptively changes the user interface based on the sentiment analysis results. For users in a hurry, the purchase process is simplified, and only the most important options are displayed. The input is the sentiment analysis results, and the output is the adjusted interface screen layout. For example, it might prioritize displaying only payment information.

[0344] Step 6:

[0345] The server converts the format of any additional information provided by the user as needed and sends it to the external system. It converts the data format from CSV to JSON and sends it using the HTTP protocol. The input is the additional information entered by the user, and the output is data formatted for the external system. For example, order information can be transferred to another warehouse management system.

[0346] Step 7:

[0347] The terminal generates a prompt for the AI ​​model. This prompt is displayed on the console and used as input for the model to return a response that takes the user's current state into account. The input consists of the user's sentiment analysis results and operation log, while the output is the generated prompt. For example, it might generate a prompt such as, "What action would you like to perform next?"

[0348] (Application Example 2)

[0349] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0350] Modern information processing systems tend to present information unilaterally, without considering the user's emotions or feelings. As a result, the user experience deteriorates, and users often experience stress. In particular, the complexity and difficulty of operating these systems become an even greater burden for the elderly and those unfamiliar with technology. Furthermore, even with home appliances, it is difficult to provide appropriate services that meet the user's needs, resulting in a lack of improvement in the quality of daily life. Solving these problems is essential.

[0351] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0352] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing the collected data with an existing database to verify consistency, means for presenting missing information to the user and receiving additional information, means for automatically converting the received additional information into a different format, means for updating the converted information in cooperation with an external processing device, means for analyzing the user's input and reactions through a terminal to recognize their emotional state, means for adjusting the interface based on the recognition of their emotional state, and means for controlling home appliances that analyze the user's behavior using voice input and sensors to provide appropriate support. This enables information processing that takes the user's emotions into consideration and smart operation of home appliances, improving the user experience and quality of life.

[0353] An "information processing device" is a device that has the function of collecting, analyzing, and transforming data, and exchanging information with external systems.

[0354] An "information source" is the source of the underlying data necessary to provide the required information.

[0355] A "database" is a collection of structured data used to organize information and ensure its consistency.

[0356] A "user" is a person who operates an information processing system and receives its services.

[0357] "Additional information" refers to information provided by users to supplement missing data.

[0358] "Format" refers to the arrangement and format of data used when converting information into a different format.

[0359] An "external processing device" is another device that has the function of linking with the system and updating information.

[0360] A "terminal" is a device used by a user to interact with an information processing device.

[0361] "Emotional state" refers to the psychological state that can be inferred from the user's input and responses.

[0362] An "interface" is an operating screen or method for exchanging data between a user and an information processing device.

[0363] "Voice input" is a method of inputting data into a device using the user's voice.

[0364] A "sensor" is a device used to detect the environment or the state of a user.

[0365] "Household appliances" are electrical devices used within the home to support daily life.

[0366] In this embodiment of the invention, an information processing device uses various sensors and voice input devices to control household appliances. The server collects necessary data from the internet and other sources and verifies the collected data through integrity checks in a database. This allows the server to efficiently receive additional information from users based on reliable information, automatically convert that information into different formats, and update the information with external processing devices as needed.

[0367] The device uses an emotion engine to analyze emotional data obtained through user input and reactions. The emotion engine analyzes input characteristics such as input speed and error frequency to recognize the user's psychological state. Based on this analysis, the interface is adjusted according to the user's emotions, for example, by simplifying explanations or providing interactions that reduce stress.

[0368] The home appliances are equipped with voice input devices and multiple environmental sensors that detect the user's voice and surrounding environment. This sensory data is analyzed by an AI system on a server, which then instructs the home appliances to take actions that meet the user's needs, making life more convenient.

[0369] For example, when a user says, "I want to relax today," the device collects this voice and analyzes it with its emotion engine. As a result, the home appliance changes the room lighting to a warmer tone and plays calming music. This series of operations is aimed at creating a comfortable home environment and helping the user relax.

[0370] An example of a prompt in a generative AI model is, "Please suggest activities to help me unwind after a long day." This prompt is used to support appropriate appliance operation based on the user's relaxation needs.

[0371] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0372] Step 1:

[0373] The server collects necessary data from the internet and other sources. This collected data is stored in the server's database and used as initial data.

[0374] Step 2:

[0375] The server compares the collected data with existing databases to verify consistency. The accuracy of the data is checked here, and if there are discrepancies, a warning is generated. This warning data becomes input for the next process.

[0376] Step 3:

[0377] The terminal receives additional information entered by the user. The data entered by the user is sent to the server through the terminal's input interface. This input data becomes the basis for further data transformation.

[0378] Step 4:

[0379] The server automatically converts the received additional information into a different format. This conversion is performed based on a predetermined template and is formatted to be suitable for communication with external processing devices. This output format becomes the data for communication with external processing devices.

[0380] Step 5:

[0381] The server communicates with an external processing unit to update the converted information. The external processing unit receives new data via an API and updates the system-wide data to keep it up-to-date. This updated data becomes the basis for the next process.

[0382] Step 6:

[0383] The device analyzes the user's input and responses, and recognizes their emotional state using an emotion engine. The user's input speed, error frequency, and other factors are analyzed and output as their emotional state. This emotional data then becomes input data for interface adjustments.

[0384] Step 7:

[0385] The device adjusts the interface based on its recognition of the user's emotional state. To reduce user stress, the interface simplifies the displayed content and highlights key points. This adjusted interface provides an improved user experience.

[0386] Step 8:

[0387] Home appliances analyze user behavior using voice input and sensors, and transmit the sensing data to a server. This sensing data forms the basis for operating home appliances based on user needs.

[0388] Step 9:

[0389] The server uses the prompts given to the generating AI model to generate support tailored to the user. For example, it might instruct home appliances to perform relaxation-related actions. This generated support is then implemented in the user's daily life.

[0390] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0391] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0392] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0393] [Third Embodiment]

[0394] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0395] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0396] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0397] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0398] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0399] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0400] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0401] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0402] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0403] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0404] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0405] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0406] This invention is an information processing system for reducing the complexity of common procedures required across different systems. In implementing the invention, the system is constructed based on the following configuration and procedure.

[0407] The server's primary role is to collect up-to-date company information, particularly company names and addresses, from the internet and official databases. This data can be obtained accurately and quickly using APIs. The server then compares the collected data with existing data to verify consistency. Based on the verification results, if any missing or inconsistent information is detected, it presents this information to the user via the terminal. The user then inputs any necessary additional information or corrections through the terminal's interface.

[0408] The server then analyzes the information received from the user and automatically converts it into the format required by each system. Even if different services require different formats, the template engine can efficiently handle this.

[0409] The converted information is sent by the server to other systems via API, and ultimately the information is updated in each respective system. This integration allows users to manage information simply and reliably without being burdened by procedures specific to each system.

[0410] For example, when a user changes the company's headquarters address, the server first retrieves the new address information from the database and compares it with the existing information. If a discrepancy is found, the terminal notifies the user and prompts them to enter the correct information. Once the user enters the new address, the server formats the address information for each system and automatically updates it via API. This automated process significantly improves the efficiency of information management.

[0411] The following describes the processing flow.

[0412] Step 1:

[0413] The server accesses designated sources to collect up-to-date data on company information. This includes using API calls and web scraping techniques.

[0414] Step 2:

[0415] The server compares the collected data with its internal database to verify consistency. Here, it evaluates whether the newly collected information matches the current data and records any discrepancies.

[0416] Step 3:

[0417] The terminal notifies the user of any missing or inconsistent information and displays the necessary corrections or additions on the interface. The user reviews this information and enters or corrects the required details.

[0418] Step 4:

[0419] The server retrieves the modified or added information from the user and converts it into the specific format required by each system. This conversion is performed automatically using a template engine.

[0420] Step 5:

[0421] The server sequentially sends the converted data via APIs to external systems to update the information. During this process, it considers various conditions, including API authentication and error handling, and performs the necessary communications.

[0422] (Example 1)

[0423] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0424] In information processing systems, a challenge is to automatically ensure the consistency and coherence of data collected from different sources and to efficiently update necessary information. In particular, there is a need to reduce the burden of manual information management and address differences in information formats across various systems, while ensuring accurate and rapid information processing.

[0425] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0426] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for verifying consistency based on the collected data, and means for presenting missing information to the user and receiving additional information based on the verification results. This enables more efficient information management and accurate data updates across different information systems.

[0427] An "information processing system" is a set of technological foundations for efficiently and accurately managing information through data collection, analysis, transformation, and external collaboration.

[0428] "Information source" refers to the place or platform from which data is obtained, such as databases or resources on the internet.

[0429] "Consistency" refers to a state where collected data matches existing data and is free from contradictions or omissions.

[0430] A "terminal" is a device that has an interface for users to present or input information.

[0431] A "template engine" is a software component designed to streamline conversion and output processes for different data formats and styles.

[0432] An "API" is a standardized programming interface that enables data communication and collaboration between different software applications.

[0433] This information processing system aims to streamline information exchange and management between different information systems. The server utilizes internet-based information sources and existing databases, collecting necessary data using APIs. This data collection places particular emphasis on information such as company information and addresses, enabling the acquisition of accurate information in real time. The server verifies the integrity of the collected data and compares it with existing databases. If there are integrity issues, the server notifies the user via a terminal. Missing information or information requiring correction is entered by the user via the terminal. The user's input process is designed to be easily performed through the terminal's interface.

[0434] Data entered by users into their terminals is analyzed by the server using a template engine and automatically converted into the format required by each system. This allows for flexible handling of different formats. The converted information is then sent by the server to external information systems via APIs, ensuring that the information is updated quickly.

[0435] To give a specific example, when a user changes the company's headquarters address, the server retrieves the new address information from the database and detects any discrepancies with the existing information. If a discrepancy is found, the user is notified via their terminal. The user enters the correct information into the terminal, which is then automatically formatted by the server for each information system, and the information is updated.

[0436] An example of a prompt message would be something like, "Please tell me the procedure for changing the company's headquarters address." This allows users to enjoy the convenience of integrated information management across systems.

[0437] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0438] Step 1:

[0439] The server collects company information from designated sources. It uses external official databases and internet requests as input, retrieving necessary data in real time via APIs. The data, including company names and addresses, forms the foundation for ensuring up-to-date information. The output is a list of the collected company information. Specifically, the server generates data queries and extracts data from the sources.

[0440] Step 2:

[0441] The server compares the collected data with existing databases to verify consistency. As input, the server uses newly collected company information and existing databases. The server performs comparisons with data within the system and executes comparison algorithms to detect inconsistencies and missing data. The output includes a consistency report and a list of inconsistencies. In specific operations, it performs database queries and comparison operations.

[0442] Step 3:

[0443] The server notifies the user via the terminal of any missing or inconsistent information based on the integrity check results. The input is the integrity check result report. The user who receives the notification will see a list of items that need correction on their terminal. The output is a user alert and a list of items to be corrected. Specifically, the server generates a notification message and displays it on the terminal's user interface.

[0444] Step 4:

[0445] The user supplements missing information and corrects inaccurate information via the terminal. The input is a list of correction items notified by the server. The user enters the necessary information on the interface and sends it to the server. The output is the corrected, supplemented data. In specific operation, the terminal provides the user interface and forwards the user's input to the server.

[0446] Step 5:

[0447] The server parses user-completed or modified information and automatically converts it to different data formats. The input is the updated data received from the user. The server uses a template engine to convert the data for each information system that requires a different format. The output is the formatted dataset. Specifically, the format conversion logic operates.

[0448] Step 6:

[0449] The server sends the converted information to an external information system via an API to update the information. The input is data with a converted format. The server sends the data to the external system, and the information in each system is updated to the latest version. The output is a confirmation message indicating that the update is complete. In specific operation, the server generates and sends an API request.

[0450] (Application Example 1)

[0451] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0452] The goal is to reduce the complexity of data linkage and format conversion between different information processing systems, thereby enabling efficient information management in logistics centers and other locations. Furthermore, it aims to improve the accuracy of information updates by quickly detecting inconsistencies and notifying users.

[0453] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0454] In this invention, the server includes means for collecting information, means for verifying the integrity of the information, means for notifying users and receiving additional information, and means for automatically converting information and coordinating with external devices. This streamlines data linkage between different systems in a logistics center and enables the rapid provision of appropriate information to users.

[0455] An "information processing device" is a device designed to collect, synchronize, transform, and update data.

[0456] An "information source" is a medium or institution that serves as the starting point for supplying the necessary data.

[0457] An "information set" refers to a collection of existing data and serves as a standard for verifying consistency.

[0458] "User" refers to a person who operates the system and provides additional information.

[0459] "Format" refers to the way in which data is represented according to specific standards.

[0460] "External devices" refer to separate systems or devices that the server interacts with.

[0461] "Notification" is the act of informing a user of specific information or a particular situation.

[0462] A "template" refers to a standardized format used for data conversion.

[0463] An "application program interface" is a means of exchanging functions between different software programs.

[0464] To implement this invention, a server is used as an information processing device. The server is responsible for processing data collection, integrity verification, information conversion, coordination with external devices, and notification.

[0465] Specifically, the server first retrieves the necessary data from designated information sources via an API. This data includes delivery destination information for logistics centers. Next, the server compares the collected data with existing information sets to verify consistency. The Python language is used for this consistency verification, allowing for efficient data comparison and updating. The requests library is used to retrieve the data, and the jinja2 library is used to format the data.

[0466] If an inconsistency is detected, the server will notify the user via the terminal. The user can receive the notification on their smartphone or tablet and enter any necessary additional information. Based on this input, the server automatically converts the information into different formats and provides it to external devices in the format required by each system. This information update is performed via an application program interface, ensuring seamless data exchange between systems.

[0467] As a concrete example, let's consider a scenario where a customer's delivery address changes at a logistics center. Using this application, the process proceeds as follows: "When the customer's new delivery address information is retrieved via API, the server compares it with the old data and sends a notification to the user stating, 'Your address has been updated.' After that, the data is automatically updated to match the format of each system."

[0468] An example of a prompt would be: "Consider an application that automates updating customer delivery addresses at a logistics center. When new delivery address information is retrieved via API, we want the system to update automatically."

[0469] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0470] Step 1:

[0471] The server retrieves delivery destination information for logistics centers from a designated source via an API. The input is the API endpoint of the source, and the output is a dataset of the latest delivery destination information. This data is retrieved using the requests library and stored in JSON format.

[0472] Step 2:

[0473] The server checks for consistency by comparing the acquired delivery address information with an existing data set. The input is the newly acquired delivery address information and the existing dataset. The output is a flag indicating whether there are inconsistencies and a list of inconsistent items. The server uses Python to sequentially compare each data item in the list and detect the differences.

[0474] Step 3:

[0475] If an inconsistency is detected, the server will notify the user via the terminal. The input is a list of the inconsistent items, and the output is a notification message to the user. The notification is sent as a push notification to smartphones and tablets.

[0476] Step 4:

[0477] The user uses a terminal to input the correct information corresponding to the inconsistent items. The input is the new shipping address information provided by the user, and the output is the corrected shipping information. The user uses the terminal interface to input the information and send it to the server.

[0478] Step 5:

[0479] The server automatically converts the correction information received from the user into the specified format. The input is the corrected delivery information, and the output is data suitable for the format required by each system. The conversion is performed using the Jinja2 library, which extracts and formats the data based on a template.

[0480] Step 6:

[0481] The server provides the converted information to an external device via an application program interface for updating. The input is formatted delivery information data, and the output is a success flag for the data update in the associated system. The server configures a POST request for the API and sends the information to the external device.

[0482] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0483] This invention aims to further enhance the user experience by incorporating an emotion engine into an information processing system. The system is configured and operated as follows:

[0484] The server collects data directly from the internet and official databases and verifies its integrity. The information obtained in this process is then presented appropriately to the user, and this is where the emotion engine plays its role.

[0485] The emotion engine analyzes user input and responses through the device to recognize their emotional state. For example, if the system determines that a user is feeling frustrated while entering complex information, based on their input speed and frequency of errors, it can adjust the interface accordingly. This is achieved by making the guidance displayed on the device clearer or, if necessary, simplifying it.

[0486] When a user adds specific information to the system, the server converts that information into the appropriate format according to the requirements of each system. During this process, based on feedback from the emotion engine, the system flexibly changes the displayed menu to reduce user stress. For example, if the emotion engine detects that the user is in a hurry, it can prioritize displaying only the most important information and request additional information only after all procedures are completed.

[0487] Ultimately, the server sends the transformed information to other systems via APIs for updates. By considering user comfort based on the output of the emotion engine, the overall efficiency of information processing and the user experience can be improved. In this way, the system goes beyond being a mere information processing device and provides a user-friendly operating environment.

[0488] The following describes the processing flow.

[0489] Step 1:

[0490] The server retrieves necessary company information from the internet and official databases. This ensures that the latest data, such as company name and address changes, is obtained.

[0491] Step 2:

[0492] The server compares the retrieved data with existing databases to verify consistency. If any discrepancies are found, the details are recorded.

[0493] Step 3:

[0494] The terminal visually displays any missing or inconsistent information to the user and requests corrections or additions of necessary information. The user responds using the terminal and enters the appropriate data.

[0495] Step 4:

[0496] The device uses an emotion engine to observe the user's input speed and behavior during input, and analyzes the user's emotional state. If user stress or confusion is detected, the device adjusts the interface to provide more user-friendly guidance.

[0497] Step 5:

[0498] The server converts the modified or additional information obtained from the user into the required format. In doing so, it utilizes the system's template engine to adapt it to the specific format required by each system.

[0499] Step 6:

[0500] The server sends the converted data to an external system using an API to ensure the information is updated correctly. Here, feedback from the sentiment engine is taken into consideration, and the user interface and processes are further optimized as needed.

[0501] (Example 2)

[0502] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0503] Conventional information processing systems suffer from several challenges, including a lack of user experience and inefficient data management. In particular, they often provide static interfaces that fail to consider the user's emotional state, leading to user stress. Furthermore, they lack flexibility in data format conversion and integration with external systems.

[0504] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0505] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing it with existing databases to verify consistency, means for performing sentiment analysis on user input and responses, and means for dynamically adjusting the user interface. This enables the provision of a comfortable interface that responds to the user's emotional state and efficient data management.

[0506] An "information processing device" is a computer system that collects, analyzes, stores, converts, and communicates data.

[0507] A "source of information" refers to an external system from which data can be obtained, such as the internet or official databases.

[0508] "Data integrity verification" is the process of verifying whether the collected data is accurate and consistent.

[0509] "Sentiment analysis" is a process that determines a user's emotional state based on factors such as their input speed and the frequency of their errors.

[0510] A "user interface" refers to the screens and controls that a user uses to interact with an information processing device.

[0511] "Format conversion" is the process of changing data into a different structure or format.

[0512] "Integration with external systems" refers to the process of exchanging and updating information with other systems.

[0513] This invention is a system for analyzing a user's emotional state and improving the user experience of an information processing system. The server uses APIs to efficiently collect necessary data from the internet and official databases. This data is temporarily stored in a database, and its accuracy and reliability are ensured by integrity checks performed using scripts such as Python.

[0514] The device captures user input in real time and sends it to the emotion engine. This emotion engine analyzes the user's input speed and error rate to determine the user's emotional state. For example, if input is slow and errors occur frequently, it is determined that the user is stressed. Machine learning algorithms are used for this analysis, and dynamic interface adjustments are made to improve the user experience.

[0515] Specifically, if the emotion engine detects that the user is in a hurry, the interface on the device automatically adjusts to display only the most important options and avoid cumbersome operations. This allows the user to access the necessary information without stress and enables efficient operation.

[0516] The server also converts additional information provided by users into different data formats, enabling data exchange with external systems. This allows information to be integrated into other systems using standard formats such as JSON and XML. A RESTful API is used for sending data to external systems, ensuring fast and secure information updates.

[0517] As a concrete example, consider a user purchasing a product on an online shopping platform. If the emotion engine detects that the user is in a hurry, the terminal will simplify the purchase process, presenting only the essential steps to reduce the user's burden. Another example of a prompt to input into the generative AI model is, "How should the interface be adjusted if the user's input speed is slow?"

[0518] Thus, the system of the present invention not only improves the efficiency of data processing but also enables the provision of a user-friendly and comfortable operating environment.

[0519] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0520] Step 1:

[0521] The server collects data from the internet and official sources via APIs. In this process, it specifies the URL or endpoint of the target data and issues an HTTP request. The input is the API endpoint, and the output is raw data received in JSON format. For example, it can retrieve the latest weather data from a weather information API.

[0522] Step 2:

[0523] The server verifies the integrity of the collected data. Using a Python script, it detects missing or outlier data and corrects or filters them as needed. The input is the JSON data obtained in step 1, and the output is clean, integrity-verified data. For example, it can impute missing values ​​in the acquired weather data.

[0524] Step 3:

[0525] The device acquires user input in real time. When a user enters data into a form, it measures key events and input time to collect input data for sentiment analysis. The input is the user's typing data, and the output is input information compiled in an analysis format. For example, it collects data from input forms for names and email addresses.

[0526] Step 4:

[0527] The device uses an emotion engine to analyze the user's emotional state. A machine learning algorithm processes the input data and estimates what emotions the user is experiencing. The input is the data used for analysis in step 3, and the output is a determination indicating the user's emotional state. For example, if the input speed is slow and there are many errors, it may be determined that the user is feeling frustrated.

[0528] Step 5:

[0529] The server adaptively changes the user interface based on the sentiment analysis results. For users in a hurry, the purchase process is simplified, and only the most important options are displayed. The input is the sentiment analysis results, and the output is the adjusted interface screen layout. For example, it might prioritize displaying only payment information.

[0530] Step 6:

[0531] The server converts the format of any additional information provided by the user as needed and sends it to the external system. It converts the data format from CSV to JSON and sends it using the HTTP protocol. The input is the additional information entered by the user, and the output is data formatted for the external system. For example, order information can be transferred to another warehouse management system.

[0532] Step 7:

[0533] The terminal generates a prompt for the AI ​​model. This prompt is displayed on the console and used as input for the model to return a response that takes the user's current state into account. The input consists of the user's sentiment analysis results and operation log, while the output is the generated prompt. For example, it might generate a prompt such as, "What action would you like to perform next?"

[0534] (Application Example 2)

[0535] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0536] Modern information processing systems tend to present information unilaterally, without considering the user's emotions or feelings. As a result, the user experience deteriorates, and users often experience stress. In particular, the complexity and difficulty of operating these systems become an even greater burden for the elderly and those unfamiliar with technology. Furthermore, even with home appliances, it is difficult to provide appropriate services that meet the user's needs, resulting in a lack of improvement in the quality of daily life. Solving these problems is essential.

[0537] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0538] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing the collected data with an existing database to verify consistency, means for presenting missing information to the user and receiving additional information, means for automatically converting the received additional information into a different format, means for updating the converted information in cooperation with an external processing device, means for analyzing the user's input and reactions through a terminal to recognize their emotional state, means for adjusting the interface based on the recognition of their emotional state, and means for controlling home appliances that analyze the user's behavior using voice input and sensors to provide appropriate support. This enables information processing that takes the user's emotions into consideration and smart operation of home appliances, improving the user experience and quality of life.

[0539] An "information processing device" is a device that has the function of collecting, analyzing, and transforming data, and exchanging information with external systems.

[0540] An "information source" is the source of the underlying data necessary to provide the required information.

[0541] A "database" is a collection of structured data used to organize information and ensure its consistency.

[0542] A "user" is a person who operates an information processing system and receives its services.

[0543] "Additional information" refers to information provided by users to supplement missing data.

[0544] "Format" refers to the arrangement and format of data used when converting information into a different format.

[0545] An "external processing device" is another device that has the function of linking with the system and updating information.

[0546] A "terminal" is a device used by a user to interact with an information processing device.

[0547] "Emotional state" refers to the psychological state that can be inferred from the user's input and responses.

[0548] An "interface" is an operating screen or method for exchanging data between a user and an information processing device.

[0549] "Voice input" is a method of inputting data into a device using the user's voice.

[0550] A "sensor" is a device used to detect the environment or the state of a user.

[0551] "Household appliances" are electrical devices used within the home to support daily life.

[0552] In this embodiment of the invention, an information processing device uses various sensors and voice input devices to control household appliances. The server collects necessary data from the internet and other sources and verifies the collected data through integrity checks in a database. This allows the server to efficiently receive additional information from users based on reliable information, automatically convert that information into different formats, and update the information with external processing devices as needed.

[0553] The device uses an emotion engine to analyze emotional data obtained through user input and reactions. The emotion engine analyzes input characteristics such as input speed and error frequency to recognize the user's psychological state. Based on this analysis, the interface is adjusted according to the user's emotions, for example, by simplifying explanations or providing interactions that reduce stress.

[0554] The home appliances are equipped with voice input devices and multiple environmental sensors that detect the user's voice and surrounding environment. This sensory data is analyzed by an AI system on a server, which then instructs the home appliances to take actions that meet the user's needs, making life more convenient.

[0555] For example, when a user says, "I want to relax today," the device collects this voice and analyzes it with its emotion engine. As a result, the home appliance changes the room lighting to a warmer tone and plays calming music. This series of operations is aimed at creating a comfortable home environment and helping the user relax.

[0556] An example of a prompt in a generative AI model is, "Please suggest activities to help me unwind after a long day." This prompt is used to support appropriate appliance operation based on the user's relaxation needs.

[0557] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0558] Step 1:

[0559] The server collects necessary data from the internet and other sources. This collected data is stored in the server's database and used as initial data.

[0560] Step 2:

[0561] The server compares the collected data with existing databases to verify consistency. The accuracy of the data is checked here, and if there are discrepancies, a warning is generated. This warning data becomes input for the next process.

[0562] Step 3:

[0563] The terminal receives additional information entered by the user. The data entered by the user is sent to the server through the terminal's input interface. This input data becomes the basis for further data transformation.

[0564] Step 4:

[0565] The server automatically converts the received additional information into a different format. This conversion is performed based on a predetermined template and is formatted to be suitable for communication with external processing devices. This output format becomes the data for communication with external processing devices.

[0566] Step 5:

[0567] The server communicates with an external processing unit to update the converted information. The external processing unit receives new data via an API and updates the system-wide data to keep it up-to-date. This updated data becomes the basis for the next process.

[0568] Step 6:

[0569] The device analyzes the user's input and responses, and recognizes their emotional state using an emotion engine. The user's input speed, error frequency, and other factors are analyzed and output as their emotional state. This emotional data then becomes input data for interface adjustments.

[0570] Step 7:

[0571] The device adjusts the interface based on its recognition of the user's emotional state. To reduce user stress, the interface simplifies the displayed content and highlights key points. This adjusted interface provides an improved user experience.

[0572] Step 8:

[0573] Home appliances analyze user behavior using voice input and sensors, and transmit the sensing data to a server. This sensing data forms the basis for operating home appliances based on user needs.

[0574] Step 9:

[0575] The server uses the prompts given to the generating AI model to generate support tailored to the user. For example, it might instruct home appliances to perform relaxation-related actions. This generated support is then implemented in the user's daily life.

[0576] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0577] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0578] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0579] [Fourth Embodiment]

[0580] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0581] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0582] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0583] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0584] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0585] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0586] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0587] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0588] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0589] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0590] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0591] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0592] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0593] This invention is an information processing system for reducing the complexity of common procedures required across different systems. In implementing the invention, the system is constructed based on the following configuration and procedure.

[0594] The server's primary role is to collect up-to-date company information, particularly company names and addresses, from the internet and official databases. This data can be obtained accurately and quickly using APIs. The server then compares the collected data with existing data to verify consistency. Based on the verification results, if any missing or inconsistent information is detected, it presents this information to the user via the terminal. The user then inputs any necessary additional information or corrections through the terminal's interface.

[0595] The server then analyzes the information received from the user and automatically converts it into the format required by each system. Even if different services require different formats, the template engine can efficiently handle this.

[0596] The converted information is sent by the server to other systems via API, and ultimately the information is updated in each respective system. This integration allows users to manage information simply and reliably without being burdened by procedures specific to each system.

[0597] For example, when a user changes the company's headquarters address, the server first retrieves the new address information from the database and compares it with the existing information. If a discrepancy is found, the terminal notifies the user and prompts them to enter the correct information. Once the user enters the new address, the server formats the address information for each system and automatically updates it via API. This automated process significantly improves the efficiency of information management.

[0598] The following describes the processing flow.

[0599] Step 1:

[0600] The server accesses designated sources to collect up-to-date data on company information. This includes using API calls and web scraping techniques.

[0601] Step 2:

[0602] The server compares the collected data with its internal database to verify consistency. Here, it evaluates whether the newly collected information matches the current data and records any discrepancies.

[0603] Step 3:

[0604] The terminal notifies the user of any missing or inconsistent information and displays the necessary corrections or additions on the interface. The user reviews this information and enters or corrects the required details.

[0605] Step 4:

[0606] The server retrieves the modified or added information from the user and converts it into the specific format required by each system. This conversion is performed automatically using a template engine.

[0607] Step 5:

[0608] The server sequentially sends the converted data via APIs to external systems to update the information. During this process, it considers various conditions, including API authentication and error handling, and performs the necessary communications.

[0609] (Example 1)

[0610] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0611] In information processing systems, a challenge is to automatically ensure the consistency and coherence of data collected from different sources and to efficiently update necessary information. In particular, there is a need to reduce the burden of manual information management and address differences in information formats across various systems, while ensuring accurate and rapid information processing.

[0612] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0613] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for verifying consistency based on the collected data, and means for presenting missing information to the user and receiving additional information based on the verification results. This enables more efficient information management and accurate data updates across different information systems.

[0614] An "information processing system" is a set of technological foundations for efficiently and accurately managing information through data collection, analysis, transformation, and external collaboration.

[0615] "Information source" refers to the place or platform from which data is obtained, such as databases or resources on the internet.

[0616] "Consistency" refers to a state where collected data matches existing data and is free from contradictions or omissions.

[0617] A "terminal" is a device that has an interface for users to present or input information.

[0618] A "template engine" is a software component designed to streamline conversion and output processes for different data formats and styles.

[0619] An "API" is a standardized programming interface that enables data communication and collaboration between different software applications.

[0620] This information processing system aims to streamline information exchange and management between different information systems. The server utilizes internet-based information sources and existing databases, collecting necessary data using APIs. This data collection places particular emphasis on information such as company information and addresses, enabling the acquisition of accurate information in real time. The server verifies the integrity of the collected data and compares it with existing databases. If there are integrity issues, the server notifies the user via a terminal. Missing information or information requiring correction is entered by the user via the terminal. The user's input process is designed to be easily performed through the terminal's interface.

[0621] Data entered by users into their terminals is analyzed by the server using a template engine and automatically converted into the format required by each system. This allows for flexible handling of different formats. The converted information is then sent by the server to external information systems via APIs, ensuring that the information is updated quickly.

[0622] To give a specific example, when a user changes the company's headquarters address, the server retrieves the new address information from the database and detects any discrepancies with the existing information. If a discrepancy is found, the user is notified via their terminal. The user enters the correct information into the terminal, which is then automatically formatted by the server for each information system, and the information is updated.

[0623] An example of a prompt message would be something like, "Please tell me the procedure for changing the company's headquarters address." This allows users to enjoy the convenience of integrated information management across systems.

[0624] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0625] Step 1:

[0626] The server collects company information from designated sources. It uses external official databases and internet requests as input, retrieving necessary data in real time via APIs. The data, including company names and addresses, forms the foundation for ensuring up-to-date information. The output is a list of the collected company information. Specifically, the server generates data queries and extracts data from the sources.

[0627] Step 2:

[0628] The server compares the collected data with existing databases to verify consistency. As input, the server uses newly collected company information and existing databases. The server performs comparisons with data within the system and executes comparison algorithms to detect inconsistencies and missing data. The output includes a consistency report and a list of inconsistencies. In specific operations, it performs database queries and comparison operations.

[0629] Step 3:

[0630] The server notifies the user via the terminal of any missing or inconsistent information based on the integrity check results. The input is the integrity check result report. The user who receives the notification will see a list of items that need correction on their terminal. The output is a user alert and a list of items to be corrected. Specifically, the server generates a notification message and displays it on the terminal's user interface.

[0631] Step 4:

[0632] The user supplements missing information and corrects inaccurate information via the terminal. The input is a list of correction items notified by the server. The user enters the necessary information on the interface and sends it to the server. The output is the corrected, supplemented data. In specific operation, the terminal provides the user interface and forwards the user's input to the server.

[0633] Step 5:

[0634] The server parses user-completed or modified information and automatically converts it to different data formats. The input is the updated data received from the user. The server uses a template engine to convert the data for each information system that requires a different format. The output is the formatted dataset. Specifically, the format conversion logic operates.

[0635] Step 6:

[0636] The server sends the converted information to an external information system via an API to update the information. The input is data with a converted format. The server sends the data to the external system, and the information in each system is updated to the latest version. The output is a confirmation message indicating that the update is complete. In specific operation, the server generates and sends an API request.

[0637] (Application Example 1)

[0638] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0639] The goal is to reduce the complexity of data linkage and format conversion between different information processing systems, thereby enabling efficient information management in logistics centers and other locations. Furthermore, it aims to improve the accuracy of information updates by quickly detecting inconsistencies and notifying users.

[0640] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0641] In this invention, the server includes means for collecting information, means for verifying the integrity of the information, means for notifying users and receiving additional information, and means for automatically converting information and coordinating with external devices. This streamlines data linkage between different systems in a logistics center and enables the rapid provision of appropriate information to users.

[0642] An "information processing device" is a device designed to collect, synchronize, transform, and update data.

[0643] An "information source" is a medium or institution that serves as the starting point for supplying the necessary data.

[0644] An "information set" refers to a collection of existing data and serves as a standard for verifying consistency.

[0645] "User" refers to a person who operates the system and provides additional information.

[0646] "Format" refers to the way in which data is represented according to specific standards.

[0647] "External devices" refer to separate systems or devices that the server interacts with.

[0648] "Notification" is the act of informing a user of specific information or a particular situation.

[0649] A "template" refers to a standardized format used for data conversion.

[0650] An "application program interface" is a means of exchanging functions between different software programs.

[0651] To implement this invention, a server is used as an information processing device. The server is responsible for processing data collection, integrity verification, information conversion, coordination with external devices, and notification.

[0652] Specifically, the server first retrieves the necessary data from designated information sources via an API. This data includes delivery destination information for logistics centers. Next, the server compares the collected data with existing information sets to verify consistency. The Python language is used for this consistency verification, allowing for efficient data comparison and updating. The requests library is used to retrieve the data, and the jinja2 library is used to format the data.

[0653] If an inconsistency is detected, the server will notify the user via the terminal. The user can receive the notification on their smartphone or tablet and enter any necessary additional information. Based on this input, the server automatically converts the information into different formats and provides it to external devices in the format required by each system. This information update is performed via an application program interface, ensuring seamless data exchange between systems.

[0654] As a concrete example, let's consider a scenario where a customer's delivery address changes at a logistics center. Using this application, the process proceeds as follows: "When the customer's new delivery address information is retrieved via API, the server compares it with the old data and sends a notification to the user stating, 'Your address has been updated.' After that, the data is automatically updated to match the format of each system."

[0655] An example of a prompt would be: "Consider an application that automates updating customer delivery addresses at a logistics center. When new delivery address information is retrieved via API, we want the system to update automatically."

[0656] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0657] Step 1:

[0658] The server retrieves delivery destination information for logistics centers from a designated source via an API. The input is the API endpoint of the source, and the output is a dataset of the latest delivery destination information. This data is retrieved using the requests library and stored in JSON format.

[0659] Step 2:

[0660] The server checks for consistency by comparing the acquired delivery address information with an existing data set. The input is the newly acquired delivery address information and the existing dataset. The output is a flag indicating whether there are inconsistencies and a list of inconsistent items. The server uses Python to sequentially compare each data item in the list and detect the differences.

[0661] Step 3:

[0662] If an inconsistency is detected, the server will notify the user via the terminal. The input is a list of the inconsistent items, and the output is a notification message to the user. The notification is sent as a push notification to smartphones and tablets.

[0663] Step 4:

[0664] The user uses a terminal to input the correct information corresponding to the inconsistent items. The input is the new shipping address information provided by the user, and the output is the corrected shipping information. The user uses the terminal interface to input the information and send it to the server.

[0665] Step 5:

[0666] The server automatically converts the correction information received from the user into the specified format. The input is the corrected delivery information, and the output is data suitable for the format required by each system. The conversion is performed using the Jinja2 library, which extracts and formats the data based on a template.

[0667] Step 6:

[0668] The server provides the converted information to an external device via an application program interface for updating. The input is formatted delivery information data, and the output is a success flag for the data update in the associated system. The server configures a POST request for the API and sends the information to the external device.

[0669] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0670] This invention aims to further enhance the user experience by incorporating an emotion engine into an information processing system. The system is configured and operated as follows:

[0671] The server collects data directly from the internet and official databases and verifies its integrity. The information obtained in this process is then presented appropriately to the user, and this is where the emotion engine plays its role.

[0672] The emotion engine analyzes user input and responses through the device to recognize their emotional state. For example, if the system determines that a user is feeling frustrated while entering complex information, based on their input speed and frequency of errors, it can adjust the interface accordingly. This is achieved by making the guidance displayed on the device clearer or, if necessary, simplifying it.

[0673] When a user adds specific information to the system, the server converts that information into the appropriate format according to the requirements of each system. During this process, based on feedback from the emotion engine, the system flexibly changes the displayed menu to reduce user stress. For example, if the emotion engine detects that the user is in a hurry, it can prioritize displaying only the most important information and request additional information only after all procedures are completed.

[0674] Ultimately, the server sends the transformed information to other systems via APIs for updates. By considering user comfort based on the output of the emotion engine, the overall efficiency of information processing and the user experience can be improved. In this way, the system goes beyond being a mere information processing device and provides a user-friendly operating environment.

[0675] The following describes the processing flow.

[0676] Step 1:

[0677] The server retrieves necessary company information from the internet and official databases. This ensures that the latest data, such as company name and address changes, is obtained.

[0678] Step 2:

[0679] The server compares the retrieved data with existing databases to verify consistency. If any discrepancies are found, the details are recorded.

[0680] Step 3:

[0681] The terminal visually displays any missing or inconsistent information to the user and requests corrections or additions of necessary information. The user responds using the terminal and enters the appropriate data.

[0682] Step 4:

[0683] The device uses an emotion engine to observe the user's input speed and behavior during input, and analyzes the user's emotional state. If user stress or confusion is detected, the device adjusts the interface to provide more user-friendly guidance.

[0684] Step 5:

[0685] The server converts the modified or additional information obtained from the user into the required format. In doing so, it utilizes the system's template engine to adapt it to the specific format required by each system.

[0686] Step 6:

[0687] The server sends the converted data to an external system using an API to ensure the information is updated correctly. Here, feedback from the sentiment engine is taken into consideration, and the user interface and processes are further optimized as needed.

[0688] (Example 2)

[0689] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0690] Conventional information processing systems suffer from several challenges, including a lack of user experience and inefficient data management. In particular, they often provide static interfaces that fail to consider the user's emotional state, leading to user stress. Furthermore, they lack flexibility in data format conversion and integration with external systems.

[0691] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0692] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing it with existing databases to verify consistency, means for performing sentiment analysis on user input and responses, and means for dynamically adjusting the user interface. This enables the provision of a comfortable interface that responds to the user's emotional state and efficient data management.

[0693] An "information processing device" is a computer system that collects, analyzes, stores, converts, and communicates data.

[0694] A "source of information" refers to an external system from which data can be obtained, such as the internet or official databases.

[0695] "Data integrity verification" is the process of verifying whether the collected data is accurate and consistent.

[0696] "Sentiment analysis" is a process that determines a user's emotional state based on factors such as their input speed and the frequency of their errors.

[0697] A "user interface" refers to the screens and controls that a user uses to interact with an information processing device.

[0698] "Format conversion" is the process of changing data into a different structure or format.

[0699] "Integration with external systems" refers to the process of exchanging and updating information with other systems.

[0700] This invention is a system for analyzing a user's emotional state and improving the user experience of an information processing system. The server uses APIs to efficiently collect necessary data from the internet and official databases. This data is temporarily stored in a database, and its accuracy and reliability are ensured by integrity checks performed using scripts such as Python.

[0701] The device captures user input in real time and sends it to the emotion engine. This emotion engine analyzes the user's input speed and error rate to determine the user's emotional state. For example, if input is slow and errors occur frequently, it is determined that the user is stressed. Machine learning algorithms are used for this analysis, and dynamic interface adjustments are made to improve the user experience.

[0702] Specifically, if the emotion engine detects that the user is in a hurry, the interface on the device automatically adjusts to display only the most important options and avoid cumbersome operations. This allows the user to access the necessary information without stress and enables efficient operation.

[0703] The server also converts additional information provided by users into different data formats, enabling data exchange with external systems. This allows information to be integrated into other systems using standard formats such as JSON and XML. A RESTful API is used for sending data to external systems, ensuring fast and secure information updates.

[0704] As a concrete example, consider a user purchasing a product on an online shopping platform. If the emotion engine detects that the user is in a hurry, the terminal will simplify the purchase process, presenting only the essential steps to reduce the user's burden. Another example of a prompt to input into the generative AI model is, "How should the interface be adjusted if the user's input speed is slow?"

[0705] Thus, the system of the present invention not only improves the efficiency of data processing but also enables the provision of a user-friendly and comfortable operating environment.

[0706] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0707] Step 1:

[0708] The server collects data from the internet and official sources via APIs. In this process, it specifies the URL or endpoint of the target data and issues an HTTP request. The input is the API endpoint, and the output is raw data received in JSON format. For example, it can retrieve the latest weather data from a weather information API.

[0709] Step 2:

[0710] The server verifies the integrity of the collected data. Using a Python script, it detects missing or outlier data and corrects or filters them as needed. The input is the JSON data obtained in step 1, and the output is clean, integrity-verified data. For example, it can impute missing values ​​in the acquired weather data.

[0711] Step 3:

[0712] The device acquires user input in real time. When a user enters data into a form, it measures key events and input time to collect input data for sentiment analysis. The input is the user's typing data, and the output is input information compiled in an analysis format. For example, it collects data from input forms for names and email addresses.

[0713] Step 4:

[0714] The device uses an emotion engine to analyze the user's emotional state. A machine learning algorithm processes the input data and estimates what emotions the user is experiencing. The input is the data used for analysis in step 3, and the output is a determination indicating the user's emotional state. For example, if the input speed is slow and there are many errors, it may be determined that the user is feeling frustrated.

[0715] Step 5:

[0716] The server adaptively changes the user interface based on the sentiment analysis results. For users in a hurry, the purchase process is simplified, and only the most important options are displayed. The input is the sentiment analysis results, and the output is the adjusted interface screen layout. For example, it might prioritize displaying only payment information.

[0717] Step 6:

[0718] The server converts the format of any additional information provided by the user as needed and sends it to the external system. It converts the data format from CSV to JSON and sends it using the HTTP protocol. The input is the additional information entered by the user, and the output is data formatted for the external system. For example, order information can be transferred to another warehouse management system.

[0719] Step 7:

[0720] The terminal generates a prompt for the AI ​​model. This prompt is displayed on the console and used as input for the model to return a response that takes the user's current state into account. The input consists of the user's sentiment analysis results and operation log, while the output is the generated prompt. For example, it might generate a prompt such as, "What action would you like to perform next?"

[0721] (Application Example 2)

[0722] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0723] Modern information processing systems tend to present information unilaterally, without considering the user's emotions or feelings. As a result, the user experience deteriorates, and users often experience stress. In particular, the complexity and difficulty of operating these systems become an even greater burden for the elderly and those unfamiliar with technology. Furthermore, even with home appliances, it is difficult to provide appropriate services that meet the user's needs, resulting in a lack of improvement in the quality of daily life. Solving these problems is essential.

[0724] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0725] In this invention, the server includes means for collecting necessary data from predetermined information sources, means for comparing the collected data with an existing database to verify consistency, means for presenting missing information to the user and receiving additional information, means for automatically converting the received additional information into a different format, means for updating the converted information in cooperation with an external processing device, means for analyzing the user's input and reactions through a terminal to recognize their emotional state, means for adjusting the interface based on the recognition of their emotional state, and means for controlling home appliances that analyze the user's behavior using voice input and sensors to provide appropriate support. This enables information processing that takes the user's emotions into consideration and smart operation of home appliances, improving the user experience and quality of life.

[0726] An "information processing device" is a device that has the function of collecting, analyzing, and transforming data, and exchanging information with external systems.

[0727] An "information source" is the source of the underlying data necessary to provide the required information.

[0728] A "database" is a collection of structured data used to organize information and ensure its consistency.

[0729] A "user" is a person who operates an information processing system and receives its services.

[0730] "Additional information" refers to information provided by users to supplement missing data.

[0731] "Format" refers to the arrangement and format of data used when converting information into a different format.

[0732] An "external processing device" is another device that has the function of linking with the system and updating information.

[0733] A "terminal" is a device used by a user to interact with an information processing device.

[0734] "Emotional state" refers to the psychological state that can be inferred from the user's input and responses.

[0735] An "interface" is an operating screen or method for exchanging data between a user and an information processing device.

[0736] "Voice input" is a method of inputting data into a device using the user's voice.

[0737] A "sensor" is a device used to detect the environment or the state of a user.

[0738] "Household appliances" are electrical devices used within the home to support daily life.

[0739] In this embodiment of the invention, an information processing device uses various sensors and voice input devices to control household appliances. The server collects necessary data from the internet and other sources and verifies the collected data through integrity checks in a database. This allows the server to efficiently receive additional information from users based on reliable information, automatically convert that information into different formats, and update the information with external processing devices as needed.

[0740] The device uses an emotion engine to analyze emotional data obtained through user input and reactions. The emotion engine analyzes input characteristics such as input speed and error frequency to recognize the user's psychological state. Based on this analysis, the interface is adjusted according to the user's emotions, for example, by simplifying explanations or providing interactions that reduce stress.

[0741] The home appliances are equipped with voice input devices and multiple environmental sensors that detect the user's voice and surrounding environment. This sensory data is analyzed by an AI system on a server, which then instructs the home appliances to take actions that meet the user's needs, making life more convenient.

[0742] For example, when a user says, "I want to relax today," the device collects this voice and analyzes it with its emotion engine. As a result, the home appliance changes the room lighting to a warmer tone and plays calming music. This series of operations is aimed at creating a comfortable home environment and helping the user relax.

[0743] An example of a prompt in a generative AI model is, "Please suggest activities to help me unwind after a long day." This prompt is used to support appropriate appliance operation based on the user's relaxation needs.

[0744] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0745] Step 1:

[0746] The server collects necessary data from the internet and other sources. This collected data is stored in the server's database and used as initial data.

[0747] Step 2:

[0748] The server compares the collected data with existing databases to verify consistency. The accuracy of the data is checked here, and if there are discrepancies, a warning is generated. This warning data becomes input for the next process.

[0749] Step 3:

[0750] The terminal receives additional information entered by the user. The data entered by the user is sent to the server through the terminal's input interface. This input data becomes the basis for further data transformation.

[0751] Step 4:

[0752] The server automatically converts the received additional information into a different format. This conversion is performed based on a predetermined template and is formatted to be suitable for communication with external processing devices. This output format becomes the data for communication with external processing devices.

[0753] Step 5:

[0754] The server communicates with an external processing unit to update the converted information. The external processing unit receives new data via an API and updates the system-wide data to keep it up-to-date. This updated data becomes the basis for the next process.

[0755] Step 6:

[0756] The device analyzes the user's input and responses, and recognizes their emotional state using an emotion engine. The user's input speed, error frequency, and other factors are analyzed and output as their emotional state. This emotional data then becomes input data for interface adjustments.

[0757] Step 7:

[0758] The device adjusts the interface based on its recognition of the user's emotional state. To reduce user stress, the interface simplifies the displayed content and highlights key points. This adjusted interface provides an improved user experience.

[0759] Step 8:

[0760] Home appliances analyze user behavior using voice input and sensors, and transmit the sensing data to a server. This sensing data forms the basis for operating home appliances based on user needs.

[0761] Step 9:

[0762] The server uses the prompts given to the generating AI model to generate support tailored to the user. For example, it might instruct home appliances to perform relaxation-related actions. This generated support is then implemented in the user's daily life.

[0763] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0764] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0765] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0766] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0767] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0768] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0769] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0770] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0771] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0772] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0773] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0774] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0775] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0776] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0777] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0778] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0779] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0780] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0781] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0782] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0783] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0784] The following is further disclosed regarding the embodiments described above.

[0785] (Claim 1)

[0786] An information processing device includes means for collecting necessary data from a predetermined information source,

[0787] Based on the collected data, a means of verifying consistency by cross-referencing it with existing databases,

[0788] A means of presenting the user with the missing information of the confirmed data and receiving additional information,

[0789] A means for automatically converting the received additional information into a different format,

[0790] A means for linking the converted information with an external system and updating it,

[0791] A system that includes this.

[0792] (Claim 2)

[0793] The system according to claim 1, further comprising means for performing automatic conversion of the aforementioned format based on a predetermined template.

[0794] (Claim 3)

[0795] The system according to claim 1, further comprising means for realizing cooperation with the aforementioned external system via an API.

[0796] "Example 1"

[0797] (Claim 1)

[0798] In an information processing system, means for collecting necessary data from a predetermined information source,

[0799] Based on the collected data, a means of verifying consistency by cross-referencing it with existing databases,

[0800] A means of presenting the missing data information identified above to the user via the terminal and receiving additional information,

[0801] A means for analyzing the received additional information and efficiently and automatically converting it into a different data format,

[0802] A means for linking the converted information with an external information system and updating the information via an API,

[0803] A system that includes this.

[0804] (Claim 2)

[0805] The system according to claim 1, which performs automatic conversion of the aforementioned data format based on a predetermined template engine.

[0806] (Claim 3)

[0807] The system according to claim 1, wherein cooperation with the aforementioned external information system is realized by a communication interface.

[0808] "Application Example 1"

[0809] (Claim 1)

[0810] An information processing device includes means for collecting necessary data from a predetermined information source,

[0811] Based on the collected data, a means of verifying consistency by cross-referencing it with existing information sets,

[0812] A means of presenting the user with the missing information of the confirmed data and receiving additional information,

[0813] A means for automatically converting the received additional information into a different format,

[0814] The means for updating the converted information in cooperation with an external device,

[0815] A means of notifying an external device,

[0816] A system that includes this.

[0817] (Claim 2)

[0818] The system according to claim 1, comprising means for performing automatic conversion of the aforementioned format based on a predetermined template.

[0819] (Claim 3)

[0820] The system according to claim 1, further comprising means for realizing cooperation with the aforementioned external device through an applied program interface.

[0821] "Example 2 of combining an emotion engine"

[0822] (Claim 1)

[0823] An information processing device includes means for collecting necessary data from a predetermined information source,

[0824] Based on the collected data, a means of verifying consistency by cross-referencing it with existing databases,

[0825] A means of presenting the user with the missing information of the confirmed data and receiving additional information,

[0826] A means for performing sentiment analysis on user input and responses via a terminal,

[0827] A means for dynamically adjusting the user interface based on the analyzed emotional state,

[0828] A means for automatically converting the received additional information into a different data format,

[0829] A means for linking the converted information with an external system and updating it,

[0830] A system that includes this.

[0831] (Claim 2)

[0832] The system according to claim 1, further comprising means for performing automatic conversion of the aforementioned format based on a predetermined template.

[0833] (Claim 3)

[0834] The system according to claim 1, further comprising means for realizing cooperation with the aforementioned external system by data exchange specifications.

[0835] "Application example 2 when combining with an emotional engine"

[0836] (Claim 1)

[0837] An information processing device includes means for collecting necessary data from a predetermined information source,

[0838] Based on the collected data, a means of verifying consistency by cross-referencing it with existing databases,

[0839] A means of presenting the user with the missing information of the confirmed data and receiving additional information,

[0840] A means for automatically converting the received additional information into a different format,

[0841] The means for updating the converted information in cooperation with an external processing device,

[0842] A means of analyzing user input and responses through a terminal to recognize their emotional state,

[0843] A means of adjusting the interface based on the recognition of emotional states,

[0844] A means of controlling home appliances that analyze user behavior using voice input and sensors and provide appropriate support,

[0845] A system that includes this.

[0846] (Claim 2)

[0847] The system according to claim 1, further comprising means for performing automatic conversion of the aforementioned format based on a predetermined template.

[0848] (Claim 3)

[0849] The system according to claim 1, further comprising means for realizing cooperation with the external processing device via an application program interface. [Explanation of symbols]

[0850] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. An information processing device includes means for collecting necessary data from a predetermined information source, Based on the collected data, a means of verifying consistency by cross-referencing it with existing information sets, A means of presenting the user with the missing information of the confirmed data and receiving additional information, A means for automatically converting the received additional information into a different format, The means for updating the converted information in cooperation with an external device, A means of notifying an external device, A system that includes this.

2. The system according to claim 1, further comprising means for performing automatic conversion of the aforementioned format based on a predetermined template.

3. The system according to claim 1, further comprising means for realizing cooperation with the aforementioned external device through an applied program interface.

Images